Special effect video generation method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a special effect video generation method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a target image which is used for displaying at least two target picture objects; in response to the first operation, at least one action template is displayed, and the action template is used for representing the interaction behavior between the two or more picture objects; in response to the second operation, a target action template is determined, a special effect video is generated based on the target action template and the target image, the special effect video is used for displaying the process that at least two target picture objects execute a target interaction behavior represented by the target action template, and after the target image is obtained, the action template is displayed through corresponding user operation. According to the invention, the target action template is selected, and the special effect video is generated for the target image based on the selected target action template, so that the generated special effect video can display the process of executing the target interaction behavior by the plurality of target picture objects in the target image, and the interaction efficiency of the video generation process is effectively improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of artificial intelligence technology, and in particular to a special effects video generation method, device, electronic device and storage medium. Background Art

[0002] Currently, artificial intelligence (AI) technology can be used to continue and expand the content of static images and generate corresponding videos, namely image-to-video technology, which greatly improves the efficiency of video material generation and content richness of users in the video creation process.

[0003] In the prior art, in the process of generating a video with multi-object interactive content based on an AI model, the user is usually required to input corresponding complex prompt words to describe the video content so that the AI ​​model can output video content that meets the user's needs.

[0004] However, the solution of using prompt words to generate videos of multi-object interactive content in the prior art has the problems of low interaction efficiency and high operation difficulty. Summary of the invention

[0005] The embodiments of the present disclosure provide a special effect video generation method, device, electronic device and storage medium to overcome the problems of low interaction efficiency and high operation difficulty when generating a video with multi-object interactive content.

[0006] In a first aspect, an embodiment of the present disclosure provides a method for generating a special effects video, including:

[0007] Acquire a target image, wherein the target image is used to display at least two target screen objects; in response to a first operation, display at least one action template, wherein the action template is used to characterize the interactive behavior between more than two screen objects; in response to a second operation, determine the target action template, and generate a special effects video based on the target action template and the target image, wherein the special effects video is used to display the process of the at least two target screen objects executing the target interactive behavior represented by the target action template.

[0008] In a second aspect, an embodiment of the present disclosure provides a special effects video generating device, including:

[0009] An acquisition module, used for acquiring a target image, wherein the target image is used for displaying at least two target screen objects;

[0010] An interaction module, configured to display at least one action template in response to a first operation, wherein the action template is used to characterize an interactive behavior between two or more screen objects; and to determine a target action template in response to a second operation;

[0011] A generation module is used to generate a special effect video based on the target action template and the target image, wherein the special effect video is used to show the process of the at least two target screen objects executing the target interactive behavior represented by the target action template.

[0012] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0013] The memory stores computer-executable instructions;

[0014] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the special effects video generation method described in the first aspect and various possible designs of the first aspect.

[0015] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the special effects video generation method described in the first aspect and various possible designs of the first aspect is implemented.

[0016] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the special effects video generation method described in the first aspect and various possible designs of the first aspect.

[0017] The special effects video generation method, device, electronic device and storage medium provided in the present embodiment obtain a target image, wherein the target image is used to display at least two target screen objects; in response to a first operation, at least one action template is displayed, wherein the action template is used to characterize the interactive behavior between more than two screen objects; in response to a second operation, a target action template is determined, and a special effects video is generated based on the target action template and the target image, wherein the special effects video is used to display the process of the at least two target screen objects executing the target interactive behavior represented by the target action template. After obtaining the target image, the action template is displayed through corresponding user operations, and a special effects video is generated for the target image based on the selected target action template, so that the generated special effects video can display the process of multiple target screen objects in the target image executing the target interactive behavior represented by the target action template. This process does not require the user to input complex prompt words, which effectively improves the interaction efficiency of the video generation process, reduces the difficulty of user operation, and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0019] Figure 1 An application scenario diagram of the special effects video generation method provided in the embodiment of the present disclosure;

[0020] Figure 2 A schematic diagram of the process of generating a special effects video provided by an embodiment of the present disclosure Figure 1 ;

[0021] Figure 3 for Figure 2 A flowchart of a specific implementation method of step S101 in the illustrated embodiment;

[0022] Figure 4 A schematic diagram of a process of displaying a template page provided by an embodiment of the present disclosure;

[0023] Figure 5 for Figure 3 A flowchart of a specific implementation method of step S1011 in the illustrated embodiment;

[0024] Figure 6 A schematic diagram of the process of generating a special effects video provided by an embodiment of the present disclosure Figure 2 ;

[0025] Figure 7 A schematic diagram of a process for generating a special effects video provided by an embodiment of the present disclosure;

[0026] Figure 8 for Figure 6 A flowchart of a specific implementation method of step S201A in the illustrated embodiment;

[0027] Fig. 9 for Figure 6 A flowchart of a specific implementation method of step S209 in the illustrated embodiment;

[0028] Fig.10 A schematic diagram of a process for generating mapping information provided by an embodiment of the present disclosure;

[0029] Fig.11 A structural block diagram of a special effects video generating device provided in an embodiment of the present disclosure;

[0030] Fig.12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure;

[0031] Fig.13 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0033] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0034] The application scenarios of the embodiments of the present disclosure are explained below:

[0035] Figure 1 An application scenario diagram of the special effects video generation method provided in the embodiment of the present disclosure. The special effects video generation method provided in the embodiment of the present disclosure can be applied to an application (APP, Application) with a special effects video generation function, such as a video editing application. More specifically, it can be applied to the application scenario of the image-generated video based on the AI ​​model. The execution subject of this embodiment can be a terminal device running the above-mentioned application with a special effects video generation function, or a server deploying the server corresponding to the above-mentioned application, or other electronic devices that perform similar functions. Among them, when the execution subject is a terminal device, the terminal device executes the method provided in this embodiment by running the above-mentioned application; when the execution subject is a server, the server of the above-mentioned application with a special effects video generation function can be partially or completely run on the server, and the method provided in this embodiment is executed on the server side, and the terminal device runs the client of the application, and the communication between the server and the terminal device is based on the server-client, so that the terminal device can obtain the execution result of the method provided in this embodiment and display it as needed.

[0036] Among them, in some embodiments, the terminal device or server can implement the special effects video generation method provided by the embodiment of the present disclosure by running various computer executable instructions or computer programs. For example, computer executable instructions can be program-level commands, machine instructions or software instructions. The computer program can be a native program or software module in the operating system; it can be a local application, that is, a program that needs to be installed in the operating system to run, or it can be a small program embedded in any APP, that is, a program that runs based on a browser environment. In summary, the above-mentioned computer executable instructions can be instructions in any form, and the above-mentioned computer program can be an application, module or plug-in in any form, and the specific implementation form can be configured as needed. Furthermore, in the process of implementing the special effects video generation method provided by the embodiment of the present disclosure, the terminal device can execute the method by running a computer executable instruction or computer program set locally, or it can execute the method by calling a computer executable instruction or computer program set in an external server. In some embodiments, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud storage, cloud communications, cloud databases, cloud computing, cloud functions, network services, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), as well as big data and artificial intelligence platforms. Among them, cloud services can be interactive processing services for terminal devices to call.

[0037] refer to Figure 1 As shown in , taking a terminal device as an example, a target application with a special effects video generation function is running in the terminal device. The target application loads the picture input by the user (such as a selfie uploaded by the user). Then, in response to the user's trigger operation (such as clicking the "Generate" button), the cloud-based or locally deployed video generation model is called to convert the static picture into a corresponding dynamic video. In this process, the target application usually controls the content of the generated video according to the description statement input by the user (shown as XXX in the figure), thereby generating a dynamic video that meets the user's preferences and needs.

[0038] Currently, in the task of generating AI videos with multi-object interaction content, such as generating special effects videos of two or more people hugging or dancing, due to the complexity of the video content and process, complex prompts are required to show the behavioral characteristics of interaction between multiple characters, resulting in complex operation steps and high operation thresholds, which affects the efficiency of human-computer interaction.

[0039] The disclosed embodiment provides a special effects video generation method to solve the above-mentioned problem.

[0040] refer to Figure 2 , Figure 2 A schematic diagram of the process of generating a special effects video provided by an embodiment of the present disclosure Figure 1 The method of this embodiment can be applied in a terminal device. The special effect video generation method includes:

[0041] Step S101: Acquire a target image, where the target image is used to display at least two target screen objects.

[0042] Step S102: In response to the first operation, at least one action template is displayed, where the action template is used to represent an interactive behavior between two or more screen objects.

[0043] Step S103: In response to the second operation, a target action template is determined, and a special effects video is generated based on the target action template and the target image, wherein the special effects video is used to show a process in which at least two target screen objects execute the target interactive behavior represented by the target action template.

[0044] For example, reference Figure 1 In the application scenario schematic diagram shown, the terminal device is used as the execution subject to introduce the special effect video generation method provided in this embodiment. First, the terminal device displays an interactive interface by running the above-mentioned application with special effect video generation function, such as a video editing interface with a video editing track. The user loads at least one static picture from the terminal device locally or in motion to the target application by operating the video editing interface, so that the terminal device obtains the target image, and the target image is the above-mentioned one or more static pictures. The picture content of the static picture contains at least one screen object, and the screen object is, for example, the subject object such as the person, animal, etc. in the picture. Taking a portrait picture as an example, the target object in the portrait picture is the "person" in the portrait picture. When the target image is a static picture, the static picture includes at least two target objects, such as multiple "people" in the portrait picture; and when the target image is at least two static pictures, each static picture can contain one or more target objects, for example, the target image includes two portrait pictures, and each portrait picture contains one "person". In the above manner, the target image obtained by the terminal device can display at least two target screen objects.

[0045] Furthermore, the user controls the terminal device to know the action template by operating the interactive interface. Specifically, after receiving the user's first operation, the terminal device displays multiple action templates. The action template can be displayed in the form of a card in the template page or template window. The action template can represent the interactive behavior between two or more screen objects through the template cover, template name or other explanatory information, thereby achieving the purpose of use guidance. Afterwards, the user further applies a second operation to the template page or template window, and determines a target action template from one or more action templates. Afterwards, the terminal device guides the video generation model based on the target interactive behavior described by the target action template, such as hugging, kissing, handshaking, etc. of multiple people, to control the process of generating video from the image, and finally generates a special effects video with the above-mentioned interactive behavior characteristics from the target image.

[0046] In one possible implementation, Figure 3 As shown, the specific method of step S101 includes:

[0047] Step S1011: displaying a video editing interface, wherein the video editing interface is configured with an image material track and an image-generated video control, and the image material track is configured with at least one image material;

[0048] Step S1012: determining the image material in the selected target image material track as the target image, or determining the selected target image material as the target image.

[0049] Exemplarily, the interactive interface of the target application is a video editing interface, and the video editing interface is configured with an image material track and a graphic video control, and the image material track is configured with at least one image material. In one possible implementation, the user can directly select any image material as the target image; in another possible implementation, for the video editing interface, the user applies a selection operation to select multiple image materials in different material tracks as the target image. In another possible implementation, for the video editing interface, the user applies a selection operation to select an image material track, that is, a target image material track, and then all image materials in the target image material track are determined as target images, that is, the target image is selected based on the track dimension.

[0050] In this implementation, correspondingly, the specific implementation of step S102 is: in response to the first operation on the image-generated video control, displaying a template page, where the template page is configured to display at least one action template.

[0051] Figure 4 A schematic diagram of a process of displaying a template page provided by an embodiment of the present disclosure, such as Figure 4As shown, first, in the video editing interface, an image material track Track_1 is displayed, and image materials P1 and P2 are configured in the image material track Track_1. On this basis, after image material P1 is selected, image material P1 is used as the target image, and in response to the first operation for the image-generated video control contr_1, it jumps to the template page, and the template page displays action templates representing different interactive behaviors, such as M1, M2, M3, etc. shown in the figure. Among them, different action templates have template covers, and the template covers can prompt the interactive behaviors represented by the action templates.

[0052] Furthermore, in a possible implementation, the action templates displayed in the template page are pre-configured, i.e., fixed action templates, which can be loaded in advance through configuration information, so that each action template can be quickly displayed after the template page is triggered. In another possible implementation, the action templates displayed in the template page are dynamically loaded. Figure 5 As shown, the specific implementation of step S1011 includes:

[0053] Step S1011 - 1 : analyzing the number of target objects of the target screen object in the target image.

[0054] Step S1011 - 2 : In response to the first operation on the image-generated video control, determine candidate action templates that match the number of target objects, where the candidate action templates are used to characterize interactive behaviors between the screen objects of the number of target objects.

[0055] Step S1011 - 3 : Generate and display a template page based on the candidate action template.

[0056] Exemplarily, after acquiring the target image, the target object number of the target screen object in the target image is determined by parsing the content of the target image. Then, according to the target object number of the target screen object in the target image, the alternative action template matching the target object number is dynamically displayed. For example, if the target object number of the target screen object in the target image is 3, the interactive behavior represented by the alternative action template matching it is, for example, 3 people hugging, 3 people holding hands, etc., that is, the alternative action template is used to represent the interactive behavior between the screen objects of the target object number. Afterwards, the template page is generated and displayed with the above alternative action template as the content, so that the action template in the template page can match the target image selected by the user. In the subsequent process of generating special effect videos, as a content template with the same number of screen objects, a better content guidance effect can be achieved, and the authenticity of the special effect video can be improved.

[0057] Furthermore, in a possible implementation, the target image includes at least a first image and a second image. Regarding the step of parsing the target object number of the target screen objects in the target image, when the target image includes at least two images, each image needs to be parsed separately to obtain the object number of the target screen objects in each image, and then the object number of the target screen objects in each image is accumulated to obtain the target object number, thereby improving the accuracy of the target object number and further improving the matching degree between the alternative action templates in the template page and the target image.

[0058] In this embodiment, a target image is acquired, and the target image is used to display at least two target screen objects; in response to a first operation, at least one action template is displayed, and the action template is used to characterize the interactive behavior between more than two screen objects; in response to a second operation, the target action template is determined, and a special effects video is generated based on the target action template and the target image, wherein the special effects video is used to display the process of at least two target screen objects executing the target interactive behavior represented by the target action template. After obtaining the target image, the action template is displayed through corresponding user operations, and based on the selected target action template, a special effects video is generated for the target image, so that the generated special effects video can display the process of multiple target screen objects in the target image executing the target interactive behavior represented by the target action template. This process does not require the user to input complex prompt words, which effectively improves the interaction efficiency of the video generation process, reduces the difficulty of user operation, and improves the user experience.

[0059] refer to Figure 6 , Figure 6 A schematic diagram of the process of generating a special effects video provided by an embodiment of the present disclosure Figure 2 In this embodiment Figure 2 On the basis of the illustrated embodiment, step S103 is further refined, wherein the action template is displayed in the template page, the template page is configured with a generation control, the second operation includes a first trigger operation and a second trigger operation, and the special effect video generation method includes:

[0060] Step S201: Acquire a target image, where the target image is used to display at least two target screen objects.

[0061] Step S202: In response to the first operation, at least one action template is displayed, where the action template is used to represent an interactive behavior between two or more screen objects.

[0062] Step S203: In response to a first trigger operation on any action template in the template page, a target action template is determined.

[0063] Step S204: In response to the second trigger operation on the generation control, the image-generated video model is called to process the target action template and the target image to generate a special effect video.

[0064] Exemplarily, in this embodiment, in combination with the application scenario of video editing, the interactive interface of the target application includes a video editing interface, and an image material track and a picture-generated video control are set in the video editing interface. After responding to the first operation on the picture-generated video control, it jumps to the template page, and multiple action templates are displayed in the template page. Afterwards, in response to the first trigger operation on any action template in the template page, the target action template is determined. This process is the process of selecting the action template. Afterwards, in response to the second trigger operation on the generation control, the picture-generated video model is called to process the target action template and the target image to generate a special effect video. Among them, the generation control is to call the trigger control of the picture-generated video model. The picture-generated video model is a video generation model based on a neural network model, which can generate a video by continuing to write a static image. The specific implementation principle is not repeated. The picture-generated video model can be deployed locally on the terminal device or in the cloud. During the call process, the picture-generated video model will continue to write the target image as the first frame based on the target interactive behavior represented by the target action template, and generate subsequent image frames of the target image, thereby forming a special effect video. The solution provided in the steps of this embodiment is to directly select and apply the action template provided in the template page to call the image-generated video model to generate a continuation video corresponding to the target image, that is, a process of special effects video.

[0065] Further, in another possible implementation, the terminal device may generate a special effect video in another manner by responding to a third trigger operation of the user; specifically, an editing control is configured in the template page, the second operation also includes a third trigger operation, and this embodiment also includes:

[0066] Step S205: In response to the third trigger operation on the editing control, an object configuration page is displayed, wherein a loading position is configured in the object configuration page, and the loading position is used to load the uploaded image.

[0067] Step S206: in response to the loading operation on the loading position, obtaining at least one uploaded picture, where the uploaded picture is used to display at least one external screen object.

[0068] Step S207: In response to the second trigger operation for generating the control, the image-generated video model is called to process the target action template, upload the picture and the target image, and generate a special effects video, wherein the special effects video is used to show the process of at least two target screen objects and an external screen object executing the target interactive behavior represented by the target action template.

[0069] Exemplarily, in another possible implementation, after selecting the target action template, an editing control is configured in the template page, and in response to a third trigger operation on the editing control, an object configuration page is displayed, and at least one loading position for loading an uploaded image is set in the object configuration page. The user can specify and load an uploaded image by applying a loading operation to the loading position, and then, the uploaded image and the original target image are combined to jointly generate a special effect video. Since the uploaded image contains an additional external screen object, the generated special effect video also contains the corresponding external screen object, as well as the target interactive behavior between the external screen object and the target screen object, thereby further improving the flexibility of generating special effect videos.

[0070] Figure 7 A schematic diagram of a process for generating a special effects video provided by an embodiment of the present disclosure is shown below. Figure 7 The above process is described in more detail, such as Figure 7 As shown, exemplarily, first, after displaying the template page and selecting the target action template M1 through the first trigger operation, one possible implementation method is: by responding to the second trigger operation for the generation control in the template page, calling the image-generated video model to process the target action template M1 and the target image P1, and generating a special effect video. Another possible implementation method is: by responding to the third trigger operation for the edit control, displaying the object configuration page, the object configuration page displays the previously acquired target image P1 and the loading position A; then, in response to the click operation for the loading position A, displaying the user gallery page, and then in response to the selection operation for the image P2 in the gallery page, loading the image P2 into the loaded A, and the image P2 is the uploaded image. After that, a generation control is set in the object configuration page, and in response to the second trigger operation for the generation control in the object configuration page, calling the image-generated video model to process the target action template M1, the image P2 and the target image P1, and generating a special effect video. It should be noted that the above two implementation methods of generating special effect videos can be selected one by one or in sequence during the process of generating special effect videos. For example, the process of generating special effect videos by responding to the second trigger operation of the generation control in the template page is first executed to generate a preview video of the special effect video. After that, the user applies a third trigger operation to execute the process of generating special effect videos by responding to the third trigger operation of the editing control in the template page to generate another preview video of the special effect video. After that, after the user further confirms the video effect, the final special effect video is generated.

[0071] Furthermore, before step S205 and after step S201, the method further includes:

[0072] Step S201A: Determine the target number of loading slots in the object configuration page.

[0073] Exemplarily, the loading position is used to load the uploaded image, thereby realizing the functional interface of adding the screen object in the uploaded image to the special effects video. In one possible implementation method, the loading position in the object configuration page can be manually set, that is, the user can add loading positions at will (within a certain range) as needed, for example, add 10 loading positions, and load a single person's portrait photo in each loading position, thereby generating a "hug video" of 11 people (the target screen object is 1). However, in the actual application process of the above scheme, when the number of photographed targets participating in the generation of the special effects video is too large or too small, it may affect the video quality of the special effects video finally generated. Therefore, in another implementation method provided by this embodiment, the target number of loading positions in the object configuration page can be determined based on the content of the target image and the target action template. Exemplarily, such as Figure 8 As shown, the specific implementation of step S201A includes:

[0074] Step S201A-1: parsing the target image to obtain a first object quantity of the target screen object corresponding to the target image;

[0075] Step S201A-2: Obtain the number of second objects matched by the target interactive behavior corresponding to the target action template;

[0076] Step S201A-3: Determine the target number of loading locations in the object configuration page according to the difference between the second object number and the first object number.

[0077] Exemplarily, first, by parsing the target image, the first object number of the target screen object corresponding to the target image is obtained, for example, 2, that is, the target image contains two characters; then the second object number matched by the target interactive behavior corresponding to the target action template is obtained. The second object number can be an attribute parameter stored in the target action template and can be directly obtained. The target interactive behavior represented by the target action template is, for example, "4 people hugging", that is, the second object number is 4, then the loading position is configured according to the difference between the above-mentioned second object number and the first object number, for example, the loading position is 2, and then the user can use the above-mentioned two loading positions to load two uploaded pictures containing only one screen object (such as single-person photos) respectively, and perform video synthesis, so that the generated special effects video matches the interactive behavior represented by the target action template in the quantity dimension, thereby reducing the difficulty of generating special effects videos and improving the generation quality of special effects videos.

[0078] Further, in a possible implementation, the second operation includes a fourth trigger operation, the target action template is marked with at least two selectable screen objects, and after step S203, the method further includes:

[0079] Step S208: Display the selectable screen objects in the target action template.

[0080] Step S209: In response to the fourth trigger operation on the selectable screen object, mapping information between the selectable screen object and the target screen object displayed by the target image is created.

[0081] Exemplarily, since the target interactive behavior represented by the target action template involves more than two screen objects, there is a mapping relationship in position and angle between the screen objects involved in the target action template and the target screen objects in the target image. For example, in the target interactive behavior represented by the target action template, two people hug each other in a left-right orientation, and the two target screen objects displayed in the target image are in a standing posture in an upper and lower orientation. In this case, how to determine the "hug position" corresponding to each target screen object needs to be determined. In one possible implementation, the position of the above-mentioned target screen object can be randomly determined based on the capabilities provided by the model, and in another possible implementation, mapping information can be first created to indicate the position mapping relationship between the target screen object in the target image and the screen object in the target action template, thereby realizing the control of the position of the target screen object in the generated special effects video.

[0082] Specifically, in this embodiment, by displaying the optional screen objects in the target action template and combining the fourth trigger operation applied by the user on the optional screen objects, a mapping relationship between the optional screen objects and the target screen objects displayed by the target image, that is, mapping information, can be created. Accordingly, the specific implementation of step S204 includes:

[0083] Step S204A: In response to the second trigger operation for generating the control, the image-generated video model is called to process the target action template, the target image and the mapping information to generate a special effects video, wherein the special effects video is used to show the process of the target screen object executing the target interactive behavior of the corresponding optional screen object in the target action template.

[0084] Exemplarily, in this embodiment, based on the calling of the graph-generated video model to process the target action template and the target image to generate the special effects video introduced in the previous embodiment, the mapping information is further combined, and the mapping information is used as the prompt input to call the graph-generated video model, so as to control the position relationship between the target screen object in the target image and the screen object in the target action template during the special effects video generation process, thereby achieving more precise video content control.

[0085] Furthermore, if Fig. 9 As shown, the specific implementation of step S209 includes:

[0086] Step S2091: displaying the first object outline of the selectable screen object in the target action template in the template page;

[0087] Step S2092: by parsing the target image, displaying the second object outline of the target screen object corresponding to the target image, and by responding to the fourth trigger operation, selecting a selectable screen object and a corresponding target screen object at least once in a pair, generating at least one mapping group, the mapping group being used to represent a mapping relationship between a selectable screen object and a target screen object;

[0088] Step S2093: Generate mapping information according to at least one mapping group.

[0089] Exemplarily, the target action template includes contour information representing the object contour of each screen object. According to the contour information, the first object contour of the optional screen object in the target action template can be displayed. After that, the terminal device displays the second object contour of the target screen object corresponding to the target image by parsing the target image. In the case of selecting to upload a picture, the second object contour of the external screen object corresponding to the uploaded image is also displayed. After that, the user identifies the optional screen object and the target screen object based on the first object contour and the second object contour, and through the fourth trigger operation, a corresponding target screen object is mapped for each optional screen object, thereby establishing a mapping between the optional screen object in the action template and the target screen object in the target image. In the case of too many target screen objects in the target image, this step can also play a role in screening and filtering the target screen objects, thereby further improving the accuracy and flexibility of video content control.

[0090] Fig.10 A schematic diagram of a process for generating mapping information provided by an embodiment of the present disclosure is shown below in conjunction with Fig.10 The above process is further introduced as follows: Fig.10As shown, in the template page, a pairing window is displayed, and the target action template M1 is displayed on one side of the pairing window, and the target image P1 is displayed on the other side. If an uploaded image has been selected, the uploaded image can also be displayed. By parsing the target action template M1 and the target image P1, the first object outline of the optional screen object is displayed in the target action template M1, and the second object outline of the target screen object (external screen object) is displayed in the target image P1 (uploaded image). Afterwards, the user establishes a mapping between the optional screen object and the target screen object by applying a fourth trigger operation, and generates at least one mapping group, for example, the optional screen object m1 is mapped to the target screen object u2 to form a mapping group T1; the optional screen object m2 is mapped to the target screen object u1 to form a mapping group T2; finally, mapping information is generated according to the set of the above mapping groups. Afterwards, the positional relationship between the target screen object in the target image and the screen object in the target action template is controlled based on the mapping information, thereby achieving more accurate video content control.

[0091] In this embodiment, the implementation method of step S201-step S202 is the same as that of the present disclosure. Figure 2 The implementation methods of step S101 and step S102 in the illustrated embodiment are the same and will not be described in detail here.

[0092] Corresponding to the special effects video generation method of the above embodiment, Fig.11 A structural block diagram of a special effects video generation device provided in an embodiment of the present disclosure. The method described in the above embodiment can be executed by the special effects video generation device, which can be implemented by software and / or hardware, and can be integrated in an electronic device with certain data processing functions. The electronic device may include but is not limited to a mobile terminal with big data processing capabilities, and a fixed terminal with big data processing capabilities such as a desktop computer and a supercomputer.

[0093] For the sake of convenience, only the parts related to the embodiments of the present disclosure are shown. Fig.11 , the special effect video generating device 3 comprises:

[0094] An acquisition module 31 is used to acquire a target image, where the target image is used to display at least two target screen objects;

[0095] The interaction module 32 is used to display at least one action template in response to a first operation, where the action template is used to represent the interactive behavior between two or more screen objects; and to determine a target action template in response to a second operation;

[0096] The generating module 33 is used to generate a special effect video based on the target action template and the target image, wherein the special effect video is used to show the process of at least two target screen objects executing the target interactive behavior represented by the target action template.

[0097] According to one or more embodiments of the present disclosure, the acquisition module 31 is specifically used to: display a video editing interface, in which an image material track and a graphic video control are configured, and at least one image material is configured in the image material track; determine the image material in the target image material track in a selected state as the target image, or determine the target image material in a selected state as the target image; the interaction module 32 is specifically used to: in response to a first operation on the graphic video control, display a template page, and the template page is configured to display at least one action template.

[0098] According to one or more embodiments of the present disclosure, when the interaction module 32 displays a template page in response to a first operation on a graphic video control, it is specifically used to: parse the target object number of the target screen objects in the target image; in response to the first operation on the graphic video control, determine an alternative action template that matches the target object number, the alternative action template being used to characterize the interactive behavior between the screen objects of the target object number; based on the alternative action template, generate and display the template page.

[0099] According to one or more embodiments of the present disclosure, the target image includes at least a first image and a second image, wherein the first image and the second image are respectively used to display at least one target screen object; when parsing the target object number of the target screen object in the target image, the interaction module 32 is specifically used to: parse the sum of the object numbers of the target screen objects in the first image and the second image respectively, and determine the target object number.

[0100] According to one or more embodiments of the present disclosure, an action template is displayed in a template page, a generation control is configured in the template page, the second operation includes a first trigger operation and a second trigger operation, and the interaction module 32, when determining the target action template in response to the second operation, is specifically used to: determine the target action template in response to the first trigger operation for any action template in the template page; when the generation module 33 generates a special effects video based on the target action template and the target image, it is specifically used to: call the image-generated video model to process the target action template and the target image in response to the second trigger operation for the generation control to generate a special effects video.

[0101] According to one or more embodiments of the present disclosure, an editing control is configured in the template page, and the second operation also includes a third trigger operation. The interaction module 32 is further used to: in response to the third trigger operation on the editing control, display an object configuration page, wherein the object configuration page is configured with a loading position, and the loading position is used to load an uploaded image; in response to the loading operation on the loading position, obtain at least one uploaded image, and the uploaded image is used to display at least one external screen object; the generation module 33 is further used to: in response to the second trigger operation on the generation control, call the image-generated video model to process the target action template, the uploaded image and the target image, and generate a special effect video, wherein the special effect video is used to display the process of at least two target screen objects and the external screen object executing the target interactive behavior represented by the target action template.

[0102] According to one or more embodiments of the present disclosure, before displaying the object configuration page, the interaction module 32 is also used to: parse the target image to obtain a first object quantity of the target screen object corresponding to the target image; obtain a second object quantity matched by the target interactive behavior corresponding to the target action template; and determine the target number of loading positions in the object configuration page based on the difference between the second object quantity and the first object quantity.

[0103] According to one or more embodiments of the present disclosure, the second operation includes a fourth trigger operation, the target action template is marked with at least two optional screen objects, and after determining the target action template in response to the first trigger operation for any action template in the template page, the interaction module 32 is also used to: display the optional screen objects in the target action template; in response to the fourth trigger operation for the optional screen objects, create mapping information between the optional screen objects and the target screen objects displayed by the target image; when the generation module 33 responds to the second trigger operation for the generation control, calls the image-generated video model to process the target action template and the target image to generate a special effects video, it is specifically used to: respond to the second trigger operation for the generation control, call the image-generated video model to process the target action template, the target image and the mapping information, and generate a special effects video, wherein the special effects video is used to show the process of the target screen object executing the target interactive behavior of the corresponding optional screen object in the target action template.

[0104] According to one or more embodiments of the present disclosure, when the generation module 33 creates mapping information between the optional screen object and the target screen object displayed by the target image in response to the fourth trigger operation for the optional screen object, it is specifically used to: display the first object outline of the optional screen object in the target action template in the template page; display the second object outline of the target screen object corresponding to the target image by parsing the target image, and generate at least one mapping group by selecting an optional screen object and a corresponding target screen object in pairs at least once in response to the fourth trigger operation, and the mapping group is used to characterize the mapping relationship between an optional screen object and a target screen object; generate mapping information according to the at least one mapping group.

[0105] The acquisition module 31, the interaction module 32 and the generation module 33 are connected in sequence. The special effect video generation device 3 provided in this embodiment can implement the technical solution of the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated in this embodiment.

[0106] Fig.12 A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure is shown in FIG. Fig.12 As shown, the electronic device 4 includes:

[0107] A processor 41, and a memory 42 communicatively connected to the processor 41;

[0108] The memory 42 stores computer executable instructions;

[0109] The processor 41 executes the computer execution instructions stored in the memory 42 to implement the following Figure 2-Figure 10 The special effects video generation method in the illustrated embodiment.

[0110] Optionally, the processor 41 and the memory 42 are connected via a bus 43 .

[0111] For related instructions, please refer to Figure 2-Figure 10 The relevant descriptions and effects corresponding to the steps in the corresponding embodiments can be understood, and no further elaboration is made here.

[0112] The present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, which are used to implement the present invention when executed by a processor. Figure 2-Figure 10 A special effects video generation method provided by any one of the corresponding embodiments.

[0113] The present invention provides a computer program product, including a computer program. When the computer program is executed by a processor, the present invention is realized. Figure 2-Figure 10 A special effects video generation method provided by any one of the corresponding embodiments.

[0114] In order to implement the above embodiment, the embodiment of the present disclosure also provides an electronic device.

[0115] refer to Fig.13 , which shows a schematic diagram of the structure of an electronic device 900 suitable for implementing the embodiment of the present disclosure, and the electronic device 900 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers, portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.13 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0116] like Fig.13 As shown, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 to a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0117] Typically, the following devices may be connected to the I / O interface 905: input devices 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 908 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although Fig.13 The electronic device 900 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0118] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0119] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0120] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0121] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0122] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0123] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0124] The units or modules involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit or module does not, in some cases, constitute a limitation on the unit itself.

[0125] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0126] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0127] In a first aspect, according to one or more embodiments of the present disclosure, a method for generating a special effect video is provided, comprising:

[0128] Acquire a target image, wherein the target image is used to display at least two target screen objects; in response to a first operation, display at least one action template, wherein the action template is used to characterize the interactive behavior between more than two screen objects; in response to a second operation, determine the target action template, and generate a special effects video based on the target action template and the target image, wherein the special effects video is used to display the process of the at least two target screen objects executing the target interactive behavior represented by the target action template.

[0129] According to one or more embodiments of the present disclosure, acquiring the target image includes: displaying a video editing interface, wherein the video editing interface is configured with an image material track and a graphic video control, wherein the image material track is configured with at least one image material; determining the image material in the target image material track in a selected state as the target image, or determining the target image material in a selected state as the target image; displaying at least one action template in response to a first operation includes: displaying a template page in response to a first operation on the graphic video control, wherein the template page is configured to display at least one of the action templates.

[0130] According to one or more embodiments of the present disclosure, the displaying of a template page in response to a first operation on the image-generated video control includes: parsing the target object quantity of the target screen objects in the target image; determining, in response to the first operation on the image-generated video control, alternative action templates matching the target object quantity, the alternative action templates being used to characterize interactive behaviors between the target object quantity of screen objects; and generating and displaying the template page based on the alternative action templates.

[0131] According to one or more embodiments of the present disclosure, the target image includes at least a first image and a second image, wherein the first image and the second image are respectively used to display at least one target screen object; and parsing the target object quantity of the target screen objects in the target image includes: respectively parsing the sum of the object quantities of the target screen objects in the first image and the second image to determine the target object quantity.

[0132] According to one or more embodiments of the present disclosure, the action template is displayed in a template page, a generation control is configured in the template page, the second operation includes a first trigger operation and a second trigger operation, and in response to the second operation, a target action template is determined, and a special effects video is generated based on the target action template and the target image, including: in response to the first trigger operation for any action template in the template page, the target action template is determined; in response to the second trigger operation for the generation control, a graph-generated video model is called to process the target action template and the target image to generate the special effects video.

[0133] According to one or more embodiments of the present disclosure, an editing control is configured in the template page, and the second operation also includes a third trigger operation. The method also includes: in response to the third trigger operation on the editing control, displaying an object configuration page, wherein the object configuration page is configured with a loading position, and the loading position is used to load an uploaded image; in response to the loading operation on the loading position, obtaining at least one uploaded image, and the uploaded image is used to display at least one external screen object; in response to the second trigger operation on the generation control, calling the image-generated video model to process the target action template, the uploaded image and the target image to generate the special effects video, wherein the special effects video is used to display the process of the at least two target screen objects and the external screen object performing the target interactive behavior represented by the target action template.

[0134] According to one or more embodiments of the present disclosure, before the object configuration page is displayed, the method further includes: parsing the target image to obtain a first object quantity of the target screen object corresponding to the target image; obtaining a second object quantity matched by the target interactive behavior corresponding to the target action template; and determining a target number of loading positions in the object configuration page based on a difference between the second object quantity and the first object quantity.

[0135] According to one or more embodiments of the present disclosure, the second operation includes a fourth trigger operation, the target action template is marked with at least two optional screen objects, and after the target action template is determined in response to the first trigger operation for any action template in the template page, it also includes: displaying the optional screen objects in the target action template; in response to the fourth trigger operation for the optional screen objects, creating mapping information between the optional screen objects and the target screen objects displayed by the target image; in response to the second trigger operation for the generated control, calling the image-generated video model to process the target action template and the target image to generate the special effects video, including: in response to the second trigger operation for the generated control, calling the image-generated video model to process the target action template, the target image and the mapping information to generate the special effects video, wherein the special effects video is used to show the process of the target screen object performing the target interactive behavior of the corresponding optional screen object in the target action template.

[0136] According to one or more embodiments of the present disclosure, in response to a fourth trigger operation for the optional screen object, creating mapping information between the optional screen object and the target screen object displayed by the target image, includes: displaying a first object outline of the optional screen object in the target action template within the template page; displaying a second object outline of the target screen object corresponding to the target image by parsing the target image, and generating at least one mapping group by selecting a selectable screen object and a corresponding target screen object in pairs at least once in response to the fourth trigger operation, wherein the mapping group is used to characterize a mapping relationship between a selectable screen object and a target screen object; and generating the mapping information according to the at least one mapping group.

[0137] In a second aspect, according to one or more embodiments of the present disclosure, a special effect video generating device is provided, including:

[0138] An acquisition module, used for acquiring a target image, wherein the target image is used for displaying at least two target screen objects;

[0139] An interaction module, configured to display at least one action template in response to a first operation, wherein the action template is used to represent an interactive behavior between two or more screen objects; and to determine a target action template in response to a second operation;

[0140] A generation module is used to generate a special effect video based on the target action template and the target image, wherein the special effect video is used to show the process of the at least two target screen objects executing the target interactive behavior represented by the target action template.

[0141] According to one or more embodiments of the present disclosure, the acquisition module is specifically used to: display a video editing interface, wherein the video editing interface is configured with an image material track and a graphic video control, wherein the image material track is configured with at least one image material; determine the image material in the target image material track in a selected state as the target image, or determine the target image material in a selected state as the target image; the interaction module is specifically used to: in response to a first operation on the graphic video control, display a template page, wherein the template page is configured to display at least one of the action templates.

[0142] According to one or more embodiments of the present disclosure, when the interaction module displays a template page in response to a first operation on the image-generated video control, it is specifically used to: parse the target object number of the target screen objects in the target image; in response to the first operation on the image-generated video control, determine an alternative action template that matches the target object number, the alternative action template being used to characterize the interactive behavior between the screen objects of the target object number; based on the alternative action template, generate and display the template page.

[0143] According to one or more embodiments of the present disclosure, the target image includes at least a first image and a second image, wherein the first image and the second image are respectively used to display at least one target screen object; when parsing the target object quantity of the target screen object in the target image, the interaction module is specifically used to: parse the sum of the object quantities of the target screen objects in the first image and the second image respectively, and determine the target object quantity.

[0144] According to one or more embodiments of the present disclosure, the action template is displayed in a template page, a generation control is configured in the template page, the second operation includes a first trigger operation and a second trigger operation, and when the interaction module determines the target action template in response to the second operation, it is specifically used to: determine the target action template in response to the first trigger operation for any action template in the template page; when the generation module generates a special effects video based on the target action template and the target image, it is specifically used to: in response to the second trigger operation for the generation control, call the image-generated video model to process the target action template and the target image to generate the special effects video.

[0145] According to one or more embodiments of the present disclosure, the template page is configured with an editing control, the second operation also includes a third trigger operation, and the interaction module is further used to: in response to the third trigger operation on the editing control, display an object configuration page, the object configuration page is configured with a loading position, and the loading position is used to load uploaded pictures; in response to the loading operation on the loading position, obtain at least one uploaded picture, and the uploaded picture is used to display at least one external screen object; the generation module is further used to: in response to the second trigger operation on the generation control, call the image-generated video model to process the target action template, the uploaded picture and the target image, and generate the special effects video, wherein the special effects video is used to display the process of the at least two target screen objects and the external screen object performing the target interactive behavior represented by the target action template.

[0146] According to one or more embodiments of the present disclosure, before the object configuration page is displayed, the interaction module is also used to: parse the target image to obtain a first object quantity of the target screen object corresponding to the target image; obtain a second object quantity matched by the target interactive behavior corresponding to the target action template; and determine the target number of loading positions in the object configuration page based on the difference between the second object quantity and the first object quantity.

[0147] According to one or more embodiments of the present disclosure, the second operation includes a fourth trigger operation, the target action template is marked with at least two optional screen objects, and after the target action template is determined in response to the first trigger operation for any action template in the template page, the interaction module is further used to: display the optional screen objects in the target action template; create mapping information between the optional screen objects and the target screen objects displayed by the target image in response to the fourth trigger operation for the optional screen objects; when the generation module calls the image-generated video model to process the target action template and the target image to generate the special effects video in response to the second trigger operation for the generation control, the generation module is specifically used to: call the image-generated video model to process the target action template, the target image and the mapping information in response to the second trigger operation for the generation control to generate the special effects video, wherein the special effects video is used to show the process of the target screen object performing the target interactive behavior of the corresponding optional screen object in the target action template.

[0148] According to one or more embodiments of the present disclosure, when the generation module creates mapping information between the optional screen object and the target screen object displayed by the target image in response to a fourth trigger operation for the optional screen object, the generation module is specifically used to: display a first object outline of the optional screen object in the target action template within the template page; display a second object outline of the target screen object corresponding to the target image by parsing the target image, and generate at least one mapping group by selecting a selectable screen object and a corresponding target screen object in pairs at least once in response to the fourth trigger operation, wherein the mapping group is used to characterize a mapping relationship between a selectable screen object and a target screen object; and generate the mapping information according to the at least one mapping group.

[0149] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0150] The memory stores computer-executable instructions;

[0151] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the special effects video generation method described in the first aspect and various possible designs of the first aspect.

[0152] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the special effects video generation method described in the first aspect and various possible designs of the first aspect is implemented.

[0153] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program, which, when executed by a processor, implements the special effects video generation method described in the first aspect and various possible designs of the first aspect.

[0154] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0155] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0156] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A special effects video generation method, characterized in that: include: Acquire a target image, where the target image is used to display at least two target screen objects; In response to the first operation, displaying at least one action template, wherein the action template is used to represent an interactive behavior between two or more screen objects; In response to the second operation, a target action template is determined, and a special effects video is generated based on the target action template and the target image, wherein the special effects video is used to show the process of the at least two target screen objects performing the target interactive behavior represented by the target action template.

2. The method according to claim 1, characterized in that: The acquiring of the target image comprises: Display a video editing interface, wherein the video editing interface is configured with an image material track and an image-generated video control, and the image material track is configured with at least one image material; Determine the image material in the selected target image material track as the target image, or determine the selected target image material as the target image; The step of displaying at least one action template in response to the first operation includes: In response to a first operation on the image-generated video control, displaying a template page, wherein the template page is configured to display at least one of the action templates; After generating the special effect video, the method further includes: replacing the target image in the image material track with the special effect video.

3. The method according to claim 2, characterized in that The step of displaying a template page in response to a first operation on the image-generated video control comprises: Analyze the target object quantity of the target screen object in the target image; In response to a first operation on the image-generated video control, determining a candidate action template that matches the number of target objects, the candidate action template being used to characterize an interactive behavior between the number of screen objects of the target object; Based on the candidate action template, the template page is generated and displayed.

4. The method according to claim 3, characterized in that The target image includes at least a first image and a second image, wherein the first image and the second image are respectively used to display at least one target screen object; The step of analyzing the number of target objects of the target screen objects in the target image includes: The sum of the object quantities of the target screen objects in the first image and the second image is analyzed respectively to determine the target object quantity.

5. The method according to claim 1, characterized in that The action template is displayed in a template page, a generation control is configured in the template page, the second operation includes a first trigger operation and a second trigger operation, and in response to the second operation, a target action template is determined, and a special effect video is generated based on the target action template and the target image, including: In response to a first trigger operation on any action template in the template page, determining the target action template; In response to a second trigger operation on the generation control, the image-generated video model is called to process the target action template and the target image to generate the special effects video.

6. The method according to claim 5, characterized in that The template page is provided with an editing control, the second operation further includes a third triggering operation, and the method further includes: In response to a third trigger operation on the editing control, an object configuration page is displayed, wherein a loading position is configured in the object configuration page, and the loading position is used to load the uploaded image; In response to a loading operation on the loading position, obtaining at least one uploaded picture, wherein the uploaded picture is used to display at least one external screen object; In response to a second trigger operation on the generated control, the image-generated video model is called to process the target action template, the uploaded picture and the target image to generate the special effects video, wherein the special effects video is used to show the process of the at least two target screen objects and the external screen object executing the target interactive behavior represented by the target action template.

7. The method according to claim 6, characterized in that Before displaying the object configuration page, the method further includes: Parsing the target image to obtain a first object quantity of target screen objects corresponding to the target image; Obtaining the number of second objects matched by the target interactive behavior corresponding to the target action template; A target number of loading bits in the object configuration page is determined according to a difference between the second number of objects and the first number of objects.

8. The method according to claim 5, characterized in that The second operation includes a fourth trigger operation, the target action template is marked with at least two optional screen objects, and after the target action template is determined in response to the first trigger operation for any action template in the template page, the second operation includes: Display the selectable screen object in the target action template; In response to a fourth trigger operation on the selectable screen object, creating mapping information between the selectable screen object and a target screen object displayed by the target image; In response to the second trigger operation on the generation control, calling the image-generated video model to process the target action template and the target image to generate the special effect video includes: In response to a second trigger operation for the generated control, the image-generated video model is called to process the target action template, the target image and the mapping information to generate the special effects video, wherein the special effects video is used to show the process of the target screen object executing the target interactive behavior of the corresponding optional screen object in the target action template.

9. The method according to claim 8, characterized in that The step of creating mapping information between the selectable screen object and the target screen object displayed by the target image in response to the fourth trigger operation on the selectable screen object includes: In the template page, displaying a first object outline of a selectable screen object in the target action template; By parsing the target image, displaying a second object outline of a target screen object corresponding to the target image, and by responding to the fourth trigger operation, selecting a selectable screen object and a corresponding target screen object at least once in a pair, generating at least one mapping group, wherein the mapping group is used to represent a mapping relationship between a selectable screen object and a target screen object; The mapping information is generated according to the at least one mapping group.

10. A special effects video generation device, characterized in that: include: An acquisition module, used for acquiring a target image, wherein the target image is used for displaying at least two target screen objects; An interaction module, configured to display at least one action template in response to a first operation, wherein the action template is used to represent an interaction behavior between two or more screen objects; In response to the second operation, determining a target action template; A generation module is used to generate a special effect video based on the target action template and the target image, wherein the special effect video is used to show the process of the at least two target screen objects executing the target interactive behavior represented by the target action template.

11. An electronic device, characterized in that: include: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor executes the special effect video generation method as described in any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When the processor executes the computer-executable instructions, the special effects video generation method as described in any one of claims 1 to 9 is implemented.

13. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the special effects video generation method according to any one of claims 1 to 9 is implemented.

Images