Dynamic special effect graph generation method, computing device, readable storage medium and computer program product

Abstract

The embodiment of the invention provides a dynamic special effect graph generation method, computing equipment, a computer readable storage medium and a computer program product. The dynamic special effect graph generation method comprises the steps of obtaining a target dynamic special effect file; analyzing the target dynamic special effect file to obtain a target style image of an image access path index in the target dynamic special effect file; according to multi-frame special effect parameters in the target dynamic special effect file, obtaining a first dynamic special effect graph in a first animation format through rendering based on the target style image; capturing the first dynamic special effect image frame by frame to obtain multiple frames of special effect images in the first dynamic special effect image; generating a second dynamic special effect image in a second animation format based on the multiple frames of special effect images; the second dynamic special effect graph in the second animation format is used for performing associated display with at least one video. According to the technical scheme provided by the embodiment of the invention, the display process of the dynamic special effect image is simplified.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to a method for generating dynamic special effects images, a computing device, a computer-readable storage medium, and a computer program product. Background Technology

[0002] With the explosive growth of short video content and the ever-increasing demand for visual communication, video creators are increasingly eager to add dynamic special effects images corresponding to keywords in their videos to enhance their appeal and highlight key information.

[0003] In related technologies, dynamic effects images are usually generated by generating dynamic effects files in JSON format. The JSON format dynamic effects file describes the effects parameters and resource references of target style images for keywords through text data, and generates dynamic effects images by relying on a parsing engine.

[0004] In the process of developing this application, the inventors discovered that the JSON format dynamic effect files generated in related technologies are essentially text data describing the effects. Every time a text effect image needs to be played, the complete process of "getting the JSON file - calling the engine to parse - rendering and compositing frame by frame" must be repeated, which makes the process of displaying dynamic effect images quite complicated. Summary of the Invention

[0005] This application provides a method for generating dynamic special effects images, a computing device, a computer-readable storage medium, and a computer program product.

[0006] Firstly, this application provides a method for generating dynamic special effects images, including:

[0007] Obtain the target dynamic effects file;

[0008] Parse the target dynamic effects file to obtain the target style image of the image access path index in the target dynamic effects file;

[0009] Based on the multi-frame effect parameters in the target dynamic effect file, a first dynamic effect image in a first animation format is obtained by rendering the target style image.

[0010] The first dynamic effect image is captured frame by frame to obtain multi-frame effect images in the first dynamic effect image;

[0011] Based on the multi-frame special effects images, a second dynamic special effects image in a second animation format is generated; the second dynamic special effects image in the second animation format is used to be displayed in association with at least one video.

[0012] Secondly, this application provides a dynamic special effects image generation device, including:

[0013] The special effects file acquisition module is used to acquire the target dynamic special effects file;

[0014] The special effects file parsing module is used to parse the target dynamic special effects file and obtain the target style image of the image access path index in the target dynamic special effects file;

[0015] The rendering module is used to render a first dynamic effect image in a first animation format based on the target style image according to the multi-frame effect parameters in the target dynamic effect file.

[0016] The capture module is used to capture the first dynamic effect image frame by frame to obtain multi-frame effect images in the first dynamic effect image.

[0017] The special effects image generation module is used to generate a second dynamic special effects image in a second animation format based on the multi-frame special effects images; the second dynamic special effects image in the second animation format is used to be displayed in association with at least one video.

[0018] Thirdly, this application provides a computing device, including a processing component and a storage component;

[0019] The storage component stores a computer program; the computer program is invoked and executed by the processing component to implement the dynamic special effects image generation method provided in this application embodiment.

[0020] Fourthly, this application provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processing component, implements the dynamic special effects image generation method provided in this application.

[0021] Fifthly, this application provides a computer program product, including a computer program or instructions, which, when executed by a processing component, implements the dynamic special effects image generation method provided in this application.

[0022] In the embodiments of this application, the target dynamic effect file is first obtained, and the image access path index within it is parsed to extract the target style image. Next, based on the multi-frame effect parameters in the target dynamic effect file, the target style image is used to render and generate a first dynamic effect image in a first animation format. Subsequently, by capturing the first dynamic effect image frame by frame, multi-frame effect images are extracted, and these images are recombined to generate a second dynamic effect image in a second animation format. In the above technical solution, the complex process of "obtaining a JSON file - calling the engine to parse - rendering and compositing frame by frame," which originally needed to be repeatedly executed, is transformed into a one-time preprocessing operation to generate a second dynamic effect image that can be used directly. This second dynamic effect image can be directly associated with and displayed with the video content without further parsing or rendering, thus simplifying the display process of dynamic effect images.

[0023] These or other aspects of this application will become more apparent in the following description of the embodiments. Attached Figure Description

[0024] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0025] Figure 1 A system architecture diagram illustrating a technical solution of an embodiment of this application that can be applied thereto is shown;

[0026] Figure 2 A flowchart of an embodiment of a dynamic special effects image generation method provided in this application;

[0027] Figure 3 A schematic diagram illustrating the special effects of target keywords provided for an exemplary embodiment of this application;

[0028] Figure 4 This illustration shows a block diagram of a dynamic special effects image generation apparatus according to an embodiment of this application;

[0029] Figure 5 A block diagram of a computing device provided in one embodiment of this application is shown. Detailed Implementation

[0030] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0031] It should be noted that, in the cases involving user information in the embodiments of this application, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse. In addition, the various models involved in this application (including but not limited to language models or large models) comply with relevant laws and standards.

[0032] Additionally, it should be noted that when user interaction operations or triggering operations are involved in the embodiments of this application, these operations include, but are not limited to, various interaction methods such as touch operations, gesture operations, voice operations, head movement operations, and eye movement operations. Touch operations include, but are not limited to, click operations, double-click operations, long-press operations, swipe operations, pinch operations, or mouse hover operations. Swipe operations include, but are not limited to, straight-line swipes and curved-line swipes.

[0033] Furthermore, it should be noted that, in the case of jumps between the first interface and the second interface in the embodiments of this application, the jump methods involved in the embodiments of this application include, but are not limited to: jumping directly from the first interface to the second interface, or jumping from the first interface to the task interface and completing the corresponding task operation on the task interface before jumping to the second interface; completing the corresponding task operation on the task interface includes, but is not limited to: completing the game operation on the game interface when the task interface is implemented as a game interface; completing identity authentication on the identity authentication interface when the task interface is implemented as an identity authentication interface; and completing the recharge operation on the recharge interface when the task interface is implemented as a recharge interface.

[0034] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0035] Figure 1 A system architecture diagram is shown that can be applied to a technical solution of an embodiment of this application. The system architecture may include a client 101 and a server 102.

[0036] In this system, client 101 and server 102 can establish a connection via a network. The network provides a communication link between client 101 and server 102. The network can include various connection types, such as wired, wireless, or fiber optic cable. Client 101 can interact with server 102 via the network to receive or send messages, etc.

[0037] The client 101 can be a browser, an app (application), a web application such as an H5 (HyperText Markup Language 5) application, a lightweight application (also known as a mini-program), or a cloud application. The client 101 can be deployed on electronic devices and depends on the device to run or on certain apps within the device. Electronic devices can have displays and support information browsing, such as personal mobile terminals like mobile phones, tablets, personal computers, desktop computers, smart speakers, smartwatches, etc. For ease of understanding, Figure 1 The client is primarily represented by the image of a device. Various other types of applications can also be configured in electronic devices, such as human-computer interaction applications, model training applications, text processing applications, web browser applications, shopping applications, search applications, instant messaging tools, email clients, and social media platform software. An electronic device can refer to a user-used device with the computing, internet access, and communication functions required by the user, such as a mobile phone, tablet computer, personal computer, or wearable device. An electronic device typically includes at least one processing component and at least one storage component. It may also include basic configurations such as a network interface card (NIC) chip, I / O (input / output) bus, and audio / video components; this application does not limit its scope. Optionally, depending on the implementation of the electronic device, it may also include peripheral devices such as a keyboard, mouse, pen, and printer; this application does not limit its scope either.

[0038] Server 102 may include servers that provide various services, such as a server for background training that supports the model used on client 101, or a server that processes interactive information sent by the client.

[0039] It should be noted that server 102 can be implemented as a distributed server cluster consisting of multiple servers, or as a single server. The server can also be a server in a distributed system, or a server integrated with blockchain. The server can also be a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms, or an intelligent cloud computing server or intelligent cloud host with artificial intelligence technology.

[0040] It should be noted that the dynamic special effects image generation method provided in this application embodiment is generally executed by the server 102, and the corresponding dynamic special effects image generation device is generally set in the server 102.

[0041] It should be understood that Figure 1 The number of clients and servers shown is merely illustrative. Depending on implementation needs, there can be any number of clients and servers.

[0042] Figure 2 This is a flowchart of an embodiment of a dynamic special effects image generation method provided in this application. The technical solution of this embodiment can be executed by the server.

[0043] Figure 2 The method for generating dynamic special effects images shown may include the following steps:

[0044] 201: Obtain the target dynamic effects file.

[0045] 202: Parse the target dynamic effects file to obtain the target style image from the image access path index in the target dynamic effects file.

[0046] The target dynamic effects file may include multi-frame effect parameters for driving the dynamic effects. In one embodiment of this application, the target dynamic effects file may refer to a predefined motion effect configuration file, such as a Lottie JSON format. The dynamic effects template may encapsulate multi-frame effect parameters, which can be used to control the dynamic effects changes such as displacement, scaling, and transparency of the target style image indexed by the target dynamic effects file at different time points.

[0047] The multi-frame effect parameters contained in the dynamic effect template can be stored in the form of a keyframe array. For example, the displacement parameter p can contain [[0,[200,400]], [1,[200,200]]], indicating that the image moves from coordinates (200,400) in frame 0 to (200,200) in second 1. The transparency parameter o can be defined as [[0,0], [0.2,100]] to achieve a dynamic effect of going from transparent to fully displayed in 0.2 seconds. In addition to displacement and transparency parameters, effect parameters can also include filter parameters, layer blending parameters, etc.

[0048] In the embodiments of this application, the image access path index in the target dynamic effects file can not only contain conventional resource location information, but also embed a fast lookup table based on hash mapping. This allows for efficient location of the target style image after parsing the target dynamic effects file, without having to scan the entire file content one by one. Furthermore, in the target dynamic effects file, multi-frame effect parameters can be recorded in the form of a sparse keyframe array, recording only the change points rather than the full frame data, thereby significantly reducing the file size of the target dynamic effects file and improving parsing efficiency.

[0049] By employing a fast lookup table based on hash mapping and a multi-frame effect parameter recording method using sparse keyframe arrays, the parsing speed of target dynamic effect files can be improved.

[0050] In the embodiments of this application, the multi-frame effect parameters recorded in the target dynamic effect file can be modified in real time and dynamically, so that during the process of parsing the target dynamic file and rendering the dynamic effect image, the effect parameters such as displacement, scaling, and transparency can be flexibly adjusted without re-parsing or re-rendering the entire animation sequence.

[0051] 203: Based on the multi-frame effect parameters in the target dynamic effect file, render the first dynamic effect image in the first animation format to obtain the first dynamic effect image.

[0052] After the server parses the target dynamic effects file and obtains the target style image, it can perform frame-by-frame transformation processing on the image based on the multi-frame effects parameters defined in the target dynamic effects file, thereby generating a preliminary dynamic effects image.

[0053] For example, in an e-commerce promotion scenario, the target style image could be a red "discount" icon. The multi-frame effect parameters define the effect of the icon floating from bottom to top with a color gradient. The rendering engine can calculate the position, size, and color value of the icon in each frame of the image according to the multi-frame effect parameters, and render it to the canvas to form a dynamically floating first dynamic effect image.

[0054] In the embodiments of this application, the first animation format serves as an intermediate form for dynamic rendering. It can employ vector animation, thereby fully preserving the multi-frame effect parameters defined in the target dynamic effect file, including dynamic effects such as displacement, scaling, and transparency changes, while supporting high-precision lossless rendering. This makes the first animation format suitable for rendering dynamic effects in complex scenes, such as those requiring support for alpha channels or interactive scenes.

[0055] 204: Capture the first dynamic effect image frame by frame to obtain multi-frame effect images from the first dynamic effect image.

[0056] The server can define the total number of frames in the first animated effect to specify the capture range. For example, in a headless browser environment based on Puppeteer, the rendering engine (such as Lottie-web) can provide an interface (such as the getDuration() method) to obtain the total number of frames in the first animated effect. Assuming the first animated effect has a frame rate of 30fps and a total duration of 5 seconds, the total number of frames is 150.

[0057] Next, the server can control the first dynamic effect image to play frame by frame and take screenshots in real time. Taking a headless browser as an example, the `page.evaluate()` method executes JavaScript code in the browser context to set the animation playback progress frame by frame, ensuring that the screen state of each frame accurately corresponds to the parameter definition in the target dynamic effect file.

[0058] After each frame is stabilized, the server saves the current canvas content as a static image via a screenshot interface. To ensure image quality and subsequent compositing effects, the frame image can be stored in PNG format (lossless compression).

[0059] 205: Based on multi-frame special effects images, generate a second dynamic special effects image in a second animation format; the second dynamic special effects image in the second animation format is used to be displayed in association with at least one video.

[0060] After obtaining the multi-frame effects images from the first dynamic effects image, the server can call a video encoding tool (such as FFmpeg) to batch process the captured PNG or JPG format effects images, merging them into common animation formats such as GIF and MP4 according to preset frame rates and encoding parameters. For example, if 150 frames of PNG images are captured (corresponding to 5 seconds of 30fps animation), executing the FFmpeg command `ffmpeg-framerate 30 -i frame_%04d.png -c:vlibx264 output.mp4` will merge these frames into an H.264 encoded MP4 video at a rate of 30 frames per second, where `frame_%04d.png` is the sequentially named frame image filename, and `-c:v libx264` specifies the video encoding method.

[0061] The generated "second animation format" (such as GIF / MP4) differs fundamentally from the "first animation format" (such as real-time vector animation on a Canvas) during the rendering stage: the second animation format can be a fixed binary media file that can be directly referenced via a URL without relying on a rendering engine for real-time parsing; the first animation format can be an intermediate form in the dynamic rendering process, dependent on a specific environment (such as a browser) for display. For example, the first dynamic effect image can be a vector animation rendered by Lottie in a browser, while the second dynamic effect image is an MP4, GIF, WebM (an open media format optimized for web pages), MKV (a flexible multimedia container format), etc., synthesized after capturing the animation frame by frame.

[0062] The generated MP4 or GIF files can be added to the video track as standalone material, and used as a second dynamic effect image to be displayed in association with at least one video.

[0063] In this embodiment, during frame-by-frame capture of the first dynamic effect image, an alpha channel preservation strategy can be adopted for each frame to avoid the loss of transparent information common in traditional format conversions. Furthermore, by adjusting the frame rate and encoding parameters, the applicability of the second animation format in complex video editing environments can be further improved.

[0064] In the embodiments of this application, the target dynamic effect file is first obtained, and the image access path index within it is parsed to extract the target style image. Next, based on the multi-frame effect parameters in the target dynamic effect file, the target style image is used to render and generate a first dynamic effect image in a first animation format. Subsequently, by capturing the first dynamic effect image frame by frame, multi-frame effect images are extracted, and these images are recombined to generate a second dynamic effect image in a second animation format. In the above technical solution, the complex process of "obtaining a JSON file - calling the engine to parse - rendering and compositing frame by frame," which originally needed to be repeatedly executed, is transformed into a one-time preprocessing operation, generating a second dynamic effect image that can be used directly. This second dynamic effect image can be directly associated with and displayed with the video content without further parsing or rendering, thus simplifying the display process of dynamic effect images. Furthermore, in the embodiments of this application, the dynamic effect file parsing and subsequent animation format conversion provide a data foundation, while the animation format conversion provides a second dynamic effect image that can be directly reused in the video association stage. The above-mentioned technical features form an organic whole through technical coherence and synergy, realizing an integrated solution from effect generation to video display.

[0065] In some embodiments, the method further includes: launching a headless browser to create a sandboxed browser environment based on the headless browser; encoding the target style image to obtain a target encoded image in the target encoding format; and updating the target style image in the target dynamic effects file using the target encoded image to obtain an updated dynamic effects file.

[0066] In the embodiments of this application, by launching a headless browser, a graphical interface-free, isolated, and secure automated rendering container can be constructed. This sandboxed browser environment is similar to a "virtual browser container," capable of independently executing JavaScript and rendering HTML / CSS, while restricting access permissions to local file systems, networks, and other resources to ensure the security and stability of the rendering process.

[0067] Typically, target style images may be indexed to the target dynamic effect file as local files (e.g., / user / images / btn.png) or HTTP remote links (e.g., https: / / cdn.com / icon.jpg). Headless browsers often have security restrictions (e.g., local file access permissions, cross-domain request restrictions). Therefore, the server can perform targeted encoding based on the image resource type: for local files, read the binary data using fs.readFileSync() and convert it to Base64 format using base64.encode(); for HTTP links, obtain the resource's binary data using axios.get() and then perform Base64 encoding. This encoding process converts image resources into text strings that can be embedded in HTML / JSON, avoiding loading failures caused by resource paths. For example, after converting the local image / path / logo.png to Base64, it can be directly embedded in the src attribute of HTML, allowing the browser to render it without parsing the local path.

[0068] Taking a dynamic effects file in JSON format as an example, the server can parse the `u` attribute (i.e., the access path index of the original target style image) in the `assets` field and replace it with an encoded Base64 string. For example, if the `u` attribute of an image resource in the original JSON is `https: / / example.com / effect.png`, after updating it becomes `data:image / png;base64,iVBORw0KGgoAAA...`. This update operation ensures that when the dynamic effects file is parsed in a sandboxed browser environment, the rendering engine (such as Lottie-web) will directly read the embedded Base64 encoded image data instead of initiating a network request or accessing a local file, thus avoiding issues such as cross-domain restrictions and insufficient local permissions. The updated JSON file can be directly provided to a headless browser for loading, for example, by injecting the updated JSON data through the `page.evaluate()` method, ensuring that the dynamic effects rendered in the browser environment are completely consistent with the original design, and that the resource loading success rate is high.

[0069] In some embodiments, obtaining a first dynamic effect image in a first animation format by rendering based on a target style image according to the multi-frame effect parameters in the target dynamic effect file can be specifically implemented as follows:

[0070] The access path of the updated dynamic effects file is provided to the headless browser, so that the headless browser can parse the updated dynamic effects file based on the access path, and obtain the first dynamic effects image in the first animation format by rendering based on the target encoded image according to the multi-frame effects parameters in the updated dynamic effects file in the sandboxed browser environment.

[0071] The server can store the updated dynamic effects file in a local path or provide it to the headless browser (such as Puppeteer) via memory mapping. Taking Puppeteer as an example, the headless browser can obtain the file content of the updated dynamic effects file by using page.goto('file: / / / temp / updated_effect.json') or by injecting JSON data into the page context (such as page.evaluate((jsonData)=>{...},updatedJson)).

[0072] After receiving the access path, the headless browser can activate its internal parsing engine to process the updated dynamic effects file. Taking JSON format as an example, the headless browser can parse the updated dynamic effects file into a JavaScript object, extracting multi-frame effect parameters (such as keyframe time, displacement, scaling, etc.) and the target encoded image. Since the updated dynamic effects file has already converted the original image resource into a directly parsable encoding format, the browser does not need to initiate network requests or access the local file system. It can directly obtain the image binary data through the built-in Base64 decoding mechanism, avoiding issues such as cross-domain restrictions and insufficient local permissions.

[0073] In a sandboxed browser environment, the rendering engine (such as Lottie-web) can control the animation rendering process based on multi-frame effect parameters. For example, after parsing parameters defined in the frames field such as "frame 0 is located at (100, 200), frame 30 moves to (300, 200)," the rendering engine can create a rendering context for the target encoded image on the Canvas and update the image's position, size, transparency, and other properties frame by frame using JavaScript. During this process, the Base64 encoded target image is decoded into pixel data in real time, working in conjunction with the multi-frame parameters to generate a continuous sequence of animation frames, i.e., the first dynamic effect image of the first animation format.

[0074] In some embodiments, before encoding the target style image to obtain a target encoded image in the target encoding format, the method further includes:

[0075] Determine the resource index type of the text effect image in the target dynamic effects file;

[0076] If the resource index type is a preset type, perform the step of encoding the target style image to obtain the target encoded image in the target encoding format.

[0077] The server can parse the path index of the descriptive text effect image in the target dynamic effect file (such as JSON format) (e.g., the value of the 'u' attribute in the assets field) and determine the type of resource that index points to. Common resource index types include: local file paths, HTTP / HTTPS remote links, and Base64 encoded strings.

[0078] By performing the step of encoding the target style image to obtain a target encoded image in the target encoding format when the resource index type belongs to a preset type, redundant processing of resources that already meet the rendering requirements can be avoided. Preset types can include local file paths and HTTP remote links—these resources cannot be safely loaded directly by headless browsers and therefore need to be converted to Base64 encoded target encoded images. Conversely, if the resource index type is Base64 encoded (i.e., a format outside of preset types), there is no need for repeated encoding, and it can be used directly.

[0079] In some embodiments, the method further includes:

[0080] Provide the client with a video effects editing page; the video effects editing page includes keyword setting prompts and style setting prompts.

[0081] In response to an editing request sent by the client, the target keywords and target style attributes are determined; wherein, the target keywords are determined by the client in response to the configuration operation of setting prompts for keywords; and the style attributes are determined in response to the configuration operation of setting prompts for styles.

[0082] Based on the target style attributes, generate the target style image corresponding to the target keyword.

[0083] Determine the dynamic effect template corresponding to the target keyword. The dynamic effect template includes multi-frame effect parameters.

[0084] The target style image is imported into the image position in the dynamic effects template to generate the target dynamic effects file. The target dynamic effects file is used to render the target style image at the image position using multi-frame effect parameters to generate dynamic effects images corresponding to the target keywords. The dynamic effects images are used to be associated with at least one video for display.

[0085] The keyword setting prompts users to enter text that needs to be highlighted with effects in the video effects editing page. The style setting prompts users to configure the display style of the text to be highlighted with effects. Display styles can include, for example, font, color scheme, font size, whether to add a border, and border style. By configuring display styles, the text content can be presented visually in a way that better matches the video style or expressive needs.

[0086] After the user configures keywords and styles, the client can encapsulate the user-configured keywords and styles into an edit request and send it to the server.

[0087] The server responds to the edit request, which means it can determine the target keywords and target style attributes from the edit request.

[0088] After obtaining the target keyword and target style attributes, the server can parse and obtain at least one style parameter from the target style attributes, such as font type, color, font size, whether to add a border, and the border style. Then, based on at least one style parameter in the target style attributes, the server can call an image processing tool, such as FFmpeg, to generate a bitmap image with a transparent background. This bitmap image can display the target keyword corresponding to the target style attribute. For example, if the target keyword is "New Product Launch", and the target style attributes can include "Bold, Red, 24-point font, 2px red solid border", then the bitmap image can display the text "New Product Launch" with "Bold, Red, 24-point font, 2px red solid border".

[0089] The dynamic effects template may include multi-frame effect parameters for driving dynamic effects. In one embodiment of this application, the dynamic effects template may refer to a predefined animation configuration file, such as a Lottie JSON format. The dynamic effects template may encapsulate multi-frame effect parameters, which can be used to control the dynamic effects changes of the target style image at different points in time, such as displacement, scaling, and transparency.

[0090] The multi-frame effect parameters contained in the dynamic effect template can be stored in the form of a keyframe array. For example, the displacement parameter p can contain [[0,[200,400]], [1,[200,200]]], indicating that the image moves from coordinates (200,400) in frame 0 to (200,200) in second 1. The transparency parameter o can be defined as [[0,0], [0.2,100]] to achieve a dynamic effect of going from transparent to fully displayed in 0.2 seconds. In addition to displacement and transparency parameters, effect parameters can also include filter parameters, layer blending parameters, etc.

[0091] The method for determining the dynamic effect template corresponding to the target keyword will be described in detail in the following examples, and will not be repeated here.

[0092] After generating the target style image and determining the dynamic effects template, the server embeds the target style image into a specified location within the dynamic effects template, thereby generating a renderable target dynamic effects file. Specifically, the dynamic effects template is a JSON file in Lottie (a lightweight JSON-based animation format) format, which internally predefines placeholder positions for image resources. The server can import the target style image into the image index position within the dynamic effects template by replacing the placeholders in the template with the storage path of the target style image.

[0093] When a target dynamic effects file is input into a rendering engine (such as the Lottie parser), the rendering engine can perform frame-by-frame calculations on the target style image at the image index position based on the multi-frame effect parameters in the target dynamic effects file: at each key time point on the timeline, intermediate frames are generated based on the multi-frame effect parameters, ultimately synthesizing a coherent dynamic effects image. For example, in the example above, within 0-1 seconds, the target style image will move from the left to the right according to the displacement parameter, while the transparency parameter controls its gradual transition from transparent to fully displayed.

[0094] In video editing software, dynamic special effects images can be placed on a separate effects track, and their playback intervals can be synchronized with the appearance time of keywords in the video (such as the keyword subtitle display period). Thus, when the video plays to a specified point in time, the dynamic special effects images will be rendered according to multi-frame effect parameters and superimposed on the video screen, achieving dynamic highlighting of keywords and improving the video's information delivery efficiency and visual appeal.

[0095] To enhance the personalization of the target dynamic effects file, in some embodiments, the method further includes sending template configuration prompts to the client.

[0096] In some embodiments, determining the target keywords and target style attributes in response to an editing request sent by the client can be specifically implemented as follows:

[0097] In response to the editing request sent by the client, the target keywords, target style attributes, and dynamic effects template are determined; the dynamic effects template is determined by the client in response to the template upload operation triggered by the template configuration prompt information.

[0098] The template configuration prompts can be used to guide users in selecting and uploading dynamic effects templates. These prompts can be presented as visual interactive elements on the video effects editing page, such as displaying a prominent text prompt "Please select or upload a dynamic effects template," or providing a "Template Upload" button with the explanation "Click to upload a custom effects template." The template configuration prompts are dynamically rendered when the client loads the editing page. The presentation of these prompts can include floating dialog boxes, guide labels, or interactive buttons. For example, a "Template Configuration Area" could be set up on the right side of the page, displaying a list of "Recommended Templates" and instructions for "Uploading a New Template."

[0099] In the embodiments of this application, when generating the target dynamic effect file, in addition to the target keywords and styles being customizable by the user, the user can also use the dynamic effect template they uploaded to generate the target dynamic effect file, further realizing the personalization of the target dynamic effect file.

[0100] To further improve the efficiency of determining dynamic effect templates, in some embodiments, determining the dynamic effect template corresponding to the target keyword can be specifically implemented as follows:

[0101] Retrieve dynamic effect templates that match the target keywords from the dynamic effects library.

[0102] In some embodiments, the dynamic effects library includes multiple types of candidate dynamic effects templates, each type of candidate dynamic effects template being adapted to keywords of a specific number of characters.

[0103] In some embodiments, obtaining a dynamic effect template matching the target keyword from a dynamic effects library can be specifically implemented as follows:

[0104] Determine the number of characters included in the target keywords;

[0105] Based on the number of characters in the target keywords, dynamic effect templates are matched from the material library.

[0106] In one embodiment of this application, the dynamic effects library can implement structured storage of dynamic effects templates according to theme type. The server can match the corresponding dynamic effects template by parsing the theme of the target keyword. For example, for the target keyword "summer promotion", the server uses natural language processing technology to identify its theme as "promotion", and then can directly retrieve all dynamic effects templates marked as "promotion" from the dynamic effects library.

[0107] In another embodiment of this application, the dynamic effects library can build an index system based on the number of characters in the keywords. The server uses the number of characters in the target keyword as the main matching dimension to obtain dynamic effects templates from the dynamic effects library that match the number of characters in the target keyword.

[0108] In another embodiment, the dynamic effects library can employ a composite indexing mechanism of "topic type - character count," with the server simultaneously performing template matching based on the business attributes and character count of the target keyword. Taking the keyword "summer promotion" as an example, the server first determines its "promotional" topic attribute through semantic analysis, and simultaneously counts the number of characters as 4. Then, it accurately locates the dynamic effects template under the "summer promotion - 4 characters" group in the dynamic effects library.

[0109] In some embodiments, the method further includes:

[0110] In response to an effects generation request, obtain at least one initial video clip;

[0111] Each initial video clip is input into the subtitle generation network in the AI ​​video editing model. The video content and / or audio segments of each initial video clip are identified, and a subtitle file for the initial video clip is generated based on the video content and / or audio segments. Each subtitle file includes: multiple lines of subtitle text, and the start and end times of each line of subtitle text.

[0112] The theme type and subtitle file of each initial video clip are input into the keyword extraction network in the AI ​​video editing model. Keyword extraction is performed on the subtitle file of each initial video clip to obtain target keywords that match the theme type.

[0113] Based on the target keyword, a keyword setting prompt message is generated; the target keyword is determined by the client's confirmation action in response to the keyword setting prompt message.

[0114] As mentioned above, dynamic special effects images are used to be displayed in association with at least one video. In video editing applications, dynamic special effects images can be placed on a separate effects track, and their playback interval can be synchronized with the appearance time of keywords in the video (such as the keyword subtitle display period). Thus, when the video plays to a specified point in time, the dynamic special effects image will be rendered according to multi-frame effect parameters and superimposed on the video frame, achieving dynamic highlighting of keywords and improving the video's information delivery efficiency and visual appeal. Superimposing dynamic special effects images onto the video frame can be achieved through video editing; the image generation method will be explained below during the video editing process.

[0115] In the embodiments of this application, the video editing application can be implemented as a standalone app, a mini-program dependent on an app, or a webpage. In this embodiment, the video editing application can be, for example, the Shotcut software, which supports editing various video, audio, and image formats. The Shotcut software is built on the Multimedia Lightweight Toolkit (MLT) framework, using the MLT framework as its video processing engine. It leverages the powerful multimedia processing capabilities to implement various video editing functions, allowing users to perform non-linear editing via a timeline and supporting features such as keyframes, filters, and transitions. In this embodiment, the Shotcut software is primarily used for local video editing and exports video editing parameters via MLT templates for subsequent batch video generation. The timeline is a visual tool used to display the temporal arrangement of media materials such as video, audio, and images. Users can perform operations such as cutting, moving, and reordering on the timeline. Non-linear editing allows users to cut, add effects, and reorder videos at any point in time, without needing to edit in a fixed order. This editing method is more flexible and can greatly improve editing efficiency. In Shotcut, users can freely edit video clips, add audio and image materials, and adjust the order and duration of materials using the timeline. For example, a user can cut video clip A into two parts and then insert another video clip B in the middle of A.

[0116] In this application embodiment, in response to a special effects generation request, at least one video clip can be obtained, each video clip having its own theme type. For ease of distinction and description, the video clips can be referred to as initial video clips. Initial video clips refer to various basic materials used for video production and editing; these materials can be pre-recorded videos, audio files, images, animations, subtitles, special effects, etc. Video clips are an indispensable part of the video creation process, providing rich content sources for video editing, enabling creators to construct diverse and colorful video works. In the examples below of this application, the initial video clips focus primarily on videos. Furthermore, this application does not limit the theme type of the initial video clips; for example, theme types include, but are not limited to, advertising, education, entertainment, news, and documentary. Further, theme types can be further subdivided; for example, advertising includes, but is not limited to, housekeeping advertisements, real estate advertisements, and product advertisements.

[0117] To automate the video editing process and improve efficiency, this application introduces an AI video editing model to perform video editing. The AI ​​video editing model is obtained by training an initial video editing model with a large amount of sample data from the video editing field, or by fine-tuning a pre-trained model. More specifically, it is obtained by training the various networks within the initial video editing model or by fine-tuning the various networks within the pre-trained model.

[0118] Taking the example of training an initial video editing model based on sample data to obtain an AI video editing model, the process is as follows: Obtain a sample dataset, which includes multiple sample video clips, sample video content and / or sample audio clips for each sample video clip, sample subtitle files, sample keywords, and the start and end times of each sample keyword displayed in the corresponding sample subtitle line text, the sample video frame corresponding to each sample keyword, the sample dynamic effect parameters and sample audio effect parameters corresponding to each sample keyword, and the sample key... The process involves several steps: first, identifying the sample dynamic effects images and audio clips associated with the words; second, determining the playback time intervals of the sample dynamic effects images and audio clips; third, recognizing the sample video content and / or sample audio segments for each sample video clip; and fourth, generating intermediate subtitle files for each sample video clip based on the intermediate video content and / or intermediate audio segments. Each intermediate subtitle file includes multiple intermediate subtitle lines, the start time of each intermediate subtitle line, and the end time of the intermediate state. Finally, the intermediate theme type of each sample video clip and the intermediate subtitle file are input into the keyword extraction network in the initial video editing model. Keyword extraction is performed on the intermediate subtitle file of each sample video clip to obtain intermediate keywords that match the intermediate theme type, as well as the intermediate start time and end time of each keyword displayed in the corresponding intermediate subtitle line text. Each intermediate keyword corresponds to its own intermediate video frame. The intermediate keywords, their corresponding intermediate video frames, and the intermediate start and end times displayed in the corresponding sample subtitle line text of each intermediate video clip are input into the special effects generation network in the initial video editing model to perform effects generation based on intermediate keywords. The word-driven special effects generation logic generates intermediate dynamic effect parameters and intermediate audio effect parameters for each intermediate keyword based on the intermediate video frame corresponding to each intermediate keyword. Based on the intermediate dynamic effect parameters and intermediate audio effect parameters, it generates intermediate dynamic effect images and intermediate audio effects associated with the intermediate keyword. Based on the intermediate start time and intermediate end time displayed in the corresponding intermediate subtitle line text for the intermediate keyword, it configures the intermediate playback time range of the intermediate dynamic effect images and intermediate audio effects with the intermediate keyword as the goal.Furthermore, based on the acquired sample dataset, the sample video content and / or sample audio segments of each sample video material and the intermediate video content and / or intermediate audio segments, as well as the sample subtitle file and the intermediate subtitle file, and the sample keywords and the sample start time and sample end time displayed in the corresponding sample subtitle line text for each sample keyword, the intermediate start time and intermediate end time displayed in the corresponding intermediate subtitle line text for the intermediate keywords, the sample video frame corresponding to each sample keyword and the intermediate video frame corresponding to each intermediate keyword, and the sample dynamic effect parameters and samples corresponding to each sample keyword. The audio effect parameters are compared with the intermediate dynamic effect parameters and intermediate audio effect parameters corresponding to each intermediate keyword, as well as the sample dynamic effect image and sample effect audio associated with each sample keyword and the intermediate dynamic effect image and intermediate effect audio associated with each intermediate keyword, and the sample playback time interval of the sample dynamic effect image and sample effect audio and the intermediate playback time interval of the intermediate dynamic effect image and intermediate effect audio. The model loss function is calculated. If the model loss function does not meet the model training termination condition, the initial business opportunity analysis model is trained again until the model loss function meets the model training termination condition, thus obtaining the AI ​​video editing model.

[0119] Optionally, based on the acquired sample dataset, the sample video content and / or sample audio segments of each sample video material and the intermediate video content and / or intermediate audio segments, as well as the sample subtitle file and the intermediate subtitle file, and the sample keywords and the sample start time and sample end time displayed in the corresponding sample subtitle line text for each sample keyword and the intermediate start time and intermediate end time displayed in the corresponding intermediate subtitle line text for the intermediate keywords, and the sample video frame corresponding to each sample keyword and the intermediate video frame corresponding to each intermediate keyword, and the sample dynamic effect parameters and sample audio effect parameters corresponding to each sample keyword and the intermediate dynamic effect parameters and intermediate audio effect parameters corresponding to each intermediate keyword. The model calculates the model loss function based on the sample dynamic effect image and sample effect audio associated with each sample keyword, the intermediate dynamic effect image and intermediate effect audio associated with each intermediate keyword, the sample playback time interval of the sample dynamic effect image and sample effect audio, and the intermediate playback time interval of the intermediate dynamic effect image and intermediate effect audio. If the model loss function does not meet the model training termination condition, the initial business opportunity analysis model continues to be trained until the model loss function meets the model training termination condition, thus obtaining the AI ​​video editing model. This includes: calculating the loss function of each network layer separately and using these loss functions as the model loss function; or, weighted summing of the loss functions calculated for each network layer to obtain the model loss function.

[0120] In this embodiment, each initial video clip can be input into the subtitle generation network of an AI video editing model. The video content and / or audio segments of each initial video clip are identified, and a subtitle file is generated based on the video content and / or audio segments. Each subtitle file includes: multiple lines of subtitle text, and the start and end times of each line of subtitle text. The audio segments are non-silent audio segments. Generating a subtitle file corresponding to each initial video clip through the subtitle generation network in the AI ​​video editing model can improve the accuracy of the content in the subtitle file.

[0121] In some embodiments, each initial video clip is input into the subtitle generation network in the AI ​​video editing model, and the video content and / or audio segments of each initial video clip are identified. The specific implementation of generating a subtitle file for the initial video clip based on the video content and / or audio segments includes, but is not limited to, the following methods.

[0122] Method 1:

[0123] Each initial video clip is input into the subtitle generation network of the AI ​​video editing model. The system identifies audio segments and corresponding video segments for each initial video clip, resulting in multiple audio segments and their corresponding video segments. Each video segment is a video clip containing visual content. Each audio segment and its corresponding video segment have their own start and end times. Based on the visual content of the video segment corresponding to each audio segment, the initial subtitle text for that audio segment is optimized to obtain the target subtitle text. Based on subtitle line segmentation rules, the target subtitle text is segmented into at least one subtitle line text that is synchronously adapted to the audio content of the audio segment and / or the visual content of the corresponding video segment. Based on each subtitle line text, its subtitle line number, and the start and end times of each subtitle line text display, a subtitle file corresponding to the initial video clip is generated.

[0124] In one optional embodiment, each initial video clip is input into the subtitle generation network of the AI ​​video editing model. Audio segments and corresponding video segments are identified for each initial video clip to obtain multiple audio segments and corresponding video segments. This includes: inputting each initial video clip into the subtitle generation network of the AI ​​video editing model to identify complete audio and video from each initial video clip. The audio includes non-silent segments and silent segments. Non-silent segments refer to parts of the audio with noticeable sound, including but not limited to: spoken content, music, sound effects, or any other perceptible sound. The main part of a video typically contains the core audio content. This application focuses on the speech content of non-silent segments. Silent segments refer to audio with no sound or very weak sound, including but not limited to: pauses in speech. The process involves identifying each silent period in the audio, segmenting the audio based on the two endpoints of each silent period to obtain multiple segmented segments, selecting non-silent segments from the multiple segmented segments as audio clips, each audio clip corresponding to its own playback time interval, and segmenting the video clips played in each playback time interval from the complete video based on the playback time interval corresponding to each audio clip as the video clip corresponding to each audio clip.

[0125] Furthermore, when segmenting audio clips, factors such as tone, pause duration, maximum number of characters per subtitle line, and video content can be considered together. Specifically, tone parameters, pause parameters, maximum number of characters per subtitle line, and video content should all be taken into account for segmentation. The tone parameter describes the pitch of the speech; for example, a question usually appears at the end of a sentence and can be broken into a sentence. The pause parameter describes the duration of the pause; a larger parameter can be set for fast speech, and a smaller parameter for slow speech. The maximum number of characters per subtitle line describes the maximum number of characters that can be displayed in a single subtitle line. Therefore, tone parameters, pause parameters, maximum number of characters per subtitle line, and video content can be used as the rules for subtitle line segmentation.

[0126] In one optional embodiment, the initial subtitle text of each audio segment is optimized based on the video content corresponding to that audio segment to obtain target subtitle text. This includes: parsing the audio segment to obtain the initial subtitle text; parsing the video content of the corresponding video segment to obtain the video content; generating subtitle guidance words based on the video content; and optimizing the initial subtitle text of the audio segment under the guidance of the subtitle guidance words to obtain the target subtitle text. The subtitle guidance words include, but are not limited to: guidance words for adapting the subtitle text to the video content; guidance words for correcting inaccurate descriptions; guidance words for guiding the structure of the subtitle text; guidance words for guiding correct and standardized terminology; and guidance words for adding appropriate modifiers based on the topic type.

[0127] In one optional embodiment, the number of characters per subtitle line that a screen can display is limited. The target subtitle text corresponding to an audio segment may contain a large number of characters, making it impossible for the screen to display all the text simultaneously. Therefore, text segmentation is required. This segmentation process corresponds to subtitle line segmentation rules. Based on these rules, the target subtitle text is segmented into at least one subtitle line text that is synchronously adapted to the audio content of the audio segment and / or the visual content of the corresponding video segment. This includes: identifying the semantic information of the target subtitle text, which contains meaning expressions at different stages; and, based on the different stages of meaning expressions contained in the semantic information, the visual content of the corresponding video segment, and the maximum number of characters per subtitle line that can be displayed on a single screen, segmenting the target subtitle text into at least one subtitle line text that is synchronously adapted to the audio content of the audio segment and / or the visual content of the corresponding video segment. Each subtitle line text corresponds to a stage of meaning expression. Here, a subtitle line text refers to a single line of subtitle text displayed on a single screen. When segmenting the target subtitle text, the system takes into account the meaning of the subtitle text at different stages, the content of the corresponding video clip, and the maximum number of text characters that can be displayed on the screen, which can improve the accuracy of subtitle text segmentation.

[0128] Method 2:

[0129] Each initial video clip is input into the subtitle generation network of the AI ​​video editing model. Based on the video file of each initial video clip, video segments are identified to obtain multiple video segments, each with its own start and end times. Based on the content of each video segment, subtitle text is generated for each video segment. Based on the subtitle line segmentation rules, each subtitle text is segmented into at least one subtitle line text that is synchronously adapted to the content of the video segment. Based on each subtitle line text, its subtitle line number, and the start and end times of each subtitle line text, a subtitle file for the initial video clip is generated.

[0130] For details on the specific implementation of each step involved in Method 2, please refer to the relevant descriptions of each real-time method in Method 1, which will not be repeated here.

[0131] Method 3:

[0132] Each initial video clip is input into the subtitle generation network of the AI ​​video editing model. Based on the audio file of the initial video clip, audio segments are identified to obtain multiple audio segments, each with its own playback start and end times. Based on the subtitle line segmentation rules, the subtitle text of each audio segment is segmented into at least one subtitle line text that is synchronously adapted to the audio content of that audio segment. Based on each subtitle line text, its subtitle line number, and the start and end times of each subtitle line text, the subtitle file of the initial video clip is generated.

[0133] For details on the specific implementation of each step involved in Method 3, please refer to the relevant descriptions of each real-time method in Method 1, which will not be repeated here.

[0134] After obtaining the subtitle file for each initial video clip, in order to accurately identify the keywords contained in each subtitle file, the theme type of each initial video clip and the subtitle file can be input into the keyword extraction network in the AI ​​video editing model. The keyword extraction operation is performed on the subtitle file of each initial video clip to obtain the target keywords that match the theme type and the start and end times of each target keyword displayed in the corresponding subtitle line text. Each target keyword corresponds to its own video frame.

[0135] It should be noted that, based on precise segmentation, the start and end times of each audio segment are obtained by summing the start and end times of the previous audio segments and silent segments. The same applies to the start and end times of video segments and subtitle text. This improves the accuracy of determining each start and end time, thereby improving the accuracy of subtitle text and keywords.

[0136] In some embodiments, the method further includes:

[0137] The target dynamic effect file is input into the image drawing tool, which then parses the file to obtain multi-frame effect parameters and the target style image. Guided by these parameters, the tool generates multi-frame effect images associated with the target style image, and then generates the desired dynamic effect image based on these images.

[0138] In the embodiments of this application, the image drawing tool can be a canvas, and the dynamic effect image processing tool can be an ffmpage tool. The target dynamic effect file is input into the image drawing tool so that the tool can parse it to obtain multi-frame effect parameters and a target style image. Guided by the multi-frame effect parameters, multi-frame effect images associated with the target style image are generated. Based on these multi-frame effect images, the dynamic effect image is generated. Specifically, this can be achieved by: inputting the target dynamic effect file into the image drawing tool, allowing the tool to parse and obtain multi-frame effect parameters and a target style image; guiding the multi-frame effect parameters, generating multi-frame effect images associated with the target keyword sequentially based on each frame's effect parameters; and during the generation of each effect image, using the ffmpage tool to record each effect image sequentially to obtain the dynamic effect image associated with the target keyword.

[0139] In some embodiments, each initial video clip is equipped with a video playback track, a subtitle display track, a dynamic effects playback track, and a time track. These tracks are interconnected and the start and end points of each track are aligned with each other, so that as time progresses on the time track, the corresponding subtitle text or effects are activated on the corresponding track.

[0140] In some embodiments, the theme type and subtitle file of each initial video clip are input into the keyword extraction network of the AI ​​video editing model. Keyword extraction is performed on the subtitle file of each initial video clip to obtain target keywords that match the theme type. Specifically, this can be achieved as follows:

[0141] The theme type and subtitle file of each initial video clip are input into the keyword extraction network in the AI ​​video editing model. Keyword extraction is performed on the subtitle file of each initial video clip to obtain target keywords that match the theme type, as well as the start and end times of the target keywords displayed in the subtitle line text.

[0142] In this embodiment, the theme type and subtitle file of each initial video clip are input into the keyword extraction network of the AI ​​video editing model. Keyword extraction is performed on the subtitle file of each initial video clip to obtain target keywords that match the theme type, as well as the start and end times of each target keyword's display in the corresponding subtitle line text, including:

[0143] The theme type of each initial video clip and the subtitle file are input into the keyword extraction network of the AI ​​video editing model. Based on the key semantic information of each subtitle line text in each subtitle file, candidate keywords for each subtitle line text in each subtitle file are determined. From the candidate keywords of each subtitle line text, keywords that match the theme type of the corresponding initial video clip are selected as the target keywords for each subtitle line text in each subtitle file. Furthermore, based on the position information of each target keyword in the corresponding subtitle line text and the start and end times of the display of that subtitle line text, the start and end times of the display of each target keyword in the corresponding subtitle line text are determined.

[0144] In one optional embodiment, the theme type and subtitle file of each initial video material are input into the keyword extraction network of the AI ​​video editing model. Based on the key semantic information of each subtitle line text in each subtitle file, candidate keywords for each subtitle line text in each subtitle file are determined. This includes: inputting the theme type and subtitle file of each initial video material into the keyword extraction network of the AI ​​video editing model; performing semantic information extraction on each subtitle line text in each subtitle file to obtain the key semantic information of each subtitle line text; and selecting keywords from each subtitle line text in each subtitle file that are moderately higher than a preset threshold as candidate keywords.

[0145] In one optional embodiment, from the candidate keywords of each subtitle line text, keywords that match the theme type of the corresponding initial video material are selected as the target keywords of each subtitle line text in each subtitle file. This includes: calculating the semantic similarity between each candidate keyword and the theme type of the corresponding initial video material; and using candidate keywords with semantic similarity greater than a preset threshold as the target keywords of each subtitle line text in each subtitle file.

[0146] It should be noted that not all subtitle lines contain keywords. If a long subtitle line contains keywords, then that subtitle line may contain one or more keywords.

[0147] After obtaining the target keywords for each subtitle line in each subtitle file of each initial video file, in order to add dynamic or audio effects to each keyword and improve the linkage between the effects and the corresponding video frames, a target keyword-driven effect generation logic can be executed based on each target keyword in the subtitle file of each initial video material, the corresponding video frame for each target keyword, and the start and end times of the display of each target keyword in the corresponding subtitle line text. Dynamic effects can include, for example, zooming, flashing, rotating, etc. Audio effects include, but are not limited to, reward sounds, celebration sounds, warning sounds, or falling sounds.

[0148] In addition, the display position of the dynamic effects of the target keywords can be set. For example, the display position of the dynamic effects can be set in the upper left corner, upper right corner, lower left corner, lower right corner or the middle of the screen. The specific position depends on the needs, and this embodiment does not limit it. Figure 3 This is a dynamic effect illustration of the keyword "30%".

[0149] In some embodiments, the method further includes:

[0150] Based on the start and end times of the target keyword displayed in the corresponding subtitle text, the playback time range of the dynamic special effects image is configured with the goal of playing the dynamic special effects image in conjunction with the target keyword.

[0151] In some embodiments, based on the start and end times of the target keyword's display in the corresponding subtitle line text, and with the goal of playing the dynamic special effects image in conjunction with the target keyword, the playback time interval of the dynamic special effects image can be configured as follows:

[0152] The playback time interval of the video frame adapted to the dynamic effect image on the time track is configured as the playback time interval of the dynamic effect image of the target keyword, which includes the playback start time and end time.

[0153] Based on the playback time interval of the dynamic effect image based on the target keyword on the time track, in the vertical dimension, the dynamic effect image of the target keyword is configured in the corresponding position interval of the dynamic effect image in the dynamic effect track as the activation position interval of the dynamic effect image.

[0154] Accordingly, based on the time information provided by the time track of the initial video material and the start and end times of the video frames, the activation position range of the video frame on the video frame playback track can be determined. This allows the video frame to be activated and start playing when the current time information on the time track indicates the start time of playback, and to stop playing when the end time of the live video frame is reached. Similarly, based on the start and end times of each subtitle line text display, the activation position range of the subtitle line text on the subtitle line track can be determined. This allows the subtitle line text to be activated and start displaying when the current time information on the time track indicates the start time of playback, and to stop playing when the end time of the live video frame is reached. The text in the subtitle line stops displaying when the end time of the text is reached; based on the start and end times of the playback of the dynamic effect image and / or effect audio for each target keyword, the activation position range of the dynamic effect image and / or effect audio for that target keyword in the dynamic effect track and / or audio effect track is determined, so that the current time information on the time track indicates that the playback start time of the dynamic effect image is reached and the playback of the dynamic effect image is activated and played, and the playback of the dynamic effect image stops when the end time of the dynamic effect image is reached; and / or, the current time information on the time track indicates that the playback start time of the effect audio is reached and the playback of the effect audio is activated and played, and the playback of the effect audio stops when the end time of the effect audio is reached.

[0155] In this embodiment, the subtitle file is typically in SRT format, a widely used subtitle file format with a simple and clear structure, including subtitle line number, start time, end time, and corresponding subtitle line text. The subtitle line number is a single number used to identify the order of each subtitle line, starting from 1 and incrementing sequentially. This helps the player display subtitles correctly in order and facilitates location and management when editing the subtitle file. The start and end times represent the start and end times of the subtitle line display, respectively. The timestamp format is HH:MM:SS, mmm, where HH represents hours, MM represents minutes, SS represents seconds, and mmm represents milliseconds. This allows the player to accurately display and hide subtitles during video playback. The subtitle text line is the text portion of the subtitle, typically a sentence or paragraph, displayed to the viewer during video playback to help them understand the dialogue or content. However, the SRT format itself does not support text styles (such as color, font size) or effects; it is only used for timeline synchronization and plain text display.

[0156] In some embodiments, the method further includes:

[0157] Guided by the editing template, based on each initial video clip, the corresponding subtitle file, the target dynamic effect file for each target keyword corresponding to each initial video clip, and the playback time range of the dynamic effect image, a target video file corresponding to each initial video clip is generated. The target video file is used to render the target video clip with synchronized subtitles, dynamic effect images, and effect audio.

[0158] In MLT, editing templates (or MLT templates) allow users to save video editing parameters and settings as template files (usually in XML format). These template files contain all editing parameters, including video cut points, filter settings, transitions, and audio processing. Exporting parameters allows users to export their currently edited video project as an MLT template file. This allows users to open the template file on other computers using the same video editing software and continue editing or batch generate videos. This export method is particularly suitable for scenarios requiring batch video generation across multiple computers. For example, in a content creation team, one editor can export the edited template, and other members can use it to generate multiple similar videos. Batch generation allows users to standardize video editing parameters using MLT templates and then use automated scripts or other tools to generate multiple videos in batches. This is extremely useful when generating a large number of similar videos (such as advertising videos or instructional videos), significantly improving work efficiency. In short, an MLT template is a predefined configuration file that guides the MLT framework on how to combine video footage, subtitle files, dynamic effects images, and audio effects to generate the final target video file. By using MLT templates, the video editing process can be automated, improving productivity and ensuring consistency and high quality of video content.

[0159] In some embodiments, guided by the editing template, a target video file is generated for each initial video clip based on the playback time interval of the target dynamic effect file for each target keyword corresponding to each initial video clip and the corresponding subtitle file. The target video file is used to render the target video clip containing the linked subtitles, dynamic effect images, and audio effects. Specifically, this can be implemented as follows:

[0160] Obtain the first storage path information for each initial video clip, the second storage path information for the subtitle file corresponding to each initial video clip, and the third storage path information for the target dynamic effect file;

[0161] Guided by the editing template rules, the target video file corresponding to each video material is generated based on the first storage path information and its playback time interval of each initial video material, the second path information of the subtitle file corresponding to each initial video material, the third storage path information and its playback time interval of the target dynamic effect file, and the configuration information of each track.

[0162] Furthermore, a video rendering engine can be used to render the target video file corresponding to each video clip to obtain the corresponding video. When rendering multiple videos in batches, multiple rendering engines can be called to render multiple target video files in parallel, thereby improving video rendering efficiency. If the user is not satisfied with the rendered video effect, for example, if the target keyword position does not meet the user's requirements, this can be resolved by fine-tuning the MLT template parameters.

[0163] Figure 4 A block diagram of a dynamic special effects image generation device provided in an embodiment of this application is shown, such as... Figure 4 As shown, the device may specifically include:

[0164] The special effects file acquisition module 401 is used to acquire the target dynamic special effects file;

[0165] The special effects file parsing module 402 is used to parse the target dynamic special effects file and obtain the target style image of the image access path index in the target dynamic special effects file.

[0166] Rendering module 403 is used to render a first dynamic effect image in a first animation format based on the multi-frame effect parameters in the target dynamic effect file and the target style image.

[0167] The capture module 404 is used to capture the first dynamic special effects image frame by frame to obtain multi-frame special effects images in the first dynamic special effects image;

[0168] The special effects image generation module 405 is used to generate a second dynamic special effects image in a second animation format based on multi-frame special effects images; the second dynamic special effects image in the second animation format is used to be displayed in association with at least one video.

[0169] In some embodiments, the device may further include:

[0170] The startup module is used to launch the headless browser to create a sandboxed browser environment based on the headless browser;

[0171] The encoding module is used to encode the target style image to obtain a target encoded image in the target encoding format;

[0172] The update module is used to update the target style image in the target dynamic effects file using the target encoded image, so as to obtain the updated dynamic effects file.

[0173] In some embodiments, the rendering module 403 is specifically used to: provide the access path of the updated dynamic effects file to the headless browser, so that the headless browser can parse the updated dynamic effects file based on the access path, and render the first dynamic effects image in the first animation format based on the target encoded image according to the multi-frame effects parameters in the updated dynamic effects file in the sandboxed browser environment.

[0174] In some embodiments, before encoding the target style image to obtain a target encoded image in the target encoding format, the apparatus may further include:

[0175] The type determination module is used to determine the resource index type of text effect images in the target dynamic effect file;

[0176] The judgment module is used to perform the step of encoding the target style image to obtain the target encoded image in the target encoding format when the resource index type belongs to the preset type.

[0177] In some embodiments, the device may further include:

[0178] The page provides a module for delivering a video effects editing page to the client; the video effects editing page includes keyword setting prompts and style setting prompts.

[0179] The style determination module is used to determine the target keywords and target style attributes in response to the editing request sent by the client. The target keywords are determined by the client in response to the configuration operation of setting prompt information for the keywords; the style attributes are determined in response to the configuration operation of setting prompt information for the styles.

[0180] The image generation module is used to generate target style images corresponding to target keywords based on target style attributes;

[0181] The template determination module is used to determine the dynamic effect template corresponding to the target keyword. The dynamic effect template includes multi-frame effect parameters.

[0182] The image import module is used to import the target style image into the image index position in the dynamic effect template to generate the target dynamic effect file. The target dynamic effect file is used to render the target style image at the image index position using multi-frame effect parameters to generate the dynamic effect image corresponding to the target keyword. The dynamic effect image is used to be associated with at least one video for display.

[0183] In some embodiments, the device may further include:

[0184] The prompt message sending module is used to send template configuration prompt messages to the client.

[0185] In some embodiments, the style determination module is specifically used for:

[0186] In response to the editing request sent by the client, the target keywords, target style attributes, and dynamic effects template are determined; the dynamic effects template is determined by the client in response to the template upload operation triggered by the template configuration prompt information.

[0187] In some embodiments, the template determination module is specifically used for:

[0188] Retrieve dynamic effect templates that match the target keywords from the dynamic effects library.

[0189] In some embodiments, the device may further include:

[0190] The material acquisition module is used to acquire at least one initial video material in response to a special effects generation request;

[0191] The material input module is used to input each initial video material into the subtitle generation network in the AI ​​video editing model, identify the video content and / or audio segments of each initial video material, and generate a subtitle file for the initial video material based on the video content and / or audio segments. Each subtitle file includes: multiple subtitle lines of text, and the start and end times of the display of each subtitle line of text;

[0192] The keyword extraction module is used to input the theme type and subtitle file of each initial video material into the keyword extraction network in the AI ​​video editing model, and to perform keyword extraction operation on the subtitle file of each initial video material to obtain target keywords that match the theme type;

[0193] The prompt message generation module is used to generate keyword-based prompt messages based on target keywords; the target keywords are determined by the client's confirmation operation in response to setting prompt messages for keywords.

[0194] In some embodiments, the device may further include:

[0195] The image generation module is used to input the target dynamic effect file into the image drawing tool, so that the image drawing tool can parse the target dynamic effect file to obtain multi-frame effect parameters and target style image. Guided by the multi-frame effect parameters, it generates multi-frame effect images associated with the target style image, and generates the target dynamic effect image based on the multi-frame effect images.

[0196] In some embodiments, the dynamic effects library includes multiple types of candidate dynamic effects templates, each type of candidate dynamic effects template being adapted to keywords of a specific number of characters;

[0197] In some embodiments, the template determination module is specifically used for:

[0198] Determine the number of characters included in the target keywords;

[0199] Based on the number of characters in the target keywords, dynamic effect templates are matched from the material library.

[0200] In some embodiments, each initial video clip is equipped with a video playback track, a subtitle display track, a dynamic effects playback track, and a time track. These tracks are interconnected and the start and end points of each track are aligned with each other, so that as time progresses on the time track, the corresponding subtitle text or effects are activated on the corresponding track.

[0201] In some embodiments, the keyword extraction module is specifically used for:

[0202] The theme type and subtitle file of each initial video clip are input into the keyword extraction network in the AI ​​video editing model. Keyword extraction is performed on the subtitle file of each initial video clip to obtain target keywords that match the theme type, as well as the start and end times of the target keywords displayed in the subtitle line text.

[0203] In some embodiments, the device may further include:

[0204] The time configuration module is used to configure the playback time range of dynamic special effects images based on the start and end times of the display of the target keyword in the corresponding subtitle line text, with the goal of playing dynamic special effects images in conjunction with the target keyword.

[0205] In some embodiments, the time configuration module is specifically used for:

[0206] The playback time interval of the video frame adapted to the dynamic effect image on the time track is configured as the playback time interval of the dynamic effect image of the target keyword, which includes the playback start time and end time.

[0207] Based on the playback time interval of the dynamic effect image based on the target keyword on the time track, in the vertical dimension, the dynamic effect image of the target keyword is configured in the corresponding position interval of the dynamic effect image in the dynamic effect track as the activation position interval of the dynamic effect image.

[0208] In some embodiments, the device may further include:

[0209] The activation component determination module is used to determine the activation position range of the dynamic effect image of the target keyword in the dynamic effect track based on the start time and end time of the dynamic effect image of each target keyword. This is so that the dynamic effect image can be activated and played when the current time information on the time track indicates that the start time of the dynamic effect image has arrived, and the dynamic effect image can be stopped when the end time of the dynamic effect image has arrived.

[0210] In some embodiments, the device may further include:

[0211] The video generation module, guided by the editing template, generates a target video file for each initial video clip based on the target dynamic effects file for each target keyword and the playback time range of the dynamic effects image. The target video file is used to render the target video clip with synchronized subtitles, dynamic effects images, and audio effects.

[0212] In some embodiments, the video generation module is specifically used for:

[0213] Obtain the first storage path information for each initial video clip, the second storage path information for the subtitle file corresponding to each initial video clip, and the third storage path information for the target dynamic effect file;

[0214] Guided by the editing template rules, the target video file corresponding to each video material is generated based on the first storage path information and its playback time interval of each initial video material, the second path information of the subtitle file corresponding to each initial video material, the third storage path information and its playback time interval of the target dynamic effect file, and the configuration information of each track.

[0215] Figure 4 The dynamic effects image generation device can perform Figure 2 The implementation principle and technical effects of the dynamic special effects image generation method in the illustrated embodiment will not be repeated here. The specific methods by which each module and unit of the dynamic special effects image generation device in the above embodiments perform operations have been described in detail in the embodiments related to this method, and will not be elaborated upon here.

[0216] It should be noted that the technical solutions in this application are applicable to virtual network environments, and the users described generally refer to "virtual users." Real users can register user accounts on the server through registration to obtain user identities in the network environment. The same user account can log in to the server through different types of client terminals, enabling the server to identify the same user.

[0217] Interactions between the server and the user can be based on user accounts. The data received or sent by the server to the user is also based on the user account; in reality, the user's client, corresponding to the user account, receives or sends data to the server. Furthermore, users can also communicate with each other through their user accounts. Here, "user" can refer to an individual or an organization, such as a company; this application does not impose specific restrictions.

[0218] It should be noted that some processes described in the above embodiments and accompanying drawings include multiple operations appearing in a specific order. However, it should be clearly understood that these operations may not be executed in the order they appear in this document, or they may be executed in parallel. The operation numbers, such as 201, 202, etc., are merely used to distinguish different operations and do not represent any execution order. Furthermore, these processes may include more or fewer operations, and these operations may be executed sequentially or in parallel. It should also be noted that the descriptions such as "first" and "second" in this document are used to distinguish different messages, devices, modules, etc., and do not represent a sequential order, nor do they limit "first" and "second" to different types.

[0219] Figure 5 This is a schematic diagram of the structure of one embodiment of a computing device provided in this application. Figure 5 As shown, in practice, the computing device may include a storage component 501 and a processing component 502.

[0220] Storage component 501 is used to store computer programs and can be configured to store various other data to support operation on a computing device. Examples of this data include instructions for any application or method used to operate on the computing device, data structures, contact data, phone book data, messages, pictures, videos, etc.

[0221] Processing component 502, coupled to storage component 501, is used to execute computer programs in storage component 501 for implementing, etc. Figure 2 The method for generating dynamic special effects images is shown.

[0222] The processing component described above includes one or more processors to execute computer instructions to complete all or part of the steps in the method described above. Alternatively, the processing component may be implemented as one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the method described above.

[0223] The aforementioned storage components can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random-Access Memory (SRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0224] The aforementioned communication component is configured to facilitate wired or wireless communication between the device housing the communication component and other devices. The device housing the communication component can access wireless networks based on communication standards, such as mobile communication networks, or combinations thereof. In one exemplary embodiment, the communication component receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel.

[0225] The aforementioned display components may include a screen, which may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation.

[0226] The aforementioned power supply components provide power to various components within the device in which they reside. These power supply components may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to the device in which they reside.

[0227] The aforementioned audio component can be configured to output and / or input audio signals. For example, the audio component includes a microphone (MIC) configured to receive external audio signals when the device containing the audio component is in an operating mode, such as call mode, recording mode, or voice recognition mode. The received audio signals can be further stored in memory or transmitted via a communication component. In some embodiments, the audio component also includes a speaker for outputting audio signals.

[0228] Accordingly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, enables the processor to implement the steps in the above-described method embodiments. The computer-readable storage medium includes volatile or non-volatile components, or a combination thereof, and can be removable or non-removable. Examples of computer-readable storage media include, but are not limited to, phase-change random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random-access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), flash memory or other memory technologies, CD-ROM, Digital Video Disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium.

[0229] Accordingly, this application also provides a computer program product, which includes a computer program or instructions that, when executed by a processor, cause the processor to implement the steps in the above method embodiments. It should be understood that each step or combination of steps in the above method flow can be implemented by the computer program or instructions. Furthermore, these computer programs or instructions can be applied to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device, enabling the processor of the general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to function as an apparatus for implementing the corresponding functions in the above method embodiments.

[0230] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0231] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0232] Finally, it should be noted that the above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A method for generating dynamic special effects images, characterized in that, include: Obtain the target dynamic effects file; Parse the target dynamic effects file to obtain the target style image of the image access path index in the target dynamic effects file; Based on the multi-frame effect parameters in the target dynamic effect file, a first dynamic effect image in a first animation format is obtained by rendering the target style image. The first dynamic effect image is captured frame by frame to obtain multi-frame effect images in the first dynamic effect image; Based on the multi-frame special effects images, a second dynamic special effects image in a second animation format is generated; the second dynamic special effects image in the second animation format is used to be displayed in association with at least one video.

2. The method according to claim 1, characterized in that, The method further includes: Launch the headless browser to create a sandboxed browser environment based on the headless browser; The target style image is encoded to obtain a target encoded image in the target encoding format; The target style image in the target dynamic effect file is updated using the target encoded image to obtain the updated dynamic effect file; The step of rendering a first dynamic effect image in a first animation format based on the target style image according to the multi-frame effect parameters in the target dynamic effect file includes: The access path of the updated dynamic effects file is provided to the headless browser, so that the headless browser can parse the updated dynamic effects file based on the access path, and render the first dynamic effects image in the first animation format based on the target encoded image according to the multi-frame effects parameters in the updated dynamic effects file in the sandboxed browser environment.

3. The method according to claim 2, characterized in that, Before encoding the target style image to obtain a target encoded image in the target encoding format, the method further includes: Determine the resource index type of the text effect image in the target dynamic effect file; If the resource index type is a preset type, the step of encoding the target style image to obtain a target encoded image in the target encoding format is performed.

4. The method according to claim 1, characterized in that, The method further includes: Provide a video effects editing page to the client; the video effects editing page includes keyword setting prompts and style setting prompts. In response to an editing request sent by the client, target keywords and target style attributes are determined; wherein, the target keywords are determined by the client in response to a configuration operation that sets prompt information for the keywords; and the style attributes are determined in response to a configuration operation that sets prompt information for the style. Based on the target style attributes, generate the target style image corresponding to the target keyword; Determine the dynamic effect template corresponding to the target keyword, wherein the dynamic effect template includes multi-frame effect parameters; The target style image is imported into the image position in the dynamic effect template to generate the target dynamic effect file. The target dynamic effect file is used to render the target style image at the image position using the multi-frame effect parameters to generate the dynamic effect image corresponding to the target keyword. The dynamic effect image is used to be associated with at least one video for display.

5. The method according to claim 4, characterized in that, The method further includes: Send template configuration prompts to the client; The process of determining the target keywords and target style attributes in response to the editing request sent by the client includes: In response to the editing request sent by the client, the target keywords, target style attributes, and dynamic effect template are determined; the dynamic effect template is determined by the client in response to the template upload operation triggered by the template configuration prompt information.

6. The method according to claim 4, characterized in that, The process of determining the dynamic effect template corresponding to the target keyword includes: Obtain dynamic effect templates that match the target keywords from the dynamic effects library.

7. The method according to claim 6, characterized in that, The dynamic effects library includes various types of candidate dynamic effects templates, each type of candidate dynamic effects template being adapted to keywords of a specific number of characters; The step of obtaining a dynamic effect template matching the target keyword from the dynamic effects library includes: Determine the number of characters included in the target keywords; Based on the number of characters in the target keyword, the dynamic effect template is obtained by matching from the material library.

8. The method according to claim 4, characterized in that, The method further includes: In response to an effects generation request, obtain at least one initial video clip; Each initial video clip is input into the subtitle generation network in the AI ​​video editing model. The video content and / or audio segments of each initial video clip are identified, and a subtitle file for the initial video clip is generated based on the video content and / or audio segments. Each subtitle file includes: multiple lines of subtitle text, and the start and end times of each line of subtitle text. The theme type and subtitle file of each initial video material are input into the keyword extraction network in the AI ​​video editing model. Keyword extraction is performed on the subtitle file of each initial video material to obtain target keywords that match the theme type. Based on the target keyword, the keyword setting prompt message is generated; the target keyword is determined by the client in response to the confirmation operation of the keyword setting prompt message.

9. The method according to claim 4, characterized in that, The method further includes: The target dynamic effect file is input into an image drawing tool, which then parses the file to obtain the multi-frame effect parameters and the target style image. Guided by the multi-frame effect parameters, a multi-frame effect image associated with the target style image is generated, and the dynamic effect image is generated based on the multi-frame effect image.

10. The method according to claim 7, characterized in that, Each initial video clip is equipped with a video playback track, a subtitle display track, a dynamic effects playback track, and a time track. These tracks are interconnected and their start and end points are aligned with each other, so that as time progresses on the time track, the corresponding subtitle text or effects are activated on the corresponding track. The process involves inputting the theme type and subtitle file of each initial video clip into the keyword extraction network of the AI ​​video editing model, and performing keyword extraction on the subtitle file of each initial video clip to obtain target keywords that match the theme type, including: The theme type and subtitle file of each initial video material are input into the keyword extraction network in the AI ​​video editing model. Keyword extraction is performed on the subtitle file of each initial video material to obtain target keywords that match the theme type, as well as the start and end times of the target keywords displayed in the subtitle line text. The method further includes: Based on the start and end times of the target keyword displayed in the corresponding subtitle text, the playback time range of the dynamic special effects image is configured with the goal of playing the dynamic special effects image in conjunction with the target keyword.

11. The method according to claim 10, characterized in that, The configuration of the playback time range of the dynamic special effects image, based on the start and end times of the target keyword's display in the corresponding subtitle line text and with the goal of playing the dynamic special effects image in conjunction with the target keyword, includes: The start and end times of the target keyword display are set within the display time interval formed on the time track. The playback time interval occupied by the video frame adapted to the dynamic special effects image on the time track is configured as the playback time interval of the dynamic special effects image of the target keyword. The playback time interval includes the playback start and end times. Based on the playback time interval of the dynamic effect image of the target keyword on the time track, in the vertical dimension, the dynamic effect image of the target keyword is configured in the corresponding position interval of the dynamic effect track within the playback time interval, which is used as the activation position interval of the dynamic effect image.

12. The method according to claim 11, characterized in that, The method further includes: Based on the start and end times of the dynamic effect image for each target keyword, the activation position range of the dynamic effect image for that target keyword in the dynamic effect track is determined, so that the current time information on the time track indicates that the dynamic effect image is activated and played when the start time of playback is reached, and the dynamic effect image is stopped when the end time of playback is reached.

13. The method according to claim 12, characterized in that, The method further includes: Guided by the editing template, a target video file is generated for each initial video material, based on the target dynamic effect file for each target keyword and the playback time range of the dynamic effect image. The target video file is used to render the target video material with synchronized subtitles, dynamic effect images and audio effects.

14. The method according to claim 13, characterized in that, Guided by the editing template, based on each initial video clip, its corresponding subtitle file, the target dynamic effect file for each target keyword corresponding to each initial video clip, and the playback time interval of its dynamic effect image, a target video file is generated for each initial video clip. This target video file is used to render target video clips that include subtitles, dynamic effect images, and synchronized audio effects. Obtain the first storage path information for each initial video clip, the second storage path information for the subtitle file corresponding to each initial video clip, and the third storage path information for the target dynamic effect file; Guided by the editing template rules, the target video file corresponding to each video material is generated based on the first storage path information and its playback time interval of each initial video material, the second path information of the subtitle file corresponding to each initial video material, the third storage path information and its playback time interval of the target dynamic effect file, and the configuration information of each track.

15. A computing device, characterized in that, This includes processing components and storage components; The storage component stores a computer program; the computer program is invoked and executed by the processing component to implement the dynamic special effects image generation method as described in any one of claims 1 to 14.

16. A computer-readable storage medium, characterized in that, It stores a computer program, which, when executed by a processing component, implements the dynamic special effects image generation method as described in any one of claims 1 to 14.

17. A computer program product, characterized in that, It includes a computer program or instructions that, when executed by a processing component, implement the dynamic special effects image generation method as described in any one of claims 1 to 14.

Images