Method and system for rendering video content and readable storage medium

Abstract

The invention discloses a video content rendering method and system and a computer readable storage medium. The method for rendering the video content comprises the steps that multimedia content is received through a remote scheduling service, the multimedia content is sent to a multimedia synthesis script, and the multimedia synthesis script is generated based on a multimedia synthesis template; the multimedia content is embedded into the multimedia synthesis template based on the multimedia synthesis script, rendering processing is carried out, and a video is output; and providing the output video to a remote scheduling service, and uploading and publishing the output video through the remote scheduling service. According to the technical scheme, the process of adjusting the project files and the configuration parameters one by one can be effectively reduced, the working efficiency is improved, and errors are reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of digital media processing, and in particular to a method, system and computer-readable storage medium for rendering video content. Background Art

[0002] In the fields of advertising, film and television, and new media, Adobe After Effects (AE) has become the tool of choice for professional designers due to its powerful animation capabilities and rich plug-in ecosystem. However, currently, using AE to edit, composite, and render videos often requires a large number of manual steps and the adjustment of project files and configuration parameters for different scenes, resulting in low efficiency and prone to errors. Summary of the Invention

[0003] In response to the defects in the prior art, the present invention provides a method for rendering video content that can effectively reduce the process of adjusting project files and configuration parameters one by one, improve work efficiency, and reduce errors.

[0004] This application provides a method for rendering video content, the method comprising:

[0005] receiving multimedia content through a remote scheduling service, and sending the multimedia content to a multimedia synthesis script, wherein the multimedia synthesis script is generated based on a multimedia synthesis template;

[0006] Embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing and outputting a video;

[0007] The output video is provided to the remote scheduling service, and the output video is uploaded and published through the remote scheduling service.

[0008] In one aspect, the steps of embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing and outputting a video include:

[0009] Inserting the multimedia content into the corresponding layer and timeline position of the multimedia composition template, and / or inserting a transition animation of the multimedia content between multiple storyboards, wherein the transition animation includes fade-in and fade-out, masking, or dynamic keyframe animation;

[0010] Call the built-in rendering engine of the multimedia synthesis template or a third-party tool to export the output video in a specified format.

[0011] In one aspect, the steps of embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing and outputting the video further include:

[0012] The remote scheduling service monitors the execution status, error log and rendering progress of the multimedia synthesis script in real time;

[0013] When an execution exception or rendering failure is detected, a backup process is triggered or the multimedia content is regenerated and a new rendering task is started.

[0014] In one aspect, the remote scheduling service further includes:

[0015] Establish an instruction queue to support the scheduling management and priority allocation of batch tasks;

[0016] Coordinate rendering tasks through parallel processing or distributed tasks.

[0017] In one aspect, the steps of embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing and outputting the video further include:

[0018] When embedding a multi-window picture-in-picture effect in the output video, automatically adjusting the target position, scaling ratio and keyframe animation based on the multimedia synthesis script;

[0019] Personalize the layout rules based on business strategies or user behavior analysis.

[0020] In one aspect, the step of receiving multimedia content via the remote scheduling service includes:

[0021] Generate multimedia content using an AI model, where the multimedia content includes at least one of text, images, video, and audio;

[0022] The generated multimedia content is format converted, resolution adjusted, or frame rate adapted to meet the compatibility of the multimedia synthesis template.

[0023] In one aspect, before the steps of embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing, and outputting the video, the steps include:

[0024] The multimedia synthesis script is deployed in a remote access environment, and security permissions are configured to cooperate with the call of the remote scheduling service.

[0025] In one aspect, the steps of generating the multimedia synthesis script based on the multimedia synthesis template include:

[0026] The multimedia synthesis script supports full-process operations on multimedia synthesis templates, including opening templates, loading synthesis sequences, dynamically replacing content, adding transition animations, and triggering rendering output.

[0027] In addition, to solve the above problems, the present application also provides a system for rendering video content, including:

[0028] A calling module, the calling module being configured to receive multimedia content through a remote scheduling service and send the multimedia content to a multimedia synthesis script, wherein the multimedia synthesis script is generated based on a multimedia synthesis template;

[0029] A rendering module, which performs rendering processing on the multimedia content based on the multimedia synthesis script and outputs a video;

[0030] The calling module is further configured to provide the output video to the remote scheduling service, and upload and publish the output video through the remote scheduling service.

[0031] In addition, in order to solve the above problems, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the method described above.

[0032] The beneficial effects of the present invention are as follows: a multimedia template generates a multimedia synthesis script, which can be used to call the functions of the multimedia synthesis template. When remotely rendering a video, after receiving multimedia content through the remote scheduling service, the multimedia synthesis script is used to render the multimedia content, directly embed the multimedia content into the multimedia synthesis template, and output the video. This reduces the need to adjust project files and configuration parameters one by one, improves work efficiency, and reduces errors. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following briefly describes the drawings required for the specific embodiments or the description of the prior art. Similar elements or parts are generally identified by similar reference numerals throughout the drawings. Elements or parts in the drawings are not necessarily drawn to scale.

[0034] Figure 1 A schematic diagram of the process steps of the method for rendering video content in this application;

[0035] Figure 2 A schematic diagram of the steps of embedding multimedia content into a multimedia synthesis template in the method for rendering video content of this application;

[0036] Figure 3 A schematic diagram of the steps for monitoring the rendering process in the method for rendering video content of this application;

[0037] Figure 4A schematic diagram of the content of the remote scheduling service in the method for rendering video content in this application;

[0038] Figure 5 This is a schematic diagram of the steps for further organizing the output video in the method for rendering video content of this application;

[0039] Figure 6 A schematic diagram of the steps of forming multimedia content in the method for rendering video content of the present application;

[0040] Figure 7 This is a schematic diagram of the steps for configuring permission management for multimedia synthesis scripts in the method for rendering video content of this application;

[0041] Figure 8 This is a schematic diagram of the steps of generating a multimedia synthesis script based on a multimedia synthesis template in the method for rendering video content of this application;

[0042] Figure 9 This is a schematic diagram of the data transmission direction in the method for rendering video content in this application;

[0043] Figure 10 Schematic diagram of the system structure for rendering video content for this application.

[0044] Description of reference numerals: 100, calling module; 200, rendering module. DETAILED DESCRIPTION

[0045] The following embodiments of the technical solution of the present invention will be described in detail with reference to the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solution of the present invention and are therefore only examples and are not intended to limit the scope of protection of the present invention.

[0046] It should be noted that, unless otherwise specified, the technical or scientific terms used in this application should have the common meanings understood by those skilled in the art to which the present invention belongs.

[0047] like Figure 1 and Figure 9 As shown, the present application provides a method for rendering video content, the method comprising:

[0048] Step S10, receiving multimedia content through the remote scheduling service, and sending the multimedia content to the multimedia synthesis script, wherein the multimedia synthesis script is generated based on the multimedia synthesis template; the remote scheduling service can receive rendering instructions and send the multimedia content to the multimedia synthesis script. The remote scheduling service can be a Node service, such as building a Node.js service on the server, and the Node.js service is used to receive instruction requests from external clients (or management terminals). Multimedia content usually refers to (AI Generated Content, AIGC). The multimedia synthesis template can be a video template provided by AE. The multimedia synthesis script is a script generated based on AE, and the functions of AE can be called through the multimedia synthesis script.

[0049] Step S20, based on the multimedia synthesis script, the multimedia content is embedded into the multimedia synthesis template, rendered and output as a video; this can reduce the workload of adjusting multiple video contents, reduce the process of adjusting project files and configuration parameters one by one, and improve work efficiency.

[0050] Step S30: Provide the output video to the remote scheduling service, and upload and publish the output video through the remote scheduling service. After rendering is completed, the output video (such as an MP4 file) is uploaded to the media platform through the remote scheduling service, and a download link can also be returned to the user.

[0051] In this embodiment, a multimedia template generates a multimedia synthesis script, which can be used to call the multimedia synthesis template's functions. When remotely rendering a video, after receiving multimedia content via the remote scheduling service, the multimedia synthesis script is used to render the multimedia content, directly embedding the multimedia content into the multimedia synthesis template and outputting the video. This reduces the need to adjust project files and configuration parameters one by one, improves work efficiency, and reduces errors.

[0052] like Figure 2 As shown, in one embodiment of the present application, the steps of embedding multimedia content into a multimedia synthesis template based on a multimedia synthesis script, performing rendering processing, and outputting a video include:

[0053] Step S210, inserts the multimedia content into the corresponding layer and timeline position of the multimedia synthesis template, and / or, inserts the transition animation of the multimedia content between multiple storyboards, and the transition animation includes fade-in and fade-out, mask or dynamic keyframe animation; for example, inserts fade-in and fade-out effects between storyboards, or defines dynamic mask animation through keyframes. Add a "radial wipe" transition between storyboard 1 and storyboard 2, with a duration of 0.5 seconds. Determine the target layer (such as "storyboard 1-background image") and the timeline position (such as the 5th to the 10th second), and insert the picture of the multimedia content into the specified position. On the AE timeline, insert the product picture of the multimedia content into the picture layer of "storyboard 2" and automatically align the keyframes.

[0054] Step S220: Call the built-in rendering engine of the multimedia synthesis template or a third-party tool to export the output video in a specified format. Use the built-in rendering queue of AE or a third-party tool to configure the output format and start the rendering task.

[0055] like Figure 3 As shown, in one embodiment of the present application, the steps of embedding multimedia content into a multimedia synthesis template based on a multimedia synthesis script, performing rendering processing, and outputting a video also include:

[0056] In step S230, the remote scheduling service monitors the execution status, error log, and rendering progress of the multimedia synthesis script in real time. The remote scheduling service integrates a monitoring system to collect the script's CPU / memory usage and rendering progress (such as the number of completed frames / total frames) in real time. For example, if a script process is detected to be stuck (no response for 30 seconds), an error log is recorded.

[0057] Step S240, when an execution anomaly or rendering failure is detected, trigger the backup process or regenerate the multimedia content and start a new rendering task. If the rendering fails, the service automatically switches to the backup template to re-execute the task, or calls to regenerate the multimedia content. For example, after the first rendering fails due to incompatibility of 4K material, the service is downgraded to a 1080p template and retried. The above method can monitor the rendering process in real time to ensure that the rendering process is normal.

[0058] like Figure 4 As shown, in one embodiment of the present application, the remote scheduling service further includes:

[0059] Step S110: Establish an instruction queue to support the scheduling management and priority allocation of batch tasks; support priority tags, such as VIP customers' rendering tasks take precedence over ordinary tasks.

[0060] Step S120: Coordinate rendering tasks through parallel processing or distributed tasks. This splits batches of tasks across multiple rendering nodes, improving throughput through coordinated task allocation. For example, processing 100 short video rendering requests simultaneously reduces the average rendering time from 10 minutes per request to 2 minutes per request.

[0061] like Figure 5 As shown, in one embodiment of the present application, the steps of embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing and outputting the video also include:

[0062] Step S250: When embedding a multi-window picture-in-picture effect in the output video, the target position, scaling ratio, and keyframe animation are automatically adjusted based on the multimedia synthesis script. The script reads the target position (e.g., lower right corner coordinates X=80%, Y=80%) and scaling ratio (e.g., 30%) from the configuration file and binds the keyframe animation using AE expressions. For example, a small commentary window embedded in the playback video automatically switches position with the main screen.

[0063] Step S260: Personalize the layout rules based on business strategies or user behavior analysis. Dynamically adjust the template layout rules based on user behavior data, such as click hotspot analysis. For example, an e-commerce platform can automatically generate promotional videos with different layout styles based on user preferences.

[0064] like Figure 6 As shown, in one embodiment of the present application, before the step of receiving multimedia content through the remote scheduling service, the following steps are included:

[0065] Step S01: Generate multimedia content using an AI model. The multimedia content includes at least one of text, images, video, and audio. The AI ​​model can be an AE, meaning that the multimedia content is generated by an AE. Alternatively, it can be another artificial intelligence model.

[0066] Step S02: convert the format, adjust the resolution or adapt the frame rate of the generated multimedia content to meet the compatibility of the multimedia synthesis template. Through format conversion and adaptation, it can be ensured that the multimedia content can be embedded in the multimedia synthesis template.

[0067] like Figure 7 As shown, in one embodiment of the present application, before the steps of embedding multimedia content into a multimedia synthesis template based on a multimedia synthesis script, performing rendering processing, and outputting a video, the steps include:

[0068] Step S03: deploy the multimedia synthesis script in the remote access environment and configure security permissions to cooperate with the call of the remote scheduling service, thereby ensuring that the remote scheduling service can access the multimedia synthesis script.

[0069] like Figure 8 As shown, in one embodiment of the present application, the steps of generating a multimedia synthesis script based on a multimedia synthesis template include:

[0070] Step S100: The multimedia synthesis script supports full-process operations on the multimedia synthesis template, including opening the template, loading the synthesis sequence, dynamically replacing the content, adding transition animation, and triggering rendering output.

[0071] like Figure 10 As shown, the present application also provides a system for rendering video content, including: a calling module 100 and a rendering module 200.

[0072] The calling module 100 is used to receive multimedia content through a remote scheduling service and send the multimedia content to a multimedia synthesis script, wherein the multimedia synthesis script is generated based on a multimedia synthesis template.

[0073] The rendering module 200 renders the multimedia content based on the multimedia synthesis script and outputs the video; the calling module is also used to provide the output video to the remote scheduling service, and upload and publish the output video through the remote scheduling service.

[0074] The specific embodiments and beneficial effects of the system for rendering video content in this application can be found in the above-mentioned method for rendering video content, which will not be repeated here.

[0075] The present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the method described above is implemented.

[0076] The specific embodiments and beneficial effects of the computer-readable storage medium in this application can be found in the above-mentioned method for rendering video content, which will not be repeated here.

[0077] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some or all of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present invention, and they should all be included in the scope of the claims and description of the present invention.

Claims

1. A method for rendering video content, characterized in that: The method comprises: receiving multimedia content through a remote scheduling service, and sending the multimedia content to a multimedia synthesis script, wherein the multimedia synthesis script is generated based on a multimedia synthesis template; Embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing and outputting a video; The output video is provided to the remote scheduling service, and the output video is uploaded and published through the remote scheduling service.

2. The method according to claim 1, characterized in that The steps of embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing and outputting a video include: Inserting the multimedia content into the corresponding layer and timeline position of the multimedia composition template, and / or inserting a transition animation of the multimedia content between multiple storyboards, wherein the transition animation includes fade-in and fade-out, masking, or dynamic keyframe animation; Call the built-in rendering engine of the multimedia synthesis template or a third-party tool to export the output video in a specified format.

3. The method according to claim 2, characterized in that The steps of embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing and outputting the video also include: The remote scheduling service monitors the execution status, error log and rendering progress of the multimedia synthesis script in real time; When an execution exception or rendering failure is detected, a backup process is triggered or the multimedia content is regenerated and a new rendering task is started.

4. The method according to claim 3, characterized in that The remote scheduling service also includes: Establish an instruction queue to support the scheduling management and priority allocation of batch tasks; Coordinate rendering tasks through parallel processing or distributed tasks.

5. The method according to claim 2, characterized in that The steps of embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing and outputting the video also include: When embedding a multi-window picture-in-picture effect in the output video, automatically adjusting the target position, scaling ratio and keyframe animation based on the multimedia synthesis script; Personalize the layout rules based on business strategies or user behavior analysis.

6. The method according to claim 1, characterized in that Before the step of receiving multimedia content through the remote scheduling service, the method includes: Generate multimedia content using an AI model, where the multimedia content includes at least one of text, images, video, and audio; The generated multimedia content is format converted, resolution adjusted, or frame rate adapted to meet the compatibility of the multimedia synthesis template.

7. The method according to claim 1, characterized in that Before the steps of embedding the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performing rendering processing, and outputting the video, the steps include: The multimedia synthesis script is deployed in a remote access environment, and security permissions are configured to cooperate with the call of the remote scheduling service.

8. The method according to claim 1, characterized in that The steps of generating the multimedia synthesis script based on the multimedia synthesis template include: The multimedia synthesis script supports full-process operations on multimedia synthesis templates, including opening templates, loading synthesis sequences, dynamically replacing content, adding transition animations, and triggering rendering output.

9. A system for rendering video content, characterized in that: include: A calling module, the calling module being configured to receive multimedia content through a remote scheduling service and send the multimedia content to a multimedia synthesis script, wherein the multimedia synthesis script is generated based on a multimedia synthesis template; A rendering module, which embeds the multimedia content into the multimedia synthesis template based on the multimedia synthesis script, performs rendering processing and outputs a video; The calling module is further configured to provide the output video to the remote scheduling service, and upload and publish the output video through the remote scheduling service.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images