A multimedia rendering method and apparatus, electronic device, and storage medium

Abstract

This application discloses a multimedia rendering method, apparatus, electronic device, and storage medium. The method includes: acquiring various multimedia materials of the current target project; mapping each multimedia material to a corresponding timeline track according to its material type to obtain trimmed blocks of each multimedia material; when the cursor of the timeline moves to the operation start node of any multimedia material trimmed block, rendering and outputting the multimedia data corresponding to the trimmed block of the multimedia material in real time based on the current basic attribute configuration and the priority of the track, until the cursor moves to the removal node of the multimedia material trimmed block; whenever the user triggers a target operation at any time point on the timeline, responding to the target operation triggered by the user at the time point; wherein, the target operation refers to the editing operation of any multimedia material trimmed block on the current timeline track or the operation of adding a new multimedia material trimmed block.

Description

Technical Field

[0001] This application relates to the field of multimedia processing technology, and in particular to a multimedia rendering method and apparatus, electronic device, and storage medium. Background Technology

[0002] With the rapid growth of the internet, multimedia content such as images, text, audio, and video has become a major component of the internet. As audio and video content continues to increase and diversify, the tools and platforms for processing and sharing this multimedia content also need to become increasingly powerful and widespread. The demand for rendering multimedia data is also rising.

[0003] The current method for processing multimedia data is mainly based on a fixed list of pre-configured processing methods. That is, for a media project, such as a live event, the relevant information of various operations is pre-configured in the configuration file. For example, during the continuous rendering of the video, at the 10-minute mark, a smiley face with a specified attribute is rendered in the video and continues for 10 minutes, thus obtaining a configuration list. Subsequent rendering and editing are based on this configuration list.

[0004] However, the pre-configuration process is quite cumbersome, and the operation cannot be changed during the process. Therefore, if there are any changes, the configuration file needs to be readjusted and re-rendered, making the whole process quite cumbersome. Furthermore, this method can only process a complete video, so it has limited limitations. Summary of the Invention

[0005] In view of the shortcomings of the prior art, this application provides a multimedia rendering method and apparatus, electronic device and storage medium to solve the problems of the prior art being relatively cumbersome and having limited limitations.

[0006] To achieve the above objectives, this application provides the following technical solution:

[0007] The first aspect of this application provides a multimedia rendering method, including:

[0008] Obtain all multimedia materials for the current target project;

[0009] Each multimedia material in the current target project is mapped to the corresponding timeline track according to its material type, resulting in a trimmed block for each multimedia material.

[0010] For each trimmed block of the multimedia material, when the time point where the cursor of the timeline moves reaches the operation start node of the trimmed block of the multimedia material, the multimedia data corresponding to the trimmed block of the multimedia material is rendered and output in real time based on the current basic attribute configuration and the priority of the track it is in, until the time point where the cursor of the timeline moves reaches the removal node of the trimmed block of the multimedia material.

[0011] Whenever a user triggers a target operation at any point in time on the timeline, the target operation triggered by the user is responded to at that point in time; wherein, the target operation refers to an editing operation on any trim block of the multimedia material on the current timeline track or an operation to add a trim block of multimedia material on the timeline track.

[0012] Optionally, in the above multimedia rendering method, before rendering and outputting the multimedia data corresponding to the trimmed block of the multimedia material based on the current basic attribute configuration and the priority of the track, the method further includes:

[0013] Determine whether the multimedia material belongs to a media type;

[0014] If it is determined that the multimedia material belongs to a media type, then the multimedia data of the multimedia material is obtained, and the multimedia data corresponding to the trimmed block of the multimedia material is obtained.

[0015] Optionally, in the above-described multimedia rendering method, for each trimmed block of the multimedia material, when the time point where the cursor on the timeline is positioned reaches the operation start node of the trimmed block, the multimedia data corresponding to the trimmed block is rendered and output in real time based on the current basic attribute configuration and the priority of the track, until the time point where the cursor on the timeline is positioned reaches the removal node of the trimmed block, including:

[0016] Once real-time rendering is started, the cursor position on the timeline is monitored in real time to determine whether the operation start node of any of the multimedia material trimming blocks has been reached.

[0017] If the time point at which the cursor of the time axis moves reaches the start point of any of the multimedia material's trimming blocks, then the player is controlled to render and output the multimedia data corresponding to the trimming block of the multimedia material in real time based on the current basic attribute configuration and the layer corresponding to the priority of the track where the trimming block of the multimedia material is located.

[0018] Real-time monitoring of whether the cursor position on the timeline has reached the removal node of the trimmed block of the multimedia material;

[0019] If the cursor position on the timeline reaches the removal node of the trimmed block of the multimedia material, the player is controlled to end the rendering of the multimedia data corresponding to the trimmed block of the multimedia material.

[0020] Optionally, in the above multimedia rendering method, the step of mapping each multimedia material of the current target project to the corresponding timeline track according to its material type to obtain the trimmed block of each multimedia material includes:

[0021] In response to the user's addition operation for each of the multimedia materials in the current target project, at a specified time point on a track of the timeline corresponding to the material type to which the multimedia material belongs, a trimming block with a span consistent with the playback time of the multimedia material is mapped out, thereby obtaining the trimming block for each multimedia material.

[0022] Optionally, in the above multimedia rendering method, rendering and outputting the multimedia data corresponding to the trimmed block of the multimedia material includes:

[0023] The multimedia data corresponding to the trimmed block of the multimedia material is rendered, and the rendering result is output to the project file of the current target project;

[0024] The project files of the current target project are pushed to the streaming media server in real time in a streaming media manner so that they can be played in real time through the streaming media server.

[0025] Optionally, the multimedia rendering method described above also includes:

[0026] Whenever an attribute configuration operation is received from the user, the current basic attribute configuration is updated in response to the user's current attribute configuration operation.

[0027] A second aspect of this application provides a multimedia rendering apparatus, comprising:

[0028] The material acquisition unit is used to acquire various multimedia materials for the current target project;

[0029] The mapping unit is used to map each of the multimedia materials in the current target project to the corresponding timeline track according to the material type, so as to obtain the trimming block of each multimedia material.

[0030] The rendering unit is used to render and output the multimedia data corresponding to the trimmed block of the multimedia material in real time based on the current basic attribute configuration and the priority of the track when the time point where the cursor of the time axis moves reaches the operation start node of the trimmed block of the multimedia material, until the time point where the cursor of the time axis moves reaches the removal node of the trimmed block of the multimedia material.

[0031] An editing unit is configured to respond to the target operation triggered by the user at any time point on the timeline whenever the user triggers the target operation; wherein the target operation refers to an editing operation on any trim block of the multimedia material on the current timeline track or an operation to add a trim block of multimedia material on the timeline track.

[0032] Optionally, the multimedia rendering apparatus described above further includes:

[0033] A type determination unit is used to determine whether the multimedia material belongs to a media type;

[0034] The data acquisition unit is used to acquire the multimedia data of the multimedia material when it is determined that the multimedia material belongs to a media type, and to obtain the multimedia data corresponding to the trimmed block of the multimedia material.

[0035] Optionally, in the above-described multimedia rendering apparatus, the rendering unit includes:

[0036] The first monitoring unit is used to monitor the time point at which the cursor of the time axis moves after real-time rendering is started, and whether it has reached the operation start node of any of the multimedia material trimming blocks.

[0037] The rendering control unit is used to control the player to render and output the multimedia data corresponding to the trimmed block of the multimedia material in real time based on the current basic attribute configuration, on the layer corresponding to the priority of the track where the trimmed block of the multimedia material is located, when the cursor of the time axis reaches the operation start node of any trimmed block of the multimedia material.

[0038] The second monitoring unit is used to monitor in real time whether the time point at which the cursor on the time axis moves reaches the removal node of the trimmed block of the multimedia material;

[0039] The termination unit is used to control the player to end the rendering of the multimedia data corresponding to the trimmed block of the multimedia material when the time point at which the cursor of the time axis reaches the removal node of the trimmed block of the multimedia material.

[0040] Optionally, in the above-described multimedia rendering apparatus, the mapping unit includes:

[0041] The mapping subunit is used to respond to the user's addition operation for each of the multimedia materials in the current target project. At a specified time point on a track of the timeline corresponding to the specified material type of the multimedia material, a trimming block with a span consistent with the playback time of the multimedia material is mapped out to obtain the trimming block of each multimedia material.

[0042] Optionally, in the multimedia rendering apparatus described above, when the rendering unit performs the rendering and output of the multimedia data corresponding to the trimmed block of the multimedia material, it is used to:

[0043] The multimedia data corresponding to the trimmed block of the multimedia material is rendered, and the rendering result is output to the project file of the current target project;

[0044] The project files of the current target project are pushed to the streaming media server in real time in a streaming media manner so that they can be played in real time through the streaming media server.

[0045] Optionally, the multimedia rendering apparatus described above further includes:

[0046] The configuration update unit is used to update the current basic attribute configuration whenever it receives the user's attribute configuration operation.

[0047] A third aspect of this application provides an electronic device, comprising:

[0048] Memory and processor;

[0049] The memory is used to store programs;

[0050] The processor is used to execute the program, which, when executed, is specifically used to implement the multimedia rendering method as described in any of the above.

[0051] A fourth aspect of this application provides a computer storage medium for storing a computer program, which, when executed by a processor, is used to implement the multimedia rendering method as described in any of the preceding claims.

[0052] This application provides a multimedia rendering method that acquires various multimedia materials from the current target project and maps each multimedia material to a corresponding timeline track according to its material type, resulting in trimmed blocks for each multimedia material. During rendering, for each trimmed block, when the timeline cursor reaches the start node of the operation for that trimmed block, the multimedia data corresponding to the trimmed block is rendered and output in real-time based on the current basic attribute configuration and the priority of the track, until the timeline cursor reaches the removal node of the trimmed block. Throughout the process, whenever the user triggers a target operation at any time point on the timeline, the method responds to the user-triggered target operation at that time point. The target operation refers to editing any trimmed block of multimedia material on the current timeline track or adding a new trimmed block of multimedia material on the timeline track, allowing for specified operations at specified time positions and segments, making rendering and editing more convenient. Furthermore, it can display multiple multimedia materials, so it is not limited to a single complete video. Attached Figure Description

[0053] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0054] Figure 1 A flowchart illustrating a multimedia rendering method provided in an embodiment of this application;

[0055] Figure 2 A schematic diagram illustrating a media material processing result provided in an embodiment of this application;

[0056] Figure 3 A flowchart illustrating a method for rendering media data provided in this application embodiment;

[0057] Figure 4 A flowchart for managing the lifecycle of multimedia materials via a timeline is provided as an embodiment of this application;

[0058] Figure 5 A flowchart illustrating a method for rendering and outputting multimedia data corresponding to a trimmed block of multimedia material, as provided in an embodiment of this application;

[0059] Figure 6This is a schematic diagram of the architecture of a multimedia rendering device provided in an embodiment of this application;

[0060] Figure 7 This is a schematic diagram of the architecture of an electronic device provided in an embodiment of this application. Detailed Implementation

[0061] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0062] In this application, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0063] This application provides a multimedia rendering method, such as... Figure 1 As shown, it includes:

[0064] S101. Obtain all multimedia materials for the current target project.

[0065] The current target project refers to the project that currently needs to be rendered and edited.

[0066] Specifically, the first step is to acquire the initial multimedia material data for the current target project. This multimedia material can include video, audio, images, subtitles, text, and filters.

[0067] S102. Map each multimedia material in the current target project to the corresponding timeline track according to its material type to obtain the trimming block of each multimedia material.

[0068] It should be noted that in this embodiment, multimedia data rendering and editing are performed from a time perspective, and the lifecycle of multimedia material operations is managed from a time perspective. Therefore, in this embodiment, the input layer is abstracted into three methods: Config, Media, and Operate. These three methods work together on the timeline to achieve unified timeline management. The first step is to create a timeline, and then map the multimedia materials onto the timeline tracks to form trimmed blocks. By processing these trimmed blocks, the data output from the media can be processed. Each executable editing operation after adding the multimedia material to the track can be considered an operation of a trimmed block. Therefore, each trimmed block has a complete lifecycle, determined by the timeline, which defines the entire process of the trimmed block from initialization, loading, running, removal, and release.

[0069] Optionally, the length of the timeline can be set according to actual needs. Typically, it is initially the length of the user's display device or the length of the longest multimedia material. For example, if a video is 40 minutes long, the timeline will start from 0 and end at 40 minutes.

[0070] Because different multimedia materials are different, the layers displayed during rendering and playback are also different. For example, subtitles are usually on top of the video. Therefore, in this embodiment, the timeline has corresponding tracks for different multimedia materials, and multiple tracks can be set for a certain type of multimedia material. For example, ... Figure 2 As shown, from top to bottom are the subtitle track, the image track, the two video tracks, and the audio track.

[0071] The order of the tracks indicates their priority, for example, as shown below. Figure 2 As shown, the higher the track is, the higher its priority, and the higher the priority, the higher the layer it is displayed on when it is played.

[0072] Therefore, in this embodiment of the application, when mapping multimedia materials to the timeline track, it is necessary to map them to a track of the corresponding type according to their type and priority, so as to form the corresponding clip on the corresponding track.

[0073] Optionally, in another embodiment of this application, one specific implementation of step S102 includes:

[0074] Responding to the user's addition of various multimedia materials in the current target project, at a specified time point on a track of the timeline corresponding to the material type of the specified multimedia material, a trimming block with a span consistent with the playback time of the multimedia material is mapped out, thus obtaining the trimming block of each multimedia material.

[0075] To meet user needs and ensure that multimedia materials are rendered and played at specified times and for specified durations, this embodiment allows users to add multimedia materials to the timeline via an add operation, such as dragging and dropping. The added position is the specified time position. The playback time is the video's playback duration, while the playback duration for subtitles and images can be initially set to a default time and adjusted later as needed, configured during addition, or determined based on the playback time information in the multimedia material's attributes.

[0076] S103. For each multimedia material trimming block, when the time point where the cursor on the timeline moves reaches the operation start node of the trimming block of the multimedia material, the multimedia data corresponding to the trimming block of the multimedia material is rendered and output in real time based on the current basic attribute configuration and the priority of the track it is on, until the time point where the cursor on the timeline moves reaches the removal node of the trimming block of the multimedia material.

[0077] The current basic attribute configuration refers to the current basic attribute configuration information. This basic attribute configuration information may include, but is not limited to, output width, height, resolution, bitrate, frame rate, sampling rate, video encoding format, audio encoding format, and container size, among other attribute information.

[0078] It should be noted that, in this embodiment of the application, the basic attribute configuration information can be continuously adjusted according to the user's needs, and can also be continuously adjusted during the rendering process. Therefore, during rendering, it is necessary to render according to the current basic attribute configuration, that is, to render according to the latest basic attribute configuration.

[0079] Therefore, optionally, in another embodiment of this application, it may further include:

[0080] Whenever a user's attribute configuration operation is received, the system responds to the user's current attribute configuration operation and updates the current basic attribute configuration.

[0081] Therefore, after setting the initial basic attribute configuration through attribute configuration operations, users can perform attribute configuration operations at any time according to their needs to update the current basic attribute configuration.

[0082] Specifically, during rendering, the cursor on the timeline moves continuously from its initial position. During this movement, if the time point of its initial position reaches the start node of the trimming block of any multimedia material, the multimedia material will begin to be rendered according to the current basic attribute configuration until the time point where the cursor on the timeline moves reaches the removal node of the trimming block of the multimedia material, so as to continuously render video files in a format that conforms to the current basic attribute configuration.

[0083] Optionally, such as Figure 2 As shown, when the cursor moves to the leftmost side of a trim block of a multimedia asset, it is considered to have reached the start node of the operation, and when the current cursor moves to the rightmost side of a trim block of a multimedia asset, it is considered to have reached the removal node.

[0084] It should be noted that multiple multimedia materials may be rendered simultaneously, so the priority of the track must be considered to determine the layer to be rendered and played.

[0085] Optionally, in another embodiment of this application, before rendering and outputting the multimedia data corresponding to the trimmed block of the multimedia material based on the current basic attribute configuration and the priority of the track, the following further steps are performed:

[0086] Determine whether multimedia materials belong to a media type.

[0087] If it is determined that the multimedia material belongs to a media type, then the multimedia data of the multimedia material is obtained, and the multimedia data corresponding to the trimmed block of the multimedia material is obtained.

[0088] Media types include video, images, and audio, while filters are not included. Only multimedia content of a media type requires the acquisition of its multimedia data.

[0089] Optionally, in another embodiment of this application, one specific implementation of step S103 is as follows: Figure 3 As shown, it includes:

[0090] S301. After real-time rendering is started, monitor the time point at which the cursor on the timeline moves to see if it has reached the start point of the operation for any multimedia material trimming block.

[0091] If the cursor position of the monitoring timeline reaches the start node of the operation of any multimedia material trimming block, then step S302 is executed.

[0092] S302: Control the player to render and output the multimedia data corresponding to the trimmed block of the multimedia material in real time based on the current basic attribute configuration and the priority layer of the track where the trimmed block of the multimedia material is located.

[0093] S303. Real-time monitoring of whether the cursor position on the timeline has reached the removal node of the trim block of the multimedia material.

[0094] If the cursor position of the monitoring timeline reaches the removal node of the trim block of the multimedia material, then step S304 is executed.

[0095] S304. Control the player to end the rendering of multimedia data corresponding to the trimmed block of the multimedia material.

[0096] This allows for lifecycle management of multimedia materials through a timeline, for example, Figure 4 As shown, after the action begins, i.e., after reaching the initial operation node, it is determined whether the multimedia material is a media type. If it is a media type, the multimedia data of the multimedia material is acquired. Then, the player is controlled through the TextureView Manager to execute the corresponding action. At the same time, it starts to determine whether the removal node has been reached based on the timeline. If the removal node has not been reached, it waits until the removal node is reached, at which point the current action is removed, and it waits for the next action.

[0097] Optionally, in one embodiment of this application, rendering and outputting the multimedia data corresponding to the trimmed blocks of multimedia material is as follows: Figure 5 As shown, it includes:

[0098] S501. Render the multimedia data corresponding to the trimmed block of the multimedia material, and output the rendering result to the project file of the current target project.

[0099] For ease of management and subsequent direct import of the entire project file, the rendering results are output to the project file of the current target project in this embodiment.

[0100] S502. Push the project files of the current target project to the streaming media server in real time as a stream for real-time playback.

[0101] S104. Whenever a user triggers a target operation at any point in time on the timeline, respond to the target operation triggered by the user at that time point.

[0102] The target operation refers to the editing operation on any trimmed block of multimedia material on the current timeline track, or the operation of adding a trimmed block of multimedia material on the timeline track. Specifically, the editing operation on the trimmed block of multimedia material on the track can include operations such as cropping and removing, for example, Figure 2 As shown, "Video2" and "Video4" were originally a single multimedia clipping block. By cropping, a portion of the middle part was removed, thus splitting it into two clipping blocks containing multiple media clippings.

[0103] Furthermore, due to the existence of multiple tracks, there may be various temporal overlaps between the target operations, and these overlaps will project onto other shear blocks on the time axis. For example, such as... Figure 2 As shown, there are four tracks, from bottom to top: Track 1 contains two audio tracks: Audio1 and Audio2; Track 2 contains two video tracks: Video2 and Video4; Track 3 contains two video tracks: Video1 and Video3; Track 4 contains one image: Image1; and Track 5 contains three subtitles: Subtitle1, Subtitle2, and Subtitle3. Of course, the number of tracks is not limited to five; it is variable and can be increased as needed. The track hierarchy increases sequentially from bottom to top, generally with audio at the bottom, subtitles at the top, and images and videos in between. Therefore, it is evident that the clips overlap in time, and correspondingly, the target operations on those clips also overlap in time. The management of each clip and its target operation is done through the timeline, i.e., mapped to a unified temporal domain. Therefore, the output duration of each track is consistent with the timeline, equal to the time point corresponding to the rightmost endpoint of the timeline minus the time point corresponding to the leftmost endpoint. The time starting point on the left is usually 0, while the time on the right is set according to the requirements.

[0104] It should be noted that in the embodiments of this application, step S104 can be executed at any time after step S102, and is not necessarily only executed after step S103. That is, after the multimedia material is mapped onto the track, any trimming block of any multimedia material on the track can be edited at any time, or any multimedia material can be added. Even during the rendering process, editing can be performed, that is, multimedia materials after the time point before rendering can be edited or added while rendering is being performed.

[0105] This application provides a multimedia rendering method. It acquires various multimedia materials from the current target project and maps each multimedia material to a corresponding timeline track according to its material type, resulting in trimmed blocks for each multimedia material. During rendering, for each trimmed block, when the time point where the timeline cursor moves reaches the operation start node of the trimmed block, the multimedia data corresponding to the trimmed block is rendered and output in real time based on the current basic attribute configuration and the priority of the track, until the time point where the timeline cursor moves reaches the removal node of the trimmed block. Throughout the process, whenever the user triggers a target operation at any time point on the timeline, the method responds to the user-triggered target operation at that time point. The target operation refers to editing any trimmed block of multimedia material on the current timeline track or adding a new trimmed block of multimedia material on the timeline track. This allows for specified operations to be performed on specified time positions and specified segments at any time, making rendering and editing more convenient. Furthermore, it can display multiple multimedia materials, so it is not limited to a single complete video.

[0106] Another embodiment of this application provides a multimedia rendering apparatus, such as... Figure 6 As shown, it includes:

[0107] The material acquisition unit 601 is used to acquire various multimedia materials of the current target project.

[0108] The mapping unit 602 is used to map each multimedia material of the current target project to the corresponding timeline track according to its material type, so as to obtain the trimmed block of each multimedia material.

[0109] The rendering unit 603 is used to render and output the multimedia data corresponding to the trim block of the multimedia material in real time based on the current basic attribute configuration and the priority of the track when the time point where the cursor of the time axis moves reaches the operation start node of the trim block of the multimedia material, until the time point where the cursor of the time axis moves reaches the removal node of the trim block of the multimedia material.

[0110] The editing unit 604 is used to respond to the target operation triggered by the user at any time point on the timeline. The target operation refers to editing any trimmed block of multimedia material on the current timeline track or adding a trimmed block of multimedia material to the timeline track.

[0111] Optionally, in another embodiment of the provided multimedia rendering apparatus, the following further includes:

[0112] The type determination unit is used to determine whether multimedia materials belong to a media type.

[0113] The data acquisition unit is used to acquire multimedia data of multimedia materials when it is determined that the multimedia material belongs to a media type, and to obtain the multimedia data corresponding to the trimmed block of the multimedia material.

[0114] Optionally, in another embodiment of the provided multimedia rendering apparatus, the rendering unit includes:

[0115] The first monitoring unit is used to monitor the time point at which the cursor on the timeline moves after real-time rendering is started, and whether it has reached the start point of the operation of any multimedia material trimming block.

[0116] The rendering control unit is used to control the player to render and output the multimedia data corresponding to the trimmed block of the multimedia material in real time based on the current basic attribute configuration, on the layer corresponding to the priority of the track where the trimmed block of the multimedia material is located, when the cursor of the monitoring timeline reaches the operation start node of any multimedia material trimmed block.

[0117] The second monitoring unit is used to monitor in real time whether the cursor position on the timeline has reached the removal node of the trimmed block of the multimedia material.

[0118] The termination unit is used to control the player to end the rendering of the multimedia data corresponding to the trimmed block of the multimedia material when the cursor position on the monitoring timeline reaches the removal node of the trimmed block of the multimedia material.

[0119] Optionally, in another embodiment of the provided multimedia rendering apparatus, the mapping unit includes:

[0120] The mapping subunit is used to respond to the user's addition operation for each multimedia material in the current target project. At a specified time point on a track of the timeline corresponding to the material type to which the specified multimedia material belongs, a trim block with a span consistent with the playback time of the multimedia material is mapped out to obtain the trim block of each multimedia material.

[0121] Optionally, in another embodiment of the provided multimedia rendering apparatus, when the rendering unit renders and outputs the multimedia data corresponding to the trimmed blocks of the multimedia material, it is used for:

[0122] Render the multimedia data corresponding to the trimmed blocks of the multimedia material, and output the rendering results to the project file of the current target project.

[0123] The project files of the current target project are pushed to the streaming media server in real time as a stream for real-time playback.

[0124] Optionally, in another embodiment of the provided multimedia rendering apparatus, the following further includes:

[0125] The configuration update unit is used to update the current basic attribute configuration whenever a user's attribute configuration operation is received.

[0126] It should be noted that the specific working process of each unit provided in the above embodiments of this application can be referred to the implementation process of the corresponding steps in the above method embodiments, and will not be repeated here.

[0127] Another embodiment of this application provides an electronic device, such as... Figure 7 As shown, it includes:

[0128] Memory 701 and processor 702.

[0129] The memory 701 is used to store the program.

[0130] The processor 702 is used to execute the program stored in the memory 701. When the program is executed, it is specifically used to implement the multimedia rendering method provided in any of the above embodiments.

[0131] Another embodiment of this application provides a computer storage medium for storing a computer program, which, when executed by a processor, is used to implement the multimedia rendering method provided in any of the above embodiments.

[0132] Computer storage media, including both permanent and non-permanent, removable and non-removable media, can store information using any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0133] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0134] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A multimedia rendering method, characterized by, include: Obtain all multimedia materials for the current target project; Each multimedia material in the current target project is mapped to a corresponding timeline track according to its material type, resulting in a trimmed block for each multimedia material. The timeline determines the entire process of the trimmed block from initialization, loading, running, removal, and release. Corresponding tracks are set for different multimedia materials under the timeline, and the position order of each track indicates its priority. When mapping multimedia materials to timeline tracks, they are mapped to the corresponding type of track according to their type and priority to form their corresponding trimmed blocks on the track. After the multimedia materials are mapped to the track, any trimmed block of any multimedia material on the track can be edited at any time, or any multimedia material can be added. During the rendering process, multimedia materials after the time point before rendering are edited or added while rendering is being performed. For each trimmed block of the multimedia material, when the time point where the cursor of the timeline moves reaches the operation start node of the trimmed block of the multimedia material, the multimedia data corresponding to the trimmed block of the multimedia material is rendered and output in real time based on the current basic attribute configuration and the priority of the track it is in, until the time point where the cursor of the timeline moves reaches the removal node of the trimmed block of the multimedia material. Whenever a user triggers a target operation at any point in time on the timeline, the target operation triggered by the user is responded to at that point in time; wherein, the target operation refers to an editing operation on any trim block of the multimedia material on the current timeline track or an operation to add a trim block of multimedia material on the timeline track.

2. The method of claim 1, wherein, Before rendering and outputting the multimedia data corresponding to the trimmed block of the multimedia material based on the current basic attribute configuration and the priority of the track, the process also includes: Determine whether the multimedia material belongs to a media type; If it is determined that the multimedia material belongs to a media type, then the multimedia data of the multimedia material is obtained, and the multimedia data corresponding to the trimmed block of the multimedia material is obtained.

3. The method of claim 1, wherein, For each trimming block of the multimedia material, when the time point where the cursor on the timeline moves reaches the start node of the operation for the trimming block, the multimedia data corresponding to the trimming block is rendered and output in real time based on the current basic attribute configuration and the priority of the track it is on, until the time point where the cursor on the timeline moves reaches the removal node of the trimming block, including: Once real-time rendering is started, the cursor position on the timeline is monitored in real time to determine whether the operation start node of any of the multimedia material trimming blocks has been reached. If the time point at which the cursor of the time axis moves reaches the start point of any of the multimedia material's trimming blocks, then the player is controlled to render and output the multimedia data corresponding to the trimming block of the multimedia material in real time based on the current basic attribute configuration and the layer corresponding to the priority of the track where the trimming block of the multimedia material is located. Real-time monitoring of whether the cursor position on the timeline has reached the removal node of the trimmed block of the multimedia material; If the cursor position on the timeline reaches the removal node of the trimmed block of the multimedia material, the player is controlled to end the rendering of the multimedia data corresponding to the trimmed block of the multimedia material.

4. The method of claim 1, wherein, The step of mapping each multimedia material in the current target project to the corresponding timeline track according to its material type to obtain the trimming block of each multimedia material includes: In response to the user's addition operation for each of the multimedia materials in the current target project, at a specified time point on a track of the timeline corresponding to the material type to which the multimedia material belongs, a trimming block with a span consistent with the playback time of the multimedia material is mapped out, thereby obtaining the trimming block for each multimedia material.

5. The method according to claim 1, characterized in that, The step of rendering and outputting the multimedia data corresponding to the trimmed blocks of the multimedia material includes: The multimedia data corresponding to the trimmed block of the multimedia material is rendered, and the rendering result is output to the project file of the current target project; The project files of the current target project are pushed to the streaming media server in real time in a streaming media manner so that they can be played in real time through the streaming media server.

6. The method according to claim 1, characterized in that, Also includes: Whenever an attribute configuration operation is received from the user, the current basic attribute configuration is updated in response to the user's current attribute configuration operation.

7. A multimedia rendering device, characterized in that, include: The material acquisition unit is used to acquire various multimedia materials for the current target project; The mapping unit is used to map each of the multimedia materials in the current target project to the corresponding timeline track according to the material type, so as to obtain the trimming block of each multimedia material. The rendering unit is used to render and output the multimedia data corresponding to the trimmed block of the multimedia material in real time based on the current basic attribute configuration and the priority of the track when the time point where the cursor of the time axis moves reaches the operation start node of the trimmed block of the multimedia material, until the time point where the cursor of the time axis moves reaches the removal node of the trimmed block of the multimedia material. An editing unit is configured to respond to the target operation triggered by the user at any time point on the timeline whenever the user triggers the target operation; wherein the target operation refers to an editing operation on any trim block of the multimedia material on the current timeline track or an operation to add a trim block of multimedia material on the timeline track. The entire process of trimming blocks, from initialization, loading, running, removal, and release, is determined by the timeline. Corresponding tracks are set for different multimedia materials under the timeline, and the position order of each track indicates its corresponding priority. When mapping multimedia materials to tracks on the timeline, they are mapped to the corresponding type of track according to their type and priority to form their corresponding trimming blocks on the track. After the multimedia materials are mapped to the track, the trimming block of any multimedia material on the track can be edited at any time, or any multimedia material can be added. During the rendering process, multimedia materials after the time point that has not yet been rendered are edited or added while rendering is being performed.

8. The apparatus according to claim 7, characterized in that, Also includes: A type determination unit is used to determine whether the multimedia material belongs to a media type; The data acquisition unit is used to acquire the multimedia data of the multimedia material when it is determined that the multimedia material belongs to a media type, and to obtain the multimedia data corresponding to the trimmed block of the multimedia material.

9. An electronic device, characterized in that, include: Memory and processor; The memory is used to store programs; The processor is used to execute the program, which, when executed, is specifically used to implement the multimedia rendering method as described in any one of claims 1 to 6.

10. A computer storage medium, characterized in that, Used to store a computer program, which, when executed by a processor, is used to implement the multimedia rendering method as described in any one of claims 1 to 6.

Images