Multimedia rendering method and device, electronic equipment and storage medium

Abstract

The invention discloses a multimedia rendering method and apparatus, an electronic device and a storage medium. The method comprises the steps of obtaining each multimedia material of a current target project; mapping each multimedia material to a track of a corresponding time axis according to the material type to which the multimedia material belongs, and obtaining a trimming block of each multimedia material; and when the vernier of the time axis moves to an operation starting node of the trimming block of any multimedia material, rendering and outputting multimedia data corresponding to the trimming block of the multimedia material in real time based on the current basic attribute configuration and the priority of the track where the current basic attribute configuration is located. The cursor is moved to the removing node of the trimming block of the multimedia material; when the user triggers the target operation at any time point position of the time axis, responding to the target operation triggered by the user at the time position point; wherein the target operation refers to an editing operation on a trimming block of any multimedia material on a track of the current time axis or an operation on a trimming block of a newly added multimedia material.

Description

Technical Field

[0001] The present application relates to the field of multimedia processing technology, and in particular to a multimedia rendering method and device, an electronic device, and a storage medium. Background Art

[0002] With the rapid growth of the Internet, multimedia content such as pictures, text, audio, and video has become a major component of the Internet. As audio and video content continues to increase and diversify, the tools and platforms for processing and sharing these multimedia contents need to become more powerful and popular. The demand for rendering multimedia data is also increasing.

[0003] The current processing method for multimedia data is mainly based on a fixed processing configuration list. That is, for a media project, such as a live broadcast event, the relevant information of various operations is pre-configured in the configuration file. For example, during the continuous rendering of the video, at the 10th minute, a smiley face with specified attributes is rendered in the video and lasts for 10 minutes, thereby obtaining a configuration list, and subsequent rendering and editing are implemented based on this configuration list.

[0004] However, the pre-configuration process is rather cumbersome, and the intermediate process cannot be changed. Therefore, if there are changes, the configuration file needs to be readjusted and re-rendered. Therefore, the operation of the whole process is rather cumbersome, and this method can only process a complete overall video, so it has fewer limitations. Summary of the invention

[0005] Based on the above-mentioned deficiencies of the prior art, the present application provides a multimedia rendering method and device, an electronic device, and a storage medium to solve the problem that the prior art is relatively cumbersome and has minor limitations.

[0006] In order to achieve the above objectives, this application provides the following technical solutions:

[0007] The first aspect of the present application provides a multimedia rendering method, comprising:

[0008] Get various multimedia materials of the current target project;

[0009] Mapping each of the multimedia materials of the current target project to a track of a corresponding timeline according to the material type to obtain a trimmed block of each of the multimedia materials;

[0010] For each trimmed block of the multimedia material, when the time point at which the cursor of the time axis moves reaches the operation start node of the trimmed block of the multimedia material, the multimedia data corresponding to the trimmed block of the multimedia material is rendered and output in real time based on the current basic attribute configuration and the priority of the track, until the time point at which the cursor of the time axis moves reaches the removal node of the trimmed block of the multimedia material;

[0011] Whenever the user triggers a target operation at any time point on the timeline, respond to the target operation triggered by the user at the time point; wherein the target operation refers to an editing operation on any trimming block of the multimedia material on the track of the current timeline or an operation of adding a trimming block of multimedia material to the track of the timeline.

[0012] Optionally, in the above multimedia rendering method, before rendering and outputting the multimedia data corresponding to the trimmed block of the multimedia material in real time based on the current basic attribute configuration and the priority of the track, the method further includes:

[0013] Determining whether the multimedia material belongs to a media type;

[0014] If it is determined that the multimedia material belongs to the media type, the multimedia data of the multimedia material is acquired, and the multimedia data corresponding to the trimmed block of the multimedia material is obtained.

[0015] Optionally, in the above-mentioned multimedia rendering method, for each trimmed block of the multimedia material, when the time point at which the moving position of the cursor of the time axis reaches the operation start node of the trimmed block of the multimedia material, the multimedia data corresponding to the trimmed block of the multimedia material is rendered and output in real time based on the current basic attribute configuration and the priority of the track, until the time point at which the moving position of the cursor of the time axis reaches the removal node of the trimmed block of the multimedia material, including:

[0016] After the real-time rendering is started, the time point at which the cursor of the time axis moves is monitored in real time to see whether it reaches the operation start node of any trimming block of the multimedia material;

[0017] If the time point at which the cursor moving position of the monitoring time axis reaches the operation start node of any trimming block of the multimedia material, the player is controlled to render and output the multimedia data corresponding to the trimming block of the multimedia material in the layer corresponding to the priority of the track where the trimming block of the multimedia material is located in real time based on the current basic attribute configuration;

[0018] Real-time monitoring of whether the time point at which the cursor of the time axis moves reaches a removal node of the trimmed block of the multimedia material;

[0019] If the time point at which the cursor moving position of the time axis is monitored reaches the removal node of the trimmed block of the multimedia material, the player is controlled to end the rendering of the multimedia data corresponding to the trimmed block of the multimedia material.

[0020] Optionally, in the above multimedia rendering method, mapping each of the multimedia materials of the current target project to a track of a corresponding timeline according to the material type to obtain a trimmed block of each of the multimedia materials includes:

[0021] In response to the user's addition operation on each of the multimedia materials of the current target project, a trimmed block with a span consistent with the playback time of the multimedia material is mapped out at a specified time point on a track of the timeline corresponding to the material type to which the specified multimedia material belongs, to obtain a trimmed block of each of the multimedia materials.

[0022] Optionally, in the above multimedia rendering method, the rendering and outputting of multimedia data corresponding to the trimmed blocks of the multimedia material includes:

[0023] Rendering the multimedia data corresponding to the trimmed blocks of the multimedia material, and outputting the rendering result to the project file of the current target project;

[0024] The project files of the current target project are pushed to the streaming media server in real time in a streaming manner so as to be played in real time through the streaming media server.

[0025] Optionally, in the above multimedia rendering method, it also includes:

[0026] Whenever an attribute configuration operation of the user is received, the current basic attribute configuration is updated in response to the current attribute configuration operation of the user.

[0027] A second aspect of the present application provides a multimedia rendering device, comprising:

[0028] A material acquisition unit, used to acquire various multimedia materials of the current target project;

[0029] A mapping unit, used to map each of the multimedia materials of the current target project to a track of a corresponding timeline according to the material type to obtain a trimmed block of each of the multimedia materials;

[0030] a rendering unit, for rendering and outputting, respectively, for each trimmed block of the multimedia material, multimedia data corresponding to the trimmed block of the multimedia material based on the current basic attribute configuration and the priority of the track when the time point at which the cursor of the time axis moves reaches the operation start node of the trimmed block of the multimedia material, until the time point at which the cursor of the time axis moves reaches the removal node of the trimmed block of the multimedia material;

[0031] An editing unit, used for responding to the target operation triggered by the user at any time point of the time axis whenever the target operation is triggered by the user at the time point; wherein the target operation refers to an editing operation on any trimming block of the multimedia material on the track of the current time axis or an operation of adding a trimming block of multimedia material to the track of the time axis.

[0032] Optionally, in the above multimedia rendering device, it also includes:

[0033] A type determination unit, used to determine whether the multimedia material belongs to a media type;

[0034] The data acquisition unit is used to acquire multimedia data of the multimedia material when it is determined that the multimedia material belongs to the media type, and obtain multimedia data corresponding to the trimmed block of the multimedia material.

[0035] Optionally, in the above-mentioned multimedia rendering device, the rendering unit includes:

[0036] A first monitoring unit is used to monitor in real time whether the time point at which the cursor of the time axis moves reaches the operation start node of any trimming block of the multimedia material after the real-time rendering is started;

[0037] A rendering control unit, for controlling the player to render and output the multimedia data corresponding to the trimmed block of the multimedia material in a layer corresponding to the priority of the track where the trimmed block of the multimedia material is located in real time based on the current basic attribute configuration when the time point at which the cursor moving position of the monitoring timeline reaches the operation start node of any trimmed block of the multimedia material;

[0038] A second monitoring unit is used to monitor in real time whether the time point at which the cursor of the time axis moves reaches a removal node of the trimmed block of the multimedia material;

[0039] The ending unit is used to control the player to end the rendering of the multimedia data corresponding to the trimmed block of the multimedia material when the time point at which the moving position of the cursor of the monitoring timeline reaches the removal node of the trimmed block of the multimedia material.

[0040] Optionally, in the above-mentioned multimedia rendering device, the mapping unit includes:

[0041] The mapping sub-unit is used to respond to the user's addition operation on each of the multimedia materials of the current target project, and map out a trimmed block with a span consistent with the playback time of the multimedia material at a specified time point on a track of the timeline corresponding to the material type to which the specified multimedia material belongs, to obtain a trimmed block of each of the multimedia materials.

[0042] Optionally, in the multimedia rendering device, when the rendering unit performs the rendering and outputting of the multimedia data corresponding to the trimmed blocks of the multimedia material, it is configured to:

[0043] Rendering the multimedia data corresponding to the trimmed blocks of the multimedia material, and outputting the rendering result to the project file of the current target project;

[0044] The project files of the current target project are pushed to the streaming media server in real time in a streaming manner so as to be played in real time through the streaming media server.

[0045] Optionally, in the above multimedia rendering device, it also includes:

[0046] The configuration updating unit is configured to update the current basic attribute configuration in response to the current attribute configuration operation of the user whenever receiving the attribute configuration operation of the user.

[0047] A third aspect of the present application provides an electronic device, including:

[0048] Memory and processor;

[0049] Wherein, the memory is used to store programs;

[0050] The processor is used to execute the program, and when the program is executed, it is specifically used to implement any one of the multimedia rendering methods described above.

[0051] A fourth aspect of the present application provides a computer storage medium for storing a computer program, wherein when the computer program is executed by a processor, the computer program is used to implement any of the multimedia rendering methods described above.

[0052] The present application provides a multimedia rendering method, which obtains each multimedia material of the current target project, and maps each multimedia material of the current target project to the corresponding track of the timeline according to the material type to obtain the trimming block of each multimedia material. When performing the rendering action, for each trimming block of the multimedia material, when the time point at which the moving position of the cursor of the timeline reaches the operation start node of the trimming block of the multimedia material, the multimedia data corresponding to the trimming block of the multimedia material is rendered and output in real time based on the current basic attribute configuration and the priority of the track, until the time point at which the moving position of the cursor of the timeline reaches the removal node of the trimming block of the multimedia material. And in the whole process, whenever the user triggers the target operation at any time point of the timeline, the target operation triggered by the user is responded to at the time position point. Among them, the target operation refers to the editing operation of the trimming block of any multimedia material on the track of the current timeline or the operation of adding a trimming block of a multimedia material to the track of the timeline, so that the specified operation can be performed on the specified time position and the specified segment at any time, making rendering and editing more convenient. And it can present multiple multimedia materials, so it is not limited to a complete overall video. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0054] Figure 1 A flowchart of a multimedia rendering method provided in an embodiment of the present application;

[0055] Figure 2 A schematic diagram of a media material processing result provided in an embodiment of the present application;

[0056] Figure 3 A flowchart of a method for rendering media data provided in an embodiment of the present application;

[0057] Figure 4 A flowchart of managing the life cycle of multimedia materials through a timeline provided in an embodiment of the present application;

[0058] Figure 5 A flowchart of a method for rendering and outputting multimedia data corresponding to a trimmed block of a multimedia material provided in an embodiment of the present application;

[0059] Figure 6A schematic diagram of the architecture of a multimedia rendering device provided in an embodiment of the present application;

[0060] Figure 7 A schematic diagram of the architecture of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0061] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0062] In this application, relational terms such as first and second, etc. are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0063] The present application embodiment provides a multimedia rendering method, such as Figure 1 As shown, including:

[0064] S101, obtaining various multimedia materials of the current target project.

[0065] The current target project refers to the project that currently needs to be rendered and edited.

[0066] Specifically, the data of each initial multimedia material of the current target project is first obtained, wherein the multimedia material may include video, audio, picture, subtitle, text, filter, etc.

[0067] S102: Map each multimedia material of the current target project to a corresponding track of the time axis according to the material type to obtain a trimmed block of each multimedia material.

[0068] It should be noted that in the embodiment of the present application, it is necessary to render and edit multimedia data from the perspective of time, and manage the life cycle of multimedia material operations from the perspective of time. Therefore, in the embodiment of the present application, the input layer is abstracted into three methods: configuration (Config), media (Media), and operation (Operate). The three methods work together on the timeline to achieve unified management of the timeline. Therefore, the first step is to create a timeline first, and then map the multimedia material to the track of the timeline to form a trimming block of the multimedia material, so that the data output by the media can be processed by processing the trimming block of the multimedia material. That is, after the multimedia material is added to the track, each edit quota operation that can be performed can be regarded as an operation of a trimming block of the multimedia material. Therefore, each trimming block has a complete life cycle, which is determined by the timeline, thereby determining the entire process of the trimming block from initialization, loading, running, removal, and release.

[0069] Optionally, the time length of the time axis can be set according to actual needs. Usually, the initial time is generally the maximum time of the user's display device, or the longest time of the multimedia material. For example, if a video is 40 minutes long, the time axis is drawn from 0 to 40 minutes.

[0070] Since different multimedia materials are different, the layers displayed when they are rendered and played are also different. For example, subtitles are usually on the upper layer of the video. Therefore, in the embodiment of the present application, corresponding tracks are set for different multimedia materials under the timeline, and a certain type of multimedia material can be set with multiple tracks, for example, Figure 2 As shown, from top to bottom are the regulations for the subtitle track, the image track, two video tracks, and the audio track.

[0071] The order of the positions of the tracks indicates their corresponding priorities, for example, Figure 2 As shown, the higher the track is, the higher its priority is. When the higher the priority is, the layer displayed is at the top.

[0072] Therefore, in the embodiment of the present application, when mapping multimedia materials to the track of the timeline, it is necessary to map them to a track of the corresponding type according to their type and priority, so as to form corresponding clips on the corresponding track.

[0073] Optionally, in another embodiment of the present application, a specific implementation of step S102 includes:

[0074] Respond to the user's addition operations on each multimedia material of the current target project respectively, and map out trimmed blocks with a span consistent with the playback time of the multimedia material at the specified time point position on a track of the timeline corresponding to the material type to which the specified multimedia material belongs, to obtain trimmed blocks of each multimedia material.

[0075] In order to meet the needs of users and allow multimedia materials to be rendered and played at a specified time point and for a specified duration, in an embodiment of the present application, the user adds multimedia materials to the track by adding operations, such as by dragging and dropping. The added position is the specified time position, and for the play time, the play time of the video is the play duration of the video, and for the play duration of subtitles and images, it can be first determined as a default time, and then adjusted according to the needs, or it can be configured when adding, or determined based on the play time in the attribute information of the multimedia material.

[0076] S103. For each trimmed block of multimedia material, when the time point at which the moving position of the cursor on the timeline reaches the operation start node of the trimmed block of the multimedia material, the multimedia data corresponding to the trimmed block of the multimedia material is rendered and output in real time based on the current basic attribute configuration and the priority of the track, until the time point at which the moving position of the cursor on the timeline reaches the removal node of the trimmed block of the multimedia material.

[0077] The current basic attribute configuration refers to the current basic attribute configuration information, and the basic attribute configuration information may include but is not limited to output width, height, resolution, bit rate, frame rate, sampling rate, video encoding format, audio encoding format, encapsulation and other attribute information.

[0078] It should be noted that in the embodiment of the present application, the basic attribute configuration information can be continuously adjusted according to user needs, and can be continuously adjusted even during the rendering process. Therefore, when rendering, it is necessary to render according to the current basic attribute configuration, that is, render according to the latest basic attribute configuration.

[0079] Therefore, optionally, in another embodiment of the present application, it may further include:

[0080] Whenever receiving a user's attribute configuration operation, responding to the user's current attribute configuration operation, the current basic attribute configuration is updated.

[0081] Therefore, after setting the initial current basic attribute configuration through attribute configuration operation, the user can perform attribute configuration operation according to the demand at any time to update the current basic attribute configuration.

[0082] Specifically, when rendering, the cursor on the timeline will continue to move from the initial position. During the movement, if the time point of its initial position reaches the operation start node of the trimming block of any multimedia material, the multimedia material will be rendered according to the current basic attribute configuration until the time point where the cursor of the timeline moves reaches the removal node of the trimming block of the multimedia material, so as to continuously render video files in a format that conforms to the current basic attribute configuration.

[0083] Alternatively, if Figure 2 As shown, usually when the cursor moves to the leftmost side of a trimmed block of a multimedia material, it is determined that the operation start node has been reached, and when the cursor moves to the rightmost side of a trimmed block of a multimedia material, it is determined that the node is large enough to be removed.

[0084] It should be noted that multiple multimedia materials may be rendered at the same time, so the priority of the track also needs to be considered to determine the layer for rendering and playback.

[0085] Optionally, in another embodiment of the present application, before rendering and outputting the multimedia data corresponding to the trimmed block of the multimedia material in real time based on the current basic attribute configuration and the priority of the track, further performing:

[0086] Determine whether the multimedia material belongs to the media type.

[0087] If it is determined that the multimedia material belongs to the media type, the multimedia data of the multimedia material is acquired, and the multimedia data corresponding to the trimmed block of the multimedia material is obtained.

[0088] Among them, media types include video, picture, audio, etc., but filters, etc. do not belong to it. Only multimedia of media type needs to obtain its multimedia data.

[0089] Optionally, in another embodiment of the present application, a specific implementation of step S103 is as follows: Figure 3 As shown, including:

[0090] S301. After the real-time rendering is started, the time point at which the cursor of the time axis moves is monitored in real time to see whether it reaches the operation start node of any trimming block of the multimedia material.

[0091] If the time point at which the cursor of the monitoring time axis moves reaches the operation start node of any trimming block of the multimedia material, step S302 is executed.

[0092] S302, controlling the player to render and output the multimedia data corresponding to the trimmed block of the multimedia material in the layer corresponding to the priority of the track where the trimmed block of the multimedia material is located in real time based on the current basic attribute configuration.

[0093] S303: monitor in real time whether the time point at which the cursor of the time axis moves reaches the removal node of the trimmed block of the multimedia material.

[0094] If the time point at which the cursor of the monitoring time axis moves reaches the removal node of the trimmed block of the multimedia material, step S304 is executed.

[0095] S304: Control the player to end rendering of the multimedia data corresponding to the trimmed blocks of the multimedia material.

[0096] Thus, the life cycle of multimedia materials can be managed through the timeline, for example, Figure 4 As shown, after the action starts, that is, after reaching the starting operation node, it is determined whether the multimedia material is of the media type. If it is of the media type, the multimedia data of the multimedia material is obtained. Then the player control is controlled by the player manager (TextureVeiw Manager) to make it perform the corresponding action. At the same time, it is determined whether the removal node is reached based on the timeline. If the removal node is not reached, it is waited until the removal node is reached, the current action is removed, and the next action is waited.

[0097] Optionally, in an embodiment of the present application, a specific implementation method of rendering and outputting multimedia data corresponding to a trimmed block of a multimedia material is as follows: Figure 5 As shown, including:

[0098] S501: Render multimedia data corresponding to the trimmed blocks of the multimedia material, and output the rendering results to a project file of the current target project.

[0099] In order to facilitate management and subsequent direct import of the entire project file, in an embodiment of the present application, the rendering result is output to the project file of the current target project.

[0100] S502: Push the project files of the current target project to the streaming media server in real time in a streaming manner, so as to play them in real time through the streaming media server.

[0101] S104. Whenever the user triggers a target operation at any time point on the timeline, respond to the target operation triggered by the user at that time point.

[0102] The target operation refers to an editing operation on a trimmed block of any multimedia material on the track of the current timeline or an operation on adding a trimmed block of multimedia material to the track of the timeline. Specifically, the editing operation on the trimmed block of multimedia material on the track may include operations such as cropping and removing. Figure 2 As shown, "Video2" and "Video4" were originally a trimmed block of a multimedia material, and the middle part was trimmed off by cropping, thereby trimming it into two trimmed blocks of multiple media materials.

[0103] Furthermore, since there are multiple tracks, there may be multiple temporal overlaps between target operations, and other cutouts may be projected on the time axis. Figure 2 As shown, there are 4 tracks, from bottom to top, track 1 contains two audios: Audio1 and Audio2; track 2 contains two videos: Video2 and Video4; track 3 contains two videos: Video1 and Video3; track 4 contains one picture: Image1; track 5 contains three subtitles: Subtitle1, Subtitle2, Subtitle3. Of course, the tracks are not limited to 5, and their number is not fixed, and can be increased according to demand. For the hierarchical relationship of the tracks, they increase from bottom to top. Generally, audio is at the bottom, subtitles are at the top, and pictures and videos are in the middle. Therefore, it can be seen that the various cutouts overlap in time, and accordingly, the target operations on the cutouts also overlap in time. The management of each cutout and target operation is managed through the timeline, that is, mapped to the unified time domain in time for management. Therefore, the output duration of each track is consistent with the timeline, that is, it is equal to the time point corresponding to the rightmost endpoint on the timeline minus the time point corresponding to the leftmost endpoint. The starting point of time on the left is usually 0, and the right side is set according to needs.

[0104] It should be noted that in the embodiment of the present application, step S104 can be executed at any time after step S102, and it is not necessarily executed after step S103. That is, after the multimedia material is mapped to the track, the trimming block of any multimedia material on the track can be edited at any time, or any multimedia material can be added. Editing can be performed even during the rendering process, that is, multimedia materials after the time point that has not been rendered can be edited or multimedia materials can be added while rendering is in progress.

[0105] The embodiment of the present application provides a multimedia rendering method, which obtains each multimedia material of the current target project, and maps each multimedia material of the current target project to the corresponding track of the timeline according to the material type to obtain the trimming block of each multimedia material. When performing the rendering action, for each trimming block of the multimedia material, when the time point at which the moving position of the cursor of the timeline reaches the operation start node of the trimming block of the multimedia material, the multimedia data corresponding to the trimming block of the multimedia material is rendered and output in real time based on the current basic attribute configuration and the priority of the track, until the time point at which the moving position of the cursor of the timeline reaches the removal node of the trimming block of the multimedia material. And in the whole process, whenever the user triggers the target operation at any time point of the timeline, the target operation triggered by the user is responded to at the time position point. Among them, the target operation refers to the editing operation of the trimming block of any multimedia material on the track of the current timeline or the operation of adding the trimming block of the multimedia material to the track of the timeline, so that the specified operation can be performed on the specified time position and the specified segment at any time, making rendering and editing more convenient. And it can present multiple multimedia materials, so it is not limited to a complete overall video.

[0106] Another embodiment of the present application provides a multimedia rendering device, such as Figure 6 As shown, including:

[0107] The material acquisition unit 601 is used to acquire various multimedia materials of the current target project.

[0108] The mapping unit 602 is used to map each multimedia material of the current target project to a corresponding track of the time axis according to the material type to obtain a trimmed block of each multimedia material.

[0109] The rendering unit 603 is used to render and output the multimedia data corresponding to the trimmed block of the multimedia material in real time based on the current basic attribute configuration and the priority of the track for each trimmed block of the multimedia material respectively, when the time point at which the moving position of the cursor of the timeline reaches the operation start node of the trimmed block of the multimedia material, until the time point at which the moving position of the cursor of the timeline reaches the removal node of the trimmed block of the multimedia material.

[0110] The editing unit 604 is used to respond to the target operation triggered by the user at a time point whenever the user triggers the target operation at any time point of the time axis. The target operation refers to the editing operation of any trimming block of multimedia material on the track of the current time axis or the operation of adding a trimming block of multimedia material on the track of the time axis.

[0111] Optionally, in another implementation of the multimedia rendering device provided in the present application, the present invention further includes:

[0112] The type determination unit is used to determine whether the multimedia material belongs to a media type.

[0113] The data acquisition unit is used to acquire multimedia data of the multimedia material when it is determined that the multimedia material belongs to the media type, and obtain multimedia data corresponding to the trimmed block of the multimedia material.

[0114] Optionally, in another embodiment of the present application, in the provided multimedia rendering device, the rendering unit comprises:

[0115] The first monitoring unit is used to monitor in real time whether the time point at which the cursor of the time axis moves reaches the operation start node of any trimming block of the multimedia material after the real-time rendering is started.

[0116] A rendering control unit is used to control the player to render and output the multimedia data corresponding to the trimmed block of the multimedia material in the layer corresponding to the priority of the track where the trimmed block of the multimedia material is located in real time based on the current basic attribute configuration when the time point at which the moving position of the cursor of the monitoring timeline reaches the operation start node of the trimmed block of any multimedia material.

[0117] The second monitoring unit is used to monitor in real time whether the time point at which the cursor of the time axis moves reaches the removal node of the trimmed block of the multimedia material.

[0118] The ending unit is used to control the player to end the rendering of the multimedia data corresponding to the trimmed block of the multimedia material when the time point at which the moving position of the cursor of the monitoring timeline reaches the removal node of the trimmed block of the multimedia material.

[0119] Optionally, in another embodiment of the present application, in the provided multimedia rendering device, the mapping unit comprises:

[0120] The mapping sub-unit is used to respond to the user's addition operations on each multimedia material of the current target project, and map out a trimmed block with a span consistent with the playback time of the multimedia material at a specified time point on a track of the timeline corresponding to the material type to which the specified multimedia material belongs, to obtain the trimmed blocks of each multimedia material.

[0121] Optionally, in another embodiment of the present application, in the provided multimedia rendering device, when the rendering unit performs rendering and outputting of multimedia data corresponding to the trimmed blocks of the multimedia material, it is used to:

[0122] The multimedia data corresponding to the trimmed blocks of the multimedia material are rendered, and the rendering results are output to the project file of the current target project.

[0123] Push the project files of the current target project to the streaming media server in real time in a streaming manner so as to play them in real time through the streaming media server.

[0124] Optionally, in another implementation of the multimedia rendering device provided in the present application, the present invention further includes:

[0125] The configuration updating unit is used to update the current basic attribute configuration in response to the user's current attribute configuration operation whenever receiving the user's attribute configuration operation.

[0126] It should be noted that the specific working process of each unit provided in the above embodiments of the present application can refer to the implementation process of the corresponding steps in the above method embodiments, and will not be repeated here.

[0127] Another embodiment of the present application provides an electronic device, such as Figure 7 As shown, including:

[0128] Memory 701 and processor 702 .

[0129] The memory 701 is used to store programs.

[0130] The processor 702 is used to execute the program stored in the memory 701. When the program is executed, it is specifically used to implement the multimedia rendering method provided in any one of the above embodiments.

[0131] Another embodiment of the present application provides a computer storage medium for storing a computer program. When the computer program is executed by a processor, it is used to implement the multimedia rendering method provided in any of the above embodiments.

[0132] Computer storage media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0133] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0134] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A multimedia rendering method, characterized in that: include: Get various multimedia materials of the current target project; Mapping each of the multimedia materials of the current target project to a track of a corresponding timeline according to the material type to obtain a trimmed block of each of the multimedia materials; For each trimmed block of the multimedia material, when the time point at which the cursor of the time axis moves reaches the operation start node of the trimmed block of the multimedia material, the multimedia data corresponding to the trimmed block of the multimedia material is rendered and output in real time based on the current basic attribute configuration and the priority of the track, until the time point at which the cursor of the time axis moves reaches the removal node of the trimmed block of the multimedia material; Whenever the user triggers a target operation at any time point on the timeline, respond to the target operation triggered by the user at the time point; wherein the target operation refers to an editing operation on any trimming block of the multimedia material on the track of the current timeline or an operation of adding a trimming block of multimedia material to the track of the timeline.

2. The method according to claim 1, characterized in that Before rendering and outputting the multimedia data corresponding to the trimmed block of the multimedia material in real time based on the current basic attribute configuration and the priority of the track, the method further includes: Determining whether the multimedia material belongs to a media type; If it is determined that the multimedia material belongs to the media type, the multimedia data of the multimedia material is acquired, and the multimedia data corresponding to the trimmed block of the multimedia material is obtained.

3. The method according to claim 1, characterized in that For each trimmed block of the multimedia material, when the time point at which the moving position of the cursor of the time axis reaches the operation start node of the trimmed block of the multimedia material, the multimedia data corresponding to the trimmed block of the multimedia material is rendered and output in real time based on the current basic attribute configuration and the priority of the track, until the time point at which the moving position of the cursor of the time axis reaches the removal node of the trimmed block of the multimedia material, including: After the real-time rendering is started, the time point at which the cursor of the time axis moves is monitored in real time to see whether it reaches the operation start node of any trimming block of the multimedia material; If the time point at which the cursor moving position of the monitoring time axis reaches the operation start node of any trimming block of the multimedia material, the player is controlled to render and output the multimedia data corresponding to the trimming block of the multimedia material in the layer corresponding to the priority of the track where the trimming block of the multimedia material is located in real time based on the current basic attribute configuration; Real-time monitoring of whether the time point at which the cursor of the time axis moves reaches a removal node of the trimmed block of the multimedia material; If the time point at which the cursor moving position of the time axis is monitored reaches the removal node of the trimmed block of the multimedia material, the player is controlled to end the rendering of the multimedia data corresponding to the trimmed block of the multimedia material.

4. The method according to claim 1, characterized in that The step of mapping each of the multimedia materials of the current target project to a track of a corresponding timeline according to the material type to obtain a trimmed block of each of the multimedia materials includes: In response to the user's addition operation on each of the multimedia materials of the current target project, a trimmed block with a span consistent with the playback time of the multimedia material is mapped out at a specified time point on a track of the timeline corresponding to the material type to which the specified multimedia material belongs, to obtain a trimmed block of each of the multimedia materials.

5. The method according to claim 1, characterized in that The rendering and outputting of multimedia data corresponding to the trimmed blocks of the multimedia material includes: Rendering the multimedia data corresponding to the trimmed blocks of the multimedia material, and outputting the rendering result to the project file of the current target project; The project files of the current target project are pushed to the streaming media server in real time in a streaming manner so as to be played in real time through the streaming media server.

6. The method according to claim 1, characterized in that Also includes: Whenever an attribute configuration operation of the user is received, the current basic attribute configuration is updated in response to the current attribute configuration operation of the user.

7. A multimedia rendering device, characterized in that: include: A material acquisition unit, used to acquire various multimedia materials of the current target project; A mapping unit, used to map each of the multimedia materials of the current target project to a track of a corresponding timeline according to the material type to obtain a trimmed block of each of the multimedia materials; a rendering unit, for rendering and outputting, respectively, for each trimmed block of the multimedia material, multimedia data corresponding to the trimmed block of the multimedia material based on the current basic attribute configuration and the priority of the track when the time point at which the cursor of the time axis moves reaches the operation start node of the trimmed block of the multimedia material, until the time point at which the cursor of the time axis moves reaches the removal node of the trimmed block of the multimedia material; An editing unit, used for responding to the target operation triggered by the user at any time point of the time axis whenever the target operation is triggered by the user at the time point; wherein the target operation refers to an editing operation on any trimming block of the multimedia material on the track of the current time axis or an operation of adding a trimming block of multimedia material to the track of the time axis.

8. The device according to claim 7, characterized in that Also includes: A type determination unit, used to determine whether the multimedia material belongs to a media type; The data acquisition unit is used to acquire multimedia data of the multimedia material when it is determined that the multimedia material belongs to the media type, and obtain multimedia data corresponding to the trimmed block of the multimedia material.

9. An electronic device, characterized in that: include: Memory and processor; Wherein, the memory is used to store programs; The processor is used to execute the program, and when the program is executed, it is specifically used to implement the multimedia rendering method according to any one of claims 1 to 6.

10. A computer storage medium, characterized in that: Used to store a computer program, which, when executed by a processor, is used to implement the multimedia rendering method according to any one of claims 1 to 6.

Images