Video rendering method and apparatus, electronic device and storage medium

Abstract

Embodiments of the present disclosure provide a video rendering method and apparatus, an electronic device and a storage medium. The method comprises: in response to reception of a sequence adjustment operation of editing tracks where editing materials are located, acquiring a preview position of the video editing effect, and determining a plurality of editing materials corresponding to the preview position, wherein the plurality of editing materials are located on a plurality of different editing tracks in a video editing interface, respectively; on the basis of an arrangement sequence of the plurality of different editing tracks, determining rendering levels respectively corresponding to the plurality of editing materials, wherein the rendering levels are used for representing the rendering priorities of the editing materials; and on the basis of the rendering levels respectively corresponding to the plurality of editing materials, rendering the plurality of editing materials to obtain the video editing effect at the preview position.

Description

Video rendering method, device, electronic device and storage medium

[0001] This application claims priority to Chinese Patent Application No. 202311266403.6 filed on September 27, 2023, and the contents of the above-mentioned Chinese patent application disclosure are hereby incorporated by reference in their entirety as a part of this application. Technical Field

[0002] Embodiments of the present disclosure relate to a video rendering method, apparatus, electronic device, and storage medium. Background Art

[0003] Currently, the multiple editing tracks in the video editing interface correspond to different rendering levels. By adjusting the rendering level of the editing track, you can adjust the display priority of the video material, thereby improving the rendering effect of the video.

[0004] Summary of the Invention

[0005] At least one embodiment of the present disclosure provides a video rendering method, apparatus, electronic device, and storage medium, which can increase the rendering freedom of editing materials and thereby improve user experience.

[0006] In a first aspect, an embodiment of the present disclosure provides a video rendering method, comprising:

[0007] In response to receiving an operation to adjust the order of the editing tracks where the editing materials are located, obtaining a preview position of the video editing effect, and determining a plurality of editing materials corresponding to the preview position, wherein the plurality of editing materials are respectively located on a plurality of different editing tracks in the video editing interface;

[0008] Determining, according to the arrangement order of the multiple different editing tracks, a rendering level corresponding to each of the multiple editing materials, wherein the rendering level is used to indicate a rendering priority of the editing material;

[0009] The multiple editing materials are rendered according to the rendering levels corresponding to the multiple editing materials to obtain the video editing effect at the preview position.

[0010] In a second aspect, an embodiment of the present disclosure provides a video rendering device, comprising:

[0011] an acquisition module configured to, in response to receiving an operation to adjust the order of the editing tracks where the editing materials are located, acquire a preview position of the video editing effect and determine a plurality of editing materials corresponding to the preview position, wherein the plurality of editing materials are respectively located on a plurality of different editing tracks in the video editing interface;

[0012] a determining module configured to determine, according to the arrangement order of the multiple different editing tracks, a rendering level corresponding to each of the multiple editing materials, wherein the rendering level is used to represent a rendering priority of the editing material;

[0013] The rendering module is configured to render the multiple editing materials according to the rendering levels corresponding to the multiple editing materials to obtain the video editing effect at the preview position.

[0014] In a third aspect, an embodiment of the present disclosure provides an electronic device, including:

[0015] at least one processor, and a memory communicatively coupled to the at least one processor;

[0016] The memory stores computer-executable instructions;

[0017] The at least one processor executes the computer-executable instructions stored in the memory to implement the video rendering method as described in the first aspect above.

[0018] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions. When at least one processor executes the computer-executable instructions, the video rendering method described in the first aspect above is implemented.

[0019] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by at least one processor, implements the video rendering method described in the first aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present disclosure rather than all embodiments. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0021] FIG1 is a schematic diagram of a video editing interface provided by an embodiment of the present disclosure;

[0022] FIG2 is a flow chart of a video rendering method provided by an embodiment of the present disclosure;

[0023] FIG3 is a schematic diagram of a video rendering method provided by an embodiment of the present disclosure;

[0024] FIG4 is a flowchart of another video rendering method provided by an embodiment of the present disclosure;

[0025] FIG5 is a schematic diagram of another video rendering method provided by an embodiment of the present disclosure;

[0026] FIG6 is a structural block diagram of a video rendering device provided by an embodiment of the present disclosure;

[0027] FIG7 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0028] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0029] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0030] Currently, for multiple editing tracks in the video editing interface, different editing tracks correspond to different rendering levels. By adjusting the rendering level of the editing track, you can adjust the display priority of the video material, thereby improving the video rendering effect.

[0031] In some video rendering methods, the multiple editing tracks in the video editing interface may include video tracks, text tracks, sticker tracks, and so on. The video track has the highest rendering level, meaning that the video assets are rendered first, followed by text assets, sticker assets, and so on. However, because the video track has the highest rendering level, text assets, sticker assets, and so on can only be displayed above the video assets, resulting in limited rendering flexibility for multiple editing assets and affecting the user experience.

[0032] It can be seen that how to improve the rendering freedom of editing materials to enhance user experience is an urgent problem that needs to be solved.

[0033] In order to solve the above problems, the embodiments of the present disclosure provide the following technical concepts: First, in response to receiving a sequence adjustment operation of the editing track where the editing material is located, the preview position of the video editing effect is obtained, and multiple editing materials corresponding to the preview position are determined, wherein the multiple editing materials are respectively located on multiple different editing tracks in the video editing interface; then, according to the arrangement order of the multiple different editing tracks, the rendering level corresponding to each of the multiple editing materials is determined, wherein the rendering level is used to represent the rendering priority of the editing material; finally, according to the rendering level corresponding to each of the multiple editing materials, the multiple editing materials are rendered to obtain the video editing effect at the preview position. That is, according to the arrangement order of the multiple different editing tracks, the rendering level corresponding to each of the multiple editing materials is determined, and the rendering levels of the multiple editing tracks can be adjusted at will. In this way, text materials, sticker materials, etc. can be displayed above or below the video material, thereby improving the rendering freedom of the editing material and thus improving the user experience.

[0034] The application scenario of the embodiment of the present disclosure is explained below: The video rendering method provided by the embodiment of the present disclosure can be applied to the scenario of adjusting the rendering level of the editing material. Figure 1 is a schematic diagram of a video editing interface provided by the embodiment of the present disclosure. As shown in Figure 1, the video editing interface includes multiple editing materials, namely video clip 1, video clip 2 and text 1. In this embodiment, the track types of video clip 1, video clip 2 and text 1 are all the same preset track type, so that text 1 can be moved to the bottom of video clip 2, and then the rendering level of text 1 and video clip 2 can be adjusted. That is, text 1 and the like can be displayed above video clip 2 or below video clip 2. The video rendering method provided by the embodiment of the present disclosure is described in detail below with reference to the illustrative embodiments.

[0035] FIG2 is a flow chart of a video rendering method provided by an embodiment of the present disclosure. The execution subject of this method can be a terminal or a server. The present disclosure embodiment uses the execution subject as an example to illustrate. As shown in FIG2, an embodiment of this method may include:

[0036] S201. In response to receiving a sequence adjustment operation of an editing track where an editing material is located, obtaining a preview position of a video editing effect, and determining a plurality of editing materials corresponding to the preview position, wherein the plurality of editing materials are respectively located on a plurality of different editing tracks in a video editing interface.

[0037] In the embodiment of the present disclosure, the sequence adjustment operation may be any operation related to the sequence of editing tracks. Optionally, the sequence adjustment operation may include an operation of adjusting the position of editing tracks and / or an operation of adding editing tracks.

[0038] In the disclosed embodiment, one editing material corresponds to one playback time period. If the preview position of the video editing effect is within the playback time period of the editing material, then the editing material is the editing material corresponding to the preview position. Accordingly, one possible implementation of this step includes: obtaining multiple candidate editing materials in the video editing interface, and for each candidate editing material, if the preview position is within the playback time period of the candidate editing material, determining that the candidate editing material is the editing material corresponding to the preview position.

[0039] Optionally, multiple candidate editing materials in the video editing interface can be obtained through the material identifier of the editing material. It should be noted that the multiple editing materials do not include audio materials. Accordingly, before obtaining multiple candidate editing materials, the material identifier corresponding to the audio material can be modified to another identifier. Optionally, the other identifier is a filter identifier. Exemplarily, the material identifier can be represented by clipID, and the filter identifier can be represented by filterID, that is, the clipID corresponding to the audio material is modified to filterID. In this way, it is possible to avoid obtaining the audio material in the video editing interface.

[0040] S202 : Determine rendering levels corresponding to the multiple editing materials according to the arrangement order of the multiple different editing tracks, where the rendering level is used to indicate the rendering priority of the editing materials.

[0041] In the disclosed embodiment, one possible implementation of this step includes: determining the sequence number of each editing track in the sequence according to the sequence of the multiple different editing tracks; determining the sequence number of the editing track in the sequence as the rendering level of the editing material on the editing track, and obtaining the rendering level corresponding to each of the multiple editing materials. Optionally, the sequence number of the editing track in the sequence can be represented by trackindex, and the rendering level of the editing material can be represented by track_render_index.

[0042] For example, as shown in Figure 3, multiple editing materials include: Video Clip 1, Video Clip 2, and Text 1. In traditional mode, the rendering level of each editing material is determined by setting the rendering level parameter (renderIndex). The rendering level parameter of Video Clip 1 is set to 1001, the rendering level parameter of Video Clip 2 is set to 1002, and the rendering level parameter of Text 1 is set to 1003. In this way, Text 1 is located above Video Clip 2, and Video Clip 2 is located above Video Clip 1.

[0043] In the free level mode provided in this embodiment, the sequence number of the editing track in the arrangement order is determined as the rendering level of the editing material on the editing track. As shown in Figure 3, in the arrangement order of the editing tracks, the sequence numbers of video clip 1, video clip 2, and text 1 are 1, 2, and 3, respectively. Correspondingly, the rendering level of video clip 1 is 1 (Track_render_Index = 1 in Figure 3), the rendering level of video clip 2 is 2 (Track_render_Index = 2 in Figure 3), and the rendering level of text 1 is 3 (Track_render_Index = 3 in Figure 3).

[0044] It should be noted that, when the video rendering mode is the free hierarchy mode, the method of this embodiment may further include: pre-converting the track types of multiple different editing tracks into the same preset track type. In this way, the arrangement order of the editing tracks can be freely adjusted.

[0045] In the disclosed embodiment, the preset track type can be a video track. For example, the multiple editing materials include: video clip 1, special effect 1, and text 1. The track types of video clip 1, special effect 1, and text 1 are all set to video track. For example, the special effect track can be represented by EffectTrack, and the video track can be represented by VideoTrack. In this case, the track type of special effect 1 is converted from EffectTrack to VideoTrack.

[0046] In an embodiment of the present disclosure, the user can also switch the video rendering mode through a switching operation. The video rendering mode may include, for example, a free hierarchy mode and a non-free hierarchy mode. Exemplarily, the switching operation may be a click operation on a switch button corresponding to the free hierarchy. Optionally, in response to receiving a switching operation of the video rendering mode, the mode interface information corresponding to the video rendering mode is obtained; if the mode interface information is a first interface identifier, the video rendering mode is determined to be a free hierarchy mode; if the mode interface information is a second interface identifier, the video rendering mode is determined to be a non-free hierarchy mode.

[0047] Exemplarily, the mode interface information is: render_index_track_mode_on interface. The first interface identifier is true, and the second interface identifier is false. If the mode interface information corresponding to the render_index_track_mode_on interface is true, the video rendering mode is determined to be free-level mode. If the mode interface information corresponding to the render_index_track_mode_on interface is false, the video rendering mode is determined to be non-free-level mode.

[0048] S203 : Render the multiple editing materials according to the rendering levels corresponding to the multiple editing materials to obtain a video editing effect at a preview position.

[0049] Optionally, according to the rendering levels corresponding to the multiple editing materials, the multiple editing materials are rendered in sequence from small to large rendering levels to obtain the video editing effect at the preview position.

[0050] For example, as shown in Figure 3, video clip 1, video clip 2, and text 1 are rendered in ascending order of rendering level. The edited material rendered later is placed above the edited material rendered earlier. That is, text 1 is placed above video clip 2, and video clip 2 is placed above video clip 1.

[0051] The disclosed embodiment provides a video rendering method: in response to receiving a sequence adjustment operation of an editing track where an editing material is located, obtaining a preview position of a video editing effect, and determining a plurality of editing materials corresponding to the preview position, wherein the plurality of editing materials are respectively located on a plurality of different editing tracks in a video editing interface; determining a rendering level corresponding to each of the plurality of editing materials according to the arrangement order of the plurality of different editing tracks, wherein the rendering level is used to represent the rendering priority of the editing material; rendering the plurality of editing materials according to the rendering level corresponding to each of the plurality of editing materials to obtain a video editing effect at the preview position. In the disclosed embodiment, since the rendering level corresponding to each of the plurality of editing materials is determined according to the arrangement order of the plurality of different editing tracks, the rendering levels of the plurality of editing tracks can be adjusted at will, so that text materials, sticker materials, etc. can be displayed above or below the video material, thereby improving the rendering freedom of the editing material and thus improving the user experience.

[0052] It should be noted that the user can also adjust the rendering effect of the material. In this case, the video editing interface can also include an adjustment track for adjusting the rendering effect. The adjustment track can adjust the rendering effect of the edited material. Accordingly, as shown in FIG4 , the method further includes:

[0053] S401: Determine the rendering level corresponding to the adjustment track.

[0054] In an embodiment of the present disclosure, the adjustment track may include multiple rendering adjustment parameters. Optionally, the rendering adjustment parameters include one or more of color temperature, hue, saturation, brightness, contrast, shadows, and highlights.

[0055] In this case, the rendering level corresponding to the adjustment track includes sub-rendering levels corresponding to multiple rendering adjustment parameters. In order to solve the problem that one adjustment track corresponds to multiple sub-rendering levels, the rendering level corresponding to the adjustment track can be amplified. Accordingly, this step is: for each adjustment track, determine the track level of the adjustment track, and determine the track level of the adjustment track as the rendering level corresponding to the adjustment track; according to the first number of multiple rendering adjustment parameters included in the adjustment track, amplify the rendering level of the adjustment track to obtain a plurality of sub-rendering levels of the same number as the first number, wherein the end serial numbers of the multiple sub-rendering levels are different; and determine the sub-rendering levels corresponding to the multiple rendering adjustment parameters in order from small to large according to the end serial numbers of the multiple sub-rendering levels.

[0056] Exemplarily, the magnification of the amplification process is 100 times. The number of rendering adjustment parameters includes color temperature, hue, saturation, brightness, contrast, shadows and highlights. At this time, the number of rendering adjustment parameters is 7. The rendering level corresponding to the adjustment track is 2. The rendering level of the adjustment track is amplified to obtain 7 sub-rendering levels, namely: 201, 202, 203, 204, 205, 206 and 207, where the end serial numbers of the multiple sub-rendering levels are different. According to the order of the end serial numbers from small to large, the sub-rendering level corresponding to color temperature is determined to be 201, the sub-rendering level corresponding to hue is 202, the sub-rendering level corresponding to saturation is 203, the sub-rendering level corresponding to brightness is 204, the sub-rendering level corresponding to contrast is 205, the sub-rendering level corresponding to shadows is 206, and the sub-rendering level corresponding to highlights is 207.

[0057] S402 : Select at least one target editing material having a rendering level smaller than the rendering level corresponding to the adjustment track from the multiple editing materials according to the rendering level corresponding to the adjustment track and the rendering levels corresponding to the multiple editing materials.

[0058] For example, the multiple editing materials include video clip 1, video clip 2, and text 1. The corresponding rendering levels for video clip 1, video clip 2, and text 1 are 1, 3, and 4, respectively. If the rendering level corresponding to the adjustment track is 2, the target editing material selected from the multiple editing materials with a rendering level less than 2 is video clip 1.

[0059] It should be noted that in one possible implementation, for multiple sub-rendering levels, whether an editing material is the target editing material is determined by comparing the rendering level of the editing material with the first digit of the sub-rendering level. For example, the sub-rendering level corresponding to color temperature is 201, and the first digit is 2. In this case, if the rendering level 1 of video clip 1 is less than 2, then video clip 1 is the target editing material. If the rendering level 1 of video clip 2 and text 1 is 3 and 4, respectively, both greater than 2, then video clip 2 and text 1 are not the target editing material.

[0060] S403: Adjust the rendering effect of at least one target editing material by adjusting the track.

[0061] Optionally, a possible implementation of this step includes: adjusting a rendering effect of at least one target editing material by adjusting a plurality of rendering adjustment parameters included in the track.

[0062] Here, if the rendering level is not amplified, multiple rendering adjustment parameters cannot be inserted between rendering level 2 and rendering level 3. The embodiment of the present disclosure sets multiple sub-rendering levels to achieve the adjustment of the rendering effect of the target editing material through multiple rendering adjustment parameters, thereby further improving the rendering freedom of the editing material.

[0063] It should be noted that in free-level mode, multiple editing tracks have the same track type. To avoid confusion between different types of editing materials during transitions, it is necessary to identify two editing materials to be transitioned. Accordingly, in one possible implementation, the method may further include: in response to receiving a transition operation for an editing material, determining a first material identifier of a first editing material before the transition and a second material identifier of a second editing material after the transition; and transitioning the first editing material to the second editing material based on the first material identifier and the second material identifier.

[0064] The material identifier is used to distinguish different editing materials. Optionally, the material identifier is the material type and material sequence number. For example, the material identifier can be video material 1, video material 2, or text 1.

[0065] Another point worth noting is that if multiple sub-editing materials are displayed on an editing track, the positions of the sub-editing materials can be swapped using a temporary editing track. Accordingly, in one possible implementation, the method may further include: in response to receiving an operation to swap the positions of a first sub-editing material and a second sub-editing material, creating a temporary editing track; transferring the second sub-editing material to the temporary editing track, adjusting the position of the first sub-editing material to the position of the second sub-editing material; and transferring the second sub-editing material from the temporary editing track to the position of the first sub-editing material.

[0066] For example, as shown in Figure 5, multiple sub-editing materials are displayed on the editing track, including: Material A, Material B, and Material C. When the positions of Materials A and B are swapped, Material A can be transferred to the temporary editing track, and then the position of Material B can be adjusted to the position of Material A, and then Material A can be transferred from the temporary editing track to the position of Material B.

[0067] Here, since the track level of the editing material is consistent with the rendering level of the editing material, the rendering levels of multiple sub-editing materials on the same editing track are the same. In this case, if the positions of the sub-editing materials are swapped, the changes in the rendering level can be avoided by creating a temporary editing track, thereby further improving the rendering freedom of the editing material.

[0068] Another point worth noting is that in free-level mode, when exporting a video using multiple edited materials, the playback duration of the exported video is determined by the edited material with the longest playback duration. Accordingly, in one possible implementation, the method may further include: determining the playback duration corresponding to each edited material in response to the video export operation; and determining the longest playback duration as the playback duration of the exported video corresponding to the multiple edited materials.

[0069] For example, the multiple editing materials include video clip 1, video clip 2, and text 1. The playback time of video clip 1 is 2 minutes, the playback time of video clip 2 is 1 minute, and the playback time of text 1 is 30 seconds. Then, the maximum playback time (2 minutes) is determined as the playback time of the exported video corresponding to the multiple editing materials.

[0070] In the disclosed embodiment, if the video rendering mode is the free-level mode, the time interface of the non-free-level mode needs to be discarded. Optionally, the time interface of the non-free-level mode includes: a set duration interface (setDuration interface) and a get duration interface (getDuration interface). In other words, the setDuration interface and the getDuration interface need to be discarded.

[0071] FIG6 is a structural block diagram of a video rendering apparatus provided by an embodiment of the present disclosure. Referring to FIG6 , the video rendering apparatus may include: an acquisition module 601 , a determination module 602 , and a rendering module 603 .

[0072] an acquisition module 601 configured to, in response to receiving an operation to adjust the order of the editing tracks where the editing materials are located, acquire a preview position of the video editing effect and determine a plurality of editing materials corresponding to the preview position, wherein the plurality of editing materials are respectively located on a plurality of different editing tracks in the video editing interface;

[0073] A determination module 602 is configured to determine a rendering level corresponding to each of the plurality of editing materials according to an arrangement order of the plurality of different editing tracks, wherein the rendering level is used to indicate a rendering priority of the editing material;

[0074] The rendering module 603 is configured to render the multiple editing materials according to the rendering levels corresponding to the multiple editing materials, so as to obtain the video editing effect at the preview position.

[0075] According to one or more embodiments of the present disclosure, when determining the rendering levels corresponding to each of the multiple editing materials according to the arrangement order of the multiple different editing tracks, the determination module 602 can be configured to: determine the serial number of each of the editing tracks in the arrangement order according to the multiple different editing tracks; determine the serial number of the editing track in the arrangement order as the rendering level of the editing material on the editing track, and obtain the rendering level corresponding to each of the multiple editing materials.

[0076] According to one or more embodiments of the present disclosure, the video rendering mode is a free-level mode; accordingly, the device further includes: a conversion module; the conversion module is configured to convert the track types of the multiple different editing tracks into the same preset track type.

[0077] According to one or more embodiments of the present disclosure, the conversion module is further configured to obtain mode interface information corresponding to the video rendering mode in response to receiving a switching operation of the video rendering mode; if the mode interface information is a first interface identifier, the video rendering mode is determined to be a free hierarchy mode; if the mode interface information is a second interface identifier, the video rendering mode is determined to be a non-free hierarchy mode.

[0078] According to one or more embodiments of the present disclosure, the video editing interface also includes an adjustment track for adjusting the rendering effect; the device also includes: an adjustment module; the adjustment module is configured to determine the rendering level corresponding to the adjustment track; according to the rendering level corresponding to the adjustment track and the rendering levels corresponding to the multiple editing materials, at least one target editing material whose rendering level is smaller than the rendering level corresponding to the adjustment track is selected from the multiple editing materials; and the rendering effect of the at least one target editing material is adjusted through the adjustment track.

[0079] According to one or more embodiments of the present disclosure, the adjustment track includes multiple rendering adjustment parameters, and the rendering level corresponding to the adjustment track includes multiple sub-rendering levels corresponding to each of the rendering adjustment parameters; accordingly, the adjustment module is further configured to: for each adjustment track, determine the track level of the adjustment track, and determine the track level of the adjustment track as the rendering level corresponding to the adjustment track; according to a first number of the multiple rendering adjustment parameters included in the adjustment track, amplify the rendering level of the adjustment track to obtain a plurality of sub-rendering levels of the same number as the first number, wherein the end serial numbers of the multiple sub-rendering levels are different; and determine the sub-rendering levels corresponding to each of the multiple rendering adjustment parameters in ascending order of the end serial numbers of the multiple sub-rendering levels.

[0080] According to one or more embodiments of the present disclosure, the device also includes: a transition module; the transition module is configured to determine a first material identifier of a first editing material before the transition and a second material identifier of a second editing material after the transition in response to receiving a transition operation for at least two editing materials among the multiple editing materials; and transition the first editing material to the second editing material based on the first material identifier and the second material identifier.

[0081] According to one or more embodiments of the present disclosure, multiple sub-editing materials are displayed on the editing track; the device also includes: a position adjustment module; the position adjustment module is configured to create a temporary editing track in response to receiving a position exchange operation for a first sub-editing material and a second sub-editing material; transfer the second sub-editing material to the temporary editing track, adjust the position of the first sub-editing material to the position of the second sub-editing material; and transfer the second sub-editing material from the temporary editing track to the position of the first sub-editing material.

[0082] According to one or more embodiments of the present disclosure, the device also includes: an export module; the export module is configured to determine the playback time corresponding to each editing material in response to a video export operation; and determine the maximum playback time as the playback time of the exported video corresponding to the multiple editing materials.

[0083] In the embodiment of the present disclosure, the acquisition module 601, the determination module 602, and the rendering module 603 are connected in sequence. The video rendering device provided in this embodiment can implement the technical solution of the above method embodiment, and its implementation principle and technical effect are similar to those of the above method embodiment, which will not be repeated here.

[0084] FIG7 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. Referring to FIG7 , the electronic device 700 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG7 is merely an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0085] As shown in FIG7 , the electronic device 700 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. Various programs and data required for the operation of the electronic device 700 are also stored in the RAM 703. The processing device 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0086] Typically, the following devices may be connected to the I / O interface 705: an input device 706 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 708 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 709. The communication device 709 may allow the electronic device 700 to communicate with other devices wirelessly or by wire to exchange data. Although FIG. 7 shows an electronic device 700 having various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0087] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 709, or installed from the storage device 708, or installed from the ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0088] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0089] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0090] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0091] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0092] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0093] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0094] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0095] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0096] In a first aspect, according to one or more embodiments of the present disclosure, a video rendering method is provided, the method comprising:

[0097] In response to receiving an operation to adjust the order of the editing tracks where the editing materials are located, obtaining a preview position of the video editing effect, and determining a plurality of editing materials corresponding to the preview position, wherein the plurality of editing materials are respectively located on a plurality of different editing tracks in the video editing interface;

[0098] Determining, according to the arrangement order of the multiple different editing tracks, a rendering level corresponding to each of the multiple editing materials, wherein the rendering level is used to indicate a rendering priority of the editing material;

[0099] The multiple editing materials are rendered according to the rendering levels corresponding to the multiple editing materials to obtain the video editing effect at the preview position.

[0100] According to one or more embodiments of the present disclosure, determining the rendering level corresponding to each of the multiple editing materials according to the arrangement order of the multiple different editing tracks includes: determining the serial number of each of the editing tracks in the arrangement order according to the multiple different editing tracks; determining the serial number of the editing track in the arrangement order as the rendering level of the editing material on the editing track, to obtain the rendering level corresponding to each of the multiple editing materials.

[0101] According to one or more embodiments of the present disclosure, the video rendering mode is a free level mode; accordingly, before determining the rendering levels corresponding to the multiple editing materials according to the arrangement order of the multiple different editing tracks, it also includes: converting the track types of the multiple different editing tracks into the same preset track type.

[0102] According to one or more embodiments of the present disclosure, it also includes: in response to receiving a switching operation of a video rendering mode, obtaining mode interface information corresponding to the video rendering mode; if the mode interface information is a first interface identifier, determining that the video rendering mode is a free hierarchy mode; if the mode interface information is a second interface identifier, determining that the video rendering mode is a non-free hierarchy mode.

[0103] According to one or more embodiments of the present disclosure, the video editing interface also includes an adjustment track for adjusting the rendering effect; the method also includes: determining the rendering level corresponding to the adjustment track; according to the rendering level corresponding to the adjustment track and the rendering levels corresponding to the multiple editing materials, selecting at least one target editing material from the multiple editing materials whose rendering level is smaller than the rendering level corresponding to the adjustment track; and adjusting the rendering effect of the at least one target editing material through the adjustment track.

[0104] According to one or more embodiments of the present disclosure, the adjustment track includes multiple rendering adjustment parameters, and the rendering level corresponding to the adjustment track includes multiple sub-rendering levels corresponding to each of the rendering adjustment parameters; accordingly, determining the rendering level corresponding to the adjustment track includes: for each adjustment track, determining the track level of the adjustment track, and determining the track level of the adjustment track as the rendering level corresponding to the adjustment track; according to a first number of the multiple rendering adjustment parameters included in the adjustment track, amplifying the rendering level of the adjustment track to obtain a plurality of sub-rendering levels of the same number as the first number, wherein the end serial numbers of the multiple sub-rendering levels are different; and determining the sub-rendering levels corresponding to each of the multiple rendering adjustment parameters in ascending order of the end serial numbers of the multiple sub-rendering levels.

[0105] According to one or more embodiments of the present disclosure, the method further includes: in response to receiving a transition operation for at least two editing materials among the multiple editing materials, determining a first material identifier of a first editing material before the transition and a second material identifier of a second editing material after the transition; and transitioning the first editing material to the second editing material according to the first material identifier and the second material identifier.

[0106] According to one or more embodiments of the present disclosure, multiple sub-editing materials are displayed on the editing track; the method also includes: creating a temporary editing track in response to receiving a position exchange operation for a first sub-editing material and a second sub-editing material; transferring the second sub-editing material to the temporary editing track, adjusting the position of the first sub-editing material to the position of the second sub-editing material; and transferring the second sub-editing material from the temporary editing track to the position of the first sub-editing material.

[0107] According to one or more embodiments of the present disclosure, the method further includes: determining the playback duration corresponding to each editing material in response to a video export operation; and determining the maximum playback duration as the playback duration of the exported video corresponding to the multiple editing materials.

[0108] In a second aspect, according to one or more embodiments of the present disclosure, a video rendering apparatus is provided, the apparatus comprising:

[0109] an acquisition module configured to, in response to receiving an operation to adjust the order of the editing tracks where the editing materials are located, acquire a preview position of the video editing effect and determine a plurality of editing materials corresponding to the preview position, wherein the plurality of editing materials are respectively located on a plurality of different editing tracks in the video editing interface;

[0110] a determining module configured to determine, according to the arrangement order of the multiple different editing tracks, a rendering level corresponding to each of the multiple editing materials, wherein the rendering level is used to represent a rendering priority of the editing material;

[0111] The rendering module is configured to render the multiple editing materials according to the rendering levels corresponding to the multiple editing materials to obtain the video editing effect at the preview position.

[0112] According to one or more embodiments of the present disclosure, the determination module is configured to determine the rendering level corresponding to each of the multiple editing materials according to the arrangement order of the multiple different editing tracks as follows: determine the serial number of each of the editing tracks in the arrangement order according to the multiple different editing tracks; determine the serial number of the editing track in the arrangement order as the rendering level of the editing material on the editing track, and obtain the rendering level corresponding to each of the multiple editing materials.

[0113] According to one or more embodiments of the present disclosure, the video rendering mode is a free-level mode; accordingly, the device further includes: a conversion module; the conversion module is configured to convert the track types of the multiple different editing tracks into the same preset track type.

[0114] According to one or more embodiments of the present disclosure, the conversion module is further configured to obtain mode interface information corresponding to the video rendering mode in response to receiving a switching operation of the video rendering mode; if the mode interface information is a first interface identifier, the video rendering mode is determined to be a free hierarchy mode; if the mode interface information is a second interface identifier, the video rendering mode is determined to be a non-free hierarchy mode.

[0115] According to one or more embodiments of the present disclosure, the video editing interface also includes an adjustment track for adjusting the rendering effect; the device also includes: an adjustment module; the adjustment module is configured to determine the rendering level corresponding to the adjustment track; according to the rendering level corresponding to the adjustment track and the rendering levels corresponding to the multiple editing materials, at least one target editing material whose rendering level is smaller than the rendering level corresponding to the adjustment track is selected from the multiple editing materials; and the rendering effect of the at least one target editing material is adjusted through the adjustment track.

[0116] According to one or more embodiments of the present disclosure, the adjustment track includes multiple rendering adjustment parameters, and the rendering level corresponding to the adjustment track includes multiple sub-rendering levels corresponding to each of the rendering adjustment parameters; accordingly, the adjustment module is configured to: for each adjustment track, determine the track level of the adjustment track, and determine the track level of the adjustment track as the rendering level corresponding to the adjustment track; according to a first number of the multiple rendering adjustment parameters included in the adjustment track, amplify the rendering level of the adjustment track to obtain a plurality of sub-rendering levels of the same number as the first number, wherein the end serial numbers of the multiple sub-rendering levels are different; and determine the sub-rendering levels corresponding to each of the multiple rendering adjustment parameters in ascending order of the end serial numbers of the multiple sub-rendering levels.

[0117] According to one or more embodiments of the present disclosure, the device also includes: a transition module; the transition module is configured to determine a first material identifier of a first editing material before the transition and a second material identifier of a second editing material after the transition in response to receiving a transition operation for at least two editing materials among the multiple editing materials; and transition the first editing material to the second editing material based on the first material identifier and the second material identifier.

[0118] According to one or more embodiments of the present disclosure, multiple sub-editing materials are displayed on the editing track; the device also includes: a position adjustment module; the position adjustment module is configured to create a temporary editing track in response to receiving a position exchange operation for a first sub-editing material and a second sub-editing material; transfer the second sub-editing material to the temporary editing track, adjust the position of the first sub-editing material to the position of the second sub-editing material; and transfer the second sub-editing material from the temporary editing track to the position of the first sub-editing material.

[0119] According to one or more embodiments of the present disclosure, the device also includes: an export module; the export module is configured to determine the playback time corresponding to each editing material in response to a video export operation; and determine the maximum playback time as the playback time of the exported video corresponding to the multiple editing materials.

[0120] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor, and a memory communicatively connected to the at least one processor;

[0121] The memory stores computer-executable instructions;

[0122] The at least one processor executes the computer-executable instructions stored in the memory to implement the video rendering method as described in the first aspect and various possible designs of the first aspect.

[0123] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer-executable instructions. When at least one processor executes the computer-executable instructions, the video rendering method described in the first aspect and various possible designs of the first aspect is implemented.

[0124] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program. When the computer program is executed by at least one processor, it implements the video rendering method described in the first aspect and various possible designs of the first aspect.

[0125] The above description is merely an exemplary embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0126] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0127] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A video rendering method, comprising: In response to receiving a sequence adjustment operation of an editing track where an editing material is located, obtaining a preview position of a video editing effect, and determining a plurality of editing materials corresponding to the preview position, wherein the plurality of editing materials are respectively located on a plurality of different editing tracks in a video editing interface; Determining rendering levels corresponding to the multiple editing materials respectively according to the arrangement order of the multiple different editing tracks, wherein the rendering level is used to indicate the rendering priority of the editing material; The multiple editing materials are rendered according to the rendering levels corresponding to the multiple editing materials respectively, so as to obtain the video editing effect at the preview position.

2. The method according to claim 1, wherein: The determining, according to the arrangement order of the multiple different editing tracks, the rendering levels corresponding to the multiple editing materials respectively includes: According to the arrangement sequence of the multiple different editing tracks, determining the sequence number of each editing track in the arrangement sequence; The sequence number of the editing track in the arrangement sequence is determined as the rendering level of the editing material on the editing track, and the rendering levels corresponding to the multiple editing materials are obtained.

3. The method according to claim 1, wherein: in, The rendering mode for rendering the plurality of editing materials is a free level mode; Before determining the rendering levels corresponding to the plurality of editing materials respectively according to the arrangement order of the plurality of different editing tracks, the method further includes: The track types of the multiple different editing tracks are converted into the same preset track type.

4. The method according to claim 3, further comprising: In response to receiving a switching operation of a video rendering mode, acquiring mode interface information corresponding to the video rendering mode; If the mode interface information is a first interface identifier, the video rendering mode is determined to be a free-level mode; if the mode interface information is a second interface identifier, the video rendering mode is determined to be a non-free-level mode.

5. The method according to any one of claims 1 to 4, wherein: The video editing interface also includes an adjustment track for adjusting the rendering effect; the method also includes: Determine the rendering level corresponding to the adjustment track; According to the rendering level corresponding to the adjustment track and the rendering levels corresponding to the multiple editing materials, selecting at least one target editing material having a rendering level smaller than the rendering level corresponding to the adjustment track from the multiple editing materials; The rendering effect of the at least one target editing material is adjusted through the adjustment track.

6. The method according to claim 5, wherein: The adjustment track includes a plurality of rendering adjustment parameters, and the adjustment track includes sub-rendering levels corresponding to the plurality of rendering adjustment parameters; The determining the rendering level corresponding to the adjustment track includes: For each adjustment track, determine the track level of the adjustment track, and determine the track level of the adjustment track as the rendering level corresponding to the adjustment track; According to a first number of the plurality of rendering adjustment parameters included in the adjustment track, a rendering level of the adjustment track is enlarged to obtain a plurality of sub-rendering levels of the same number as the first number, wherein the end sequence numbers of the plurality of sub-rendering levels are different; The sub-rendering levels corresponding to the multiple rendering adjustment parameters are determined in sequence according to the ascending order of the tail serial numbers of the multiple sub-rendering levels.

7. The method according to any one of claims 1 to 6, further comprising: In response to receiving a transition operation for at least two of the plurality of editing materials, determining a first material identifier of a first editing material before the transition and a second material identifier of a second editing material after the transition; The first editing material is converted into the second editing material according to the first material identifier and the second material identifier.

8. The method according to any one of claims 1 to 6, wherein: The editing track displays a plurality of sub-editing materials; the method further comprises: In response to receiving a position exchange operation for the first sub-editing material and the second sub-editing material, creating a temporary editing track; Transferring the second sub-editing material to the temporary editing track, and adjusting the position of the first sub-editing material to the position of the second sub-editing material; The second sub-editing material is transferred from the temporary editing track to the location of the first sub-editing material.

9. The method according to any one of claims 1 to 8, further comprising: In response to the video export operation, determining the playback duration corresponding to each edited material; The maximum playback duration is determined as the playback duration of the exported videos corresponding to the multiple editing materials.

10. A video rendering device, comprising: an acquisition module, configured to, in response to receiving a sequence adjustment operation of an editing track where an editing material is located, acquire a preview position of a video editing effect, and determine a plurality of editing materials corresponding to the preview position, wherein the plurality of editing materials are respectively located on a plurality of different editing tracks in a video editing interface; A determination module, configured to determine, according to the arrangement order of the multiple different editing tracks, a rendering level corresponding to each of the multiple editing materials, wherein the rendering level is used to indicate a rendering priority of the editing material; The rendering module is configured to render the multiple editing materials according to the rendering levels corresponding to the multiple editing materials respectively, so as to obtain the video editing effect at the preview position.

11. An electronic device, comprising: at least one processor, and a memory communicatively coupled to the at least one processor; in The memory stores computer executable instructions; The at least one processor executes the computer executable instructions stored in the memory to implement the video rendering method according to any one of claims 1 to 9.

12. A computer-readable storage medium storing computer-executable instructions, wherein: When the computer executable instructions are executed by at least one processor, the video rendering method according to any one of claims 1 to 9 is implemented.

13. A computer program product comprising a computer program, wherein: When the computer program is executed by at least one processor, the video rendering method according to any one of claims 1 to 9 is implemented.

Images