Method and apparatus for adjusting rendering level order
The method and apparatus for adjusting rendering level orders in multimedia content enable flexible rearrangement of clip material segments, overcoming limitations in fixed orders to enhance user creativity and achieve desired visual effects.
Patent Information
- Application Number
- JP2023579182
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-08-31
- Filing Date
- 2023-08-28
- Publication Date
- 2025-08-19
- Estimated Expiration
- 2043-08-28
AI Technical Summary
Existing rendering methods for multimedia content fail to achieve desired visual effects due to fixed rendering level orders of clip material segments, limiting flexibility and user creativity in video editing.
A method and apparatus for adjusting the rendering level order by displaying a rendering level adjustment panel, allowing users to freely rearrange the display positions of clip material segment marks, and determining a target rendering level order based on user input.
Enables flexible adjustment of rendering levels, enhancing user creativity and achieving desired visual effects in video clips by allowing free rearrangement of clip material segments.
Smart Images

Figure 0007725622000001 
Figure 0007725622000002 
Figure 0007725622000003
Abstract
Description
[Technical Field]
[0001] [Related Applications] This application claims priority from Chinese Patent Application No. 202211065529.2 filed on August 31, 2022, the entire contents of which are incorporated herein by reference.
[0002] [Technical field] SUMMARY OF THE INVENTION An embodiment of the present disclosure relates to a method and apparatus for adjusting a rendering level order. [Background technology]
[0003] Rendering is the final process of computer-generated image rendering, ultimately matching the image to a 3D scene. As users increasingly demand visual effects for multimedia content, they often edit the main material, for example, adding stickers, special effects, and picture-in-picture effects to the main material, thereby obtaining multimedia content with rich visual effects. In such rendering scenes, a rendering level order is predefined for different categories of clip materials, and then the main material and each added clip material are rendered according to the predefined rendering level order. However, the visual effects presented in the clipped multimedia content obtained by the above rendering method often fail to achieve the desired effect. Summary of the Invention [Means for solving the problem]
[0004] To solve the above technical problems, the present disclosure provides a method and apparatus for adjusting a rendering level order.
[0005] In a first aspect, the present disclosure provides a method for adjusting a rendering level order, the method comprising: a step of displaying a rendering level adjustment panel corresponding to a target time position of a timeline track of a video clip in response to a first command triggered for the target time position, wherein marks of a plurality of clip material segments are displayed on the rendering level adjustment panel according to an initial arrangement order, a position interval covered by the plurality of clip material segments on the timeline track includes the target time position, and the initial arrangement order of the marks of the plurality of clip material segments coincides with an initial rendering level order of the plurality of clip material segments; a step of adjusting a display position of the mark of at least one clip material segment on the rendering level adjustment panel in response to a movement operation on the mark of at least one clip material segment among the marks of the plurality of clip materials, and displaying the marks of the plurality of clip material segments on the rendering level adjustment panel in accordance with a target arrangement order; and determining a target rendering level order of the plurality of clip material segments according to a target arrangement order of the marks of the plurality of clip material segments in response to a second command triggered to the rendering level adjustment panel.
[0006] In a second aspect, the present disclosure provides a rendering level order adjustment device, including: a display module; and a rendering level order determination module; the display module is used to display a rendering level adjustment panel corresponding to a target time position of a timeline track of a video clip in response to a first command triggered for the target time position, wherein marks of a plurality of clip material segments are displayed on the rendering level adjustment panel according to an initial arrangement order, a position interval covered by the plurality of clip material segments on the timeline track includes the target time position, and the initial arrangement order of the marks of the plurality of clip material segments coincides with an initial rendering level order of the plurality of clip material segments; the display module is further used to adjust a display position of the at least one clip material segment mark on the rendering level adjustment panel in response to a movement operation on the mark of at least one clip material segment among the marks of the plurality of clip materials, and display the marks of the plurality of clip material segments on the rendering level adjustment panel in accordance with a target arrangement order; The rendering level order determination module is used to determine a target rendering level order of the plurality of clip material segments according to a target arrangement order of the marks of the plurality of clip material segments in response to a second command triggered to the rendering level adjustment panel.
[0007] In a third aspect, the present disclosure provides an electronic device, comprising: a memory; and a processor; the memory is configured to store computer program instructions; The processor is arranged to execute the computer program instructions to cause the electronic device to implement the first aspect and the method for adjusting a rendering level order according to the first aspect.
[0008] In a fourth aspect, the present disclosure provides a readable storage medium, comprising computer program instructions, and an electronic device executing the computer program instructions to implement the method for adjusting a rendering level order described in the first aspect.
[0009] In a fifth aspect, the present disclosure provides a computer program product, and an electronic device executes the computer program product to cause the electronic device to realize the method for adjusting a rendering level order according to the first aspect.
[0010] The drawings herein are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure, and together with the specification serve to explain the principles of the present disclosure.
[0011] In order to more clearly describe the embodiments of the present disclosure, the following briefly describes the drawings that need to be used in the embodiments, and it is obvious that those skilled in the art can obtain other drawings based on these drawings without any creative work. [Brief explanation of the drawings]
[0012] [Figure 1] 1 is a flowchart of a method for adjusting a rendering level order provided by an embodiment of the present disclosure. [Figure 2A] FIG. 1 is a schematic diagram of a human-computer interaction interface provided by an embodiment of the present disclosure. [Figure 2B] FIG. 1 is a schematic diagram of a human-computer interaction interface provided by an embodiment of the present disclosure. [Figure 2C] FIG. 1 is a schematic diagram of a human-computer interaction interface provided by an embodiment of the present disclosure. [Figure 2D] FIG. 1 is a schematic diagram of a human-computer interaction interface provided by an embodiment of the present disclosure. [Figure 2E] FIG. 1 is a schematic diagram of a human-computer interaction interface provided by an embodiment of the present disclosure. [Figure 2F] FIG. 1 is a schematic diagram of a human-computer interaction interface provided by an embodiment of the present disclosure. [Figure 3A] FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 3B] FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 3C] FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 3D] FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 3E] FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 3F]FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 3G] FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 3H] FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 3I] FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 3J] FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 3K] FIG. 2 is a schematic diagram of a rendering level adjustment logic provided by an embodiment of the present disclosure. [Figure 4] FIG. 2 is a structural schematic diagram of a rendering level order adjustment device provided by an embodiment of the present disclosure; [Figure 5] 1 is a structural schematic diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0013] In order to make the above-mentioned objectives, features and advantages of the present disclosure more clearly understood, the technical solution of the present disclosure will be further described below. It should be noted that, if not contradictory, the embodiments and features in the embodiments of the present disclosure can be combined with each other.
[0014] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure; however, the present disclosure may be embodied in other forms different from those described herein, and it is to be understood that the embodiments in the specification are merely some embodiments of the present disclosure, and not all embodiments.
[0015] Currently, the rendering level order of clip material segments of different categories is fixed, and the rendering level order of clip materials of the same category is ordered according to the added time of the clip material segments, so the visual effects presented in the video obtained by rendering in the above manner are greatly limited and cannot meet the effects desired by users. For example, the different rendering level orders in clip tools or clip software are, from highest to lowest, text, sticker, picture-in-picture, and main material, and according to this order, it is not possible to realize moving text / sticker below picture-in-picture, nor is it possible to realize cross-editing of picture-in-picture, text, sticker, etc., so it is not possible to meet the needs of users.
[0016] To solve the above problem, an embodiment of the present disclosure provides a method and apparatus for adjusting a rendering level order, the method including: displaying a rendering level adjustment panel corresponding to a target time position of a timeline track of a video clip in response to a command triggered for the target time position, wherein marks of a plurality of clip material segments whose position intervals on the timeline track include the target time position are displayed on the rendering level adjustment panel according to an initial arrangement order; moving the marks of the clip material segments and adjusting their display positions to display the marks of the plurality of clip material segments according to the target arrangement order; and then determining a target rendering level order of the plurality of clip material segments according to the target arrangement order of the marks of the plurality of clip material segments. This method allows the rendering level order of the clip material segments to be freely adjusted, thereby meeting the needs of users for video clips.
[0017] To solve the above problems and improve the rendering flexibility and the visual effects presented in clipped videos, an embodiment of the present disclosure provides a method and apparatus for adjusting a rendering level order, which displays a rendering level adjustment panel corresponding to a target time position in response to a command input by a user, displays marks corresponding to each of a plurality of clip material segments on the rendering level adjustment panel according to the current rendering level order of the plurality of clip material segments, and adjusts the rendering level order of the clip material segments by moving the display positions of the marks corresponding to the clip material segments. The method provided by the present disclosure allows a user to freely adjust the rendering level order of the clip material segments, allowing the user to freely create. Furthermore, in the rendering level adjustment interface presented to the user, marks corresponding to each clip material segment are displayed according to the rendering level order, making it easy for the user to quickly understand and use.
[0018] For example, the method for adjusting the order of rendering levels provided by the present disclosure can be performed by a device for adjusting the order of rendering levels provided by the present disclosure, and the device for adjusting the order of rendering levels can be implemented in any software and / or hardware manner. For example, the device for adjusting the order of rendering levels can be an electronic device, and the electronic device can include, but is not limited to, a mobile phone, a tablet PC, a wearable electronic device, a laptop, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc., and the present disclosure does not limit the specific type of the electronic device. The present disclosure does not limit the type of operating system of the electronic device, and the operating system can be, for example, an Android system, a Linux system, a Windows system, an iOS system, etc.
[0019] Next, some specific examples will be used to describe in detail the video clip template search method provided by the present disclosure by combining scenes and drawings.
[0020] 1 is a flowchart of a method for adjusting the order of rendering levels according to an embodiment of the present disclosure. As shown in FIG. 1, the method according to this embodiment includes steps S101 to S103.
[0021] S101: In response to a first command triggered for a target time position of a timeline track of a video clip, display a rendering level adjustment panel corresponding to the target time position, and marks of multiple clip material segments are displayed on the rendering level adjustment panel according to an initial arrangement order, a position interval covered by the multiple clip material segments on the timeline track includes the target time position, and the initial arrangement order of the marks of the multiple clip material segments matches the initial rendering level order of the multiple clip material segments.
[0022] A user can launch a clip tool (e.g., a video clip application program) installed on an electronic device and create a corresponding clip process. A clip process can be understood as a clip draft, and includes imported original video and original audio, as well as instruction information for editing operations. A clip process corresponds to one timeline track, and the imported original video, original audio, and clip material segments added by editing operations each cover corresponding position sections on the timeline track based on their respective start times and durations.
[0023] In the process of video clipping, the user can add clip material segments of different categories, such as text, stickers, filters, picture-in-picture, etc., to the clip process through editing operations, and each category can add one or more clip material segments. Under some circumstances, after the user adds clip material segments of various categories to the clip process and edits or adjusts the display times of the clip material segments, there may be multiple clip material segments at some time positions on the timeline track, and the covering relationship between these clip material segments corresponds to the rendering level order, and when the image positions of multiple clip material segments overlap each other, the clip material segments with higher rendering levels will cover the clip material segments with lower rendering levels.
[0024] The target time position is a time position in the timeline track, and is the current preview time position.
[0025] In some embodiments, at the target time position, the clip tool may present a visual entry to the user, allowing the user to input a first command to the clip tool by manipulating the visual entry. For example, after the user adds or edits a clip material segment at the target time position, the clip tool interface may display a window or panel, which may include entries or controls for various editing operations, allowing the user to edit the clip material segment by manipulating these entries or controls. Inputting a first command to the clip tool may include entering an entry in a rendering level adjustment panel and manipulating, e.g., tapping, the entry.
[0026] In response to the first command, the clip tool determines a plurality of clip material segments whose position intervals cover the target time position, displays a rendering level adjustment panel, and displays marks of the plurality of clip material segments in the rendering level adjustment panel according to an initial arrangement order. The plurality of clip material segments may be clip material of a specified category or clip material segments of all categories, and the present disclosure is not limited thereto. When the first command is triggered for a clip material segment of a specified category, it can be understood that the clip tool realizes free adjustment of the rendering level order of a single module, and when the first command is triggered for clip material segments of all categories, it can be understood that the clip tool realizes free adjustment of the rendering level order of all categories.
[0027] It should be noted that the clip material segments of "all categories" referred to herein are all clip material segments of the first category, and the clip material segments of the first category affect the visual effects of video editing, for example, the first category may include an image category and may include visual elements such as text, stickers, picture-in-picture, filters / adjustments, etc. Clip material segments whose positional intervals on the timeline track cover the target time position may further include clip material segments of the second category, and it can be understood that the clip material segments of the second category do not affect the visual effects of video editing, for example, the second category may include a non-image category and may include audio material.
[0028] The specified category may be one or more of the subcategories included in the first category, for example, the first category may be an image category, and the image category may include multiple subcategories such as text, stickers, picture-in-picture, filters, adjustments, etc., and the specified category may be a text category or a sticker category.
[0029] When the rendering level order of the clip material segments is not adjusted, the initial arrangement order can be determined in the following manner: The rendering level order of clip material segments of different categories is specified in advance, for example, the rendering level order is preset to be text, sticker, filter, picture-in-picture, and main material in descending order of highest; of course, the preset order may be other orders, and this is merely exemplary; the rendering level order of clip material segments of the same category is arranged according to the addition time of the clip material segments, with the earlier added clip material segments having lower rendering levels and the later added clip material segments having higher rendering levels. When the rendering level order of the clip material segments is adjusted, the current rendering level order of each clip material segment is the initial arrangement order.
[0030] The marks corresponding to the plurality of clip materials may include thumbnails corresponding to the clip materials and / or descriptive text of the clip materials, which may be names, category information, etc., but are not limited to these.
[0031] The initial rendering level order of the multiple clip material segments is closely related to the display position of the marks corresponding to each clip material segment, and the user can quickly and clearly understand the current rendering level order status of the multiple clip material segments targeted by the first command by the content displayed on the rendering level adjustment page.
[0032] S102: In response to a movement operation on at least one clip material segment mark among the plurality of clip material marks, the display position of the at least one clip material segment mark is adjusted on a rendering level adjustment panel, and the plurality of clip material segment marks are displayed on the rendering level adjustment panel in accordance with a target arrangement order.
[0033] In some embodiments, a user can move the display position of the mark of a clip material segment displayed in the rendering level adjustment panel by dragging the mark corresponding to the clip material from its current display position to another display position and releasing it, thereby adjusting the arrangement order of the marks of multiple clip material segments. If multiple clip material segments need to be adjusted, this can be achieved by performing the move operation one by one.
[0034] For example, the rendering level adjustment panel displays marks for three clip material segments, namely clip material segment A, clip material segment B, and clip material segment C, with the rendering levels A>B>C, from highest to lowest, and the thumbnails of the three clip material segments are displayed arranged from left to right in order of highest rendering level, with the rightmost being the thumbnail of clip material segment A, the middle being the thumbnail of clip material segment B, and the leftmost being the thumbnail of clip material segment C. When the user drags the thumbnail of clip material segment C to the right of clip material segment A, the thumbnails corresponding to clip material segment A and clip material segment B move to the right, and after adjustment, the rightmost being the thumbnail of clip material segment C, the middle being the thumbnail of clip material segment A, and the leftmost being the thumbnail of clip material segment B, and the arrangement order of the three changes.
[0035] In some embodiments, a user may adjust the display position of a mark corresponding to the same clip material segment multiple times, thereby adjusting the rendering level order of the clip material segment multiple times. For example, a user may adjust the display position of the thumbnail of clip material segment C multiple times, first by adjusting the thumbnail of clip material segment C to the right of the thumbnail of clip material segment A, and then by re-adjusting the thumbnail of clip material segment C to be midway between the thumbnails of clip material segment A and clip material segment B, thereby adjusting the arrangement order of clip material segments A, B, and C multiple times.
[0036] S103, in response to a second command triggered to the rendering level adjustment panel, determining a target rendering level order of the plurality of clip material segments according to a target arrangement order of the marks of the plurality of clip material segments.
[0037] The method provided by this embodiment allows a user to freely adjust the rendering level order of clip material segments of a single module or all categories, allowing the user to freely create and obtain a video that meets the desired visual effect. Furthermore, the user can adjust the rendering level order of the clip material segments by moving the display position of the marks corresponding to the clip material segments, which is simple to operate and allows the user to quickly understand and use the rendering level adjustment function provided by the clip tool. Furthermore, in this embodiment, the rendering level adjustment panel presented to the user displays marks corresponding to each clip material segment according to the rendering level order, allowing the user to quickly understand and use the rendering level adjustment function provided by the clip tool.
[0038] Based on the embodiment shown in FIG. 1 , assuming that the first command is triggered for a clip material segment of a specified category, the clip tool can also support the user in switching between displaying clip material segments of all categories to facilitate user use. In a possible embodiment, in response to a third command triggered for the rendering level adjustment panel, marks of clip material segments of all categories whose position intervals on the timeline track cover and include the target time position are displayed on the rendering level adjustment panel. The user can trigger and display a specific pop-up window by specifying an entry in the rendering level adjustment panel, and trigger the third command by operating a setting item in the specific pop-up window. Thereafter, in response to a movement operation on at least one clip material segment mark among the marks of the clip material of all categories, the clip tool adjusts the display position of the corresponding at least one clip material segment mark on the rendering level adjustment panel, displays the marks of the clip material segments of all categories on the rendering level adjustment panel according to the target arrangement order, and determines the target rendering level order of the clip material segments of all categories according to the target arrangement order of the marks of the clip material segments of all categories.
[0039] Based on the embodiment shown in FIG. 1 , the clip tool follows the user's operation in real time, and determines the rendering level order of multiple clip material segments whose position sections in the timeline track cover the target time position based on the arrangement order of the marks of each clip material segment, and performs rendering display, making it easy for the user to preview the clip effect of adjusting the rendering level order in real time.
[0040] In addition, the user can adjust the position of the mark on the same clip material segment multiple times, and the clip tool will render and display the user's operations in real time, allowing the user to preview the clip effect of each movement operation in real time.
[0041] Referring to the example of step S102, for example, first the user adjusts the thumbnail of clip material segment C to the right of the thumbnail of clip material segment A, in which case the clip tool renders and displays the video frame image at the current preview position and the images of the three clip material segments in real time according to the rendering level order C>A>B, from highest to lowest; next, the user adjusts the thumbnail of clip material segment C again to be midway between the thumbnails of clip material segment A and clip material segment B, in which case the clip tool renders and displays the video frame image at the current preview position and the three clip material segments in real time according to the rendering level order A>C>B, from highest to lowest.
[0042] 1, the user can further create a new clip material segment in the clipping process. In a possible embodiment, the clip tool creates a new clip material segment at the target time position in response to a fourth command triggered for the target time position, and determines an initial rendering level order corresponding to the newly created clip material segment according to a preset rendering level order.
[0043] The preset rendering level order is, in descending order, text, sticker, filter, adjustment, and picture-in-picture, and the step of determining the rendering level order corresponding to the newly created clip material segment according to the preset rendering level order includes: The method includes the steps of: if the newly created clip material segment is a character, determining that an initial rendering level of the newly created clip material segment is the highest level; if the newly created clip material segment is a sticker, determining that an initial rendering level of the newly created clip material segment is lower than that of the character clip material segment with the lowest level; if the newly created clip material segment is a filter or adjustment, determining that an initial rendering level of the newly created clip material segment is lower than that of the sticker clip material segment with the lowest level; and if the newly created clip material segment is a picture-in-picture, determining that an initial rendering level of the newly created clip material segment is lower than that of the filter or adjustment clip material segment with the lowest level.
[0044] As will be understood, the pre-set rendering level order may be other orders and is not limited to the above examples, for example, stickers may be higher than text, picture-in-picture may be higher than filters and adjustments, and can be flexibly set according to needs.
[0045] The human-computer interaction process of the rendering level order adjustment method provided by the present disclosure will be exemplarily described below using the interaction interfaces shown in Figures 2A to 2F. In the following example, the electronic device is a mobile phone, and a clip tool (e.g., a video clip application program, hereinafter abbreviated as Application 1) is installed on the mobile phone.
[0046] A user launches application 1 installed on a mobile phone, imports the original video into application 1, and adds four clip material segments to the current preview position, which are picture-in-picture 1, sticker 1, sticker 2, and sticker 3, respectively. Picture-in-picture 1 is added later than sticker 1, sticker 1 is added later than sticker 2, and sticker 2 is added later than sticker 3. Therefore, without adjusting the rendering level order, the rendering level of sticker 1 is higher than that of sticker 2, sticker 2 is higher than that of sticker 3, and picture-in-picture 1 has the lowest rendering level.
[0047] When clip materials of several categories are added, they can be displayed within a preset time, and these clip materials can be understood as clip material segments. As illustrated in Figures 2A to 2E, Sticker 1 to Sticker 3 added to the current preview position can be understood as Sticker Segment 1 to Sticker Segment 3.
[0048] When the user adds a new clip material segment or selects an added clip material segment, the application 1 displays an editing tool panel corresponding to the clip material to the user, and the editing tool panel may include an entry for entering a rendering level adjustment panel. The editing tool panel may further include other entries or controls, and the present disclosure is not limited thereto.
[0049] 2A exemplarily shows an editing tool panel corresponding to stickers displayed by application 1 after a user adds sticker 3 at the current preview position. As shown in FIG. 2A, user interface 11 includes area 101, area 102, area 103, and entry 104.
[0050] Area 101 is a preview area used to display the preview effect of the corresponding preview position. The present disclosure does not limit the parameters such as the size, display position, and shape of area 101. For example, as shown in FIG. 2A , area 101 may be rectangular and located in the middle area of user interface 11.
[0051] The area 102 is used to display the original video and each added clip material segment according to the timeline track. The black bold vertical line in the area 102 is used to indicate the current preview position, i.e., the target time position. The area 102 can also provide an entry for adding video, a control for turning off the original sound of the video, etc.
[0052] Area 103 is used to display an editing tool panel, which is used to provide entries or controls corresponding to editing operations. Fig. 2A exemplarily shows an editing tool panel corresponding to a sticker displayed in area 103 after a user has newly created sticker 3, and area 103 includes an entry 104 for entering a rendering level adjustment panel. As will be understood, when a user newly creates another clip material segment, or taps an image area corresponding to another clip material segment in area 101, or taps a mark corresponding to a clip material segment in area 102, area 103 can display an editing tool panel corresponding to the newly created clip material segment or the selected other clip material segment.
[0053] Entry 104 is used to enter a rendering level adjustment panel, allowing the user to adjust the rendering level order of one or more clip materials whose position interval covers the current preview position. The present disclosure does not limit the implementation of entry 104, and entry 104 can be implemented in one or more ways, such as an icon, text, image, or symbol. For example, as shown in FIG. 2A , entry 104 is implemented in a way that combines an icon and the text "rendering level." Furthermore, the present disclosure does not limit the display parameters of entry 104, such as the size, display position, and color.
[0054] When application 1 receives a trigger operation (e.g., a tap operation) on entry 104 by the user, application 1 displays a rendering level adjustment panel and can display marks of clip material segments of a single module (i.e., a single specified category) in the rendering level adjustment panel according to the initial arrangement order, where the rendering level adjustment panel displays marks of all stickers whose position intervals cover the current preview position.
[0055] When the marks of the clip material segments of a single module are displayed by default in the rendering level adjustment panel, the designated category relates to the entry or path into the rendering level adjustment panel.
[0056] For example, if the entry to enter the rendering level adjustment panel is located in an editing tool panel corresponding to stickers, the rendering level adjustment panel will display all sticker marks whose position range covers the current preview position by default. Similarly, if the entry to enter the rendering level adjustment panel is located in an editing tool panel corresponding to picture-in-picture, the rendering level adjustment panel will display all picture-in-picture marks whose position range covers the current preview position by default. Similarly, if the entry to enter the rendering level adjustment panel is located in an editing tool panel corresponding to text, the rendering level adjustment panel will display all text marks whose position range covers the current preview position by default. Other situations are similar and will not be listed here.
[0057] As will be appreciated, the rendering level adjustment panel may be entered from entry 104 shown in FIG. 2B, and marks for all categories of clip material segments may be displayed by default in the rendering level adjustment panel.
[0058] Based on the embodiment shown in FIG. 2A, in response to a user's trigger operation on entry 104, application 1 illustratively displays user interface 12 shown in FIG. 2B on the mobile phone, where user interface 12 includes area 105.
[0059] The area 105 is used to display a rendering level adjustment panel, which includes an area 105a that displays the current rendering level order of the clip material, and related controls, such as a confirmation control 105b.
[0060] In the area 105a, each clip material segment corresponds to one display area, and one or more items of the thumbnail, name, and category information of the corresponding clip material segment can be displayed to the user within the display area. Also, in the area 105a, the marks corresponding to these clip material segments are arranged in descending order of rendering level.
[0061] For example, as shown in FIG. 2B, area 105a includes display areas corresponding to sticker segments 1 to 3, respectively, and is used to display thumbnails corresponding to sticker segments 1 to 3, respectively.
[0062] The display type of the mark for each clip material segment can be set flexibly and is not limited to the format shown in FIG. 2B.
[0063] To help the user quickly understand the relationship between the mark of each clip material segment in area 105a and the ordering status of the rendering levels, guide information can be displayed in area 105a, for example, the text content "top" is displayed in area 105c and the text content "bottom" is displayed in area 105d. Under some circumstances, the ordering status of the initial rendering levels of each clip material segment may be explained in area 105a by combining arrows and text, or may be implemented in any other manner, and the present disclosure is not limited thereto.
[0064] The user can adjust the display position on the rendering level adjustment panel by dragging the mark corresponding to the clip material segment.
[0065] 2B , assuming that the user drags the mark corresponding to sticker segment 2 to the right of the mark of sticker segment 3, application 1 can exemplarily display user interface 13 shown in FIG. 2C on the mobile phone. Sticker segment 2 is the clip material segment on which the above-mentioned move operation was performed. In user interface 13, the display positions of the marks corresponding to sticker segment 2 and sticker segment 3, respectively, change, and correspondingly, the rendering level order of sticker segment 2 and sticker segment 3 is adjusted from sticker segment 2 being higher than sticker segment 3 to sticker segment 3 being higher than sticker segment 2. The rendering level of sticker segment 1 remains higher than sticker segment 2 and sticker segment 3.
[0066] Based on the embodiment shown in FIG. 2C , application 1 can render and display in area 101 based on the adjusted rendering level order of sticker segments 1 to 3, the picture-in-picture rendering level order, and the video frame at the current preview position, so that the user can preview the clip effect.
[0067] 2B , assuming that a user drags the mark corresponding to sticker segment 2 to the left of the mark of sticker segment 1, application 1 can exemplarily display user interface 14 shown in FIG. 2D on the mobile phone. Sticker segment 2 is the clip material segment on which the above-mentioned move operation has been performed. In user interface 14, the positions of the marks corresponding to sticker segment 1 and sticker segment 2, respectively, change, and correspondingly, the rendering level order of sticker segment 1 and sticker segment 2 is adjusted from sticker segment 1 being higher than sticker segment 2 to sticker segment 2 being higher than sticker segment 1. The rendering level of sticker segment 3 remains lower than sticker segment 1 and sticker segment 2.
[0068] Based on the embodiment shown in FIG. 2D , application 1 can render and display in area 101 in real time based on the adjusted rendering level order of sticker segments 1 to 3, the picture-in-picture rendering level order, and the video frame image at the current preview position, so that the user can preview the clip effect.
[0069] Assume that, when the rendering level order is not adjusted, sticker segment 1 covers a portion of sticker segment 2, sticker segment 2 covers a portion of sticker segment 3, and there is no overlapping area between sticker segment 1 and sticker segment 3. After adjusting the rendering level order according to the above two examples, in area 101 of user interface 13 shown in FIG. 2C, sticker segment 3 is displayed positioned above sticker segment 2, i.e., sticker segment 3 covers a portion of sticker segment 2, and in area 101 of user interface 14 shown in FIG. 2D, sticker segment 2 is displayed positioned above sticker segment 1, i.e., sticker segment 2 covers a portion of sticker segment 1.
[0070] Referring to the clip effect shown in area 101 in the embodiment shown in FIGS. 2C and 2D, after adjusting the rendering level order of each sticker segment 1 to 3, the coverage relationship between multiple sticker segments has changed.
[0071] Under some circumstances, the user may adjust the positions of the display areas corresponding to sticker segments 1 to 3 in area 105a multiple times, thereby adjusting the rendering level order of sticker segments 1 to 3, and each time the clip material segments are rendered and displayed according to the rendering level order after adjustment, thereby allowing the user to preview the clip effect and continue until the desired visual effect is achieved.
[0072] If the user is satisfied that the current clip effect meets his / her desires, he / she can input a second command by operating the confirmation control 105b, and in response to the second command, the application 1 determines the target rendering level order of the above-mentioned multiple clip material segments based on the target arrangement order of the marks of each current clip material segment.
[0073] In some embodiments, application 1 supports a user switching from adjusting the rendering level order of clip material segments of a single module to adjusting the rendering level order of clip material of an entire category in the rendering level adjustment panel.
[0074] For example, the application 1 may display an entry for entering the category switching panel in the rendering level adjustment panel to the user. As shown in FIG. 2B, the area 105 further includes an entry 106.
[0075] In response to a user's trigger operation (e.g., a tap operation) on entry 106, application 1 can exemplarily display user interface 15 shown in FIG. 2E on the mobile phone, where user interface 15 includes a pop-up window 107, which may include multiple setting items, each setting item corresponding to one category setting, and by operating these setting items, the user can switch between clip materials of a single module or all categories displayed in area 105a.
[0076] The pop-up window 107 includes a setting item 107a and a setting item 107b, where the setting item 107a corresponds to a single module and the setting item 107b corresponds to all categories. The names of the setting items 107a and 107b can be set based on the actual situation. For example, the name of the setting item 107a can be “xx only”, where “xx” indicates a single module, and the name of the setting item 107b can be “all categories”.
[0077] Referring to the embodiment shown in FIG. 2A above, entry 104 is located in the editing tool panel corresponding to stickers, and therefore the clip material segment of the single module corresponding to setting item 107a is in the category of stickers, the name of setting item 107a is "Stickers only", and it is positioned in setting item 107a by default, and the name of setting item 107b is "All Categories".
[0078] If the rendering level adjustment panel is entered from the entry 104 and the marks of the clip material segments of all categories are displayed by default, the pop-up window 107 can be positioned by default in the setting item 107b when it is entered.
[0079] Also, the embodiment shown in FIG. 2E exemplarily illustrates a situation in which the pop-up window 107 includes two setting items, and in some embodiments, the pop-up window 107 may further include more setting items. For example, if the current preview position corresponds to three categories of clip material segments, the pop-up window 107 may display four setting items, three of which are single-module setting items and the other one is an all-category setting item.
[0080] Continuing to refer to the example shown in FIG. 2E, when application 1 receives a user trigger operation on setting item 107b and a trigger operation on entry 106, application 1 can exemplarily display user interface 16 shown in FIG. 2F on the mobile phone.
[0081] Area 105a of user interface 16 includes display areas corresponding to sticker segments 1 to 3 and picture-in-picture 1, and marks corresponding to the four clip material segments are arranged from left to right in descending order of current rendering level.
[0082] In some embodiments, the video frame at the current preview position can correspond to more clip material segments, and due to the limited size of the mobile phone screen, marks corresponding to some of the clip material can be displayed on the mobile phone screen, and the user can view marks corresponding to more clip material segments by sliding left or right.
[0083] In some embodiments, after adjusting the rendering level order of the clip material of a single module in the manner shown in Figure 2C or Figure 2D, the user can further enter the pop-up window 107 from the entry 106 of the corresponding panel and switch which category of clip material segment marks to display in area 105a using the setting items displayed in the pop-up window 107.
[0084] In some embodiments, the user can enter the pop-up window 107 from the entry 106 multiple times to repeatedly switch between the setting items 107a and 107b, and the display of marks of clip material segments of different categories in the area 105a will be switched according to the user's operation to meet the user's needs.
[0085] The user can control the popup window 107 to be turned off by tapping anywhere outside the popup window 107 or by tapping the entry 106 again.
[0086] 2A to 2F, the user can adjust the rendering level order of clip material segments of the same category and the rendering level order of clip material segments of different categories, breaking the limitation of the fixed arrangement of the rendering level order and thereby meeting the clip needs of the user. For example, the user can move and display picture-in-picture above stickers and text, and can realize cross-editing of video frames at different positions, greatly enriching the visual effect of the video obtained from the clip.
[0087] The following describes in detail the logic of adjusting the rendering level order in the method for adjusting the rendering level order provided by the present disclosure by combining several embodiments and drawings. It can be divided into two situations: one is adjusting the rendering level order of clip material segments of a single module, and the other is adjusting the rendering level order of clip material segments of all categories.
[0088] 1. Single module (adjusting the rendering level order of clip material segments in a specified category)
[0089] The adjustment logic of the rendering level order of the clip material segments of a single module satisfies the following several cases:
[0090] Case 1: For a clip material segment on which a move operation is performed, after adjustment, if there is a clip material segment of the same category one level before, it will be adjacent to the previous clip material segment of the same category.
[0091] Case 2: for the clip material segment on which the move operation is performed, if there is no clip material segment of the same category one level before after the adjustment, it will be adjacent to a clip material segment of the same category later.
[0092] Case 3: for the clip material segments that perform the move operation, if the rendering level order of each clip material segment of a single module does not change after adjustment, the rendering level order of each clip material segment is not adjusted.
[0093] For example, assume that the video frame at the current preview position corresponds to seven clip material segments. Each clip material segment is marked by a rectangle, and its length indicates the position interval that the clip material segment covers on the timeline track. Three black-filled rectangles indicate clip material segments of the same category, named A, B, and C, respectively. One clip material segment of another category exists one level before clip material segment A, one clip material segment of another category exists between clip material segments A and B, one clip material segment of another category exists between clip material segments B and C, and one clip material segment of another category exists one level after clip material segment C. The seven clip material segments are arranged from top to bottom in descending order of rendering level. In the following diagrams, vertical bold black solid lines indicate the current preview position (i.e., the target time position).
[0094] In a single-module adjustment scene, assuming that after the adjustment, the rendering level of clip material segment B is lower than that of clip material segment C, and the rendering level of clip material segment A remains unchanged, referring to the embodiment shown in FIG. 3A, the rendering level order can be updated from the order shown on the left side of FIG. 3A to the order shown on the right side. In combination with the description of case 1 above, after the adjustment, there is a clip material segment C of the same category one level before the clip material segment B, in which case the rendering level of clip material segment B can be adjacent to the rendering level of clip material segment C, that is, after the adjustment, the rendering level of clip material segment C is 5, and the rendering level of clip material segment B is 6.
[0095] In a single-module adjustment scene, assuming that after the adjustment, the rendering level of clip material segment B is higher than that of clip material segment A, and the rendering level of clip material segment C remains unchanged, referring to the embodiment shown in FIG. 3B, the rendering level order can be updated from the order shown on the left side of FIG. 3B to the order shown on the right side. In combination with the description of case 2 above, after the adjustment, there is no clip material segment of the same category one level before clip material segment B, in which case the rendering level of clip material segment B can be adjacent to the rendering level of clip material segment A, that is, after the adjustment, the rendering level of clip material segment B is 2, and the rendering level of clip material segment A is 3.
[0096] In a single-module adjustment scene, assuming that the rendering level order of the three clip material segments A, B, and C remains unchanged after the adjustment, refer to the example shown in Figure 3C, and the rendering level order of the seven clip material segments remains consistent before and after the adjustment.
[0097] 2. All categories
[0098] In an all-category adjustment scene, the marks of multiple clip material segments whose position intervals cover the current preview position in the timeline track are arranged in descending order of rendering level, and the clip material segment to which the move operation is performed can be inserted at the position to be adjusted, and the rendering level orders of other related clip material segments can be adjusted overall up or down.
[0099] The adjustment logic of the rendering level order of clip material segments of a single module and all categories shown above can be understood to be interpreted from a local perspective, and for clarity, the adjustment logic of the rendering level order of clip material segments will be described below from a global perspective using the examples shown in Figures 3D to 3F.
[0100] Specifically, when adding clip material segments to the clip process, each clip material segment corresponds to one global track level position, and the global track level position is the track level position corresponding to the rendering level.
[0101] Adjusting the level of a clip material segment can be handled in the following manner.
[0102] In case a, if the category of the clip material segment existing in the target track to be adjusted matches the category of the clip material segment to be moved, and if there is a position to place it, the clip material segment to be moved is placed on the target track.
[0103] In case b, if the category of the clip material segment existing in the target track to be adjusted matches the category of the clip material segment on which the move operation is to be performed, but there is no place to place it, then if the track one layer before that is a track of the same category as the clip material segment on which the move operation is to be performed, then the clip material segment on which the move operation is to be performed is placed; otherwise, a new track is created above and set as the target track, and the clip material segment on which the move operation is to be performed is placed.
[0104] In case c, if the category of the clip material segment existing in the target track to be adjusted does not match the category of the clip material segment for which the move operation is to be performed, then if the track one layer before the said track is of the same category as the clip material segment for which the move operation is to be performed, then it is placed thereon; otherwise, a new track is created above and set as the target track, and then the clip material segment for which the move operation is to be performed is placed thereon.
[0105] In case d, if there is no other clip material in the target track to be adjusted after the level adjustment, a track is directly created as the target track, and the clip material segment to be moved is placed therein.
[0106] For example, from a global perspective, if a clipping operation includes multiple clip material segments, each clip material segment corresponds to one global level track position, and the rendering levels corresponding to the global level tracks from top to bottom decrease. There may be multiple clip material segments in some tracks, and multiple clip material segments in the same track do not interfere with each other.
[0107] For example, as shown in FIG. 3D, assume that a user adds eight clip material segments, the eight clip material segments correspond to seven tracks, and two clip material segments exist on track 5. If the user wishes to adjust the rendering level order of clip material segment 8 from the current track 7 to track 4, since clip material segment 8 and clip material segment 4 belong to the same clip material segment category and track 4 is the location for placing clip material segment 8, clip material segment 8 can be adjusted to track 4, as shown in FIG. 3E, thereby adjusting the rendering level order of clip material segment 8 to the rendering level order corresponding to track 4. That is, this corresponds to the processing method shown in case a.
[0108] For example, as shown in FIG. 3F, suppose a user adds eight clip material segments and wants to adjust the rendering level order of clip material segment 8 from the current track 7 to track 4. Although clip material segment 8 and clip material segment 4 have the same clip material segment type, there is no position in track 4 to place clip material segment 8 (i.e., clip material segment 8 and clip material segment 4 will interfere when positioned on track 4 at the same time). Therefore, a new track 4 can be created to place clip material segment 8, as shown in FIG. 3G, and the rendering level order of clip material segment 8 is thereby adjusted to the rendering level order corresponding to track 4. That is, this corresponds to the processing method shown in case b.
[0109] As shown in FIG. 3G, the tracks corresponding to clip material segments 4 to 7 move downward in order, and the rendering levels of clip material segments 4 to 7 correspondingly become lower overall.
[0110] For example, as shown in FIG. 3H, suppose a user adds eight clip material segments and wants to adjust the rendering level order of clip material segment 8 from the current track 7 to the position of track 4. Because clip material segment 8 and clip material segment 4 are not the same type of clip material segment, a new track 4 can be created to place clip material segment 8, as shown in FIG. 3I, and the rendering level order of clip material segment 8 is adjusted to the rendering level order corresponding to track 4. That is, this corresponds to the processing method shown in case c.
[0111] As shown in FIG. 3I, the tracks corresponding to clip material segments 4 to 7 move downward in order, and the rendering levels of clip material segments 4 to 7 decrease overall accordingly.
[0112] For example, as shown in FIG. 3J, suppose a user wants to add eight clip material segments and adjust the rendering level order of clip material segment 8 from the current track 7 to a position between tracks 4 and 5. A new track 5 can be created to place clip material segment 8, as shown in FIG. 3K, thereby adjusting the rendering level order of clip material segment 8 to the rendering level order corresponding to track 5. That is, this corresponds to the processing method shown in case d.
[0113] As shown in FIG. 3K, the tracks corresponding to clip material segments 5 to 7 move downward in order, and the rendering levels of clip material segments 5 to 7 decrease overall accordingly.
[0114] The embodiment shown in Figures 3E to 3K above is a logic schematic diagram for adjusting the rendering level order of clip material segments from a global perspective. In actual applications, some clip tools, for example, clip tools installed on a PC terminal, can present the user with the user interfaces shown in Figures 3E to 3K based on the above implementation logic, making it easier for users to understand the rendering level adjustment process and use the rendering level adjustment function.
[0115] Illustratively, the present disclosure further provides a rendering level order adjustment device.
[0116] 4 is a structural diagram of a rendering level order adjusting device provided in an embodiment of the present disclosure. As shown in FIG. 4, the rendering level order adjusting device 400 provided in this embodiment includes a display module 401 and a rendering level order determining module 402.
[0117] The display module 401 is used to display a rendering level adjustment panel corresponding to a target time position of a timeline track of a video clip in response to a first command triggered for the target time position, wherein marks of multiple clip material segments are displayed on the rendering level adjustment panel according to an initial arrangement order, a position interval covered by the multiple clip material segments on the timeline track includes the target time position, and the initial arrangement order of the marks of the multiple clip material segments is consistent with the initial rendering level order of the multiple clip material segments.
[0118] The display module 401 is further used to adjust the display position of the at least one clip material segment mark on the rendering level adjustment panel in response to a movement operation on the mark of at least one clip material segment among the marks of the plurality of clip materials, and display the marks of the plurality of clip material segments on the rendering level adjustment panel according to a target arrangement order.
[0119] The rendering level order determination module 402 is used to determine a target rendering level order of the plurality of clip material segments according to a target arrangement order of the marks of the plurality of clip material segments in response to a second command triggered on the rendering level adjustment panel.
[0120] In some embodiments, the system further includes a rendering module 403 adapted to render images at the target time positions of the plurality of clip material segments according to the initial rendering level order in response to selecting the target time position in the timeline track as a preview position, and a display module 401 adapted to display the rendered images in a preview area.
[0121] The rendering module 403 is further used to render images at the target time positions of the plurality of clip material segments according to the target rendering level order in response to a second command triggered to the rendering level adjustment panel, and the display module 401 is further used to display the rendered images in a preview area.
[0122] In some embodiments, when the first command is triggered for a clip material segment of a specified category, all of the multiple clip material segments displayed on the rendering level adjustment panel are clip material segments of the specified category.
[0123] In some embodiments, the display module 401 is further used for, in response to a third command triggered on the rendering level adjustment panel, displaying marks of clip material segments of all categories whose position intervals covering the timeline track include the target time position on the rendering level adjustment panel, and, in response to a movement operation on at least one clip material segment mark among the clip material marks of all categories, adjusting the display position of the corresponding at least one clip material segment mark on the rendering level adjustment panel, and displaying the clip material segment marks of all categories on the rendering level adjustment panel according to a target arrangement order.
[0124] The rendering level order determining module 402 is further used for determining the target rendering level order of the clip material segments of all categories according to the target arrangement order of the marks of the clip material segments of all categories.
[0125] In some embodiments, the rendering level order determination module 402 is specifically used to determine that if there is no clip material segment of the same category at an upper level of the clip material segment on which the move operation is performed, the rendering level one level after the rendering level corresponding to the clip material segment on which the move operation is performed is a clip material segment of the same category; if there is a clip material segment of the same category at an upper level of the clip material segment on which the move operation is performed, the rendering level one level before the rendering level corresponding to the clip material segment on which the move operation is performed is a clip material segment of the same category; and if the rendering level order of the clip material segments of the specified category before and after the move operation is consistent, not adjust the rendering level order of all clip material segments corresponding to the target time position of the multiple clip material segments.
[0126] In some embodiments, the mark of the clip material segment displayed on the rendering level adjustment panel comprises a thumbnail corresponding to the clip material segment and / or a descriptive text of the clip material segment.
[0127] In some embodiments, the rendering level order determination module 402 is further used to, in response to a fourth command triggered for the target time position, create a new clip material segment at the target time position, and determine an initial rendering level corresponding to the newly created clip material segment according to a preset rendering level order.
[0128] In some embodiments, the preset rendering level order is, in descending order, text, sticker, filter, adjustment, and picture-in-picture, and the rendering level order determination module 402 is specifically used to determine the initial rendering level corresponding to the newly created clip material segment in the following manner:
[0129] If the newly created clip material segment is a character, it is determined that the initial rendering level of the newly created clip material segment is the highest level; if the newly created clip material segment is a sticker, it is determined that the initial rendering level of the newly created clip material segment is lower than that of the character clip material segment with the lowest level; if the newly created clip material segment is a filter or adjustment, it is determined that the initial rendering level of the newly created clip material segment is lower than that of the sticker clip material segment with the lowest level; and if the newly created clip material segment is picture-in-picture, it is determined that the initial rendering level of the newly created clip material segment is lower than that of the filter or adjustment clip material segment with the lowest level.
[0130] The rendering device provided in this embodiment can be used to implement the technical solutions of any of the above method embodiments, and its implementation principles and technical effects are similar. Reference can be made to the detailed descriptions of the above method embodiments, and for the sake of brevity, they will not be repeated here.
[0131] 5 is a structural schematic diagram of an electronic device provided by an embodiment of the present disclosure. As shown in FIG. 5, an electronic device 500 provided by this embodiment includes a memory 501 and a processor 502.
[0132] The memory 501 may be an independent physical unit, or may be connected to the processor 502 via a bus 503. The memory 501 and the processor 502 may be integrated and implemented by hardware, etc. The memory 501 is used to store program instructions, and the processor 502 calls the program instructions to implement the method for adjusting the rendering level order provided by any of the above method embodiments.
[0133] Alternatively, if part or all of the method of the above embodiment is implemented by software, the electronic device 500 may include only the processor 502. The memory 501 for storing a program is located outside the electronic device 500, and the processor 502 is connected to the memory via circuits / wires and is used to read and execute the program stored in the memory. The processor 502 may be a central processing unit (CPU), a network processor (NP), or a combination of a CPU and an NP. The processor 502 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.
[0134] The memory 501 may include volatile memory, such as random-access memory (RAM), or may include non-volatile memory, such as flash memory, a hard disk drive (HDD), or a solid-state drive (SSD), or may further include a combination of the above memories.
[0135] The present disclosure further provides a readable storage medium, comprising computer program instructions, which, when executed by at least one processor of an electronic device, cause the electronic device to implement the method for adjusting a rendering level order provided by any of the method embodiments above.
[0136] The present disclosure further provides a computer program product, which, when executed by a computer, causes the computer to implement the method for adjusting the rendering level order provided by any of the above method embodiments.
[0137] It should be noted that, in this specification, relational terms such as "first" and "second" are merely used to distinguish one entity or operation from another and do not necessarily require or imply the existence of any actual relationship or order between those entities or operations. Furthermore, the terms "comprise," "include," or any other variation thereof are intended to cover a non-exclusive inclusion, whereby a process, method, article, or device comprising a set of elements not only includes those elements, but also includes other elements not expressly listed, or elements inherent in such process, method, article, or device. Absent further limitations, an element qualified by the phrase "comprises one of" does not exclude the presence of other identical elements in the process, method, article, or device that includes that element.
[0138] The foregoing are merely specific embodiments of the present disclosure, enabling those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be embodied in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments set forth herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A method for adjusting a rendering level order, comprising: a step of displaying a rendering level adjustment panel corresponding to a target time position of a timeline track of a video clip in response to a first command triggered for the target time position, wherein marks of a plurality of clip material segments are displayed on the rendering level adjustment panel according to an initial arrangement order, a position interval covered by the plurality of clip material segments on the timeline track includes the target time position, and the initial arrangement order of the marks of the plurality of clip material segments matches an initial rendering level order of the plurality of clip material segments; a step of adjusting a display position of the at least one clip material segment mark on the rendering level adjustment panel in response to a movement operation on the at least one clip material segment mark among the plurality of clip material segment marks, and displaying the plurality of clip material segment marks on the rendering level adjustment panel in accordance with a target arrangement order; and determining a target rendering level order of the plurality of clip material segments according to a target arrangement order of the marks of the plurality of clip material segments in response to a second command triggered to the rendering level adjustment panel.
2. Prior to the step of responding to a first instruction triggered with respect to a target time position of a timeline track of a video clip, the method for adjusting a rendering level order includes: further comprising a step of rendering an image at the target time position of the plurality of clip material segments in accordance with the initial rendering level order and displaying the image at the target time position in a preview area in response to selecting the target time position in the timeline track as a preview position; 2. The method for adjusting a rendering level order according to claim 1, wherein after the step of responding to a second command triggered to the rendering level adjustment panel, the method for adjusting a rendering level order further includes a step of rendering images at the target time positions of the plurality of clip material segments according to the target rendering level order and displaying them in a preview area.
3. A method for adjusting the rendering level order as described in claim 1, wherein when the first command is triggered for a clip material segment of a specified category, all of the multiple clip material segments displayed on the rendering level adjustment panel are clip material segments of the specified category.
4. In response to a third command triggered to the rendering level adjustment panel, displaying marks of clip material segments of all categories whose position intervals covering the timeline track include the target time position on the rendering level adjustment panel; a step of adjusting a display position of the mark of at least one corresponding clip material segment on the rendering level adjustment panel in response to a movement operation on the mark of at least one clip material segment among the marks of the clip material segments of all the categories, and displaying the marks of the clip material segments of all the categories on the rendering level adjustment panel in accordance with a target arrangement order; 4. The method for adjusting the rendering level order according to claim 3, further comprising: determining a target rendering level order for the clip material segments of all categories according to a target arrangement order of the marks of the clip material segments of all categories.
5. The step of determining a target rendering level order of the plurality of clip material segments according to a target arrangement order of the marks of the plurality of clip material segments includes: If there is no clip material segment of the same category at the upper level of the clip material segment on which the move operation is performed, one level after the rendering level corresponding to the clip material segment on which the move operation is performed is a clip material segment of the same category; If there is a clip material segment of the same category at a higher level of the clip material segment on which the move operation is performed, the clip material segment of the same category is at the level one level before the rendering level corresponding to the clip material segment on which the move operation is performed; 5. The method for adjusting the rendering level order according to claim 4, further comprising: when the rendering level order of the clip material segments of the specified category is the same before and after the execution of the move operation, not adjusting the rendering level order of all clip material segments corresponding to the target time position of the plurality of clip material segments.
6. A method for adjusting the rendering level order described in any one of claims 1 to 4, wherein the mark of the clip material segment displayed on the rendering level adjustment panel includes a thumbnail corresponding to the clip material segment and / or descriptive text of the clip material segment.
7. The method for adjusting the rendering level order described in any one of claims 1 to 4 further includes a step of creating a new clip material segment at the target time position in response to a fourth command triggered for the target time position, and determining an initial rendering level corresponding to the newly created clip material segment according to a preset rendering level order.
8. The preset rendering level order is, in descending order, text, sticker, filter, adjustment, and picture-in-picture, and the step of determining an initial rendering level corresponding to the newly created clip material segment according to the preset rendering level order includes: If the newly created clip material segment is a character, determining that the initial rendering level of the newly created clip material segment is the highest level; If the newly created clip material segment is a sticker, determining that the initial rendering level of the newly created clip material segment is lower than that of the lowest level character clip material segment; If the newly created clip material segment is a filter or an adjustment, determining that the initial rendering level of the newly created clip material segment is lower than the lowest level sticker clip material segment; 8. The method for adjusting the rendering level order of claim 7, further comprising: if the newly created clip material segment is picture-in-picture, determining that the initial rendering level of the newly created clip material segment is lower than that of the lowest-level filter or adjustment clip material segment.
9. A rendering level order adjusting device, comprising: a display module; and a rendering level order determining module; the display module is used to display a rendering level adjustment panel corresponding to a target time position of a timeline track of a video clip in response to a first command triggered for the target time position, the marks of a plurality of clip material segments are displayed on the rendering level adjustment panel according to an initial arrangement order, a position interval covered by the plurality of clip material segments on the timeline track includes the target time position, and the initial arrangement order of the marks of the plurality of clip material segments is consistent with an initial rendering level order of the plurality of clip material segments; the display module is further used to adjust a display position of the at least one clip material segment mark on the rendering level adjustment panel in response to a movement operation on the at least one clip material segment mark among the plurality of clip material segment marks, and display the plurality of clip material segment marks on the rendering level adjustment panel in accordance with a target arrangement order; A rendering level order adjustment device, wherein a rendering level order determination module is used to determine a target rendering level order of the plurality of clip material segments according to a target arrangement order of the marks of the plurality of clip material segments in response to a second command triggered to the rendering level adjustment panel.
10. An electronic device comprising: a memory; and a processor; the memory is configured to store computer program instructions; An electronic device, wherein the processor is arranged to execute the computer program instructions to cause the electronic device to implement the method for adjusting a rendering level order according to any one of claims 1 to 4.
11. a readable storage medium containing computer program instructions; A readable storage medium that enables an electronic device to implement the method for adjusting a rendering level order according to any one of claims 1 to 4 by executing the computer program instructions.
12. A computer program, which when executed by a processor, enables the method for adjusting a rendering level order according to any one of claims 1 to 4 to be executed.
Citation Information
Patent Citations
Video clip synthesis method and electronic equipment
CN113891113A
Video preview method and device, equipment and storage medium
CN114827722A
Structure editing device, video structure editing device and computer-readable recording medium recorded with program executed by computer as each means of the devices
JP2002112170A
Program, method and system for selecting video segment, and program for selecting media clip segment
JP2014176086A
Media editing application with anchored timeline for captions and subtitles
US20190104259A1