Video processing method and apparatus, device, and storage medium

Abstract

The present disclosure provides a video processing method and apparatus, a device, and a storage medium. The method comprises: first, in response to highlight recognition of a video clip on a video main track, determining a highlight clip included in a video clip; then determining a video clip corresponding to a secondary track clip on a target secondary track; when the video clip corresponding to the secondary track clip comprises the highlight clip, determining a secondary track sub-clip for the highlight clip from the secondary track clip; and further generating a target video on the basis of the highlight clip and the secondary track sub-clips.

Description

Video processing method, device, equipment and storage medium

[0001] The present application claims priority from the Chinese patent application No. 202411036298.1 filed on July 30, 2024 and entitled "A video processing method, device, equipment and storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present disclosure relates to the field of data processing, and in particular, to a video processing method, device, equipment and storage medium. BACKGROUND

[0003] In the video editing technology, the main track is used to display the video content; the sub-track is used to display the audio, text, special effects and other content added to the video content, and the sub-track includes, for example, a special effect track, an audio track, a text track and the like, wherein the main track and the sub-track on the same video editing interface are different tracks displayed based on the same time axis. SUMMARY

[0004] The present disclosure provides a video processing method, device, equipment and storage medium.

[0005] In a first aspect, the present disclosure provides a video processing method, comprising:

[0006] In response to highlight identification for a video segment on a video main track, determining a highlight segment contained in the video segment;

[0007] Determining a video segment corresponding to a sub-track segment on a target sub-track; the target sub-track and the video main track belong to an audio-video editing component;

[0008] If the video segment corresponding to the sub-track segment contains a highlight segment, determining a sub-track sub-segment for the highlight segment from the sub-track segment;

[0009] Generating a target video based on the highlight segment and the sub-track sub-segment.

[0010] In an optional implementation, if the video segment corresponding to the sub-track segment contains a highlight segment, the sub-track sub-segment for the highlight segment is determined from the sub-track segment, comprising:

[0011] If the video segment corresponding to the sub-track segment contains a highlight segment, determining the sub-track sub-segment corresponding to the highlight segment from the sub-track segment based on a start time difference between the video segment and the sub-track segment, and a start time of the highlight segment in the video segment.

[0012] In an alternative embodiment, the step of determining the sub-track sub-segment corresponding to the highlight sub-segment from the sub-track segment based on the start time difference between the video segment and the sub-track segment and the start time of the highlight sub-segment in the video segment comprises:

[0013] If the number of video segments corresponding to the sub-track segment is not greater than 1, determining the start time difference between the video segment and the sub-track segment as a first start time difference;

[0014] Adjusting the start time of the sub-track segment based on the first start time difference so that the start time difference between the highlight sub-segment and the sub-track segment meets a preset condition;

[0015] If there is a time intersection between the highlight sub-segment and the sub-track segment after the start time is adjusted, segmenting the sub-track sub-segment corresponding to the highlight sub-segment from the sub-track segment.

[0016] In an alternative embodiment, the step of determining the sub-track sub-segment corresponding to the highlight sub-segment from the sub-track segment based on the start time difference between the video segment and the sub-track segment and the start time of the highlight sub-segment in the video segment comprises:

[0017] If the number of video segments corresponding to the sub-track segment is greater than 1, determining an initial highlight sub-segment based on a time sequence;

[0018] Segmenting a sub-track segment corresponding to the initial highlight sub-segment from the sub-track segment based on the start time difference between the video segment to which the initial highlight sub-segment belongs and the sub-track segment, to obtain a segmented sub-track segment corresponding to the sub-track segment;

[0019] Determining a target highlight sub-segment based on the time sequence, and segmenting a sub-track sub-segment corresponding to the target highlight sub-segment from the segmented sub-track segment based on the start time difference between the video segment to which the target highlight sub-segment belongs and the target highlight sub-segment.

[0020] In an alternative embodiment, after the step of determining a target highlight sub-segment based on the time sequence, and segmenting a sub-track sub-segment corresponding to the target highlight sub-segment from the segmented sub-track segment based on the start time difference between the video segment to which the target highlight sub-segment belongs and the target highlight sub-segment, the method further comprises:

[0021] If it is determined that there is still a highlight segment for which a sub-segment of the secondary track has not been determined in the video segment corresponding to the secondary track segment, the target highlight segment is re-determined based on the time sequence, and the step of segmenting the sub-segment of the secondary track corresponding to the target highlight segment from the segmented secondary track segment based on the start time difference between the video segment to which the target highlight segment belongs and the target highlight segment is continuously performed until there is no highlight segment for which a sub-segment of the secondary track has not been determined in the video segment corresponding to the secondary track segment.

[0022] In an optional implementation, the step of segmenting the sub-segment of the secondary track corresponding to the initial highlight segment from the secondary track segment based on the start time difference between the video segment to which the initial highlight segment belongs and the secondary track segment to obtain the segmented secondary track segment corresponding to the secondary track segment comprises:

[0023] The start time difference between the video segment to which the initial highlight segment belongs and the secondary track segment is determined as a second start time difference.

[0024] The start time of the secondary track segment is adjusted according to the second start time difference, so that the start time difference between the initial highlight segment and the secondary track segment after the adjustment of the start time meets a preset condition.

[0025] If there is a time intersection between the secondary track segment after the adjustment of the start time and the initial highlight segment, the sub-segment of the secondary track corresponding to the initial highlight segment is segmented from the secondary track segment to obtain the segmented secondary track segment corresponding to the secondary track segment.

[0026] In an optional implementation, the step of segmenting the sub-segment of the secondary track corresponding to the initial highlight segment from the secondary track segment based on the start time difference between the video segment to which the initial highlight segment belongs and the secondary track segment to obtain the segmented secondary track segment corresponding to the secondary track segment comprises:

[0027] The start time difference between the video segment to which the initial highlight segment belongs and the secondary track segment is determined as a second start time difference.

[0028] The start time of the secondary track segment is adjusted according to the second start time difference, so that the start time difference between the initial highlight segment and the secondary track segment after the adjustment of the start time meets a preset condition.

[0029] If there is a time intersection between the secondary track segment after the adjustment of the start time and the initial highlight segment, the sub-segment of the secondary track corresponding to the initial highlight segment is segmented from the secondary track segment to obtain the segmented secondary track segment corresponding to the secondary track segment.

[0030] In an alternative implementation, before the generating the target video based on the highlight segment and the sub-track segment, the method further comprises:

[0031] playing a preview video in a video preview window; wherein the preview video comprises a preview segment obtained by applying the sub-track segment to the highlight segment;

[0032] displaying the video segment on a preview track corresponding to the video preview window, and displaying the highlight segment with the sub-track segment in the video segment in a preset identification style.

[0033] In an alternative implementation, before the generating the target video based on the highlight segment and the sub-track segment, the method further comprises:

[0034] receiving a highlight interval adjustment request for the highlight segment; wherein the highlight interval adjustment request comprises highlight interval information of an adjusted highlight segment;

[0035] determining, from the sub-track segment, a corresponding sub-track segment for the adjusted highlight segment based on the highlight interval information.

[0036] In an alternative implementation, the target sub-track comprises a picture-in-picture track, and after the determining the sub-track segment for the highlight segment from the sub-track segment, the method further comprises:

[0037] acquiring a video frame picture corresponding to a time interval of the sub-track segment from a picture-in-picture source video file, and updating picture-in-picture content of the sub-track segment by using the video frame picture.

[0038] In a second aspect, the present disclosure provides a video processing device, the device comprising:

[0039] a first determining module configured to determine a highlight segment contained in a video segment on a video main track in response to highlight recognition of the video segment;

[0040] a second determining module configured to determine a video segment corresponding to a sub-track segment on a target sub-track; the target sub-track and the video main track belong to an audio-video editing component;

[0041] a third determining module configured to determine a sub-track segment for the highlight segment from the sub-track segment when the video segment corresponding to the sub-track segment contains the highlight segment;

[0042] a first generating module configured to generate a target video based on the highlight segment and the sub-track segment.

[0043] In a third aspect, the present disclosure provides a computer readable storage medium, having stored therein instructions which, when executed on a terminal device, cause the terminal device to implement the method described above.

[0044] In a fourth aspect, the present disclosure provides a video processing device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the method described above when executing the computer program.

[0045] In a fifth aspect, the present disclosure provides a computer program product, comprising computer programs / instructions which, when executed on a processor, implement the method described above.

[0046] The technical solutions provided by the embodiments of the present disclosure have at least the following advantages compared with the prior art:

[0047] The embodiments of the present disclosure provide a video processing method. Specifically, first, in response to highlight identification for a video segment on a video main track, a highlight segment contained in the video segment is determined. Then, a video segment corresponding to a sub-track segment on a target sub-track is determined. The target sub-track and the video main track belong to an audio-video editing component. If the video segment corresponding to the sub-track segment contains the highlight segment, a sub-track sub-segment for the highlight segment is determined from the sub-track segment. Further, a target video is generated based on the highlight segment and the sub-track sub-segment. BRIEF DESCRIPTION OF DRAWINGS

[0048] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and serve to explain the principles of the present disclosure, together with the description.

[0049] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure or the prior art, the drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, for those skilled in the art, other drawings can also be obtained based on these drawings without creative labor.

[0050] FIG. 1 is a flowchart of a video processing method according to an embodiment of the present disclosure;

[0051] FIG. 2 is a schematic diagram of the relationship between a sub-track segment and a video segment according to an embodiment of the present disclosure;

[0052] FIG. 3 is a schematic diagram of a sub-track segment, a video segment, and a highlight segment according to an embodiment of the present disclosure;

[0053] FIG. 4 is a schematic diagram of a sub-track segment, a video segment, and a highlight segment according to an embodiment of the present disclosure;

[0054] FIG. 5 is a schematic view of a preview video page according to an embodiment of the present disclosure;

[0055] FIG. 6 is a schematic view of a video processing device according to an embodiment of the present disclosure;

[0056] FIG. 7 is a schematic view of a video processing device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0057] In order to more clearly understand the above-mentioned purposes, features and advantages of the present disclosure, the schemes of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0058] In the following description, a large number of specific details are set forth in order to facilitate a thorough understanding of the present disclosure, but the present disclosure can also be implemented in other different manners from those described herein; obviously, the embodiments described in the specification are only a part of the embodiments of the present disclosure, rather than all the embodiments.

[0059] In the video editing technology, the main track is used to display the video content; the sub-track is used to display the audio, text, special effects and other content added to the video content, and the sub-track includes, for example, a special effect track, an audio track, a text track and the like, wherein the main track and the sub-track on the same video editing interface are different tracks displayed based on the same time axis.

[0060] In the traditional video editing technology, after the video main track is cropped, the corresponding sub-track segment of the video main track also needs to be adjusted accordingly, and the corresponding sub-track segment is usually cropped based on the time interval of the edited and cropped video main track on the time axis. However, the above-mentioned method needs to manually realize the cropping of the sub-track segment, and the cropping efficiency is low. Obviously, it cannot meet the needs of users for video editing processing. At present, on the interface for editing the video based on the main track and the sub-track, how to enrich the video editing related functions to meet the video editing experience of users is a technical problem to be solved.

[0061] Therefore, the embodiments of the present disclosure provide a video processing method, specifically, in response to the highlight recognition of the video segment on the video main track, the highlight segment contained in the video segment is determined, then the video segment corresponding to the sub-track segment on the target sub-track is determined, the target sub-track and the video main track belong to an audio-video editing component, if the video segment corresponding to the sub-track segment contains the highlight segment, the sub-track segment for the highlight segment is determined from the sub-track segment, and then the target video is generated based on the highlight segment and the sub-track segment.

[0062] In the embodiments of the present disclosure, after identifying the highlight segment on the video segment on the video main track, the corresponding sub-track segment of the highlight segment contained in the corresponding video segment can be intelligently determined from the sub-track segment on the target sub-track, so as to realize intelligent linkage clipping of the sub-track segment, improve the video clipping efficiency, enrich the video clipping function, and further improve the user's video clipping experience.

[0063] Specifically, the embodiments of the present disclosure provide a video processing method, and a flowchart of the video processing method is provided with reference to FIG. 1, and specifically includes:

[0064] S101: In response to highlight identification of a video segment on a video main track, determining a highlight segment contained in the video segment.

[0065] The video processing method provided by the embodiments of the present disclosure can be applied to a client, wherein the client can be deployed on a terminal such as a smart phone, a tablet computer, a notebook computer, a desktop computer, and the like.

[0066] The video main track is a track for displaying video content on an audio-video editing interface, and one or more video segments can be displayed on the video main track, and the video segment can include media materials uploaded by a user.

[0067] Each video segment can contain one or more highlight segments, and usually, multiple highlight segments identified in the same video segment are merged into one highlight segment. The highlight segment refers to a segment with higher video content and video picture quality in the video segment or a highlight part in the video segment.

[0068] In the embodiments of the present disclosure, usually, multiple highlight segments identified in the same video segment are merged into one highlight segment. Specifically, if it is detected that a video segment contains multiple highlight segments, the multiple highlight segments contained in the video segment are spliced based on time sequence as the highlight segment of the video segment.

[0069] In an optional embodiment, the method for identifying the highlight of the video segment on the video main track can set a highlight identification control. Specifically, when a trigger operation for the highlight identification control is received, the highlight of the video segment on the video main track is identified.

[0070] S102: Determining a video segment corresponding to a sub-track segment on a target sub-track.

[0071] The target sub-track and the video main track belong to an audio-video editing component.

[0072] In the embodiments of the present disclosure, the target sub-track is a track corresponding to the video main track displayed on the audio and video clip interface, and the target sub-track can include a sub-track for displaying special effects, text, filters, picture-in-picture and the like. Specifically, the target sub-track can include a special effect track, a text track, a filter track, and a picture-in-picture track and the like.

[0073] In the embodiments of the present disclosure, the sub-track segment can be a sub-track segment for adding special effects, text, filters, picture-in-picture and the like to the target sub-track. The sub-track segment can be selected from one or more sub-track segments, and the sub-track segment can belong to any type of track in the target sub-track. The sub-track segment includes multimedia content displayed on the corresponding sub-track.

[0074] In the embodiments of the present disclosure, the sub-track segment includes multimedia content displayed on the corresponding sub-track. The multimedia content can include text type content, special effect type content, or filter type content and the like.

[0075] In the embodiments of the present disclosure, the video segment corresponding to the sub-track segment belongs to the video main track, that is, the video main track displays the above-mentioned video segment. The video segment corresponding to the sub-track segment can be one video segment or multiple video segments. Each video segment can include one or more highlight segments. Usually, multiple highlight segments identified in the same video segment are merged into one highlight segment. The highlight segment refers to a segment with high video content and high video quality or a highlight part in the video segment.

[0076] Specifically, the video segment corresponding to the sub-track segment can be a video segment having an overlapping time interval with the sub-track segment on the time axis.

[0077] In one application scenario, the sub-track segment corresponds to one video segment, that is, the time interval of the sub-track segment belongs to a sub-interval of the time interval of the video segment.

[0078] As shown in FIG. 2, it is a schematic diagram of the relationship between the sub-track segment and the video segment provided by the embodiments of the present disclosure. As can be seen from the figure, the time interval of the sub-track segment M is 0-6s, the time interval of the video segment A is 0-10s, and the time interval of the video segment B is 10-20s. As can be seen from the figure, the video segment corresponding to the sub-track segment M is the video segment A.

[0079] In another application scenario, one sub-track segment corresponds to multiple video segments, i.e., the time interval of the sub-track segment spans the time intervals of multiple video segments. As shown in FIG. 2, the time interval of the sub-track segment N is 9-15s, the time interval of the video segment A is 0-10s, the time interval of the video segment B is 10-20s, the time interval of the sub-track segment N spans the time intervals of the video segments A and B, and the sub-track segment N corresponds to two video segments, i.e., the video segment A and the video segment B.

[0080] That is, the sub-track segment and the video segment in the embodiment of the present disclosure can be in a one-to-one relationship, i.e., the time interval of one sub-track segment is within the time interval of one video segment; or the sub-track segment and the video segment can be in a one-to-many relationship, i.e., the time interval of the sub-track segment spans the time intervals of multiple video segments.

[0081] S103: If the video segment corresponding to the sub-track segment contains a highlight segment, a sub-track segment corresponding to the highlight segment is determined from the sub-track segment.

[0082] In order to ensure the video editing effect after the linkage editing of the sub-track segment, the embodiment of the present disclosure can determine the start time of the sub-track segment corresponding to the highlight segment in the video segment according to the time difference between the start time of the video segment corresponding to the sub-track segment and the start time of the sub-track segment.

[0083] Specifically, the start time of the sub-track segment, the start time of the video segment corresponding to the sub-track segment, and the start time of the highlight segment in the video segment are obtained, then the start time of the video segment is subtracted from the start time of the sub-track segment to obtain the start time difference between the video segment and the sub-track segment, and then the sub-track segment corresponding to the highlight segment in the video segment is determined from the sub-track segment. The time difference between the start time of the highlight segment in the video segment and the start time of the sub-track segment corresponds to the start time difference.

[0084] In actual application, the video editing interface supports the function of adding multiple sub-track segments on the same sub-track for the video segments displayed on the main track of the video, so there are cases where one sub-track segment corresponds to one video segment and cases where one sub-track segment corresponds to multiple video segments. Therefore, before determining the sub-track segment corresponding to the highlight segment in the embodiment of the present disclosure, the number of video segments corresponding to the sub-track segment needs to be determined, so as to determine the sub-track segment corresponding to the highlight segment in each video segment in different ways.

[0085] In an alternative implementation, a video segment corresponding to the sub-track segment is obtained, and then it is determined whether the number of video segments corresponding to the sub-track segment is greater than 1. If it is determined that the number of video segments corresponding to the sub-track segment is not greater than 1, that is, the sub-track segment corresponds to one video segment, the start time of the video segment and the start time of the sub-track segment are determined, and a start time difference between the two is calculated as a first start time difference.

[0086] Then, after the first start time difference is determined, the start time of the sub-track segment is adjusted according to the first start time difference, so that the relationship between the start time difference between the highlight segment in the video segment and the sub-track segment and the first start time difference meets a preset condition.

[0087] The preset condition includes that the start time difference between the highlight segment and the sub-track segment is equal to the first start time difference, or the difference between the start time difference and the first start time difference is less than a preset threshold.

[0088] The number of video segments corresponding to the sub-track segment not being greater than 1 can represent that the time interval of the sub-track segment is within the time interval of the video segment, and is a sub-interval of the time interval of the video segment, that is, the sub-track segment corresponds to one video segment.

[0089] In addition, the start time of the sub-track segment is adjusted based on the first start time difference, so that the relationship between the start time difference between the highlight segment and the sub-track segment and the first start time difference meets the preset condition. Specifically, the sub-track segment can be moved along the time axis direction based on the first start time difference until the start time difference between the highlight segment and the sub-track segment is equal to the first start time difference, or the difference between the start time difference and the first start time difference is less than a preset threshold.

[0090] As shown in FIG. 3, it is a schematic diagram of a sub-track segment, a video segment, and a highlight segment provided by an embodiment of the present disclosure. As can be seen from the figure, the sub-track segment M corresponds to the video segment A, the video segment A contains the highlight segment 1, the start time difference between the sub-track segment M and the video segment A is T (the first start time difference), the start time of the highlight segment 1 is t1, and it is assumed that the time axis direction is to the right. Based on T, the sub-track segment M is moved to the right, so that the difference between the start time of the highlight segment 1 and the start time t2 of the adjusted sub-track segment is equal to T.

[0091] In actual application, after adjusting the start time of the sub-track segment and making the start time difference between the highlight segment and the sub-track segment meet the preset condition, the highlight segment corresponding sub-track segment is determined from the sub-track segment. After adjusting the start time of the sub-track segment, the present embodiment further judges whether there is a time intersection between the sub-track segment after adjusting the start time and the highlight segment.

[0092] The time intersection between the sub-track segment after adjusting the start time and the highlight segment can be that the sub-track segment after adjusting the start time has an overlapping time interval with the highlight segment on the time axis. In one application scenario, the time interval of the sub-track segment after adjusting the start time belongs to a sub-interval of the time interval of the highlight segment. In another application scenario, part of the time interval of the sub-track segment after adjusting the start time overlaps part of the time interval of the highlight segment. In yet another application scenario, the time interval of the highlight segment belongs to a sub-interval of the time interval of the sub-track segment after adjusting the start time.

[0093] In an optional embodiment, if it is determined that there is a time intersection between the time interval of the sub-track segment after adjusting the start time and the highlight segment, the overlapping relationship between the time interval of the sub-track segment after adjusting the start time and the time interval of the highlight segment is further detected. If at least one of the following conditions is detected, i.e., part of the time interval of the sub-track segment after adjusting the start time overlaps part of the time interval of the highlight segment, or the time interval of the highlight segment belongs to a sub-interval of the time interval of the sub-track segment after adjusting the start time, the sub-track segment corresponding to the highlight segment is segmented from the sub-track segment after adjusting the start time, and the segmented sub-track segment corresponding to the sub-track segment after adjusting the start time can be discarded.

[0094] As shown in FIG. 3, it can be seen from FIG. 3 that there is a time intersection between the sub-track segment M after adjusting the start time and the highlight segment 1, and the sub-track segment M1 corresponding to the highlight segment 1 is segmented from the sub-track segment after adjusting the start time, and the segmented sub-track segment M2 is discarded.

[0095] In another optional embodiment, if it is determined that there is a time intersection between the sub-track segment after adjusting the start time and the highlight segment, and it is detected that the time interval of the sub-track segment after adjusting the start time belongs to a sub-interval of the time interval of the highlight segment, the sub-track segment after adjusting the start time is taken as the sub-track segment corresponding to the highlight segment.

[0096] In the embodiment of the present disclosure, when it is determined that the number of video segments corresponding to the sub-track segment is not greater than 1, the start time of the sub-track segment is adjusted based on the start time difference between the sub-track segment and the corresponding video segment, so as to ensure that the timing of the sub-track segment corresponding to the highlight segment appearing in the highlight segment is synchronized with the timing of the sub-track segment appearing in the video segment.

[0097] For the case that the number of video segments corresponding to the sub-track segment is greater than 1, it is introduced in subsequent embodiments, which will not be repeated here.

[0098] In actual application, on the basis of determining the sub-track segment corresponding to the highlight segment in the video segment corresponding to the sub-track segment, if the target sub-track to which the sub-track segment belongs contains a picture-in-picture track, it is further needed to adjust the picture-in-picture content of the picture-in-picture track on the basis of determining the sub-track segment corresponding to the highlight segment, so as to ensure that the highlight segment and the picture-in-picture content corresponding thereto maintain a corresponding relationship.

[0099] In an optional implementation, after determining the sub-track segment corresponding to the highlight segment in the video segment corresponding to the sub-track segment, if it is detected that the sub-track segment belongs to a picture-in-picture track, the time interval of the sub-track segment corresponding to the highlight segment is obtained, the video frame picture corresponding to the time interval is obtained from the picture-in-picture source video file based on the time interval of the sub-track segment, and the picture-in-picture content in the sub-track segment is updated by using the video frame picture.

[0100] In the embodiment of the present disclosure, by adjusting the picture-in-picture content in the sub-track segment, the picture-in-picture content in the sub-track segment can be kept in a corresponding relationship with the highlight segment, and the user browsing experience can be improved.

[0101] S104: generating a target video based on the highlight segment and the sub-track segment.

[0102] The target video in the embodiment of the present disclosure is generated based on the highlight segment in the video segment corresponding to the sub-track segment and the corresponding sub-track segment, that is, the target video is composed of the highlight segment and the corresponding sub-track segment.

[0103] In actual application, in order to enrich the video editing processing mode, the embodiment of the present disclosure also supports a preview function for the video segment.

[0104] In an optional implementation, on the basis of determining the sub-track segment corresponding to the highlight segment in the video segment, a preview video is played in a video preview window, wherein the preview video includes a preview segment obtained by applying the sub-track segment to the highlight segment, and the preview video also includes a non-highlight segment in the video segment.

[0105] In addition, the video preview window corresponds to a preview track on which a video segment is displayed, and a highlight segment having a sub-track segment is displayed in the video segment in a preset identification pattern. The preset identification pattern is used to distinguish the highlight segment from a non-highlight segment.

[0106] Notably, the video segment displayed in the preview track includes not only the highlight segment but also the non-highlight segment. In addition, sliding the preview track can display a picture of the highlight segment and a picture of the non-highlight segment.

[0107] As shown in FIG. 4, a schematic diagram of a preview video page provided by an embodiment of the present disclosure is shown. The preview video page displays a video preview window 401 and a preview track on which a video segment is displayed. The video segment includes a highlight segment 402 having a sub-track segment and a non-highlight segment 403.

[0108] In actual applications, to further enrich the video editing method and improve the user editing experience, an embodiment of the present disclosure also supports adjusting a highlight interval of the highlight segment included in the video segment. The adjustment operation triggered for the highlight interval of the highlight segment can occur before generating a target video based on the highlight segment and the sub-track segment, or after generating the target video based on the highlight segment and the sub-track segment and entering a video editing page.

[0109] In an optional implementation, when a highlight interval adjustment request for the highlight segment in the video segment is received, the highlight interval of the highlight segment is adjusted based on highlight interval information of the adjusted highlight segment carried in the highlight interval adjustment request, to obtain an adjusted highlight segment. In addition, the corresponding sub-track segment for the adjusted highlight segment is determined based on the sub-track segment in the video segment corresponding to the video segment to which the adjusted highlight segment belongs.

[0110] The highlight interval adjustment request includes the highlight interval information of the adjusted highlight segment. Specifically, the highlight interval adjustment request includes a time interval of the adjusted highlight segment.

[0111] In actual applications, after generating the target video based on the highlight segment in the video segment corresponding to the sub-track segment and the corresponding sub-track segment, other video editing operations can be performed on the target video. For this purpose, an embodiment of the present disclosure does not make any limitation.

[0112] The video processing method provided in the embodiments of the present disclosure first determines a highlight segment contained in a video segment in response to highlight identification of the video segment on a video main track, then determines a video segment corresponding to a sub-track segment on a target sub-track, the target sub-track and the video main track belong to an audio-video editing component, if the video segment corresponding to the sub-track segment contains the highlight segment, a sub-track sub-segment for the highlight segment is determined from the sub-track segment, and then a target video is generated based on the highlight segment and the sub-track sub-segment.

[0113] In the embodiments of the present disclosure, after a highlight segment is identified for a video segment on a video main track, a corresponding sub-track sub-segment can be intelligently determined for the highlight segment contained in the corresponding video segment from a sub-track segment on a target sub-track, thereby realizing intelligent linkage editing of the sub-track segment, improving video editing efficiency, enriching video editing functions, and further improving the user's video editing experience.

[0114] In another optional implementation, based on the sub-track segment, a video segment corresponding to the sub-track segment is obtained, and it is determined whether the number of the video segments is greater than 1. If it is determined that the number of the video segments corresponding to the sub-track segment is greater than 1, that is, the sub-track segment spans multiple video segments, an initial highlight segment is first determined based on the time sequence. The video segment to which the initial highlight segment belongs is the first video segment corresponding to the sub-track segment based on the time sequence, and the initial highlight segment is all highlight segments in the video segment.

[0115] As shown in FIG. 5, it is a schematic diagram among a sub-track segment, a video segment and a highlight segment provided in the embodiments of the present disclosure. As can be seen from the figure, the sub-track segment N spans the video segment B and the video segment C. Based on the time sequence, the video segment B is the first video segment corresponding to the sub-track segment N, and the video segment B only contains the highlight segment b. Therefore, the highlight segment b is taken as the initial highlight segment.

[0116] After the initial highlight segment is determined based on the time sequence, the starting time of the video segment to which the initial highlight segment belongs and the starting time of the sub-track segment are determined, the difference between the starting times is calculated, and then the sub-track sub-segment corresponding to the initial highlight segment is segmented from the sub-track segment, and the segmented sub-track segment corresponding to the sub-track segment is obtained. The segmented sub-track segment corresponding to the sub-track segment is the sub-track segment in the sub-track segment except the sub-track sub-segment corresponding to the highlight segment.

[0117] In an alternative embodiment, after obtaining the initial start time difference between the initial highlight segment and the sub-track segment, the start time difference between the initial highlight segment and the sub-track segment is taken as a second start time difference, and then the start time of the sub-track segment is adjusted according to the second start time difference, so that the initial start time difference between the initial highlight segment and the sub-track segment and the second start time difference meet a preset condition. The preset condition includes that the initial start time difference between the initial highlight segment and the sub-track segment is equal to the second start time difference, or the difference between the initial start time difference and the second start time difference is less than a preset threshold.

[0118] As shown in FIG. 5, the initial highlight segment is the highlight segment b, the highlight segment b belongs to the video segment B, the start time difference between the video segment B and the sub-track segment N is T1, and the start time of the sub-track segment N is adjusted so that the start time difference between the highlight segment b and the sub-track segment after the start time is adjusted is equal to T1.

[0119] In actual application, after the start time of the sub-track segment is adjusted so that the initial start time difference between the initial highlight segment and the sub-track segment after the start time is adjusted and the second start time difference meet the preset condition, in order to determine the sub-track segment corresponding to the highlight segment from the sub-track segment, the disclosure embodiment further judges whether there is a time intersection between the sub-track segment after the start time is adjusted and the highlight segment after the start time is adjusted.

[0120] In an alternative embodiment, if it is determined that there is a time intersection between the sub-track segment after the start time is adjusted and the initial highlight segment, the overlapping relationship between the time interval of the sub-track segment after the start time is adjusted and the time interval of the initial highlight segment is further detected, if it is detected that there is an overlap between part of the time interval of the sub-track segment after the start time is adjusted and part of the time interval of the highlight segment, or the time interval of the highlight segment belongs to a sub-interval of the time interval of the sub-track segment after the start time is adjusted, the sub-track sub-segment corresponding to the initial highlight segment is segmented from the sub-track segment, and the segmented sub-track segment corresponding to the sub-track segment is obtained.

[0121] As shown in FIG. 5, there is a time intersection between the sub-track segment N after the start time is adjusted and the initial highlight segment (the highlight segment b), so the sub-track segment N is segmented to obtain the sub-track sub-segment N1 corresponding to the initial highlight segment, and the segmented sub-track segment N2 corresponding to the sub-track segment.

[0122] Based on the above-mentioned embodiments, since the sub-track segment corresponds to multiple video segments, after the sub-track sub-segment corresponding to the initial highlight segment is determined, the highlight segment in the second video segment corresponding to the sub-track segment is determined based on the segmented sub-track segment corresponding to the sub-track segment, and the corresponding sub-track sub-segment of the highlight segment is determined from the segmented sub-track segment.

[0123] Specifically, the target highlight segment is determined based on the time sequence, and then the starting time of the target highlight segment and the video segment to which the target highlight segment belongs is determined. The starting time difference between the two is calculated, and based on the starting time difference, the sub-track segment corresponding to the target highlight segment is segmented from the segmented sub-track segment corresponding to the sub-track segment.

[0124] The video segment to which the target highlight segment belongs is the second video segment corresponding to the sub-track segment based on the time sequence, that is, the video segment to which the target highlight segment belongs is the second video segment determined from the video segment corresponding to the sub-track segment based on the time sequence. The target highlight segment is all the highlight segments in the video segment.

[0125] As shown in FIG. 5, the video segment C is the second video segment corresponding to the sub-track segment N, and the highlight segment c in the video segment C is the target highlight segment.

[0126] In an optional implementation, the starting time of the video segment to which the target highlight segment belongs and the starting time of the target highlight segment are determined, the starting time difference between the two is calculated as a third starting time difference.

[0127] Then, based on the third starting time difference, the starting time of the segmented sub-track segment corresponding to the sub-track segment is adjusted, so that the relationship between the starting time difference between the target highlight segment and the segmented sub-track segment and the third starting time difference meets a preset condition. The preset condition includes that the starting time difference between the target highlight segment and the segmented sub-track segment is equal to the third starting time difference, or the difference between the starting time difference and the first starting time difference is less than a preset threshold.

[0128] The starting time of the segmented sub-track segment corresponding to the sub-track segment is adjusted, so that the relationship between the starting time difference between the target highlight segment and the segmented sub-track segment and the third starting time difference meets a preset condition, which can be that the starting time difference between the segmented sub-track segment after the adjustment and the target highlight segment is equal to the third starting time difference.

[0129] As shown in FIG. 5, the target highlight segment is the highlight segment c in the video segment C, and the starting time difference between the target highlight segment and the video segment C is T2. The starting time of the segmented sub-track segment N2 corresponding to the sub-track segment is adjusted, so that the starting time difference between the target highlight segment and the segmented sub-track segment N2 is equal to T2.

[0130] In actual application, after adjusting the start time of the segmented sub-track segment, and making the start time difference between the target highlight segment and the segmented sub-track segment meet the preset condition, it is further judged whether there is time intersection between the segmented sub-track segment after adjusting the start time and the target highlight segment.

[0131] In an alternative embodiment, if it is determined that there is time intersection between the segmented sub-track segment after adjusting the start time and the target highlight segment, a sub-track segment corresponding to the target highlight segment is segmented from the segmented sub-track segment after adjusting the start time.

[0132] As shown in FIG. 5, there is time intersection between the segmented sub-track segment N2 after adjusting the start time and the target highlight segment, and a sub-track segment N21 corresponding to the target highlight segment is segmented from the segmented sub-track segment N2.

[0133] In actual application, after the sub-track segment corresponding to the target highlight segment is segmented from the segmented sub-track segment, there can be more than two video segments in the sub-track segment, and therefore, after the sub-track segment corresponding to the target highlight segment is segmented from the segmented sub-track segment, it is further judged whether there is a highlight segment whose sub-track segment is not determined in the video segment corresponding to the sub-track segment.

[0134] In an alternative embodiment, after the sub-track segment corresponding to the target highlight segment in the second video segment corresponding to the sub-track segment is determined, it is judged whether there is a highlight segment whose sub-track segment is not determined in the next video segment corresponding to the sub-track segment based on time sequence, and if it is determined that there is a highlight segment whose sub-track segment is not determined in the video segment, the processing manner for determining the sub-track segment corresponding to the target highlight segment in the second video segment corresponding to the sub-track segment is referred to for execution, and the step of determining the sub-track segment corresponding to the highlight segment in the video segment corresponding to the sub-track segment is ended when it is determined that there is no highlight segment whose sub-track segment is not determined in the multiple video segments corresponding to the sub-track segment.

[0135] In an application scenario, it is assumed that the sub-track segment corresponds to more than two video segments, and after the sub-track segment of the highlight segment in the second video segment is determined, the sub-track segment corresponding to the highlight segment in the third video segment is determined based on the sub-track segment after the last segmentation.

[0136] Based on the above embodiment, if it is determined that there is no highlight segment whose sub-track segment is not determined in the video segment corresponding to the sub-track segment, the segmented sub-track segment obtained last is discarded.

[0137] Based on the above method embodiments, the disclosure also provides a video processing device. Referring to FIG. 6, a structural schematic diagram of a video processing device according to an embodiment of the disclosure is shown. The device comprises:

[0138] The first determining module 601 is configured to determine a highlight segment contained in a video segment in response to highlight identification of the video segment on a video main track.

[0139] The second determining module 602 is configured to determine a video segment corresponding to a sub-track segment on a target sub-track. The target sub-track and the video main track belong to an audio-video editing component.

[0140] The third determining module 603 is configured to determine a sub-track segment corresponding to the highlight segment from the sub-track segment when the video segment corresponding to the sub-track segment contains the highlight segment.

[0141] The first generating module 604 is configured to generate a target video based on the highlight segment and the sub-track segment.

[0142] In an optional embodiment, the third determining module is specifically configured to:

[0143] If the video segment corresponding to the sub-track segment contains the highlight segment, a sub-track segment corresponding to the highlight segment is determined from the sub-track segment based on a start time difference between the video segment and the sub-track segment and a start time of the highlight segment in the video segment.

[0144] In an optional embodiment, the third determining module comprises:

[0145] The fourth determining module is configured to, when the number of video segments corresponding to the sub-track segment is not greater than 1, determine a start time difference between the video segment and the sub-track segment as a first start time difference.

[0146] The adjusting module is configured to adjust the start time of the sub-track segment according to the first start time difference, so that the relationship between the start time difference between the highlight segment and the sub-track segment and the first start time difference meets a preset condition.

[0147] The first dividing module is configured to, when there is a time intersection between the sub-track segment after the start time is adjusted and the highlight segment, divide the sub-track segment corresponding to the highlight segment from the sub-track segment.

[0148] In an optional embodiment, the third determining module comprises:

[0149] The fifth determining module is configured to, when the number of video segments corresponding to the sub-track segment is greater than 1, determine an initial highlight segment based on time sequence.

[0150] The second splitting module is configured to split the initial highlight segment corresponding sub-track segment from the sub-track segment based on the start time difference between the video segment to which the initial highlight segment belongs and the sub-track segment, to obtain the split sub-track segment corresponding to the sub-track segment.

[0151] The third splitting module is configured to determine a target highlight segment based on the time sequence, and split the target highlight segment corresponding sub-track segment from the split sub-track segment based on the start time difference between the video segment to which the target highlight segment belongs and the target highlight segment.

[0152] In an optional implementation, the apparatus further comprises:

[0153] The sixth determining module is configured to, when it is determined that there is a highlight segment of which the sub-track segment corresponding to the sub-track segment has not been determined in the video segment corresponding to the sub-track segment, re-determine the target highlight segment based on the time sequence, and continue to perform the step of splitting the target highlight segment corresponding sub-track segment from the split sub-track segment based on the start time difference between the video segment to which the target highlight segment belongs and the target highlight segment, until there is no highlight segment of which the sub-track segment corresponding to the sub-track segment has not been determined in the video segment corresponding to the sub-track segment.

[0154] In an optional implementation, the second splitting module comprises:

[0155] The first determining submodule is configured to determine the start time difference between the video segment to which the initial highlight segment belongs and the sub-track segment as a second start time difference.

[0156] The first adjusting submodule is configured to adjust the start time of the sub-track segment according to the second start time difference, so that the start time difference between the initial highlight segment and the sub-track segment and the second start time difference meet a preset condition.

[0157] The first splitting submodule is configured to split the initial highlight segment corresponding sub-track segment from the sub-track segment when there is a time intersection between the initial highlight segment and the sub-track segment after the start time is adjusted, to obtain the split sub-track segment corresponding to the sub-track segment.

[0158] In an optional implementation, the third splitting module comprises:

[0159] The second determining submodule is configured to determine the start time difference between the video segment to which the target highlight segment belongs and the target highlight segment as a third start time difference.

[0160] a second adjusting sub-module, configured to adjust a start time of the segmented secondary track segment according to the third start time difference, so that a start time difference between the target highlight segment and the segmented secondary track segment meets a preset condition in relation to the third start time difference;

[0161] a second segmenting sub-module, configured to segment a secondary track sub-segment corresponding to the target highlight segment from the segmented secondary track segment when the segmented secondary track segment and the target highlight segment have a time intersection after the start time is adjusted.

[0162] In an optional implementation, the apparatus further includes:

[0163] a playing module, configured to play a preview video in a video preview window, wherein the preview video includes a preview segment obtained by applying the secondary track sub-segment to the highlight segment;

[0164] a displaying module, configured to display the video segment on a preview track corresponding to the video preview window, and display the highlight segment with the secondary track sub-segment in a preset display style in the video segment.

[0165] In an optional implementation, the apparatus further includes:

[0166] a receiving module, configured to receive a highlight interval adjustment request for the highlight segment, wherein the highlight interval adjustment request includes highlight interval information of an adjusted highlight segment;

[0167] a seventh determining module, configured to determine, from the secondary track segment, a secondary track sub-segment corresponding to the adjusted highlight segment based on the highlight interval information.

[0168] In an optional implementation, the apparatus further includes:

[0169] an updating module, configured to acquire a video frame picture corresponding to a time interval of the secondary track sub-segment from a picture-in-picture source video file, and update picture-in-picture content of the secondary track sub-segment by using the video frame picture.

[0170] Embodiments of the present disclosure provide a video processing apparatus. Specifically, in response to highlight recognition for a video segment on a video main track, a highlight segment included in the video segment is determined. Then, a video segment corresponding to a secondary track segment on a target secondary track is determined. The target secondary track and the video main track belong to an audio-video editing component. If the video segment corresponding to the secondary track segment includes the highlight segment, a secondary track sub-segment for the highlight segment is determined from the secondary track segment. Furthermore, a target video is generated based on the highlight segment and the secondary track sub-segment.

[0171] In the embodiments of the present disclosure, after the highlight segment is identified for the video segment on the main track of the video, the corresponding sub-track sub-segment can be intelligently determined for the highlight segment contained in the corresponding video segment from the sub-track segment on the target sub-track, so as to realize intelligent linkage clipping for the sub-track segment, improve the video clipping efficiency, enrich the video clipping function, and further improve the user's video clipping experience.

[0172] In addition to the method and device described above, the embodiments of the present disclosure further provide a computer readable storage medium, which stores instructions, and when the instructions are run on a terminal device, the terminal device implements the video processing method provided by the embodiments of the present disclosure.

[0173] The embodiments of the present disclosure further provide a computer program product, which includes computer programs / instructions, and when the computer programs / instructions are executed by a processor, the video processing method provided by the embodiments of the present disclosure is implemented.

[0174] In addition, the embodiments of the present disclosure further provide a video processing device, as shown in FIG. 7, which can include:

[0175] The processor 701, the memory 702, the input device 703 and the output device 704. The number of processors 701 in the video processing device can be one or more, and one processor is taken as an example in FIG. 7. In some embodiments of the present disclosure, the processor 701, the memory 702, the input device 703 and the output device 704 can be connected through a bus or other means, and a connection through a bus is taken as an example in FIG. 7.

[0176] The memory 702 can be used to store software programs and modules, and the processor 701 executes various function applications and data processing of the video processing device by running the software programs and modules stored in the memory 702. The memory 702 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application required by a function, and the like. In addition, the memory 702 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. The input device 703 can be used to receive input digital or character information, and generate signal input related to the user settings and function control of the video processing device.

[0177] Specifically in the present embodiment, the processor 701 will load the executable file corresponding to the process of one or more application programs into the memory 702 according to the following instructions, and run the application program stored in the memory 702 by the processor 701, so as to realize the various functions of the video processing device described above.

[0178] It can be understood that, before using the technical solutions disclosed in the embodiments of the present disclosure, the type of information involved in the present disclosure, the use range, the use scenario, etc. should be informed to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations.

[0179] For example, in response to receiving an active request of a user, a prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed will require obtaining and using personal information of the user. Thus, the user can autonomously select whether to provide the personal information to the software or hardware such as an electronic device, an application program, a server or a storage medium, etc. performing the operation of the technical solutions of the present disclosure according to the prompt information.

[0180] As an optional but non-limiting implementation manner, in response to receiving an active request of a user, the manner of sending a prompt information to the user may, for example, be a pop-up window manner, in which the prompt information can be presented in a text manner. In addition, the pop-up window can also carry a selection control for the user to select “agree” or “disagree” to provide the personal information to the electronic device.

[0181] It can be understood that the above notification and obtaining of user authorization process is only illustrative, and does not limit the implementation manners of the present disclosure, and other manners meeting the relevant laws and regulations can also be applied to the implementation manners of the present disclosure.

[0182] It should be noted that, in this document, the relationship terms such as “first” and “second” are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations. Moreover, the terms “include”, “contain” or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement “including a…” does not exclude the presence of another identical element in the process, method, article or device including the element.

[0183] The above is only a specific implementation of the present disclosure, enabling those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to these embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A video processing method, wherein, include: In response to highlight recognition of a video segment on the main video track, determine the highlight segments contained in the video segment; Identify the video segment corresponding to the sub-track segment on the target sub-track; The target sub-track and the main video track belong to the audio and video editing components; If the video segment corresponding to the subtrack segment contains a highlight segment, then a subtrack sub-segment is determined from the subtrack segment for the highlight segment; The target video is generated based on the highlight fragment and the subtrack fragment.

2. The method according to claim 1, wherein, If the video segment corresponding to the sub-track segment contains a highlight segment, then determining a sub-track sub-segment for the highlight segment from the sub-track segment includes: If the video segment corresponding to the subtrack segment contains a highlight segment, then based on the start time difference between the video segment and the subtrack segment, and the start time of the highlight segment in the video segment, the subtrack sub-segment corresponding to the highlight segment is determined from the subtrack segment.

3. The method according to claim 2, wherein, The step of determining the sub-track sub-segment corresponding to the highlight segment from the sub-track segment based on the start time difference between the video segment and the sub-track segment, and the start time of the highlight segment in the video segment, includes: If the number of video segments corresponding to the sub-track segment is not greater than 1, then the starting time difference between the video segment and the sub-track segment is determined as the first starting time difference. The start time of the sub-track segment is adjusted according to the first start time difference so that the relationship between the start time difference between the highlight segment and the sub-track segment and the first start time difference meets the preset conditions. If there is a temporal overlap between the subtrack segment after adjusting the start time and the highlight segment, then the subtrack sub-segment corresponding to the highlight segment is segmented from the subtrack segment.

4. The method according to claim 2, wherein, The step of determining the sub-track sub-segment corresponding to the highlight segment from the sub-track segment based on the start time difference between the video segment and the sub-track segment, and the start time of the highlight segment in the video segment, includes: If the number of video segments corresponding to the sub-track segment is greater than 1, the initial highlight segment is determined based on the time sequence. Based on the start time difference between the video segment to which the initial highlight segment belongs and the sub-track segment, the sub-track sub-segment corresponding to the initial highlight segment is segmented from the sub-track segment to obtain the segmented sub-track segment corresponding to the sub-track segment; Based on the time sequence, the target highlight segment is determined, and based on the start time difference between the video segment to which the target highlight segment belongs and the target highlight segment, the sub-track segment corresponding to the target highlight segment is segmented from the segmented sub-track segment.

5. The method according to claim 4, wherein, After determining the target highlight segment based on the time sequence, and segmenting the sub-track sub-segment corresponding to the target highlight segment from the segmented sub-track segment based on the start time difference between the video segment to which the target highlight segment belongs and the target highlight segment, the method further includes: If it is determined that there are still highlight segments with undetermined sub-sub-segments in the video segment corresponding to the sub-track segment, then the target highlight segment is re-determined based on the time sequence, and the step of segmenting the sub-track segment corresponding to the target highlight segment from the segmented sub-track segment based on the start time difference between the video segment to which the target highlight segment belongs and the target highlight segment is executed, until there are no more highlight segments with undetermined sub-sub-segments in the video segment corresponding to the sub-track segment.

6. The method according to claim 4, wherein, The process involves segmenting the sub-track segment corresponding to the initial highlight segment from the sub-track segment based on the start time difference between the video segment to which the initial highlight segment belongs and the sub-track segment, resulting in the segmented sub-track segment corresponding to the sub-track segment. This includes: The starting time difference between the video segment to which the initial highlight segment belongs and the sub-track segment is determined as the second starting time difference; The start time of the sub-track segment is adjusted according to the second start time difference so that the relationship between the start time difference between the initial highlight segment and the sub-track segment and the second start time difference meets the preset conditions. If there is a temporal overlap between the subtrack segment after adjusting the start time and the initial highlight segment, then the subtrack sub-segment corresponding to the initial highlight segment is segmented from the subtrack segment to obtain the segmented subtrack segment corresponding to the subtrack segment.

7. The method according to claim 6, wherein, The step of segmenting the sub-track sub-segment corresponding to the target highlight segment from the segmented sub-track segment based on the start time difference between the video segment to which the target highlight segment belongs and the target highlight segment includes: The starting time difference between the video segment to which the target highlight segment belongs and the target highlight segment is determined, and is used as the third starting time difference; The start time of the segmented sub-track segment is adjusted according to the third start time difference so that the relationship between the start time difference between the target highlight segment and the segmented sub-track segment and the third start time difference meets the preset conditions. If there is a temporal overlap between the segmented subtrack segment after adjusting the start time and the target highlight segment, then the subtrack sub-segment corresponding to the target highlight segment is segmented from the segmented subtrack segment.

8. The method according to claim 1, wherein, Before generating the target video based on the highlight fragment and the sub-track fragment, the process further includes: Play a preview video in the video preview window; wherein, the preview video includes a preview segment obtained by applying the subtrack sub-segment to the highlight segment; In addition, the video clip is displayed on the preview track corresponding to the video preview window, and the highlight segment with the sub-track sub-segment is displayed in the video clip with a preset identifier style.

9. The method according to claim 1, wherein, Before generating the target video based on the highlight fragment and the sub-track fragment, the process further includes: Receive a highlight range adjustment request for the highlight segment; wherein the highlight range adjustment request includes highlight range information of the adjusted highlight segment; From the sub-track segment, a corresponding sub-track sub-segment is determined for the adjusted highlight segment based on the highlight interval information.

10. The method according to claim 1, wherein, The target subtrack includes a picture-in-picture track. After determining the subtrack sub-segment for the highlight segment from the subtrack segment, the method further includes: Based on the time interval corresponding to the sub-track segment, video frames corresponding to the time interval are obtained from the picture-in-picture source video file, and the picture-in-picture content of the sub-track segment is updated using the video frames.

11. A video processing apparatus, wherein, The device includes: The first determining module is configured to determine, in response to highlight recognition of a video segment on the main video track, a highlight segment contained in the video segment. The second determining module is used to determine the video segment corresponding to the sub-track segment on the target sub-track; the target sub-track and the main video track belong to the audio and video editing components. The third determining module is used to determine a sub-track sub-segment for the highlight segment from the sub-track segment when the video segment corresponding to the sub-track segment contains a highlight segment. The first generation module is used to generate a target video based on the highlight fragment and the subtrack fragment.

12. A computer-readable storage medium, wherein, The computer-readable storage medium stores instructions that, when executed on a terminal device, cause the terminal device to perform the method as described in any one of claims 1-10.

13. A video processing device, wherein, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the method as claimed in any one of claims 1-10.

14. A computer program product, wherein, The computer program product includes a computer program / instruction that, when executed by a processor, implements the method as described in any one of claims 1-10.

Images