Video processing method and apparatus, electronic device, and storage medium

Abstract

Provided in the embodiments of the present disclosure are a video processing method and apparatus, an electronic device, and a storage medium. The method comprises: creating a target video editing task corresponding to a target video material; in response to a first editing operation for triggering the target video editing task, placing a target video clip formed by the target video material on a video editing track of a video editing interface; in response to a second editing operation on the target video clip, determining a target video editing result of adding to the target video clip a video effect corresponding to the second editing operation, the video effect corresponding to the second editing operation at least comprising a video beat-sync effect or a video speed-changing effect; and presenting a new video corresponding to the target video editing result.

Description

Video processing method, device, electronic device and storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed on January 24, 2024, with application number 202410102772.X and invention name “Video processing method, device, electronic device and storage medium”. The entire contents of that application are incorporated by reference into this application. Technical Field

[0003] The embodiments of the present disclosure relate to the field of computer technology, and in particular to a video processing method, apparatus, electronic device, and storage medium. Summary of the Invention

[0004] The present disclosure provides a video processing method, device, electronic device, and storage medium.

[0005] In a first aspect, an embodiment of the present disclosure provides a video processing method, the method comprising:

[0006] Creating a target video editing task corresponding to the target video material;

[0007] In response to a first editing operation for triggering a target video editing task, placing a target video clip formed by the target video material into a video editing track of a video editing interface;

[0008] In response to a second editing operation on the target video clip, determining a target video editing result of adding a video effect corresponding to the second editing operation to the target video clip, where the video effect corresponding to the second editing operation at least includes a video card effect or a video speed change effect;

[0009] The new video corresponding to the target video editing result is presented.

[0010] In a second aspect, an embodiment of the present disclosure further provides a video processing device, the device comprising:

[0011] A creation module, used to create a target video editing task corresponding to the target video material;

[0012] A first editing module is configured to place a target video clip formed by the target video material into a video editing track of a video editing interface in response to a first editing operation for triggering a target video editing task;

[0013] a second editing module configured to, in response to a second editing operation on a target video segment, determine a target video editing result by adding a video effect corresponding to the second editing operation to the target video segment, wherein the video effect corresponding to the second editing operation includes at least a video card effect or a video speed change effect;

[0014] The video display module is used to present the new video corresponding to the target video editing result.

[0015] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

[0016] at least one processor; and

[0017] a memory communicatively connected to the at least one processor; wherein,

[0018] The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor so that the at least one processor can perform the video processing method according to any one of the above embodiments.

[0019] In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable medium, wherein the computer-readable medium stores computer instructions, and the computer instructions are used to enable a processor to implement the video processing method described in any one of the above embodiments when executed.

[0020] The technical solution of the embodiment of the present disclosure is as follows: when executing a target video editing task on a target video material, a target video editing task corresponding to the target video material is created; in response to a first editing operation for triggering the target video editing task, a target video clip formed by the target video material is placed on a video editing track of a video editing interface; in response to a second editing operation on the target video clip, a target video editing result of adding a video special effect corresponding to the second editing operation to the target video clip is determined, and the video special effect corresponding to the second editing operation includes at least a video card special effect or a video speed change special effect; and a new video corresponding to the target video editing result is presented.

[0021] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0023] FIG1 is a flow chart of a video processing method provided by an embodiment of the present disclosure;

[0024] FIG2 is a flow chart of another video processing method provided by an embodiment of the present disclosure;

[0025] FIG3a is a schematic diagram of a process for adding a video card effect to a video clip according to an embodiment of the present disclosure;

[0026] FIG3 b is a schematic diagram of a process for obtaining a card point in a process of adding a video card point special effect to a video clip provided by an embodiment of the present disclosure;

[0027] FIG4a is a schematic diagram of an orthogonal situation of a video clip and an audio clip on an editing track provided by an embodiment of the present disclosure;

[0028] FIG4 b is a schematic diagram of another orthogonal situation of video clips and audio clips on an editing track provided by an embodiment of the present disclosure;

[0029] FIG4c is a schematic diagram of another orthogonal situation of video clips and audio clips on an editing track provided by an embodiment of the present disclosure;

[0030] FIG4 d is a schematic diagram of another orthogonal situation of a video clip and an audio clip on an editing track provided by an embodiment of the present disclosure;

[0031] FIG4e is a schematic diagram of another orthogonal situation of video clips and audio clips on an editing track provided by an embodiment of the present disclosure;

[0032] FIG5 is a schematic diagram of a design of a frame passer provided in an embodiment of the present disclosure;

[0033] FIG6 is a flow chart of another video processing method provided by an embodiment of the present disclosure;

[0034] FIG7 is a schematic diagram of a process for adding a video speed change effect to a video clip according to an embodiment of the present disclosure;

[0035] FIG8 is a schematic diagram of a branch method for adding a video speed change effect and a video card effect to a video clip provided by an embodiment of the present disclosure;

[0036] FIG9 is a schematic structural diagram of a video processing device provided by an embodiment of the present disclosure;

[0037] FIG10 is a schematic structural diagram of an electronic device for implementing a video processing method provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0038] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0039] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0040] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0041] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0042] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0043] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0044] With the rapid development of online video platforms, the demand for video processing is increasing. For example, sometimes it is hoped to match background music to a video to generate a video with music timing.

[0045] However, the relevant solutions can only edit videos containing specified actions, and the matching of background music needs to be done manually. It is impossible to automatically generate videos based on the rhythm of the background music. This consumes a lot of manpower in actual business scenarios, and the video editing efficiency is low. In addition, errors are prone to occur during the manual editing process, resulting in inaccurate edited videos.

[0046] Figure 1 is a flow chart of a video processing method provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to the case of adding video card point special effects and video speed change special effects to video materials. The method can be executed by a video processing device, which can be implemented in the form of software and / or hardware and is generally integrated on any electronic device with network communication function, which can be a mobile terminal, PC or server, etc.

[0047] As shown in FIG1 , the video processing method according to an embodiment of the present disclosure may include the following steps:

[0048] S110: Create a target video editing task corresponding to the target video material.

[0049] The preset video material library includes candidate video materials, and in response to a triggering operation on a target video material among the candidate video materials, a target video editing task for performing video editing on the target video material is created for the target video material.

[0050] S120 : In response to a first editing operation for triggering a target video editing task, placing a target video segment formed by a target video material into a video editing track of a video editing interface.

[0051] When selecting the target material to create a video editing task, the first editing operation can be triggered for the target video editing task. At this time, the video editing interface is displayed, and the video editing interface presents an editing track. The editing track includes a video track for carrying the video clips corresponding to the video material.

[0052] S130. In response to the second editing operation on the target video clip, determine a target video editing result of adding a video effect corresponding to the second editing operation to the target video clip, where the video effect corresponding to the second editing operation at least includes a video card effect or a video speed change effect.

[0053] Optionally, the target video editing task includes adding video card point effects or video speed change effects to the target video material. Among them, video card point effects are to enhance the rhythm and rhythm of the video by adding special visual effects or transitions at key frames or specific time points in the video during video editing. Video card point effects can make the video produce unique visual changes at these time points. Video speed change effects can refer to changing the playback speed of the video to make it fast forward or slow down; by adjusting the frame rate of the video, the effect of acceleration or deceleration can be achieved. For example, slow motion can highlight the details and actions in the video, while fast motion can create a tense and exciting atmosphere.

[0054] Optionally, the second editing operation is specifically a triggering operation of a target video special effect identifier among at least one candidate video special effect identifier presented for the target video clip, and at least one candidate video special effect identifier presented on the video editing interface is presented in a target special effect display window, which is presented by triggering the addition of an identifier to the special effect presented on the video editing interface corresponding to the target video clip.

[0055] S140: Presenting a new video corresponding to the target video editing result.

[0056] The technical solution of the disclosed embodiment is to create a target video editing task corresponding to the target video material when executing a target video editing task on the target video material; in response to a first editing operation for triggering the target video editing task, place a target video clip formed by the target video material on a video editing track in the video editing interface; in response to a second editing operation on the target video clip, determine a target video editing result of adding a video special effect corresponding to the second editing operation to the target video clip, wherein the video special effect corresponding to the second editing operation includes at least a video card special effect or a video speed change special effect; and present a new video corresponding to the target video editing result. This solution can achieve the rapid addition of video card special effects and video speed change special effects to a video even without professional special effects editing skills, greatly improving the efficiency of special effects editing on the target video material and making the video production process more efficient and convenient.

[0057] Figure 2 is a flow chart of another video processing method provided by an embodiment of the present disclosure. The technical solution of this embodiment further optimizes the process of determining the target video editing result of adding the second editing operation corresponding to the video special effects to the target video segment in the aforementioned embodiment on the basis of the technical solution of the aforementioned embodiment. This embodiment can be combined with various optional solutions in one or more of the aforementioned embodiments.

[0058] As shown in FIG2 , the video processing method according to an embodiment of the present disclosure may include the following steps:

[0059] S210: Create a target video editing task corresponding to the target video material.

[0060] S220 : In response to a first editing operation for triggering a target video editing task, placing a target video segment formed by a target video material into a video editing track of a video editing interface.

[0061] S230: In response to a second editing operation on the target video segment, detecting whether a first target video editing result corresponding to the target video segment exists in the first cache, wherein the video special effects corresponding to the second editing operation at least include video card special effects.

[0062] For a target video clip placed on a video editing track in the video editing interface, if a second editing operation has been triggered for the same target video clip before, the second editing operation will be triggered on the target video clip, and the first target video editing result corresponding to the target video clip generated by adding a video card point special effect corresponding to the second editing operation to the target video clip will be cached in the first cache.

[0063] To this end, referring to Figure 3a, when a second editing operation is triggered for a target video clip placed on a video editing track in the video editing interface, the video editing results stored in the first cache can be traversed to determine whether a first target video editing result generated by adding a video card point special effect corresponding to the second editing operation to the target video clip exists. If so, the first target video editing result corresponding to the target video clip placed on the video editing track in the video editing interface is directly read from the first cache.

[0064] For the above method, when the video clip on the video track is not modified or the video effect that does not affect the video clip is modified, if the first target video editing result stored in the cache can be directly obtained and used from the previous cache, then the operation delay of the second editing operation to obtain the target video editing result will be 0, which means that after the second editing operation, the first target video editing result of the target video clip will be presented immediately without any waiting time. This instant response experience can provide extremely high fluency, making the second editing operation very smooth and natural.

[0065] S240. If not, determine target card point information that matches the target video clip. The target card point information is used to indicate the position or time point in the target video clip where a card point needs to be made, so that the target video clip forms a visual effect of rhythm and cadence at the position or time point where a card point needs to be made.

[0066] Referring to FIG. 3a , if the first cache is searched and verified and the first target video editing result corresponding to the target video clip is not found in the first cache, target checkpoint information matching the target video clip can be determined first. The target checkpoint information can indicate the location or time point in the target video clip where a checkpoint is required. During the video editing process, the target checkpoint information can indicate the time point or location at which the image of the target video clip can be matched to the rhythm or beat of the audio, thereby ensuring that the image of the target video clip matches the rhythm or beat of the audio.

[0067] By determining these target checkpoints, the target video clip can be positioned at the desired checkpoint locations or time points to create a visual effect with a sense of rhythm and flow, enhancing the video's appeal and interest, and making it easier to immerse yourself in the atmosphere. For example, in a video, target checkpoints can be determined based on the rhythm and beat of the music, aligning the video's image with the music's tempo, creating a strong sense of rhythm and flow. In a dance video, target checkpoints can be determined based on key dance moves, aligning the movements with the music's rhythm, enhancing the dance's expressiveness and appeal.

[0068] As an optional but non-limiting implementation, determining target card point information matching the target video segment includes the following steps A1-A3:

[0069] Step A1: Detect whether there is a reference audio clip on the audio editing track of the video editing interface corresponding to the target video clip. The reference audio clip is used to provide a position point or time point where a card point is required in the target video clip of the video editing track.

[0070] Referring to Figure 3a, upon detecting that the first target video editing result generated by adding a video card effect corresponding to the second editing operation to the target video clip is not present in the first cache, the system further checks whether a reference audio clip exists in the audio editing track on the video editing interface corresponding to the target video clip currently being edited. The reference audio clip is used to provide the location or time point in the target video clip where the card point is to be added. Specifically, the reference audio clip is extracted from the audio clip's rhythm and beat to generate the location or time point in the target video clip where the card point is to be added.

[0071] Optionally, the reference audio clip can be an audio clip corresponding to the audio material imported synchronously when the target video material is imported, and of course it can also be an audio clip associated with the video special effect corresponding to the second editing operation, which can be used as a reference. The reference audio clip contains the rhythm and beat information of the audio, which can assist in determining the position or time point in the target video clip where the card point needs to be made.

[0072] Step A2: If a reference audio clip exists, determine the target check point information that the reference audio clip is to provide to the target video clip. The target check point information includes the number of music beats in the reference audio clip and the time offset of each music beat on the time axis corresponding to the reference audio clip.

[0073] As shown in Figure 3a, if a reference audio clip is detected in the audio editing track on the video editing interface corresponding to the target video clip, target checkpoint information for the reference audio clip to be provided to the target video clip is further determined. This target checkpoint information includes two key elements: the number of musical beats and the time offset of each musical beat on the timeline corresponding to the reference audio clip.

[0074] The number of beats in the reference audio clip indicates the number of beats in the reference audio clip. The time offset indicates the relative position of each beat on the timeline of the reference audio clip. It can be expressed in time units (such as seconds or milliseconds) to indicate the specific time position of each beat in the reference audio clip. For example, target card point information can be represented as the following array: Array<{offsetMs,beats}> data, where beats represents the beat number in the audio clip (typically 4 / 4 or 3 / 4 beats), and offsetMs is the time offset of beats on the timeline of the audio clip.

[0075] Step A3: If there is no reference audio segment, the pre-stored default card point information is determined as the target card point information matched with the target video segment.

[0076] As shown in Figure 3a, if the target video clip's audio editing track on the video editing interface doesn't contain a reference audio clip, the pre-stored default checkpoint information will be used as the target checkpoint information for the target video clip. Default checkpoint information is a pre-set set of commonly used checkpoint patterns or rules, which can be set based on general music rhythm and video editing requirements. It provides a basic checkpoint reference, allowing you to add a basic sense of rhythm and flow to the target video clip even without a specific reference audio clip.

[0077] In this solution, the purpose of the target checkpoint information is to synchronize the rhythm of the reference audio clip with the target video clip. By obtaining the music beat count and time offset, the desired checkpoint location can be precisely located in the target video clip, achieving a coordinated effect between the music and the video.

[0078] As an optional but non-limiting implementation, detecting whether there is a first target video editing result corresponding to the target video segment in the first cache includes the following steps B1-B2:

[0079] Step B1. Determine the first video identifier corresponding to the target video clip. The first video identifier is determined based on the storage path of the target video material corresponding to the target video clip, the start and end time of the target video clip, the audio identifier of the reference audio clip corresponding to the target video clip, and the relative position of the reference audio clip and the target video clip on the reference timeline. The reference audio clip is the audio clip on the audio editing track that overlaps with the target video clip on the reference timeline. The reference timeline is the timeline corresponding to the video editing track and the audio editing track of the video editing interface.

[0080] Step B2: Detect whether there is a first target video editing result in the first cache that matches the first video identifier corresponding to the target video segment.

[0081] When the video clip on the video track is not modified or the modification does not affect the final effect, leveraging the previous cache can reduce the response delay of the second edit operation to zero, greatly improving the smoothness of the operation. However, introducing cache is a risky operation because inaccurate calculations may introduce errors, resulting in changes not being detected, leading to application failure. Therefore, it is necessary to design a cache calculation factor to determine the cache's accuracy. When adding the video card point special effect corresponding to the second edit operation to the target video clip, this solution first considers the target video clip itself. The uniqueness of the video is determined by the video clip's file path plus the start and end time stamps of each video playback. Secondly, the reference audio clip is considered. The audio clip's unique representation and the card point information involved in generating the speed-shifted video are used to mark it (if there is no reference audio clip, a default key is used). Finally, the relative position of the reference audio and video clips on the timeline is considered. The overlapping position of the two is marked (if there is no overlap, a default key is used). This method obtains the first video identifier corresponding to the target video clip, and then accurately searches the cache for the corresponding first target video editing result.

[0082] As an optional but non-limiting implementation, determining target card point information to be provided by the reference audio segment to the target video segment includes the following steps C1-C3:

[0083] Step C1: Detect whether the second buffer contains target card point information to be provided to the target video segment by the reference audio segment.

[0084] Step C2: If the target card point information exists in the second cache, the target card point information matching the target video clip pre-stored in the second cache is obtained.

[0085] Referring to Figure 3b, when determining the target card point information to be provided by the reference audio segment to the target video segment, a priority attempt is made to search and verify whether the target card point information related to the reference audio segment is already stored in the second cache. The second cache is a temporary storage area for storing data, which can improve data access speed in certain situations. If the target card point information is detected in the second cache, the target card point information that matches the target video segment can be quickly retrieved from the second cache. This avoids repeated calculations or obtaining the same information from other data sources, thereby improving efficiency. Optionally, if the target card point information exists in the second cache, the target card point information stored in the second cache can be TrimRange filtered and returned to the caller. By performing TrimRange filtering on the second cache, it is ensured that the target card point information returned to the caller is relevant to the current needs.

[0086] Step C3: If the target card point information does not exist in the second cache, obtain the target card point information of the reference audio segment generated by parsing the audio beats in the reference audio segment by the server or the local terminal to be provided to the target video segment.

[0087] Referring to Figure 3b, if there is no target card point information related to the reference audio clip in the second cache, it is necessary to use the server or local terminal to parse the audio beats in the reference audio clip, and the generated reference audio clip will provide the target card point information of the target video clip.

[0088] Through the above steps, the target card point information can be efficiently acquired and processed to meet the video editing requirements of the video clip. This process aims to increase data access speed and reduce repeated calculations, thereby improving the overall video editing performance and editing experience.

[0089] As an optional but non-limiting implementation, obtaining target card point information of a target video clip to be provided by the generated reference audio clip after parsing the audio beats in the reference audio clip by the server or local terminal includes the following steps D1-D3:

[0090] Step D1: Detect whether the target card point information to be provided to the target video segment by the reference audio segment exists on the server.

[0091] Step D2: If the target card point information does not exist in the second cache and the target card point information does not exist on the server, after the first card point information is fully written into the second cache, the target card point information of the reference audio clip corresponding to the first card point information to be provided to the target video clip is obtained from the second cache. The first card point information is the target card point information of the reference audio clip generated by parsing the audio beats in the reference audio clip by calling the video editor of the local terminal and providing the reference audio clip generated by the parsing to the target video clip.

[0092] Step D3: If the target card point information does not exist in the second cache and the target card point information exists on the server, then after the second card point information is fully written into the second cache, the target card point information of the reference audio clip corresponding to the second card point information to be provided to the target video clip is obtained from the second cache. The second card point information is the target card point information of the reference audio clip to be provided to the target video clip obtained by racing the first acquisition operation and the second acquisition operation. The first acquisition operation is used to call the video editor of the local terminal to parse the audio beats in the reference audio clip to generate the target card point information to be provided to the target video clip by the reference audio clip. The second acquisition operation is used to request the server to pull the target card point information to be provided to the target video clip by the reference audio clip from the server.

[0093] Referring to Figure 3b, when the target card point information does not exist in the second cache and the target card point information does not exist on the server, the video editor VE of the local terminal can be directly called to parse the audio beats in the reference audio clip and provide the target card point information of the reference audio clip generated by the analysis to the target video clip, and write the generated target card point information in full into the second cache to facilitate subsequent reading of the target card point information from the second cache.

[0094] Referring to Figure 3b, when the target card point information does not exist in the second cache and exists on the server, to improve card point acquisition efficiency, not only is the target card point information of the reference audio clip to be provided to the target video clip pulled from the server, but the local terminal's video editor is also simultaneously called to parse the audio beats in the reference audio clip and provide the target card point information of the reference audio clip generated from the parsed reference audio clip to the target video clip. The local terminal's video editor is then asked to race to generate card points and pull card points from the server. The target card point information of the reference audio clip to be provided to the target video clip that is completed first is fully written to the second cache. Whether the card point information is generated locally or pulled from the server, it is fully written to the cache for future use.

[0095] S250: Curve-shift the target video segment according to the target card point information to generate a first target video editing result by adding a video special effect corresponding to the second editing operation to the target video segment.

[0096] As shown in Figure 3a, the target card point information for the target video clip is the key time point or position determined during the video editing process, which is used to mark the part of the video that needs to be carded. The target video clip can be the target for curve speed change and video effects.

[0097] After obtaining the target card point information for the target video clip, the playback speed of the target video clip can be adjusted between key time points based on the target card point information, achieving a speed change effect. Curved speed change allows the video to play at different speeds at different time points, creating unique visual effects. After the target video clip is subjected to the curved speed change, the first target video editing result is obtained. The first target video editing result can be saved as a new video file or used in further video production processes.

[0098] Optionally, the second editing operation corresponding to the video special effects can include not only special effects editing operations on the target video clip based on the curve speed change, such as adjusting color, applying transition effects and other special effects editing operations, but also special processing for changing the appearance and effects of the video, such as blurring, color correction, filters, particle effects and other special effects editing operations.

[0099] As an optional but non-limiting implementation, the target video segment is subjected to a curve speed change according to the target card point information to generate a first target video editing result for adding a video special effect corresponding to the second editing operation to the target video segment, including the following steps E1-E2:

[0100] Step E1. Determine the first target curve speed change parameter information to be provided by the reference audio clip to the target video clip based on the target card point information. The reference audio clip is the audio clip on the audio editing track that overlaps with the target video clip on the reference time axis. The reference time axis is the time axis corresponding to the video editing track and the audio editing track of the video editing interface.

[0101] Step E2: curve speed change is performed on the target video segment according to the first target curve speed change parameter information, to generate a first target video editing result by adding a video special effect corresponding to the second editing operation to the target video segment.

[0102] Audio clips on the audio editing track of the video editing interface that overlap with the target video clip on the reference timeline can be used as reference audio clips for the target video clip. Five scenarios are derived based on the orthogonality of the reference audio clip and the target video clip on the editing track. Curved speed changes are applied only to the sections of the video clip that are expected to be orthogonal, while sections without orthogonal speeds are played at their original speed. If there is no reference audio clip, the default speed change is used for the entire target video clip.

[0103] As an optional but non-limiting implementation, performing curve speed change on the target video segment according to the first target curve speed change parameter information to generate a first target video editing result for adding a video special effect corresponding to the second editing operation to the target video segment includes the following steps F1-F2:

[0104] Step F1: Curve-shift the speed of a reference video segment in the target video segment according to first target curve-shift parameter information. The reference video segment is a portion of the target video segment that overlaps with the reference audio segment on a reference time axis.

[0105] Step F2: Generate a first target video editing result for adding a video special effect corresponding to the second editing operation to the target video segment based on the curve speed change result of the reference video segment.

[0106] Referring to Figure 4a, taking Video 1 as the target video segment, when the orthogonal overlapping portion between the target video segment and the reference audio segment is in the second half of the target video segment, the first half of the target video segment is played at the original speed, and the orthogonal overlapping portion of the second half of the target video segment adopts curve speed change.

[0107] Referring to Figure 4b, video 1 is taken as the target video segment. The orthogonal overlapping part between the target video segment and the reference audio segment is in the first half of the target video segment. The first half of the target video segment is curve-speeded, and the orthogonal overlapping part of the second half of the target video segment is played at the original speed.

[0108] Referring to Figure 4c, video 1 is used as the target video segment. The orthogonal overlapping portion between the target video segment and the reference audio segment is in the middle portion of the target video segment. The first and second halves of the target video segment are played at the original speed, and the orthogonal portion in the middle is played at the original speed.

[0109] Referring to FIG4d , video 1 is used as the target video segment. The length of the orthogonal overlap between the target video segment and the reference audio segment is equal to the length of the target video segment. The entire target video segment is speed-changed using a curve.

[0110] Referring to FIG4e , video 1 is used as the target video segment. The target video segment has no matching reference audio segment. In this case, the entire target video segment uses the default curve speed change.

[0111] As an optional but non-limiting implementation, determining first target curve speed change parameter information to be provided to the target video segment by the reference audio segment based on the target card point information includes the following steps H1-H2:

[0112] Step H1: Based on the target card point information, a curve speed change parameter acquisition request is sent to the curve speed change parameter generator, and the response of the curve speed change parameter generator is monitored.

[0113] Step H2: Based on the monitored response message generated by the curve speed change parameter generator, determine the first target curve speed change parameter information to be provided by the reference audio segment to the target video segment.

[0114] As shown in Figure 5, there is a timer inside the frame jumper, which can periodically call the NLE frame jump operation interface to submit the curve speed change parameter acquisition request EffectRequest to the curve speed change parameter generator Effect. At the same time, the frame jumper will register the Effect Response listener. When the response message generated by the curve speed change parameter generator arrives, the message will be processed using the MessageHandler injected from the outside. If the response message Response generated by the curve speed change parameter generator is paged, after collecting the response messages generated by all the curve speed change parameter generators, the external PageMergingHandler will be called for final processing, and then the first target curve speed change parameter information to be provided to the target video segment by the processed reference audio segment will be returned to the caller.

[0115] The framer is designed as the foundation for communication with the curve speed parameter generator Effect. Different businesses can inject custom MessageHandlers and PageMergingHandlers for reuse. This improves code reusability and scalability, allowing different businesses to customize processing according to their own needs.

[0116] S260: Presenting a new video corresponding to the target video editing result.

[0117] The technical solution of the disclosed embodiment is to create a target video editing task corresponding to the target video material when executing a target video editing task on the target video material; in response to a first editing operation for triggering the target video editing task, place a target video clip formed by the target video material on a video editing track in the video editing interface; in response to a second editing operation on the target video clip, determine a target video editing result of adding a video special effect corresponding to the second editing operation to the target video clip, wherein the video special effect corresponding to the second editing operation includes at least a video card special effect; and present a new video corresponding to the target video editing result. This solution can achieve the rapid addition of video card special effects to a video even without professional special effects editing skills, greatly improving the efficiency of special effects editing on the target video material and making the video production process more efficient and convenient.

[0118] Figure 6 is a flow chart of another video processing method provided by an embodiment of the present disclosure. The technical solution of this embodiment further optimizes the process of determining the target video editing result of adding the second editing operation corresponding to the video special effects to the target video segment in the aforementioned embodiment on the basis of the technical solution of the aforementioned embodiment. This embodiment can be combined with various optional solutions in one or more of the aforementioned embodiments.

[0119] As shown in FIG6 , the video processing method according to the embodiment of the present disclosure may include the following steps:

[0120] S610: Create a target video editing task corresponding to the target video material.

[0121] S620: In response to a first editing operation for triggering a target video editing task, a target video segment formed by a target video material is placed in a video editing track of a video editing interface.

[0122] S630: In response to a second editing operation on the target video segment, detecting whether a second target video editing result corresponding to the target video segment exists in the first cache, wherein the video special effects corresponding to the second editing operation at least include a video speed change special effect.

[0123] Referring to Figure 7, for the target video clip placed on the video editing track of the video editing interface, if the second editing operation has been triggered for the same target video clip before, then the second editing operation will be triggered on the target video clip, and the second target video editing result corresponding to the target video clip generated by adding the corresponding video speed change effect of the second editing operation to the target video clip will be cached in the first cache.

[0124] To this end, referring to Figure 7, when a second editing operation is required for a target video clip placed on a video editing track in the video editing interface, the video editing results stored in the first cache can be traversed to determine whether a second target video editing result generated by adding a video speed change effect corresponding to the second editing operation to the target video clip exists. If so, the second target video editing result corresponding to the target video clip placed on the video editing track in the video editing interface is directly read from the first cache.

[0125] For the above method, when the video clip on the video track is not modified or the video effect that does not affect the video clip is modified, if the video editing result stored in the cache can be directly obtained from the previous cache and used, then the operation delay of the second editing operation to obtain the target video editing result will be 0, which means that after the second editing operation, the target video editing result of the target video clip will be presented immediately without any waiting time. This instant response experience can provide extremely high fluency, making the second editing operation very smooth and natural.

[0126] Optionally, if it exists, the second target video editing result corresponding to the target video segment is read from the first cache.

[0127] For the above method, when the video clip on the video track is not modified or the video effect that does not affect the video clip is modified, if the second target video editing result stored in the cache can be directly obtained from the previous cache and used, then the operation delay of the second editing operation to obtain the target video editing result will be 0, which means that after the second editing operation, the second target video editing result of the target video clip will be presented immediately without any waiting time. This instant response experience can provide extremely high fluency, making the second editing operation very smooth and natural.

[0128] As an optional but non-limiting implementation, referring to FIG7 , detecting whether there is a first target video editing result corresponding to the target video segment in the first buffer includes the following steps K1-K2:

[0129] Step K1: Determine a second video identifier corresponding to a target video segment. The second video identifier is determined based on a storage path of a target video material corresponding to the target video segment and a start and end time of the target video segment.

[0130] Step K2: Detect whether there is a second target video editing result in the first cache that matches the second video identifier corresponding to the target video segment.

[0131] When the video clip on the video track is not modified or the modification of the video clip does not affect the final effect, if the previous cache is used, the response delay of the second editing operation can be reduced to 0, thereby greatly improving the smoothness of the operation. However, introducing a cache is a dangerous operation, because in the case of inaccurate calculations, errors may be introduced, resulting in changes that cannot be monitored, causing application failure. For this reason, it is necessary to design a cache calculation factor to determine the accuracy of the cache. For the process of adding a second editing operation corresponding to the video speed change effect to the target video clip, this solution mainly considers the target video clip itself. The uniqueness of the video is determined by the file path of the video clip itself plus the start and end time stamps of each video playback, so as to obtain the second video identifier corresponding to the target video clip, and then accurately search the cache for the corresponding second target video editing result.

[0132] S640: If not, determine the expected duration information after speed-changing the target video segment.

[0133] S650: Perform curve speed change on the target video segment according to the expected duration information, and generate a second target video editing result by adding a video special effect corresponding to the second editing operation to the target video segment.

[0134] As an optional but non-limiting implementation, referring to FIG. 5 and FIG. 7 , a target video segment is subjected to a curve speed change based on the desired duration information to generate a second target video editing result by adding a video special effect corresponding to the second editing operation to the target video segment, including the following steps M1-M3:

[0135] Step M1: Based on the expected duration information, a curve speed change parameter acquisition request is sent to a curve speed change parameter generator, and a response from the curve speed change parameter generator is monitored.

[0136] Step M2: Determine the second target curve speed change parameter information to be provided by the reference audio segment to the target video segment based on the monitored response message generated by the curve speed change parameter generator.

[0137] Step M3: curve speed change is performed on the target video segment according to the second target curve speed change parameter information, to generate a second target video editing result by adding a video special effect corresponding to the second editing operation to the target video segment.

[0138] S660: Present a new video corresponding to the editing result of the second target video.

[0139] Referring to Figure 8, the video special effects for adding the second editing operation to the target video clip include two processes: video card point special effects and video speed change special effects. The two processes of video card point special effects and video speed change special effects will have multiple process branches due to whether the first cache is hit and whether there is a reference audio clip, and a total of 5 branches will be derived.

[0140] The technical solution of the disclosed embodiment is to create a target video editing task corresponding to the target video material when executing a target video editing task on the target video material; in response to a first editing operation for triggering the target video editing task, place a target video clip formed by the target video material on a video editing track of the video editing interface; in response to a second editing operation on the target video clip, determine a target video editing result of adding a video special effect corresponding to the second editing operation to the target video clip, wherein the video special effect corresponding to the second editing operation includes at least a video speed change special effect; and present a new video corresponding to the target video editing result. This solution can achieve the rapid addition of a video speed change special effect to a video even without professional special effects editing skills, greatly improving the efficiency of special effects editing on the target video material and making the video production process more efficient and convenient.

[0141] Figure 9 is a structural schematic diagram of a video processing device provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to the case of adding video card point special effects and video speed change special effects to video materials. The video processing device can be implemented in the form of software and / or hardware and is generally integrated on any electronic device with network communication function, which can be a mobile terminal, PC or server, etc.

[0142] As shown in FIG9 , the video processing device according to an embodiment of the present disclosure may include the following:

[0143] A creation module 910 is used to create a target video editing task corresponding to a target video material;

[0144] A first editing module 920 is configured to place a target video clip formed by the target video material into a video editing track on a video editing interface in response to a first editing operation for triggering a target video editing task;

[0145] A second editing module 930 is configured to, in response to a second editing operation on a target video segment, determine a target video editing result by adding a video effect corresponding to the second editing operation to the target video segment, where the video effect corresponding to the second editing operation includes at least a video card effect or a video speed change effect;

[0146] The video display module 940 is used to present the new video corresponding to the target video editing result.

[0147] Based on the above embodiment, optionally, the second editing operation is specifically a triggering operation of a target video special effect identifier among at least one candidate video special effect identifier presented for the target video clip, and the at least one candidate video special effect identifier presented on the video editing interface is presented in a target special effect display window, and the target special effect display window is presented by triggering the special effect addition identifier presented on the video editing interface corresponding to the target video clip.

[0148] Based on the above embodiment, optionally, the video special effect corresponding to the second editing operation includes at least a video card special effect, and determining a target video editing result of adding the video special effect corresponding to the second editing operation to the target video clip includes:

[0149] Detecting whether a first target video editing result corresponding to the target video segment exists in the first buffer;

[0150] If not, determining target card point information that matches the target video segment, wherein the target card point information is used to indicate a position point or a time point in the target video segment where a card point needs to be placed, so that the target video segment forms a visual effect of rhythm and cadence at the position point or time point where a card point needs to be placed;

[0151] Performing curve speed change on the target video segment according to the target card point information, and generating a first target video editing result by adding a video special effect corresponding to the second editing operation to the target video segment;

[0152] If so, the first target video editing result corresponding to the target video segment is read from the first cache.

[0153] Based on the above embodiment, optionally, determining target check point information matched by the target video segment includes:

[0154] Detecting whether there is a reference audio clip on the audio editing track of the video editing interface corresponding to the target video clip, wherein the reference audio clip is used to provide a position point or time point where a check point is required in the target video clip of the video editing track;

[0155] If a reference audio clip exists, determining target checkpoint information of the reference audio clip to be provided to the target video clip, the target checkpoint information including the number of music beats in the reference audio clip and the time offset of each music beat on the time axis corresponding to the reference audio clip;

[0156] If there is no reference audio segment, pre-stored default card point information is determined as target card point information matched with the target video segment.

[0157] Based on the above embodiment, optionally, detecting whether a first target video editing result corresponding to the target video segment exists in the first cache includes:

[0158] Determining a first video identifier corresponding to the target video clip, the first video identifier being determined based on a storage path of a target video material corresponding to the target video clip, a start and end time of the target video clip, an audio identifier of a reference audio clip corresponding to the target video clip, and a relative position of the reference audio clip and the target video clip on a reference timeline, the reference audio clip being a portion of an audio clip on an audio editing track that overlaps with the target video clip on a reference timeline, and the reference timeline being a timeline corresponding to a video editing track and an audio editing track in a video editing interface;

[0159] It is detected whether there is a first target video editing result in the first cache that matches the first video identifier corresponding to the target video segment.

[0160] Based on the above embodiment, optionally, determining target card point information to be provided by the reference audio segment to the target video segment includes:

[0161] detecting whether target card point information to be provided by the reference audio segment to the target video segment exists in the second buffer;

[0162] If the target card point information exists in the second cache, obtaining the target card point information matching the target video clip pre-stored in the second cache;

[0163] If the target card point information does not exist in the second cache, the server or the local terminal parses the audio beats in the reference audio segment, and obtains the target card point information of the reference audio segment to be provided to the target video segment.

[0164] Based on the above embodiment, optionally, obtaining target card point information of the reference audio segment to be provided to the target video segment by parsing the audio beats in the reference audio segment by the server or the local terminal includes:

[0165] Detecting whether target card point information to be provided by the reference audio segment to the target video segment exists on the server;

[0166] If the target card point information does not exist in the second cache and the target card point information also does not exist on the server, then after the first card point information is fully written to the second cache, the target card point information of the reference audio segment corresponding to the first card point information to be provided to the target video segment is obtained from the second cache, where the first card point information is the target card point information of the reference audio segment generated by parsing the audio beats in the reference audio segment by invoking a video editor on the local terminal and providing the reference audio segment generated by the parsing to the target video segment.

[0167] If the target card point information does not exist in the second cache and the target card point information exists on the server, after the second card point information is fully written into the second cache, the target card point information of the reference audio clip corresponding to the second card point information to be provided to the target video clip is obtained from the second cache. The second card point information is the target card point information of the reference audio clip to be provided to the target video clip obtained by racing the first acquisition operation and the second acquisition operation. The first acquisition operation is used to call the video editor of the local terminal to parse the audio beats in the reference audio clip to generate the target card point information of the reference audio clip to be provided to the target video clip. The second acquisition operation is used to request the server to pull the target card point information of the reference audio clip to be provided to the target video clip from the server.

[0168] Based on the above embodiment, optionally, performing curve speed change on the target video segment according to the target card point information to generate a first target video editing result for adding a video special effect corresponding to the second editing operation to the target video segment includes:

[0169] Determining, based on the target card point information, first target curve speed parameter information to be provided by the reference audio clip to the target video clip, wherein the reference audio clip is a portion of the audio clip on the audio editing track that overlaps with the target video clip on a reference timeline, and the reference timeline is a timeline corresponding to the video editing track and the audio editing track in the video editing interface;

[0170] The target video segment is subjected to curve speed change according to the first target curve speed change parameter information, and a first target video editing result is generated by adding a video special effect corresponding to the second editing operation to the target video segment.

[0171] Based on the above embodiment, optionally, determining first target curve speed change parameter information to be provided by the reference audio segment to the target video segment according to the target card point information includes:

[0172] Based on the target card point information, a curve speed change parameter acquisition request is sent to a curve speed change parameter generator, and a response of the curve speed change parameter generator is monitored;

[0173] Based on the monitored response message generated by the curve speed change parameter generator, first target curve speed change parameter information to be provided by the reference audio segment to the target video segment is determined.

[0174] Based on the above embodiment, optionally, performing curve speed change on the target video segment according to the first target curve speed change parameter information to generate a first target video editing result for adding a video special effect corresponding to the second editing operation to the target video segment includes:

[0175] Performing curve speed change on a reference video segment in the target video segment according to the first target curve speed change parameter information, wherein the reference video segment is a portion of the target video segment that overlaps with the reference audio segment on a reference time axis;

[0176] According to the curve speed change result of the reference video segment, a first target video editing result is generated for adding a video special effect corresponding to the second editing operation to the target video segment.

[0177] Based on the above embodiment, optionally, the video special effect corresponding to the second editing operation includes at least a video speed change effect, and determining a target video editing result of adding the video special effect corresponding to the second editing operation to the target video segment includes:

[0178] Detecting whether a second target video editing result corresponding to the target video segment exists in the first cache;

[0179] If not, determining the expected duration information of the target video segment after speed change;

[0180] Performing curve speed change on the target video segment according to the expected duration information, and generating a second target video editing result by adding a video special effect corresponding to the second editing operation to the target video segment;

[0181] If so, the second target video editing result corresponding to the target video segment is read from the first cache.

[0182] Based on the above embodiment, optionally, detecting whether a first target video editing result corresponding to the target video segment exists in the first cache includes:

[0183] Determining a second video identifier corresponding to the target video segment, where the second video identifier is determined based on a storage path of a target video material corresponding to the target video segment and a start and end time of the target video segment;

[0184] It is detected whether there is a second target video editing result matching the second video identifier corresponding to the target video segment in the first cache.

[0185] Based on the above embodiment, optionally, performing curve speed change on the target video segment according to the expected duration information to generate a second target video editing result by adding a video special effect corresponding to the second editing operation to the target video segment includes:

[0186] Based on the expected duration information, sending a curve speed change parameter acquisition request to a curve speed change parameter generator, and monitoring a response from the curve speed change parameter generator;

[0187] determining, based on the monitored response message generated by the curve speed change parameter generator, second target curve speed change parameter information to be provided by the reference audio segment to the target video segment;

[0188] The target video segment is subjected to curve speed change according to the second target curve speed change parameter information, and a second target video editing result is generated by adding a video special effect corresponding to the second editing operation to the target video segment.

[0189] The technical solution of the disclosed embodiment is to create a target video editing task corresponding to the target video material when executing a target video editing task on the target video material; in response to a first editing operation for triggering the target video editing task, place a target video clip formed by the target video material on a video editing track in the video editing interface; in response to a second editing operation on the target video clip, determine a target video editing result of adding a video special effect corresponding to the second editing operation to the target video clip, wherein the video special effect corresponding to the second editing operation includes at least a video card special effect or a video speed change special effect; and present a new video corresponding to the target video editing result. This solution can achieve the rapid addition of video card special effects and video speed change special effects to a video even without professional special effects editing skills, greatly improving the efficiency of special effects editing on the target video material and making the video production process more efficient and convenient.

[0190] The video processing device provided in the embodiments of the present disclosure can execute the video processing method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects for executing the video processing method.

[0191] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0192] Figure 10 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Referring to Figure 10 below, it shows a schematic diagram of the structure of an electronic device (such as the terminal device or server in Figure 10) 1000 suitable for implementing an embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in Figure 10 is only an example and should not bring any limitations to the functions and scope of use of the embodiments of the present disclosure.

[0193] As shown in FIG10 , the electronic device 1000 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. Various programs and data required for the operation of the electronic device 1000 are also stored in the RAM 1003. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An edit / output (I / O) interface 1005 is also connected to the bus 1004.

[0194] Typically, the following devices may be connected to the I / O interface 1005: an input device 1006 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1007 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1008 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the electronic device 1000 to communicate with other devices wirelessly or by wire to exchange data. Although FIG. 10 illustrates the electronic device 1000 with various devices, it should be understood that not all of the devices shown are required to be implemented or present. More or fewer devices may alternatively be implemented or present.

[0195] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 1009, or installed from the storage device 1008, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the video processing method of the embodiment of the present disclosure are performed.

[0196] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0197] The electronic device provided by the embodiment of the present disclosure and the video processing method provided by the above embodiment belong to the same inventive concept. For technical details not fully described in this embodiment, please refer to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0198] An embodiment of the present disclosure provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the video processing method provided by the above embodiment is implemented.

[0199] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0200] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0201] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0202] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: creates a target video editing task corresponding to the target video material; in response to a first editing operation for triggering the target video editing task, places the target video clip formed by the target video material on the video editing track of the video editing interface; in response to a second editing operation on the target video clip, determines a target video editing result of adding a video special effect corresponding to the second editing operation to the target video clip, and the video special effect corresponding to the second editing operation at least includes a video card special effect or a video speed change special effect; and presents a new video corresponding to the target video editing result.

[0203] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0204] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0205] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0206] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0207] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0208] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0209] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0210] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A video processing method, comprising: Creating a target video editing task corresponding to the target video material; In response to a first editing operation for triggering the target video editing task, placing a target video segment formed by the target video material on a video editing track of a video editing interface; In response to a second editing operation on the target video segment, determining a target video editing result of adding a video special effect corresponding to the second editing operation to the target video segment, where the video special effect corresponding to the second editing operation at least includes a video beat effect or a video speed change effect; Presenting a new video corresponding to the target video editing result.

2. The method according to claim 1, wherein the second editing operation is specifically a triggering operation on a target video special effect identifier among at least one candidate video special effect identifier presented for the target video segment, and the at least one candidate video special effect identifier presented on the video editing interface is presented in a target special effect display window, and the target special effect display window is presented when triggering an effect addition identifier presented on the video editing interface corresponding to the target video segment.

3. The method according to claim 1, wherein the video special effect corresponding to the second editing operation at least includes a video beat effect, and determining a target video editing result of adding a video special effect corresponding to the second editing operation to the target video segment includes: Detecting whether a first target video editing result corresponding to the target video segment exists in a first cache; If not, determining target beat information matching the target video segment, where the target beat information is used to indicate a position point or time point in the target video segment where a beat is required, so that a visual effect with a sense of rhythm and rhythm is formed at the position point or time point where the target video segment requires a beat; Performing curve speed change on the target video segment according to the target beat information to generate a first target video editing result of adding a video special effect corresponding to the second editing operation to the target video segment; If it exists, reading the first target video editing result corresponding to the target video segment from the first cache.

4. The method according to claim 3, wherein determining the target beat information matching the target video segment includes: Detecting whether a reference audio segment exists on an audio editing track of a video editing interface corresponding to the target video segment, where the reference audio segment is used to provide a position point or time point in the target video segment on the video editing track where a beat is required; If a reference audio segment exists, determining the target beat information to be provided by the reference audio segment to the target video segment, where the target beat information includes the number of music beats in the reference audio segment and the time offset of each music beat on the time axis corresponding to the reference audio segment; If no reference audio segment exists, determining the default beat information stored in advance as the target beat information matching the target video segment.

5. The method according to claim 4, wherein detecting whether a first target video editing result corresponding to the target video segment exists in a first cache includes: Determine a first video identifier corresponding to the target video segment, where the first video identifier is determined based on the storage path of the target video material corresponding to the target video segment, the start and end times of the target video segment, the audio identifier of the reference audio segment corresponding to the target video segment, and the relative position of the reference audio segment and the target video segment on the reference timeline. The reference audio segment is a partial audio segment on the audio editing track that overlaps with the target video segment on the reference timeline, and the reference timeline is the timeline corresponding to the video editing track and the audio editing track in the video editing interface; Detect whether there is a first target video editing result in the first cache that matches the first video identifier corresponding to the target video segment.

6. The method according to claim 4, wherein determining the target beat information that the reference audio segment is to provide to the target video segment includes: Detect whether there is target beat information that the reference audio segment is to provide to the target video segment in the second cache; If there is target beat information in the second cache, obtain the target beat information pre-stored in the second cache that matches the target video segment; If there is no target beat information in the second cache, obtain the target beat information that the reference audio segment is to provide to the target video segment generated by parsing the audio beats in the reference audio segment by the server or the local terminal.

7. The method according to claim 6, wherein obtaining the target beat information that the reference audio segment is to provide to the target video segment generated by parsing the audio beats in the reference audio segment by the server or the local terminal includes: Detect whether there is target beat information that the reference audio segment is to provide to the target video segment on the server; If there is no target beat information in the second cache and there is also no target beat information on the server, after the first beat information is fully written into the second cache, obtain the target beat information that the reference audio segment corresponding to the first beat information is to provide to the target video segment from the second cache. The first beat information is the target beat information that the audio beats in the reference audio segment are parsed by calling the video editor of the local terminal and provided to the target video segment; If the target keyframe information does not exist in the second cache but exists on the server, after the second keyframe information is fully written into the second cache, the target keyframe information corresponding to the reference audio segment to be provided to the target video segment is obtained from the second cache. The second keyframe information is the target keyframe information that the reference audio segment to be provided to the target video segment obtained by racing ahead through the first acquisition operation and the second acquisition operation. The first acquisition operation is used to call the video editor of the local terminal to parse the audio beats in the reference audio segment to generate the target keyframe information that the reference audio segment is to provide to the target video segment. The second acquisition operation is used to request from the server to pull the target keyframe information that the reference audio segment is to provide to the target video segment.

8. The method according to claim 4, wherein performing curve speed change on the target video segment according to the target keyframe information to generate a first target video editing result for adding video special effects corresponding to the second editing operation to the target video segment, includes: Determining first target curve speed change parameter information that the reference audio segment is to provide to the target video segment according to the target keyframe information, where the reference audio segment is a partial audio segment on the audio editing track that overlaps with the target video segment on the reference time axis, and the reference time axis is the time axis corresponding to the video editing track and the audio editing track in the video editing interface; Performing curve speed change on the target video segment according to the first target curve speed change parameter information to generate a first target video editing result for adding video special effects corresponding to the second editing operation to the target video segment.

9. The method according to claim 8, wherein determining first target curve speed change parameter information that the reference audio segment is to provide to the target video segment according to the target keyframe information, includes: Based on the target keyframe information, sending a curve speed change parameter acquisition request to the curve speed change parameter generator and listening for the response of the curve speed change parameter generator; Based on the response message generated by the curve speed change parameter generator monitored, determining first target curve speed change parameter information that the reference audio segment is to provide to the target video segment.

10. The method according to claim 8, wherein performing curve speed change on the target video segment according to the first target curve speed change parameter information to generate a first target video editing result for adding video special effects corresponding to the second editing operation to the target video segment, includes: Performing curve speed change on the reference video segment in the target video segment according to the first target curve speed change parameter information, where the reference video segment is a partial video segment of the target video segment that overlaps with the reference audio segment on the reference time axis; Generating a first target video editing result for adding video special effects corresponding to the second editing operation to the target video segment according to the curve speed change result of the reference video segment.

11. The method according to claim 1, wherein the video special effects corresponding to the second editing operation at least include video speed change special effects. Determining the target video editing result of adding the video special effects corresponding to the second editing operation to the target video segment includes: Detecting whether there is a second target video editing result corresponding to the target video segment in the first cache; If not, determining the expected duration information after changing the speed of the target video segment; Performing curve speed change on the target video segment according to the expected duration information to generate a second target video editing result of adding the video special effects corresponding to the second editing operation to the target video segment; If it exists, reading the second target video editing result corresponding to the target video segment from the first cache.

12. The method according to claim 11, wherein detecting whether there is a first target video editing result corresponding to the target video segment in the first cache includes: Determining a second video identifier corresponding to the target video segment, where the second video identifier is determined based on the storage path of the target video material corresponding to the target video segment and the start and end times of the target video segment; Detecting whether there is a second target video editing result in the first cache that matches the second video identifier corresponding to the target video segment.

13. The method according to claim 11, wherein performing curve speed change on the target video segment according to the expected duration information to generate a second target video editing result of adding the video special effects corresponding to the second editing operation to the target video segment includes: Based on the expected duration information, sending a curve speed change parameter acquisition request to a curve speed change parameter generator and listening for the response of the curve speed change parameter generator; Based on the response message generated by the curve speed change parameter generator monitored, determining the second target curve speed change parameter information that the reference audio segment is to provide to the target video segment; Performing curve speed change on the target video segment according to the second target curve speed change parameter information to generate a second target video editing result of adding the video special effects corresponding to the second editing operation to the target video segment.

14. A video processing device, comprising: A creation module, configured to create a target video editing task corresponding to a target video material; A first editing module, configured to place the target video segment formed by the target video material on a video editing track of a video editing interface in response to a first editing operation for triggering the target video editing task; A second editing module, configured to determine a target video editing result of adding video special effects corresponding to a second editing operation to the target video segment in response to a second editing operation on the target video segment, where the video special effects corresponding to the second editing operation at least include video beat special effects or video speed change special effects; A video display module, configured to present a new video corresponding to the target video editing result.

15. An electronic device, comprising: One or more processors; A storage device, configured to store one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the video processing method according to any one of claims 1-13.

16. A storage medium containing computer-executable instructions, wherein the computer-executable instructions are used to execute the video processing method according to any one of claims 1-13 when executed by a computer processor.

Images