Video processing methods, apparatus, devices, and media

Abstract

An embodiment of the present disclosure relates to a video processing method, apparatus, device, and medium, the method including: obtaining a reference cut edit operation sequence including at least one reference cut edit operation arranged according to an operation priority specified by a user; and guiding a user step-by-step to perform a reference cut edit operation on a target video by providing operation suggestions according to the priority of the reference cut edit operations, wherein each reference cut edit operation in the reference cut edit operation sequence has a corresponding operation suggestion.

Description

Technical Field

[0001] [Cross - reference to Related Applications] This application is based on an application with a CN application number of 202111432171.8 and a filing date of November 29, 2021, claims its priority, and the disclosure content of the CN application is incorporated herein in its entirety into this application.

[0002] This disclosure relates to the technical field of video processing, and particularly relates to a video processing method, apparatus, device, and medium.

Background Art

[0003] In some video cut - editing applications, a "cut - edit in the same way" function is provided to users. Specifically, a plurality of template videos are provided to users, and these template videos are all obtained by performing a series of cut - editing operations such as special effects, transitions, and speed changes on the original video material in advance. After the user selects the required template video and the cut - editing target material, the video cut - editing application directly performs cut - editing on the cut - editing target material based on the template video, and provides the cut - editing finished product to the user. This cut - editing finished product has the same cut - editing operations as the template video selected by the user and can present the same cut - editing effect.

Summary of the Invention

[0004] According to some embodiments of this disclosure, a video processing method is provided. The method includes at least one referenceThe process includes: obtaining a reference cut editing operation sequence that includes a cut editing operation; for the first cut editing operation in the reference cut editing operation sequence, issuing an operation prompt to the trigger control corresponding to the first cut editing operation in the cut editing operation interface so that the user can perform the first cut editing operation on the target video using the trigger control corresponding to the first cut editing operation; and for a cut editing operation that is not the first in the reference cut editing operation sequence, if it is detected that the user has already performed a cut editing operation prior to the non-first cut editing operation, issuing an operation prompt to the trigger control corresponding to the non-first cut editing operation in the cut editing operation interface so that the user can perform the non-first cut editing operation on the target video using the trigger control corresponding to the non-first cut editing operation.

[0005] According to some embodiments of this disclosure, a video processing method is provided, the method comprising at least one arrangement of operations specified by the user according to an operational priority order. reference This includes obtaining a reference cut editing operation sequence that includes cut editing operations, and guiding the user step-by step to perform the reference cut editing operations on the target video by presenting the operations according to the priority of the reference cut editing operations, Of the aforementioned reference cut editing operation sequence Each reference cut editing operation has one corresponding operation suggestion.

[0006] In some embodiments, providing operation suggestions according to the priority of the reference cut editing operations includes, for the first cut editing operation in the reference cut editing operation sequence, issuing an operation suggestion to the trigger control corresponding to the first cut editing operation in the cut editing operation interface so that the user can perform the first cut editing operation on the target video using the trigger control corresponding to the first cut editing operation; and, for a cut editing operation that is not the first in the reference cut editing operation sequence, if it is detected that the user has already performed a cut editing operation prior to the non-first cut editing operation, issuing an operation suggestion to the trigger control corresponding to the non-first cut editing operation in the cut editing operation interface so that the user can perform the non-first cut editing operation on the target video using the trigger control corresponding to the non-first cut editing operation.

[0007] In some embodiments, the step of obtaining a reference cut editing operation sequence corresponding to the target video includes performing a cut editing operation analysis on a template video, which is a video obtained by cutting and editing at least one original material segment selected by the user according to a cut editing means indicated by a predetermined cut editing template, to obtain a cut editing operation sequence for the template video, and setting the cut editing operation sequence for the template video as a reference cut editing operation sequence specified by the user.

[0008] In some embodiments, the method further includes, in response to a user's operation withdrawal command, rolling back the current cut editing state presented by the target video to a previous cut editing state, wherein the current cut editing state is a video presentation state corresponding to the operation to be withdrawn as instructed by the operation withdrawal command, and the previous cut editing state is a video presentation state corresponding to the cut editing operation prior to the operation to be withdrawn.

[0009] In some embodiments, the method further includes performing a specified termination operation in response to receiving a termination command or in response to having finished performing the last cut editing operation in the reference cut editing operation sequence, wherein the termination operation includes a video save operation and / or a video cut editing interface termination operation.

[0010] In some embodiments, the method further includes, in response to receiving a restart command, rolling back the current cut editing state presented by the target video to the initial state of the target video, and / or, in response to receiving a loop playback command, rolling back the current cut editing state presented by the target video to the initial state of the target video after having finished executing the last cut editing operation in the reference cut editing operation sequence.

[0011] In some embodiments, a video cut editing interface displays trigger controls corresponding to multiple cut editing operations, each of which is in an unavailable state, and the step of issuing an operation prompt in the cut editing interface for a trigger control corresponding to a non-first cut editing operation includes switching the trigger control corresponding to the non-first cut editing operation from the unavailable state to an available state, and issuing a prompt message in the cut editing interface by means specified to indicate that the trigger control is available.

[0012] In some embodiments, providing operation suggestions according to the priority of the reference cut editing operations includes determining the reference cut editing operation currently to be performed based on the priority of the reference cut editing operations and the current presentation state of the target video, setting the icon corresponding to the currently performed reference cut editing operation as the target icon, switching the target icon from an unavailable state to an available state, and issuing a suggestion message indicating that the target icon is available by a specified means.

[0013] In some embodiments, the method further includes issuing a message asking whether to continue video cut editing in response to the user not performing an operation corresponding to an operation prompt issued by the user for a predetermined amount of time, and performing a video save operation and / or a video cut editing interface termination operation in response to receiving a confirmation command that video cut editing will not be continued.

[0014] In some embodiments, the method further includes, in response to receiving a confirmation command to continue video cut editing, waiting for the user to perform the operation corresponding to the operation prompt within a specified time.

[0015] In some embodiments, the icons corresponding to playback, pause, and video process drag operations displayed in the video editing interface are all available for use.

[0016] According to some embodiments of this disclosure, at least one of the operations specified by the user, arranged in order of priority referenceThe present invention provides a video processing device comprising: a sequence acquisition module for acquiring a reference cut editing operation sequence including a cut editing operation; a first suggestion module for causing the user to perform the first cut editing operation on the target video using the trigger control corresponding to the first cut editing operation in the cut editing operation interface, in order to enable the user to perform the first cut editing operation on the target video using the trigger control corresponding to the first cut editing operation; and a second suggestion module for causing the user to perform the second cut editing operation on the target video using the trigger control corresponding to the second cut editing operation in the cut editing operation interface, when the present invention detects that the user has already performed a cut editing operation prior to the second cut editing operation in the reference cut editing operation sequence.

[0017] According to some embodiments of this disclosure, at least one of the operations specified by the user, arranged in order of priority reference The module includes a sequence acquisition module for obtaining a reference cut editing operation sequence that includes cut editing operations, and a presentation module for guiding the user step-by step to perform the reference cut editing operations on a target video by presenting the operations according to the priority of the reference cut editing operations. Of the aforementioned reference cut editing operation sequence Each reference cut editing operation further provides a video processing device having a corresponding operation prompt.

[0018] In some embodiments, the suggestion module includes a first suggestion module for the first cut edit operation in the reference cut edit operation sequence, which causes the user to perform the first cut edit operation on the target video using the trigger control corresponding to the first cut edit operation in the cut edit operation interface; and a second suggestion module for a cut edit operation that is not the first in the reference cut edit operation sequence, which, when it is detected that the user has already performed a cut edit operation prior to the non-first cut edit operation, causes the user to perform the non-first cut edit operation on the target video using the trigger control corresponding to the non-first cut edit operation in the cut edit operation interface.

[0019] Some embodiments of the present disclosure further provide electronic devices comprising a processor and a memory for storing instructions executable by the processor, wherein the processor reads the executable instructions from the memory and is used to execute the instructions to implement a video processing method provided in any of the embodiments described above.

[0020] According to some embodiments of the present disclosure, a computer-readable storage medium is further provided which stores a computer program for performing a video processing method provided in any of the embodiments described above.

[0021] According to some embodiments of the present disclosure, a computer program is further provided which, when executed by a processor, includes instructions causing the processor to perform the video processing method described in any of the embodiments described above.

[0022] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood from the following description.

Brief Description of the Drawings

[0023] The drawings herein are incorporated into the specification and form a part of the specification, showing embodiments suitable for the present disclosure and used in conjunction with the specification to interpret the principles of the present disclosure.

[0024] To more clearly illustrate the technical solutions in the embodiments of the present disclosure or in the prior art, the drawings necessary for the description of the embodiments or the prior art will be briefly described below. Obviously, those skilled in the art can obtain other drawings based on these drawings without creative efforts.

[0025] [Figure 1] It is a flowchart of the video processing method provided by the embodiments of the present disclosure. [Figure 2] It is a state transition schematic diagram provided by the embodiments of the present disclosure. [Figure 3] It is a structural schematic diagram of the operation sequence tree provided by the embodiments of the present disclosure. [Figure 4a] It is a schematic diagram of the interface of the video cut editing application provided by the embodiments of the present disclosure. [Figure 4b] It is a schematic diagram of the interface of the video cut editing application provided by the embodiments of the present disclosure. [Figure 4c] It is a schematic diagram of the interface of the video cut editing application provided by the embodiments of the present disclosure. [Figure 5] It is a structural schematic diagram of the video processing device provided by the embodiments of the present disclosure. [Figure 6] It is a structural schematic diagram of the electronic device provided by the embodiments of the present disclosure.

Modes for Carrying Out the Invention

[0026] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the technical proposals of this disclosure are further described below. It should be noted that, to the extent that they do not conflict, the embodiments and features relating to this disclosure can be combined with each other.

[0027] While the following description includes many specific details to facilitate understanding of the disclosure, the disclosure may be implemented in other forms different from those described herein. Clearly, the examples in the specification represent only a selection of, not all, examples of the disclosure.

[0028] The inventors found that the "cut and edit in the same way" function in conventional video editing applications cuts and edits the user's uploaded original material based on a template video selected directly by the user, and then presents the finished cut and edited product to the user. This not only lacks user participation, but the template video is a complete black box to the user, requiring the user to guess the cut and editing sequence used in the template video, and making it difficult to change. For example, if the cut editing sequence used in template video 1 is A, B, and C, and A, B, and C represent different cut editing operations such as transitions, special effects, and speed changes, then when the user uses the "cut editing in the same way" function on template video 1, the video cut editing application directly cuts and edits the user's material based on the A, B, and C cut editing sequence, presenting the user with the final cut edit. All of the effects A, B, and C are already added to this cut edit. In other words, the cut edit seen by the user is the finished product screen after the three types of effects A, B, and C have been applied. In this case, the user cannot reliably perceive what cut editing operations were actually applied to the cut edit, or in what order each cut editing operation was performed. For example, the user cannot accurately perceive whether two effects, three effects, or four effects were added to the resulting cut edit. The conventional "cut editing in the same way" function actually performs all cut editing operations on the user's material in one go, but the specific operations performed remain a black box for the user. Furthermore, it is difficult for users to adjust the finished cut edits. Even if they try to make changes, they can only perform subsequent operations based on the finished cut edit. For example, if the final state of the finished cut edit after performing operations A, B, and C is "C done," the user can only further process it based on "C done," and cannot create a finished cut edit that includes, for example, only cut editing operation A.

[0029] To improve at least one of the above problems, embodiments of the present disclosure provide video processing methods, apparatus, devices and media, which are described in detail below.

[0030] Figure 1 is a schematic flowchart of a video processing method provided by an embodiment of the present disclosure, the method being executable by a video processing device, which can be implemented by employing software and / or hardware and is generally integrable into electronic devices. As shown in Figure 1, the method mainly comprises the following steps S102 to S106.

[0031] In step S102, a sequence of reference cut editing operations is obtained, which includes at least one reference cut editing operation arranged according to the operation priority specified by the user.

[0032] In some embodiments, the user can first upload a target video and then, in response to a cut-edit command on the target video, obtain a reference cut-edit operation sequence specified by the user. In other embodiments, in response to a selection command on a template video by the user, the cut-edit operation sequence of the template video may be set as a reference cut-edit operation sequence specified by the user, and then the user may be prompted to upload a target video based on the reference cut-edit operation sequence, thereby enabling the user to cut-edit the target video based on the reference cut-edit operation sequence. The target video may be video material previously uploaded by the user, video material shot by the user in real time, or video material selected by the user from a photo album. Cut-edit commands can be issued by the user.

[0033] For example, in several specific application scenarios, if a user selects video footage that needs to be cut (target video) and a template video that needs to be referenced, and then selects the "Cut and Edit Like" function, it is considered that a cut and edit command has been issued. Alternatively, if a user selects the "Replay" function (replays the cut and edit operation sequence of the template video) for the template video that needs to be referenced, it is considered that a cut and edit command has been issued, in which case the reference cut and edit operation sequence corresponding to the target video is obtained.

[0034] In several specific embodiments for obtaining a reference cut editing operation sequence, a cut editing operation analysis is performed on a template video selected by the user to obtain a cut editing operation sequence for the template video, and then this sequence can be used as a reference cut editing operation sequence specified by the user. A template video is a video in which at least one original material segment has been cut and edited according to the cut editing means indicated by a predetermined cut editing template. The template creator may upload it to the video cut editing application for public use, or it may be officially released by the video cut editing application. The cut editing template includes information such as the cut editing operation type and operation order. Generally, what the video cut editing application provides to the user is a video obtained based on a cut editing template (i.e., a template video), allowing the user to intuitively understand the video effects that can be achieved with the template. The video cut editing application can provide the user with many template videos, and since different cut editing templates are used for different template videos, the effects presented will naturally be different. After the user selects a template video that needs to be referenced as needed, the video cut editing application can perform a cut editing operation analysis on that template video. In other words, template videos are reference videos for users who want to "cut and edit in the same way" as mentioned earlier, and users can choose their own template videos.

[0035] In some embodiments, the template video is also generated based on the video cut editing application, so the cut editing operation sequence of the reference video is recorded in the video cut editing application, and when performing cut editing operation analysis on the template video, the cut editing record can be directly obtained, and the cut editing operation sequence can be obtained based on the cut editing record.

[0036] In another embodiment, since the template video is a video obtained by cutting and editing at least one original material segment according to a cut editing means indicated by a predetermined cut editing template, the corresponding predetermined cut editing template can be directly called and a cut editing operation sequence can be extracted from the predetermined cut editing template.

[0037] In step S104, for the first cut editing operation in the reference cut editing operation sequence, an operation prompt is issued in the cut editing operation interface to the trigger control corresponding to the first cut editing operation, so that the user performs the first cut editing operation on the target video using the trigger control corresponding to the first cut editing operation.

[0038] In some embodiments, the cut editing interface can display trigger controls (which may also be called cut editing operation entries) corresponding to multiple cut editing operations, thereby making it easier for the user to perform the corresponding cut editing operation via the trigger controls. Different trigger controls may have different control indicators (icons) in the cut editing interface, and the trigger controls may be displayed in the form of virtual buttons. When the user clicks such a virtual button, it is assumed that the trigger control is activated so that the user can perform the corresponding cut editing operation.

[0039] In step S106, if it is detected that the user has already performed a cut editing operation prior to a cut editing operation that is not the first in the reference cut editing operation sequence, the cut editing operation interface will issue an operation prompt to the trigger control corresponding to the non-first cut editing operation, causing the user to perform the non-first cut editing operation on the target video using the trigger control corresponding to the non-first cut editing operation.

[0040] For example, if the reference cut editing operation sequence is A, B, and C, first an operation prompt is issued to the trigger control corresponding to cut editing operation A. If it is detected that the user has already performed cut editing operation A, an operation prompt is issued to the trigger control corresponding to cut editing operation B. If it is detected that the user has already performed cut editing operation B, an operation prompt is issued to the trigger control corresponding to cut editing operation C.

[0041] In steps S104 and S106 described above, an operation prompt can be initiated based on a reference cut editing operation sequence so that the user performs an operation corresponding to the operation prompt on the target video. Among the reference cut editing operation sequences Each reference cut editing operation corresponds to one operation prompt, and any operation prompt that is not the first is initiated after the operation corresponding to the previous operation prompt has been completed.

[0042] In other words, the operation can be presented according to the priority of the reference cut editing operations included in the reference cut editing operation sequence. Among the reference cut editing operation sequences Each reference cut editing operation has one corresponding operation prompt. For example, if a reference cut editing operation sequence includes a transition, special effects, and speed change from front to back, the transition prompt can be initiated first. After the user performs the transition operation, the special effects prompt can be initiated, and after the user performs the special effects operation, the speed change prompt can be initiated. The user can perform the corresponding operation according to the prompt, and through step-by-step prompting, the user can realize a replay effect of the cut editing operations used in the template video on the target video they uploaded, and the user will clearly understand the specific cut editing operations and their sequence used in the template video. When the user no longer wants to perform the corresponding operation, they can terminate the process. At this point, the user's finished cut edit may only have the effects of some of the cut editing operations in the template video, such as only the transition effect and special effects, thus suitably enhancing the flexibility of the cut editing.

[0043] In the above configuration, the user can be guided step-by-step through operation prompts to perform cut editing operations on the video. This not only strengthens the user's sense of participation but also allows the user to clearly understand the necessary cut editing operations without wasting energy guessing, further contributing to flexible video cut editing.

[0044] Furthermore, taking into consideration that the user may have a need to withdraw an action, the above method further includes, in response to the user's operation withdrawal command, rolling back the current cut editing state presented by the target video to the previous cut editing state, where the current cut editing state is the video presentation state corresponding to the operation to be withdrawn as instructed by the operation withdrawal command, and the previous cut editing state is the video presentation state corresponding to the cut editing operation prior to the operation to be withdrawn. The cut editing state is the result of the operation corresponding to the cut editing operation. Exemplarily, the reference cut editing operation sequence includes three cut editing operations from front to back: transition, special effect, and speed change. If, after the user has performed the transition and special effect, the current cut editing state presented by the target video has both the transition effect and the special effect, then, if the user no longer needs the special effect, they can issue an operation withdrawal command, causing the target video to roll back to a state with only the transition effect. The user can also roll back further, for example, to the initial state of the video to remove the transition effect. According to the above configuration, users can be given a great deal of freedom in editing cuts, and they can perform corresponding operations based on the operation prompts. If they find that an operation is inappropriate, they can also undo the operation they have already performed and remove the corresponding effect.

[0045] Furthermore, in some embodiments, the method further includes performing a specified termination operation in response to receiving a termination command or in response to completing the last cut editing operation in the reference cut editing operation sequence, the termination operation including a video save operation and / or a video cut editing interface termination operation. That is, when a user performs video cut editing based on a reference cut editing operation sequence, the video cut editing may be terminated at any time as needed, or it may be stopped after all cut editing operations have been completed. For example, if a reference cut editing operation sequence includes four types of cut editing operations A, B, C, and D, the user may, depending on their needs, terminate the cut editing after performing operation A, in which case the target video will only have the effect corresponding to operation A (which may be said to have only the A cut editing state), or the user may, depending on their needs, terminate the cut editing after performing operations A, B, and C, in which case the target video will only have the effects corresponding to three types of operations A, B, and C. In contrast to the requirement in related technologies that the finished cut edit presented directly to the user by the "cut edit in the same way" function must always have the effects corresponding to all four types of operations A, B, C, and D, the above-described embodiment provided by the embodiments of this disclosure allows the user to retain only the effects of some operations in the template according to their needs, making video cut editing more flexible and favorably enhancing the user experience.

[0046] Furthermore, in some embodiments, the method further includes at least one of the following: rolling back the current cut editing state presented by the target video to the initial state of the target video in response to receiving a restart command; and rolling back the current cut editing state presented by the target video to the initial state of the target video after the last cut editing operation in the reference cut editing operation sequence has been completed in response to receiving a loop playback command. According to the above embodiment, it is possible to roll back directly to the initial state of the target video, which is a state in which no cut editing operations have been performed on the target video; in other words, the initial state is a state in which the target video does not contain any cut editing effects.

[0047] In some embodiments, the video cut editing interface displays trigger controls corresponding to multiple cut editing operations, and each trigger control corresponding to a cut editing operation is in an unavailable state. For example, the video cut editing interface presents trigger controls corresponding to multiple cut editing operations such as transitions, adding music, adding special effects, picture-in-picture, and speed changes, and the video cut editing application typically monitors the state of each trigger control, and when a trigger control is triggered (for example, when the user clicks the trigger control), the operation corresponding to that icon is executed.

[0048] In some embodiments, in order for the user to clearly and accurately understand the cut editing operation sequence of a template video and to enable replay of the cut editing operations of the template video, the trigger control corresponding to each cut editing operation can be set to an unavailable state, that is, a trigger control in an unavailable state cannot be triggered by the user. Based on this, the step of issuing an operation prompt for a trigger control corresponding to a cut editing operation that is not the first in the cut editing operation interface includes switching the trigger control corresponding to the cut editing operation that is not the first in the cut editing operation from an unavailable state to an available state, and issuing a prompt message in the cut editing operation interface indicating that the trigger control is available by a specified means. The specified means may be, for example, highlighting an icon corresponding to the trigger control, or pointing to the trigger control with a specific indicator such as a virtual gesture or a triangular prompt, and the same applies to the first cut editing operation.

[0049] For example, in a cut editing operation interface, there are five touch controls corresponding to cut editing operations A, B, C, D, and E, all of which are currently unavailable. The reference cut editing operation sequence specified by the user is A, B, and C. When the user starts a cut edit, first, touch control A, corresponding to cut editing operation A, is switched to an available state, thereby allowing the user to perform cut editing operation A using touch control A. After the user performs cut editing operation A, touch control B, corresponding to cut editing operation B, is switched to an available state, thereby allowing the user to perform cut editing operation B using touch control B. After the user performs cut editing operation B, touch control C, corresponding to cut editing operation C, is switched to an available state, thereby allowing the user to perform cut editing operation C using touch control C. In some embodiments, after the user performs a corresponding cut editing operation using a touch control, that touch control is subsequently switched to an unavailable state. For example, after the user performs cut editing operation A, touch control A is subsequently switched to an unavailable state.

[0050] In some embodiments, since the touch controls can be displayed as icons in the cut editing operation interface, the step of initiating an operation suggestion based on a reference cut editing operation sequence includes determining the reference cut editing operation currently being performed based on the reference cut editing operation sequence and the current presentation state of the target video, setting the icon corresponding to the reference cut editing operation currently being performed as the target icon, switching the target icon to an available state, and initiating a suggestion message that the target icon is available by a specified means.

[0051] For example, if the reference cut editing operation sequence includes four types of cut editing operations, A, B, C, and D, from front to back, and the target video is in its initial state, it is determined that the currently executed reference cut editing operation is operation A. At this time, the icon corresponding to operation A is switched to an available state, and a notification message indicating that icon A is available is issued by a specified means. After the user triggers icon A and executes operation A, the current presentation state of the target video becomes a state with effect A. At this time, it is determined that the currently executed reference cut editing operation is operation B. Subsequently, the icon corresponding to operation B is switched to an available state, and a notification message indicating that icon B is available is issued by a specified means. After the user triggers icon B and executes operation B, the current presentation state of the target video becomes a state with effect A and effect B. At this time, it is determined that the currently executed reference cut editing operation is operation C, and so on. This is an analogy and will not be explained in detail. In actual application, the specified means may be, for example, highlighting the icon, or indicating the icon with specific signs such as arrows, triangles, or virtual fingers, and is not limited thereto.

[0052] The icons for playback, pause, and video process drag operations displayed in the aforementioned video editing interface are all available for use.

[0053] Furthermore, in some embodiments, the method further includes issuing a message asking whether to continue video editing in response to the user not performing the operation corresponding to the operation prompt initiated by the user for a predetermined period of time, and performing at least one of the operations of a video save operation and a video editing interface termination operation in response to receiving a confirmation command that the user will not continue video editing. If a confirmation command to continue video editing is received, the system waits for the user to perform the operation corresponding to the operation prompt within a specified time.

[0054] The video processing method provided by the embodiments of this disclosure primarily analyzes a template video to obtain an operation sequence for the template video (i.e., a reference cut editing operation sequence), and then replays the cut editing state for the operation sequence of the template video. Specifically, when this is achieved, the state is controlled by a state machine. Cut editing It is possible to record the state and achieve single-step replay of the cut editing state (e.g., replay step by step in the order of A, B, C) and partial replay (e.g., replay only A and B), and also roll back (undo) the video, for example, from the A, B, C state to the A, B, C state.

[0055] For easier understanding, refer to the schematic diagram of state transitions shown in Figure 2, which mainly illustrates the Parse Status and Running Status. The Parse Status includes the Uninitialized, Configured, and Parsed states. After the analysis of the template is complete, the system can automatically enter the Running Status, which mainly includes the Running, Paused, Stopped, and Error states. Different states can be converted to each other. Based on user instructions, actions such as Clear, Restart, Back, Forward, Set Loop, End of Operation / Stop may be performed. The above-mentioned parse status, running status, and sub-states are all managed by a state machine (finite state automaton). According to the above state transitions, the embodiments of this disclosure can analyze a template video (template / draft), obtain a reference cut editing operation sequence, and achieve the effect of replaying each cut editing operation / cut editing state in the reference cut editing operation sequence. Specifically, effects such as single-step replay (i.e., step-by-step replay) and partial replay based on undo / redo (i.e., only some operations can be replayed by means of termination / cancellation, etc.) can be achieved. Undo is used to record the data before modification, and redo is used to record the data after modification.

[0056] The above state control mechanism controls actions such as pausing, advancing, and rolling back the operation state. Note that, unlike related technologies, the "same cut editing" function in related technologies only pauses the playback progress, pauses time, and does not pause the operation state.

[0057] Specifically, the video is initially in an initial state, enters a placed state after the user sets a draft (template video), and then enters an analyzed state after the analysis operation. In the analyzed state, it is possible to return to the initial state at any time (because situations such as errors occurring in the analysis of the draft may occur), and the results constructed after analysis become the sequenced cut editing operation (reference cut editing operation sequence). After that, it can automatically start to enter the running state, the initial state of the running phase is Running, and when replaying the cut editing operation sequence midway, it may remain in the running state without making any changes, or after performing some operations, it is possible to choose to undo the previous operation and enter the paused state, the running state always represents the latest state of the timeline and operation sequence, in the paused state it can maintain one operation stack on its own, when undoing an operation the user has pushed to the stack, when moving forward the application pops the operation from the stack and performs a state check, and returns to the running state when the stack is empty. Furthermore, it can support loop playback settings, meaning that after the operation sequence is completed, it can automatically jump to the initial state. If it is not a loop, it can monitor to enter a terminated state when the operation sequence is executed to completion. The user can also voluntarily enter a terminated state to enable partial replay. A restart operation can return to the initial execution state, and a direct clear operation can return to the analyzed state, allowing for the exchange of drafts and re-analysis. In addition, if a non-crash error occurs during the replay process of a cut edit and the system enters an error state, it can automatically jump to a terminated state after catching the error information.

[0058] Furthermore, in some embodiments, a cut editing operation sequence can be obtained by analyzing the operation sequence of a draft, and the order of operation sequencing can be determined by an operation tree (for example, a video can be added first, and then operations such as clipping can be performed on the video). Specifically, the operation sequencing result can be obtained based on a breadth-first search or a depth-first search. An embodiment of this disclosure provides a schematic diagram of the structure of the operation sequence tree shown in Figure 3, illustrating that a cut editing operation (editor) can be divided into multiple operations such as add video, cut edit, add audio, text edit, stickers, pic-in-pic, filters, and canvas. Furthermore, add video is further broken down into segmentation, speed rate, animation, track op, matting, feature, audio separation, and edit; add audio is further broken down into fade / segmentation; text edit is further broken down into add text, subtitles, and template; and canvas is further broken down into color, style, and blur.Furthermore, speed rate is further broken down into normal and curve; animation is further broken down into entry / out / combine animation; track op is further broken down into delete, replace, and add; matting is further broken down into AI matting and color matting; feature is further broken down into adjust, beauty, and game; edit is further broken down into mirror, rotation, and clip; curve is further broken down into flash-in and flash-out; adjust is further broken down into brightness, sharpen, and highlights; and beauty is further broken down into exfoliating and thin face. Please note that the above are merely examples of cut editing operations and should not be considered limiting.

[0059] Based on the foregoing, for ease of understanding, the embodiments of this disclosure are shown in Figures 4a to 44. c The following provides a schematic diagram of the interface of the video cut editing application shown in Figure 4a, where the template selection interface is simply illustrated. Based on this interface, the user can select the required "same cut editing" template video. Furthermore, each template video shows the user usage and the number of "likes". Figure 4a simply shows four template videos (Template 1 to Template 4). )butThis is simply illustrated. Figure 4b simply illustrates an interface for selecting functions on user-uploaded material. When the user selects the "Replay" function, it indicates that the cut editing operation sequence of the selected template video needs to be replayed. That is, it displays step-by-step what operations are available on the template video and guides the user step-by-step to operate their uploaded material accordingly. The video interface helps the user sense what cut editing effect will occur after performing a cut editing operation. In other words, a video cut editing application can, after the user selects a template video, analyze it to obtain the cut editing operation sequence of the template video (i.e., a reference cut editing operation sequence), and then directly replay the "reference cut editing operation sequence" on the user-uploaded material, guiding the user step-by-step to cut and edit their uploaded material according to the reference cut editing operation sequence. During this process, any time-related operations on the user's screen playback (e.g., pausing at a time level, dragging the progress bar, etc.) are also possible. Such operations are not cut editing operations in the embodiments of this disclosure and do not belong to the replay of the reference cut editing operation sequence.

[0060] Figure 4c illustrates how the reference cut editing operation sequence is presented to the "video" when replaying it. It shows that, aside from the play / stop and undo buttons, all other elements are grayed out (indicating they are unavailable). Furthermore, the user may drag the progress bar themselves as needed. Note that time-related operations, such as controlling video playback / stop / adjusting progress at a time level, are not part of the cut editing operations and are therefore always available to the user. After the user clicks "video," further presentations to the "start video" guide the user step-by-step through the replay of the reference cut editing operation sequence, ensuring the user clearly understands the types of cut editing operations used in the reference template and their order. During the replay process, the user can also choose to replay only certain cut editing operations, ensuring that the user-uploaded material only partially replicates the template's cut editing effects.

[0061] In correspondence with the video processing method described above, embodiments of the present disclosure provide a video processing device, in some embodiments the video processing device has at least one arranged according to the operational priority specified by the user reference The module includes a sequence acquisition module for obtaining a reference cut editing operation sequence that includes cut editing operations, and a presentation module for guiding the user step-by step to perform the reference cut editing operations on a target video by presenting the operations according to the priority of the reference cut editing operations. Among the reference cut editing operation sequences Each reference cut editing operation has one corresponding operation suggestion.

[0062] In some embodiments, the presentation module is used to determine the currently performed reference cut editing operation based on the priority of the reference cut editing operations and the current presentation state of the target video, to set the icon corresponding to the currently performed reference cut editing operation as the target icon, to switch the target icon from an unavailable state to an available state, and to issue a presentation message indicating that the target icon is available by a specified means.

[0063] Figure 5 is a schematic diagram of the structure of a video processing device provided in some other embodiments of the present disclosure, which can be implemented by software and / or hardware and can generally be integrated into an electronic device, and includes a sequence acquisition module 502, a first presentation module 504 and a second presentation module 506, as shown in Figure 5.

[0064] The sequence acquisition module 502 is used to acquire a sequence of reference cut editing operations, which includes at least one reference cut editing operation arranged according to the operation priority specified by the user.

[0065] The first presentation module 504 is used to cause the user to perform the first cut editing operation on the target video by triggering an operation suggestion in the cut editing operation interface for the first cut editing operation in the reference cut editing operation sequence, thereby prompting the user to perform the first cut editing operation on the target video using the trigger control corresponding to the first cut editing operation.

[0066] The second suggestion module 506 is used to cause the user to perform the non-first cut editing operation on the target video by triggering an operation suggestion in the cut editing interface to the trigger control corresponding to the non-first cut editing operation when it detects that the user has already performed a cut editing operation prior to the non-first cut editing operation in the reference cut editing operation sequence.

[0067] In the above configuration, the user can be guided step-by-step through operation prompts to perform cut editing operations on the video. This not only strengthens the user's sense of participation but also allows the user to clearly understand the necessary cut editing operations without wasting energy guessing, further contributing to flexible video cut editing.

[0068] In some embodiments, the sequence acquisition module 502 specifically performs a cut editing operation analysis on a template video, which is a video obtained by cutting and editing at least one original material segment selected by the user according to a cut editing means indicated by a predetermined cut editing template, to obtain a cut editing operation sequence for the template video, and uses the cut editing operation sequence for the template video as a reference cut editing operation sequence specified by the user.

[0069] In some embodiments, the apparatus is The system further includes a withdrawal module for rolling back the current cut editing state presented by the target video to a previous cut editing state in response to a user's withdrawal command, wherein the current cut editing state is a video presentation state corresponding to the operation to be withdrawn as instructed by the withdrawal command, and the previous cut editing state is a video presentation state corresponding to the cut editing operation prior to the operation to be withdrawn.

[0070] In some embodiments, the apparatus is The system further includes a termination module for performing a specified termination operation in response to receiving a termination command or in response to completing the last cut editing operation in the reference cut editing operation sequence, the termination operation including at least one of a video save operation and a video cut editing interface termination operation.

[0071] In some embodiments, the apparatus is The system further includes an initial rollback module for rolling back the current cut editing state presented by the target video to its initial state in response to receiving a restart command, and / or for rolling back the current cut editing state presented by the target video to its initial state in response to receiving a loop playback command, after having finished executing the last cut editing operation in the reference cut editing operation sequence.

[0072] In some embodiments, a video cut editing interface displays trigger controls corresponding to multiple cut editing operations, each of which is in an unavailable state, and a second presentation module 506 is used specifically to switch the trigger control corresponding to the first cut editing operation from the unavailable state to an available state, and to issue a presentation message indicating that the trigger control is available by means specified in the cut editing interface.

[0073] In some embodiments, the icons corresponding to playback, pause, and video process drag operations displayed in the video editing interface are all available for use.

[0074] In some embodiments, the apparatus is A query module for issuing a message asking whether to continue video editing in response to the user not performing the corresponding action for a predetermined time after receiving an action prompt, The system further includes a termination module for performing a video save operation and / or a video cut editing interface termination operation in response to receiving a confirmation command that video cut editing should not be continued.

[0075] In some embodiments, the apparatus further includes a receiving module for waiting for the user to perform the operation corresponding to the operation prompt within a specified time in response to receiving a confirmation command to continue video cut editing.

[0076] A video processing apparatus provided by an embodiment of the present disclosure can perform a video processing method provided by any embodiment of the present disclosure and has corresponding functional modules and beneficial effects for performing the method.

[0077] As will be obvious to those skilled in the art, for the sake of clarity and conciseness, the specific operating processes of the embodiments of the apparatus described above can be referenced to the corresponding processes in the embodiments of the method and will not be repeated here.

[0078] Embodiments of the present disclosure further provide electronic equipment comprising a processor and memory for storing instructions executable by the processor, wherein the processor reads executable instructions from the memory and is used to execute the instructions in order to implement any one of the video processing methods described above.

[0079] Figure 6 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. As shown in Figure 6, the electronic device 600 includes one or more processors 601 and memory 602.

[0080] The processor 601 may be a central processing unit (CPU) or another form of processing unit having data processing capability and / or instruction execution capability, and can control other components in the electronic device 600 to perform a desired function.

[0081] The memory 602 may contain one or more computer program products, which may include various forms of computer-readable storage media such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or high-speed cache memory (cache). The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored in the computer-readable storage media, and the processor 601 can implement the video processing method and / or other desired functions according to the embodiments of this disclosure described above by executing the program instructions. Various contents such as input signals, signal components, and noise components may be further stored in the computer-readable storage media.

[0082] In one example, the electronic device 600 may further include an input device 603 and an output device 604, and these components are interconnected by a bus system and / or other forms of connection mechanisms (not shown).

[0083] Furthermore, the input device 603 may include, for example, a keyboard or a mouse.

[0084] The output device 604 can output various information to the outside, including determined distance information and direction information. The output device 604 may include, for example, a display, a speaker, a printer, a communication network, and remote output devices connected thereto.

[0085] Of course, for the sake of simplification, Figure 6 shows only some of the components of the electronic device 600 relevant to this disclosure, and components such as buses and input / output interfaces are omitted. In addition, depending on the specific application, the electronic device 600 may further include any other suitable components.

[0086] In addition to the above-described methods and apparatus, embodiments of this disclosure may also be computer program products including computer program instructions, which, when executed by a processor, cause the processor to execute the video processing method provided by embodiments of this disclosure.

[0087] The computer program product may be composed of program code for performing the operations of the embodiments of the present disclosure in any combination of one or more programming languages, the programming languages ​​including object-oriented programming languages ​​such as Java and C++, and further including conventional procedural programming languages ​​such as the C language or similar programming languages. The program code may be executed entirely on the user's computing device, partially on the user's device, executed as a standalone package, partially on the user's computing device and partially on a remote computing device, or fully on a remote computing device or server.

[0088] Furthermore, the embodiments of this disclosure may also be computer-readable storage media in which computer program instructions are stored, and when the computer program instructions are executed by a processor, the processor causes the processor to execute the video processing method provided by the embodiments of this disclosure.

[0089] The computer-readable storage medium can be any combination of one or more readable media. The readable media may be a readable signal medium or a readable storage medium. The readable storage medium includes, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any combination of more than these. More specific examples of readable storage media (a non-exhaustive list) include electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0090] Embodiments of the present disclosure further provide a computer program product including a computer program / instruction, which, when executed by a processor, implements the video processing method of the embodiment of the present disclosure.

[0091] In this specification, relational terms such as “first” and “second” are merely used to distinguish one entity or operation from another, and do not necessarily require or suggest that any such actual relationship or order exists between these entities or operations. Furthermore, terms such as “includes,” “incorporates,” or any other variation thereof are intended to encompass non-exclusive inclusion, meaning that a process, method, article, or apparatus containing a set of elements includes not only those elements but also other elements not explicitly listed, or further elements specific to such process, method, article, or apparatus. Unless further limited, an element limited by the phrase “includes one…” does not preclude the existence of other identical elements in a process, method, article, or apparatus containing such element.

[0092] The above description is merely a specific embodiment of the Disclosure, intended to enable those skilled in the art to understand or implement the Disclosure. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the Disclosure. Accordingly, the Disclosure is not limited to these embodiments described herein, but rather conforms to the broadest scope that is consistent with the principles and novel features disclosed herein.

Claims

1. A video processing method comprising obtaining a sequence of reference cut editing operations, which includes multiple reference cut editing operations arranged according to an operation priority specified by the user, The cut editing interface displays trigger controls corresponding to multiple reference cut editing operations, and sets them to an unavailable state, so that each trigger control corresponding to each reference cut editing operation executes that operation, and that the trigger controls in an unavailable state cannot be triggered by the user. For the first cut editing operation in the aforementioned reference cut editing operation sequence, the trigger control corresponding to the first cut editing operation is switched from an unavailable state to an available state, and an operation prompt is issued to the trigger control corresponding to the first cut editing operation in the cut editing operation interface. A video processing method that, with respect to a cut editing operation that is not the first in the aforementioned reference cut editing operation sequence, detects that the user has already performed a cut editing operation prior to the non-first cut editing operation, switches the trigger control corresponding to the non-first cut editing operation from an unavailable state to an available state, and issues a notification message indicating that the trigger control is available by means specified in the cut editing operation interface.

2. Obtaining the aforementioned reference cut editing operation sequence specified by the user is: The process involves performing a cut editing operation analysis on a template video, which is a video obtained by cutting and editing at least one original material segment selected by the user according to a cut editing means instructed by a predetermined cut editing template, in order to obtain a cut editing operation sequence for the template video. The method according to claim 1, further comprising setting the cut editing operation sequence of the template video to the reference cut editing operation sequence specified by the user.

3. The method according to claim 1, further comprising rolling back the current cut editing state presented by the target video to a previous cut editing state in response to the user's command to withdraw an operation, wherein the current cut editing state is a video presentation state corresponding to the operation to be withdrawn as instructed by the command to withdraw an operation, and the previous cut editing state is a video presentation state corresponding to the cut editing operation prior to the operation to be withdrawn.

4. The process further includes performing a specified termination operation in response to receiving a termination command or in response to having finished performing the last cut edit operation in the reference cut edit operation sequence, wherein the termination operation is: The method according to claim 1, comprising at least one of a video saving operation and a video cut editing interface termination operation.

5. In response to receiving a restart command, the current cut editing state presented by the target video is rolled back to the initial state of the target video, The method according to claim 1, further comprising at least one of the following: in response to receiving a loop playback command, after completing the last cut editing operation in the reference cut editing operation sequence, rolling back the current cut editing state presented by the target video to the initial state of the target video.

6. Providing instructions according to the priority order of the aforementioned reference cut editing operations is, Based on the priority of the aforementioned reference cut editing operations and the current presentation state of the target video, the reference cut editing operation to be performed is determined. The method according to claim 1, comprising setting an icon corresponding to the currently performed reference cut editing operation as a target icon, switching the target icon from an unavailable state to an available state, and issuing a notification message indicating that the target icon is available by a specified means.

7. In response to the user not performing the corresponding operation for a predetermined period of time after initiating an operation prompt, a message is issued asking whether or not to continue video editing. The method according to claim 1, further comprising: in response to receiving a confirmation command that video cut editing should not be continued, performing at least one of the following operations: a video save operation and a video cut editing interface termination operation.

8. The method according to claim 7, further comprising waiting for the user to perform the operation corresponding to the operation prompt within a specified time in response to receiving a confirmation command to continue video cut editing.

9. The method according to claim 1, wherein the icons corresponding to playback, pause, and video process drag operations displayed on the video cut editing interface are all available.

10. A sequence acquisition module for acquiring a sequence of reference cut editing operations, which includes multiple reference cut editing operations arranged according to the operation priority specified by the user, and for displaying trigger controls corresponding to the multiple reference cut editing operations on the cut editing operation interface and setting them to an unavailable state, wherein the trigger control corresponding to each reference cut editing operation executes each reference cut editing operation, and the trigger control in an unavailable state cannot be triggered by the user. A first presentation module for causing the user to perform the first cut editing operation on the target video using the trigger control corresponding to the first cut editing operation in the aforementioned reference cut editing operation sequence, by switching the trigger control corresponding to the first cut editing operation from an unavailable state to an available state, and by initiating an operation suggestion in the cut editing operation interface to the trigger control corresponding to the first cut editing operation, A video processing device comprising: a second presentation module that, with respect to a cut editing operation that is not the first in the aforementioned reference cut editing operation sequence, detects that the user has already performed a cut editing operation prior to the non-first cut editing operation, switches the trigger control corresponding to the non-first cut editing operation from an unavailable state to an available state, and issues a presentation message indicating that the trigger control is available by means specified in the cut editing operation interface.

11. Processor and An electronic device including a memory for storing instructions executable by the processor, The processor is an electronic device used to read the executable instructions from the memory and to execute the instructions in order to realize the video processing method described in any one of claims 1 to 9.

12. A computer-readable storage medium storing a computer program for performing the video processing method described in any one of claims 1 to 9 above.

13. A computer program that, when executed by a processor, includes instructions that cause the processor to execute the video processing method described in any one of claims 1 to 9.

Images