Video processing method and related equipment

Abstract

The present application provides a video processing method and related equipment. According to the method, for a video (or video clip) that has been automatically speed-changed in the background of an electronic device, the user can continue to perform speed-changed editing, thereby reducing the user's editing burden and improving the user's editing efficiency, thereby improving the user experience. In some embodiments, the speed-changed editing performed by the user includes: canceling the speed-changed editing performed by the electronic device, resuming the speed-changed editing performed by the electronic device, performing fine-tuning based on the speed-changed editing performed by the electronic device, etc., thereby improving the efficiency of the user's speed-changed editing.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a video processing method and related equipment. Background Art

[0002] Speed-changing editing of videos is a common video editing method used to adjust the playback speed of videos. When editing videos, you can perform regular speed-changing on video clips, that is, speed-changing editing on the video clip based on a fixed speed-changing ratio; you can also perform curve speed-changing on the video clip, that is, speed-changing editing on the video clip based on a speed-changing ratio that changes with the shape of the curve. Summary of the invention

[0003] The present application provides a video processing method and related devices, which can improve user experience.

[0004] In a first aspect, a video processing method is provided, which is applied to an electronic device, the method comprising: in response to a first operation of a user, displaying a first interface, the first interface comprising a preview window, a first video clip icon and a first speed change control, displaying the first video clip in the preview window, the video clip indicated by the first video clip icon is the first video clip, the first video clip icon comprises a speed change mark, the speed change mark is used to indicate that the first video clip is obtained by a first speed change editing performed in the background; in response to the user clicking the first speed change control, displaying the second video clip in the preview window, the first video clip icon is updated to the second video clip icon, the first video clip icon is different from the second video clip icon, the first video clip and the second video clip have the same video content, and a first playback speed of the first video clip is different from a second playback speed of the second video clip.

[0005] In the above scheme, for videos that have been automatically speed-changed in the background of the electronic device, the user can continue to perform speed-changed editing, thereby providing the user with the authority to perform speed-changed editing on the basis of reducing the user's editing burden and improving the user's editing efficiency, thereby improving the user experience.

[0006] In a possible embodiment, the second video clip icon does not include a speed change mark, and the second video clip icon is used to indicate that the second playback speed is the original playback speed. The method also includes: in response to a user clicking on the first speed change control, the first speed change control is updated to a second speed change control.

[0007] In the above scheme, the user can cancel the first speed change editing performed in the background by clicking the first speed change control. Therefore, if the user is not satisfied with the speed change editing performed in advance by the electronic device, the corresponding speed change editing can be canceled for a single video clip. This provides the user with the authority to perform speed change editing on the basis of reducing the user's editing burden, thereby improving the user experience.

[0008] It can be understood that the speed change mark can intuitively show the user which video clips are edited at variable speeds by the electronic device and which video clips are not edited at variable speeds by the electronic device, so that the user can perform variable speed editing in a targeted manner and improve the efficiency of the user's variable speed editing.

[0009] In a possible embodiment, the method further includes: in response to a user clicking on a second speed control, displaying the first video clip in the preview window, restoring the second speed control to the first speed control, and restoring the second video clip icon to the first video clip icon.

[0010] In the above scheme, the user can restore the first speed change editing performed in the background by clicking the second speed change control, so that the user can restore the corresponding speed change editing for a single video clip. This provides the user with the authority of speed change editing on the basis of reducing the user's editing burden, thereby improving the user experience.

[0011] In a possible embodiment, the second video clip icon does not include a speed change mark, the second video clip icon is used to indicate that the second playback speed is the original playback speed, and in response to a user clicking on the first speed change control, the second video clip is displayed in the preview window, including: in response to a user clicking on the first speed change control, a second interface is displayed, the second interface includes a preview window and a first speed adjustment panel, the first speed adjustment panel includes a first sub-control and a second sub-control, the first sub-control is used to indicate the first playback speed, the second sub-control is used to indicate the second playback speed, the state of the first sub-control is selected, the state of the second sub-control is unselected, and the first video clip is displayed in the preview window; in response to a user clicking on the second sub-control, the state of the second sub-control is updated to selected, the state of the first sub-control is updated to unselected, and the second video clip is displayed in the preview window.

[0012] In the above scheme, the user can cancel the first variable speed editing performed in the background by clicking the second sub-control, and can restore the first variable speed editing by clicking the first sub-control. Therefore, the user can cancel or restore the corresponding variable speed editing for a single video clip, and provide the user with the authority of variable speed editing on the basis of reducing the user's editing burden, thereby improving the user experience.

[0013] In a possible embodiment, the first speed adjustment panel also includes a third sub-control, and the third sub-control is used to indicate a third playback speed, and the third playback speed is X times the first playback speed, wherein 0<X<1 or X>1. The method also includes: in response to a user clicking on the third sub-control, the state of the third sub-control is updated to be selected, the state of the first sub-control is updated to be unselected, the third video clip is displayed in the preview window, the second video clip icon is updated to the third video clip icon, the third video clip icon is different from the second video clip icon, and the video content of the third video clip is the same as that of the second video clip.

[0014] In the above scheme, the user can make fine adjustments based on the first playback speed by clicking the third sub-control. Compared with directly canceling the preset first speed change editing, it gives the user the authority to adjust the speed ratio more accurately, further improving the user experience.

[0015] In a possible embodiment, when the first speed change edit is a regular speed change, in response to a user clicking on the first speed change control, a second video clip is displayed in a preview window, including: in response to a user clicking on the first speed change control, a third interface is displayed, the third interface includes a preview window and a second speed adjustment panel, the first video clip is displayed in the preview window, the second speed adjustment panel displays a variety of speed ratios for the original playback speed that are selectable by the user, the second speed adjustment panel also displays a status of a preset speed ratio as being selected, the preset speed ratio being the rate of change of the first playback speed relative to the original playback speed; in response to a user operation on the second speed adjustment panel, the second speed adjustment panel displays a status of the first speed ratio as being selected, the second video clip is displayed in the preview window, and the first speed ratio is the rate of change of the second playback speed relative to the original playback speed.

[0016] In the above scheme, after the first speed change editing is performed in the background, the user can flexibly adjust the speed ratio of the initial video clip through the second speed adjustment panel, thereby providing the user with the authority of speed change editing on the basis of reducing the user's editing burden and improving the user experience.

[0017] In some embodiments, when the first speed change ratio is 1, the second video clip icon does not include a speed change mark, and the second video clip icon is used to indicate that the second playback speed is the original playback speed.

[0018] In the above scheme, the user can cancel the first speed change editing performed in the background by clicking the first speed change control. Therefore, if the user is not satisfied with the speed change editing performed in advance by the electronic device, the corresponding speed change editing can be canceled for a single video clip. This provides the user with the authority to perform speed change editing on the basis of reducing the user's editing burden, thereby improving the user experience.

[0019] In a possible embodiment, the second video clip icon does not include a speed change mark, the second video clip icon is used to indicate that the second playback speed is the original playback speed, and when the first speed change is edited as a curve speed change, in response to a user clicking on the first speed change control, the second video clip is displayed in the preview window, including: in response to a user clicking on the first speed change control, a fourth interface is displayed, the fourth interface includes a preview window and a fourth sub-control, and the first video clip is displayed in the preview window; in response to a user clicking on the fourth sub-control, the second video clip is displayed in the preview window.

[0020] In the above scheme, the user can restore the first playback speed to the original playback speed by clicking the fourth sub-control, so that the user can cancel the corresponding variable speed editing for a single video clip. This provides the user with the authority of variable speed editing on the basis of reducing the user's editing burden, thereby improving the user experience.

[0021] In a possible embodiment, the fourth interface includes a third speed adjustment panel, the third speed adjustment panel includes a fourth sub-control and a speed curve adjustment control, the speed curve adjustment control displays a first speed curve for performing a first speed editing on the first video clip, and the method also includes: in response to the user's operation on the speed curve adjustment control, the speed curve adjustment control displays a second speed curve, and the fourth video clip is displayed in the preview window, the second speed curve is a speed curve of the fourth video clip relative to the original playback speed.

[0022] In the above scheme, after performing the first speed change editing in the background, the user can make fine adjustments based on the curve shape of the first playback speed through the third speed adjustment panel. Compared with directly canceling the preset first speed change editing, the user is given the authority to adjust the speed ratio more accurately, further improving the user experience.

[0023] In a possible embodiment, the speed change mark includes a pointer pattern, wherein the pointer pattern points to the upper right corner of the interface, and the speed change mark is also used to indicate that the playback speed of the first video clip is greater than the original playback speed; alternatively, the pointer pattern points to the upper left corner of the interface, and the speed change mark is also used to indicate that the playback speed of the first video clip is less than the original playback speed.

[0024] It can be understood that the direction of the pointer in the speed change mark can intuitively indicate to the user whether the video clip is played at an accelerated speed or in a slow speed, so that the user can perform speed change editing in a targeted manner and improve the efficiency of the user's speed change editing.

[0025] In some embodiments, the first video clip icon also includes a first duration identifier, which is used to indicate the first duration of the first video clip; the second video clip icon also includes a first duration identifier, which is used to indicate the second duration of the second video clip; when the first playback speed is greater than the second playback speed, the first duration is less than the second duration; or, when the first playback speed is less than the second playback speed, the first duration is greater than the second duration.

[0026] In a possible embodiment, in response to a first operation of a user, a first interface is displayed, including: in response to the first operation, a first interface is displayed, the first interface includes a preview window and a first speed change control, a video to be edited is played in the preview window, and the video to be edited includes a first video clip; in response to the user clicking the first video clip icon for the first time, the video to be edited is paused in the preview window, and the video playback progress in the preview window is updated to the first frame of the first video clip; in response to the user clicking the first video clip icon for the second time, the first video clip is played in the preview window from the first frame.

[0027] That is to say, in the global playback mode (when the preview window plays the video to be edited), the user clicks on the thumbnail of a video clip to switch the preview window playback progress to the first frame of the video clip. Thus, the user can be automatically positioned to the time period corresponding to the video clip, further improving the efficiency of the user's video editing and improving the user experience.

[0028] In a possible embodiment, the preset speed ratio includes a first sub-ratio and a second sub-ratio, the first speed editing includes a first sub-ratio and a second sub-ratio, and when the first speed editing is a curve speed changing, the method further includes: identifying wonderful frames in the initial video clip; performing a first sub-ratio on the wonderful frames based on the first sub-ratio, and performing a second sub-ratio on other frames in the initial video clip except the wonderful frames based on the second sub-ratio, to obtain a first video clip, wherein the first sub-ratio is lower than the second sub-ratio, the first sub-ratio changes with the curve, and the second sub-ratio is one times.

[0029] That is to say, when performing curve speed change, the wonderful frames are played slowly, while the playback speed of other frames remains unchanged, which can emphasize the wonderful frames, improve the effect of speed change editing, and enhance the user experience.

[0030] In a possible embodiment, the highlight frame includes a first sub-frame and a second sub-frame, the second sub-frame is after the first sub-frame, the first sub-ratio includes a third sub-ratio and a fourth sub-ratio, the first sub-speed-changing editing includes a third sub-speed-changing editing and a fourth sub-speed-changing editing, and the highlight frame is subjected to the first sub-speed-changing editing based on the first sub-ratio, including: obtaining content information corresponding to the highlight frame, the content information indicating that the sub-content displayed by the first sub-frame is used to trigger the sub-content displayed by the second sub-frame; performing the third sub-speed-changing editing on the first sub-frame based on the third sub-ratio, and performing the fourth sub-speed-changing editing on the second sub-frame based on the fourth sub-ratio, wherein the third sub-ratio gradually decreases from the second sub-ratio to the fourth sub-ratio, and the fourth sub-ratio is fixed.

[0031] In other words, setting the speed ratio of the second subframe to the lowest and using the speed ratio of the first subframe as the transition between the second subframe and other frames can make the transition from other frames to the wonderful frames more natural while emphasizing the wonderful frames, thereby improving the effect of variable speed editing and enhancing user experience.

[0032] In a possible embodiment, the highlight frame also includes a third sub-frame, and the sub-content displayed by the third sub-frame is used to terminate the content displayed by the highlight frame. The third sub-frame is after the second sub-frame, and the first sub-ratio also includes a fifth sub-ratio. The highlight frame is subjected to a first sub-speed change editing based on the first sub-ratio, and also includes: performing a first speed change editing on the third sub-frame based on the fifth sub-ratio, wherein the fifth sub-ratio gradually increases from the fourth sub-ratio to the second sub-ratio.

[0033] In other words, setting the speed ratio of the second subframe to the lowest and using the speed ratio of the third subframe as the transition between the second subframe and other frames can emphasize the wonderful frames while naturally transitioning to other frames after the wonderful frames, thereby improving the effect of variable speed editing and enhancing user experience.

[0034] In a second aspect, the present application provides an electronic device, comprising one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method described in the first aspect and any possible implementation method of the first aspect.

[0035] In a third aspect, an embodiment of the present application provides a chip system, which is applied to an electronic device, and the chip system includes one or more processors, which are used to call computer instructions so that the electronic device executes the method described in the first aspect and any possible implementation method of the first aspect.

[0036] In a fourth aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, causes the electronic device to execute the method described in the first aspect and any possible implementation of the first aspect.

[0037] In a fifth aspect, the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect and any possible implementation of the first aspect.

[0038] It can be understood that the electronic device provided in the second aspect, the chip system provided in the third aspect, the computer storage medium provided in the fourth aspect, and the computer program product provided in the fifth aspect are all used to execute the method provided in the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figures 1A to 1F A schematic diagram showing an exemplary method of entering the first interface provided in an embodiment of the present application;

[0040] Figure 2A A schematic diagram of an example of a first interface provided in an embodiment of the present application;

[0041] Figure 2B The video clip icon provided in the embodiment of the present application includes a schematic diagram of a thumbnail of a video clip (taking the first video clip icon as an example);

[0042] Figure 2C A schematic diagram of another example of the first interface provided in an embodiment of the present application;

[0043] FIG. 3A to FIG. 3D A schematic diagram of an example of a user interface provided in an embodiment of the present application;

[0044] FIG. 3E to FIG. 3H A schematic diagram of another example of a user interface provided in an embodiment of the present application;

[0045] 4A to 4D A schematic diagram of another example of a user interface provided in an embodiment of the present application;

[0046] FIG. 4E to FIG. 4H A schematic diagram of another example of a user interface provided in an embodiment of the present application;

[0047] FIG. 5A to FIG. 5D A schematic diagram of another example of a user interface provided in an embodiment of the present application;

[0048] FIG. 5E to FIG. 5H A schematic diagram of another example of a user interface provided in an embodiment of the present application;

[0049] Fig.5I and Figure 5J A schematic diagram of another example of a user interface provided in an embodiment of the present application;

[0050] Figure 5K to Figure 5N A schematic diagram of another example of a user interface provided in an embodiment of the present application;

[0051] Fig. 6A and Figure 6B A schematic diagram of an example of a user interface for controlling the playback content and playback status of a preview window provided in an embodiment of the present application;

[0052] Figure 6C and Fig.6D A schematic diagram of another example of a user interface for controlling the playback content and playback status of a preview window provided in an embodiment of the present application;

[0053] Fig. 6E and Fig. 6F A schematic diagram of another example of a user interface for controlling the playback content and playback status of a preview window provided in an embodiment of the present application;

[0054] Figure 7 A schematic diagram of a video processing method 100 provided in an embodiment of the present application;

[0055] FIG. 8A to FIG. 8F A schematic diagram of some examples of preset speed ratios provided in an embodiment of the present application;

[0056] FIG. 8G to FIG. 8I Schematic diagrams of other examples of preset speed ratios provided in embodiments of the present application;

[0057] Figure 8J A schematic diagram of another example of a preset speed ratio provided in an embodiment of the present application;

[0058] Fig. 9 A software structure block diagram of a mobile phone provided in an embodiment of the present application;

[0059] Fig.10 An embodiment of the present application provides a hardware system suitable for an electronic device of the present application. DETAILED DESCRIPTION

[0060] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0061] Speed-changing editing of videos is a common video editing method used to adjust the playback speed of videos. When editing videos, you can perform regular speed-changing on video clips, that is, speed-changing editing on the video clip based on a fixed speed-changing ratio; you can also perform curve speed-changing on the video clip, that is, speed-changing editing on the video clip based on a speed-changing ratio that changes with the shape of the curve.

[0062] If users edit the speed of videos by themselves, it usually requires users to have certain experience. Users who do not have professional speed editing skills may need to try many times to complete the speed editing, which is inefficient. It is also possible that the user will eventually determine that the speed ratio is not appropriate, resulting in poor performance of the final video.

[0063] In a possible implementation, the user can use the function of the electronic device to automatically perform speed-changing editing on the video to efficiently obtain the video after speed-changing editing. However, the video after the electronic device automatically performs speed-changing editing may not fully meet the user's requirements.

[0064] The present application provides a video processing method, for a video (or video clip) that has been automatically speed-changed in the background of an electronic device, a user can continue to perform speed-changed editing, thereby reducing the editing burden of the user and improving the editing efficiency of the user, thereby improving the user experience. In some embodiments, the speed-changed editing performed by the user includes: canceling the speed-changed editing performed by the electronic device, restoring the speed-changed editing performed by the electronic device, performing fine-tuning based on the speed-changed editing performed by the electronic device, etc., thereby improving the efficiency of the speed-changed editing performed by the user.

[0065] It should be noted that the speed ratio used for speed-variable editing of a video clip (or video) involved in this application can be understood as the ratio of the playback speed of the video clip (or video) after speed-variable editing to the original playback speed (i.e., 1x or 1x). A unified explanation is given here and no further elaboration is given below.

[0066] It should also be noted that if the speed ratio is greater than 1x, that is, a certain video clip is a video that is played at an accelerated speed to the corresponding initial video clip; if the speed ratio is less than 1x, that is, the video clip is a video that is played at a decelerated speed to the initial video clip; if the speed ratio is equal to 1x, that is, the video clip is played at the original speed of the initial video clip. A unified explanation is given here and no further elaboration is given below.

[0067] It should also be noted that the form of "Ax" in this application (A is a numerical value) indicates that the speed ratio is A times, for example, the preset speed ratio is 0.5 times. This is explained here uniformly and will not be repeated below.

[0068] Figures 1A to 1F A user interface diagram showing an exemplary method of entering the first interface provided by an embodiment of the present application is shown. Figure 1F Afterwards, the first interface is displayed (to be described below).

[0069] like Figure 1A As shown, the gallery interface is displayed, and it is detected that the user has selected an original video #1 with a duration of 6 seconds.

[0070] For example, in Figure 1A Previously, users clicked on the icon of the gallery app, or users opened the gallery app through a smart voice assistant.

[0071] like Figure 1B As shown, it is detected that the user continues to select an original photo #1, and in response to the user having selected 2 or more original materials, the "One-click Blockbuster" function entrance is displayed. The original material may include images and / or videos.

[0072] like Figure 1C As shown in the figure, it is detected that the user clicks on the "One-click Blockbuster" function entrance. Figure 1D As shown, the electronic device is an original material intelligent matching template, which is used to generate a video to be edited (understandably, a video that can be edited by the user) based on the original material according to a preset processing method, and the current interface displays the progress of the intelligent matching template. When the progress reaches 100%, the electronic device generates a video to be edited according to the template. The video to be edited includes N video clips #1, and the N video clips #1 include the first video clip.

[0073] Exemplarily, in the above-mentioned preset processing method, it includes: processing step 1, generating an initial video according to N original materials, and the initial video includes N video segments #2. If the original material includes an original picture, a video segment #2 of a preset duration (for example, 3 seconds) is generated according to the original picture; if the original material includes an original video, each original video is a corresponding video segment #2. Processing step 2, speed-editing some or all of the N video segments #2 according to a preset speed ratio, and generating N video segments #1 respectively.

[0074] The N video clips #2 include an initial video clip, and the N video clips #1 include a first video clip, which is obtained by performing a first speed-variable editing on the initial video clip.

[0075] like Figure 1E As shown, a video editing interface is displayed, which includes a preview window for playing the video to be edited; the interface also includes a "clip" function entrance for entering the clip editing interface.

[0076] like Figure 1FAs shown, in response to the user clicking on the "Fragment" function entrance, the first interface (to be introduced below) is displayed.

[0077] Alternatively, the present application can also enter the first interface in other ways, such as opening the video editing software, turning on the "one-click blockbuster" function, then selecting the original material, performing template matching, and then displaying the Figure 1E and Figure 1F Alternatively, the first interface may be entered in other ways, which are not limited in this application.

[0078] Figure 2A A schematic diagram of an example of the first interface provided in an embodiment of the present application.

[0079] like Figure 2A As shown in the middle left figure, the first interface (segment editing interface) includes: a preview window 201 for previewing the video to be edited; a segment editing panel 202 including N video segments ( Figure 2A A video clip icon (or also referred to as a thumbnail in this application) and multiple controls are provided in the preview window 201 (taking the video to be edited as an example, the video includes 2 video clips); a play progress control 205a, used to display the play time of the video in the preview window 201 and control its play progress; a preview first control 206, used to zoom or rotate the preview window 201; a preview second control 207, used to control the size of the preview window.

[0080] The clip editing panel 202 includes a first video clip icon (thumbnail 2031a) of the first video clip, a thumbnail 2032 of another video clip (eg, video clip 2032), and a thumbnail 2033 of the end credits; and also includes a first speed control 204a.

[0081] It should be noted that the icons of video clips provided by the present application may include: a thumbnail of the video clip and a duration mark, and may optionally include a speed change mark and a video mark. In order to more clearly see the patterns (such as the video mark, speed change mark, duration mark, etc.) included in the icons of video clips, the icons of video clips in the schematic diagram of the user interface of the present application do not include thumbnails of the video clips. Figure 2B The video clip icon provided in the embodiment of the present application includes a schematic diagram of a thumbnail of the video clip (taking the first video clip icon as an example). Figure 2A 2031a, such as Figure 2B The first video clip icon shown includes a thumbnail of the first video clip. The icons of the video clips provided in this application are uniformly described here and will not be repeated below.

[0082] The border of thumbnail 2031 is thicker than the border of thumbnail 2032 , indicating that the first video clip is currently selected and the preview window 201 is playing the first video clip.

[0083] Optionally, since thumbnail 2031 is located at the first of the N video clips included in the video to be edited in time sequence, after entering the first interface, thumbnail 2031 is selected by default. Alternatively, in response to the user clicking the thumbnail 2031, the border of thumbnail 2031 is thickened.

[0084] The duration mark of the thumbnail 2031a shows "2.0s", indicating that the duration of the first video segment is 2s. The lower right corner of the thumbnail 2031a may include a video mark (e.g. Figure 2A The lower left corner of the thumbnail 2031a may include a speed indicator (e.g. Figure 2A The instrument panel pattern 20311 shown in the figure indicates that the first video clip is obtained by speed-changing editing in the background (including the preset processing method mentioned above). For the convenience of explanation, the speed-changing ratio of the first playback speed of the first video clip relative to the original playback speed is called the preset speed-changing ratio. If there is no speed-changing mark in the thumbnail, it indicates that the video corresponding to the thumbnail has not been speed-changed in the background, that is, the playback speed of the video is the original speed.

[0085] It should be noted that this application does not limit the position and form of expression of the video identifier, speed change identifier or duration identifier.

[0086] Optionally, a speed indicator (eg Figure 2A The instrument panel pattern 20311 shown in the figure includes a pointer pattern, the pointer pattern points to the upper right corner of the interface, and the speed change mark is also used to indicate that the playback speed of the first video clip is greater than the original playback speed; or, the pointer pattern points to the upper left corner of the interface, and the speed change mark is also used to indicate that the playback speed of the first video clip is less than the original playback speed. Figure 2A As shown, in the instrument panel pattern in the lower left corner of the thumbnail 2031a, the pointer points to the upper right, indicating that the playback speed of the first video clip is greater than the original playback speed, that is, the preset speed ratio is greater than 1.

[0087] Among them, the duration icon of thumbnail 2032 shows the time "3.0s", indicating that the duration of video clip 2032 is 3s; there is no video icon in the lower right corner of thumbnail 2032, which is used to indicate that the original material corresponding to thumbnail 2032 is a photo; there is no speed change icon in the lower left corner of thumbnail 2032, indicating that video clip 2032 is not obtained through speed change editing, that is, video clips #1 and #2 corresponding to thumbnail 2032 are the same video.

[0088] It can be understood that the speed change mark can intuitively show the user which video clips are edited at variable speeds by the electronic device and which video clips are not edited at variable speeds by the electronic device, so that the user can perform variable speed editing in a targeted manner and improve the efficiency of the user's variable speed editing.

[0089] It can also be understood that the direction of the pointer pattern in the speed change mark can intuitively indicate to the user whether the video clip is played at an accelerated speed or in a slow speed, so that the user can perform speed change editing in a targeted manner and improve the efficiency of the user's speed change editing.

[0090] It should be noted that the thumbnails and related speed change marks and video marks involved in this application can all refer to the description of thumbnails 2031a and thumbnail 2032, which will not be repeated below.

[0091] The thumbnail 2033 displays the word “end credits”, which corresponds to the end credits of the video to be edited (not included in the video to be edited). For example, it can be preset by the electronic device (for example, preset based on the above smart template).

[0092] Among them, the first speed change control 204a includes an icon #a and a name #a (both are examples), the icon #a is a dashboard with a pointer #a; the name #a is "cancel speed change", indicating that the first speed change control 204a can restore the preset speed change ratio to 1 times, that is, restore the first playback speed to the original playback speed. Since the border of the thumbnail 2031a is bolded in the current interface, indicating that the first video clip is selected, the first speed change control 204a can be edited for the first video clip. Specifically, if it is detected that the user clicks on the first speed change control 204a, the first speed change editing of the first video clip can be canceled, that is, the first video clip can be restored to the initial video clip before the first speed change editing. Optionally, the pointer #a points directly upward, indicating that the speed change ratio of the video clip obtained after canceling the speed change is 1 times.

[0093] Among them, the play progress control 205a shows that the length of the video played in the current preview window 201 is 5 seconds, that is, the video played in the current preview window 201 is the video to be edited (including the first video segment and the video segment 2032). Alternatively, the total duration displayed by the play progress control 205a is 2 seconds, that is, the video played in the preview window 201 is the first video segment.

[0094] In response to the user clicking the first speed control 204a, the following is displayed: Figure 2A The updated first interface is shown in the right picture.

[0095] like Figure 2A As shown in the right figure, compared with Figure 2AIn the left figure, the play progress control 205a is updated to the play progress control 205b, the first speed change control 204a is updated to the second speed change control 204b, the first video clip played in the preview window 201 is updated to the second video clip, the first video clip icon (thumbnail 1031a) is updated to the second video clip icon (thumbnail 1031b), the first video clip icon is different from the second video clip icon, the first video clip and the second video clip have the same video content, the first play speed of the first video clip is different from the second play speed of the second video clip (or, the speed change ratio of the second play speed relative to the original play speed is called the first speed change ratio, and the first speed change ratio is different from the preset speed change ratio).

[0096] Among them, thumbnail 2031b displays the time "6.0s", indicating that the length of the second video clip is 6s; there is no dashboard icon in the lower left corner, indicating that the second video clip corresponding to thumbnail 2031b has not been speed-changed by the electronic device, or, is used to indicate that the second playback speed is the original playback speed.

[0097] Among them, the play progress control 205b shows that the length of the video played in the current preview window 201 is 9 seconds, that is, the video played in the current preview window 201 is the video to be edited (including the second video segment and the video segment 2032). Alternatively, the total duration displayed by the play progress control 205b is 6 seconds, that is, the video played in the preview window 201 is the second video segment.

[0098] Among them, the second speed control 204b includes an icon #b and a name #b (both are examples), the icon #b is a dashboard with a pointer #b; the name #b is "resume speed change". Specifically, if it is detected that the user clicks the second speed control 204b, the first speed change editing can be restored to the second video clip, that is, the second video clip is restored to the first video clip obtained by the first speed change editing. Optionally, the pointer #b points to the upper right, indicating that the speed ratio of the video clip after the speed change is restored is greater than 1. Optionally, the direction of the pointer #b changes with the direction of the pointer in the dashboard in the lower left corner of the thumbnail 2031a.

[0099] In the above scheme, the user can cancel the first speed change editing by clicking the first speed change control. Therefore, if the user is not satisfied with the speed change editing pre-performed by the electronic device, the corresponding speed change editing can be canceled for a single video clip. This provides the user with the authority to perform speed change editing on the basis of alleviating the user's editing burden, thereby improving the user experience.

[0100] In addition, in the dashboard icon in the lower left corner of the thumbnail of the first video clip and / or the dashboard icon of the second speed control, the pointer points to indicate the size relationship between the preset speed ratio and 1, which can intuitively indicate to the user that the first speed editing is to speed up or slow down the initial video clip, thereby improving the user experience.

[0101] Optionally, in Figure 2A In response to the user clicking the second speed control 204b, the updated first interface shown in the right figure of FIG. Figure 2A The interface shown in the left figure in FIG. 1 , that is, the first video clip is displayed in the preview window 201, and the second speed control 204b is updated to the first speed control 204a.

[0102] That is, the first speed control 204a and the second speed control 204b can be understood as two states of a switch control. The switch control is used to control whether to perform the first speed change editing on the initial video clip. If the switch control is displayed as the first speed change control 204a, it means that the first speed change editing has been performed on the initial video clip; if the switch control is displayed as the second speed change control 204b, it means that the first speed change editing has not been performed on the initial video clip.

[0103] In the above text, Figure 2A The following description will be made by taking the case where the first playback speed is greater than the original playback speed (ie, the preset speed ratio>1) as an example.

[0104] Figure 2C This is a schematic diagram of another example of the first interface provided in an embodiment of the present application. In this implementation, the first playback speed is less than the original playback speed (preset speed ratio <1).

[0105] like Figure 2C As shown in the left figure, the preview window 211 refers to the description of the preview window 201 above; the segment editing panel 212 includes a thumbnail 2131a and a first speed control 214a, and a play progress control 215a, which are used to display the play time of the video in the preview window 211 and control its play progress.

[0106] The initial video has a duration of 6 seconds, the first video clip has a duration of 12 seconds, the preset speed ratio is 0.5x, and the pointer in the dashboard icon in the lower left corner of the thumbnail 1031a points to the upper left. The play progress control 215a shows that the play duration of the video to be edited is 15 seconds.

[0107] In response to the user clicking the first speed control 214a, the following is displayed: Figure 2C The interface shown in the right figure. Figure 2C The interface shown in the right figure is the same as Figure 2AThe difference between the interface shown in the right figure in FIG. 214 is that the pointer in the second speed control 214b points to the upper left.

[0108] In the above scheme, the user can restore the first speed change editing performed in the background by clicking the second speed change control, so that the user can restore the corresponding speed change editing for a single video clip. This provides the user with the authority of speed change editing on the basis of reducing the user's editing burden, thereby improving the user experience.

[0109] FIG. 3A to FIG. 3D A schematic diagram of an example of a user interface provided in an embodiment of the present application.

[0110] like Figure 3A As shown, the first interface includes a preview window 301, a play progress control 305a, and a thumbnail 3031a included in the clip editing panel 302, all of which can be referred to above. Figure 2A 3. The corresponding description of the preview window 201, the play progress control 205a and the thumbnail 2031a in the left figure of FIG. 3. The first speed control 304 includes an icon #c and a name #c (both are examples), the icon #c is a dashboard with a pointer #c; the name #c is "speed change". Optionally, the pointer #c points to the same direction as the pointer of the dashboard in the lower left corner of the thumbnail 3031a.

[0111] In response to the user clicking the first speed control 304, the following is displayed: Figure 3B The second interface includes a preview window 301, a first speed adjustment panel 306, and a play progress control 305a. For example, the first speed adjustment panel 306 includes a first sub-control 3041 and a second sub-control 3042. The first sub-control 3041 is used to select a preset speed ratio or to indicate the first play speed (e.g. Figure 3B The "default speed change" in the figure can be understood as the default speed change set by the electronic device according to the intelligent module), and the second sub-control 3042 is used to select the first speed change ratio or to indicate the second playback speed (for example Figure 3B The "original speed" here can be understood as the case where the first speed ratio is 1, that is, the original speed of the initial video clip is used for playback).

[0112] like Figure 3B As shown, the state of the first sub-control 3041 is selected, and the state of the second sub-control 3042 is unselected, indicating that the initial video clip has been processed using the default speed change, and accordingly, the first video clip is displayed in the preview window.

[0113] In response to the user clicking the second sub-control 3042, the following is displayed: Figure 3C In the interface shown, the status of the second sub-control 3042 is updated to be selected, and the status of the first sub-control 3041 is updated to be unselected.

[0114] In response to the user clicking the “√” control of the first speed adjustment panel 306, it is determined to restore the first video clip to the original speed, and the following is displayed: Figure 3D The interface shown.

[0115] like Figure 3D As shown, the preview window 301, the play progress control 305a, and the thumbnail 3031b can be seen above. Figure 2A 201, the playback progress control 205a, and the thumbnail 2031b in the right figure.

[0116] It should be noted that the direction of the pointer #c in the icon #c of the first sub-control 304 is not limited.

[0117] In the above scheme, the user can cancel the first variable speed editing performed in the background by clicking the second sub-control, and can restore the first variable speed editing by clicking the first sub-control. Therefore, the user can cancel or restore the corresponding variable speed editing for a single video clip, and provide the user with the authority of variable speed editing on the basis of reducing the user's editing burden, thereby improving the user experience.

[0118] FIG. 3E to FIG. 3H A schematic diagram of another example of a user interface is provided for an embodiment of the present application.

[0119] like Figure 3E As shown, the preview window 311, the play progress control 315a and the thumbnail 3131b can be seen above. Figure 2C The preview window 211, the play progress control 215a and the thumbnail 2131a in the left figure of FIG. The first speed control 314 can refer to the description of the first speed control 304 above, except that the pointer in the icon of the first speed control 314 points to the upper left.

[0120] In response to the user clicking the first speed control 314, the following is displayed: Figure 3F The second interface is shown.

[0121] like Figure 3F As shown, the second interface includes a preview window 311, a first speed adjustment panel 316, and a play progress control 315a. For example, the first speed adjustment panel 306 includes a first sub-control 3141, a second sub-control 3142, a third sub-control (#1) 3143, and a third sub-control (#2) 3144. The first sub-control 3141 and the second sub-control 3142 refer to the description of the first sub-control 3041 and the second sub-control 3042 above. The third sub-control (#1) 3143 indicates "1.5 times the default speed change", which is used to select the second speed change ratio #1, which is 1.5 times the preset speed change ratio (in Figure 3EThe preset speed ratio is 2x as an example, and the second speed ratio #1 is 3x). The third sub-control (#2) 3144 is represented as "0.5 times the default speed ratio", which is used to select the second speed ratio #2, which is 0.5 times the preset speed ratio (in Figure 3E The preset speed ratio shown is 2x as an example, and the second speed ratio #2 is 1x).

[0122] It should be noted that the number of third sub-controls can be one or more, and the playback speed indicated by the third sub-control can be X times the first playback speed (0<X<1 or X>1). The third sub-control (#1) 3143 and the third sub-control (#2) 3144 are used as examples here, but the protection scope is not limited.

[0123] like Figure 3F As shown, the state of the first sub-control 3141 is selected, and the states of the other sub-controls are unselected, indicating that the initial video clip has been processed using the default speed change, and accordingly, the first video clip is displayed in the preview window.

[0124] In response to the user clicking the third sub-control (#1) 3143, the following is displayed: Figure 3G In the interface shown, the status of the third sub-control (#1) 3143 is updated to be selected, and the status of the first sub-control 3141 is updated to be unselected.

[0125] In response to the user clicking the “√” control of the first speed adjustment panel 316, it is determined that the first video segment is speed-changed based on 1.5x to obtain the third video segment (that is, the initial video segment is speed-changed based on the second speed ratio to obtain the third video segment), and the following is displayed: Figure 3H The updated first interface is shown in FIG. The second video clip icon (thumbnail 3131b) is updated to a third video clip icon (thumbnail 3131c), the third video clip icon is different from the second video clip icon, and the third video clip has the same video content as the second video clip.

[0126] like Figure 3H As shown, compared to Figure 3E, the first video clip displayed in the preview window 311 is updated to the third video clip; the thumbnail 3131a is updated to the thumbnail 3131b, and the play progress control 315a is updated to the play progress control 315b. The thumbnail 3131b displays the time "18.0s", indicating that the duration of the third video clip is 18s. The play progress control 315b shows that the length of the video currently played in the preview window 311 is 21s, that is, the video currently played in the preview window 311 is the video to be edited (including the third video clip and another video clip with a duration of 3s). Alternatively, the total duration displayed by the play progress control 315b is 18s, that is, the video played in the preview window 311 is the third video clip.

[0127] In the above scheme, the user can make fine adjustments based on the first playback speed by clicking the third sub-control. Compared with directly canceling the preset first speed change editing, it gives the user the authority to adjust the speed ratio more accurately, further improving the user experience.

[0128] 4A to 4D A schematic diagram of another example of a user interface provided in an embodiment of the present application.

[0129] Figure 4A The interface shown includes: a preview window 401, a play progress control 405a, a clip editing panel 402, a thumbnail 4031a and a first speed change control 404, which can be seen in Figure 3A 304, and the related descriptions of the preview window 301, the play progress control 305a, the segment editing panel 302, the thumbnail 3031a and the first speed change control 304.

[0130] In response to the user clicking the first speed change control, the following is displayed: Figure 4B The third interface is shown. The third interface includes a preview window 401 and a second speed adjustment panel 403. The first video clip is displayed in the preview window 401, and the second speed adjustment panel 406 is used to adjust the speed ratio of the initial video clip for regular speed change with respect to the original playback speed. For example, the second speed adjustment panel 406 includes a plurality of speed ratios for regular speed change for the user to choose from, such as a ratio scale with scales, which respectively represent the plurality of speed ratios. For example, the current speed ratio is displayed in bold (or in other ways such as using different colors). For example, by detecting the user's operation of sliding the ratio scale to the left or right, the speed ratio ( Figure 4B Optionally, the second speed adjustment panel 406 is further used to display the duration of the initial video segment and the duration of the first video segment, i.e., "segment duration: 6.0s→2.0s", indicating that the duration of the first video segment generated after the first speed adjustment of the initial video segment with a duration of 6s is 2s.

[0131] The second speed adjustment panel 406 displays the speed ratio of the initial video clip currently being normally changed as a preset speed ratio (eg Figure 4B In response to the user's operation on the second speed adjustment panel (e.g., the user slides the ratio scale to the right), the adjusted speed ratio is determined to be the first speed ratio. The second speed adjustment panel displays the state of the first speed ratio as being selected. For example, the first speed ratio is as follows: Figure 4C Alternatively, the first speed ratio is 1x. Optionally, the "segment duration" of the second speed adjustment panel 406 is also updated to "6.0s→3.0s", indicating that the duration of the second video segment generated after the initial video segment of 6s is adjusted by the user is 3s.

[0132] In response to the user clicking the “√” control of the second speed adjustment panel 406, it is determined that the second video segment is generated based on the first speed ratio according to the initial video segment, and the display is as follows: Figure 4D It can be understood that when the first speed ratio is 1x, the second video clip is the initial video clip.

[0133] like Figure 4D As shown, compared to Figure 4A , the first video clip displayed in the preview window 401 is updated to the second video clip; the thumbnail 3031a is updated to the thumbnail 3031b, and the play progress control 405a is updated to the play progress control 405b. Thumbnail 3031b displays the time "3.0s", indicating that the duration of the second video clip is 3s. The play progress control 405b shows that the length of the video currently played in the preview window 401 is 6s, that is, the video currently played in the preview window 401 is the video to be edited (including the second video clip and another video clip with a duration of 3s). Alternatively, the total duration displayed by the play progress control 405b is 3s, that is, the video played in the preview window 401 is the second video clip.

[0134] In another implementation, when the first speed ratio is one, Figure 4C In the example, the user slides the magnification scale and selects "1x". In response to the user selecting "1x", the following is displayed: Figure 3D The second video clip icon does not include a speed change mark, and the second video clip icon is used to indicate that the second playback speed is the original playback speed.

[0135] FIG. 4E to FIG. 4H A schematic diagram of another example of a user interface provided in an embodiment of the present application.

[0136] Figure 4E You can refer to Figure 4A Related description. FIG. 4F to FIG. 4H and FIG. 4B to FIG. 4DThe difference is:

[0137] Figure 4F In the example, it is taken as an example to detect that the user slides the magnification scale to the left; Figure 4G In the example, the first speed ratio is 6x. Figure 4H In the example, the time displayed by thumbnail 3031c is "1.0s", and the duration of the second video clip is 1s; the duration of the video played in the current preview window 401 displayed by the play progress control 405c is 4s, that is, the video played in the current preview window 401 is the video to be edited (including the second video clip and another video clip with a duration of 3s). Alternatively, the total duration displayed by the play progress control 405b is 1s, that is, the video played in the preview window 401 is the second video clip.

[0138] In the above scheme, after the first speed change editing is performed in the background, the user can flexibly adjust the speed ratio of the initial video clip through the second speed adjustment panel, thereby providing the user with the authority of speed change editing on the basis of reducing the user's editing burden and improving the user experience.

[0139] FIG. 5A to FIG. 5D This is a schematic diagram of another example of a user interface provided in an embodiment of the present application. In this implementation, the first speed ratio is 1x as an example for explanation.

[0140] like Figure 5A As shown, the video editing interface includes a preview window 501, a play progress control 505a, a clip editing panel 502, and a thumbnail 5031a, which can be seen in Figure 4A In response to the user clicking the first speed change control 504, the fourth interface is displayed.

[0141] like Figure 5B As shown, the fourth interface includes a preview window 501, a play progress control 505a, and a third speed adjustment panel (custom panel) 506. The third speed adjustment panel 506 includes a fourth sub-control 507, which is used to restore the speed ratio of the video displayed in the preview window to 1x. For example, the fourth sub-control 507 displays "Restore 1x", indicating that the preset speed ratio is restored to 1x.

[0142] Optionally, the third speed adjustment panel 506 is also used to display the duration of the initial video segment and the duration of the first video segment, that is, "segment duration: 6.0s→2.0s", indicating that the duration of the first video segment generated after the first speed adjustment editing of the initial video segment with a duration of 6s is 2s.

[0143] Optionally, the third speed adjustment panel 506 further includes a speed curve adjustment control 508, which is used to display and adjust the speed ratio of the initial video segment for the curve speed change (or, to display the curve shape corresponding to the speed ratio of the initial video segment for the curve speed change). Figure 5B In the speed curve adjustment control 508, the currently displayed curve shape is the preset curve shape corresponding to the preset speed ratio, the horizontal coordinate of the curve is the duration of the first video clip, and the vertical coordinate is the speed ratio. In the speed curve adjustment control 508, the vertical line is a pointer indicating the playback progress (the pointer moves backward synchronously with the playback progress indicated by the playback progress control 505a), and the nodes in the curve shape (including black dots and white dots) represent key frames. Nodes that do not intersect with the vertical line are black dots, and the black dots become white dots after intersecting with the vertical line. The white dots represent the key frames currently being played. It can be understood that in video editing, key frames specify specific attribute values ​​of a video clip at a certain point in time on the timeline, such as position, size, color, etc. Key frames are usually marked for later editing and adjustment. In the present application, a key frame is used to indicate the speed ratio at a certain time point on the timeline, and the curve between the speed ratio values ​​of two adjacent black dots (or white dots) in the speed curve adjustment control 508 is used to represent the speed ratio of the image frame between the corresponding two adjacent key frames.

[0144] In response to the user clicking the fourth sub-control 507, the following is displayed: Figure 5C The interface shown in the figure. Figure 5C As shown, the curve shape in the speed curve adjustment control 508 is updated to a straight line with a vertical coordinate of 1x, indicating that the preset speed ratio is restored to 1x. Optionally, the "segment duration" of the third speed adjustment panel 506 is also updated to "6.0s→6.0s", indicating that the duration of the second video segment generated after the initial video segment with a duration of 6s is adjusted by the user is 6s.

[0145] In response to the user clicking the “√” control of the third speed adjustment panel 506, it is determined that the second video segment is generated based on the initial video segment based on the first speed ratio (1x at this time), and the following is displayed: Figure 5D It can be understood that when the first speed ratio is 1x, the second video clip is the initial video clip.

[0146] In the above scheme, the user can restore the preset speed ratio to 1x by clicking the fourth sub-control, so that the user can cancel the corresponding speed editing for a single video clip. This provides the user with the permission of speed editing on the basis of reducing the user's editing burden, thereby improving the user experience.

[0147] FIG. 5E to FIG. 5HThis is a schematic diagram of another example of a user interface provided in an embodiment of the present application. In this implementation, the curve shape of the first gear ratio can be customized by the user as an example for explanation.

[0148] Figure 5E You can refer to Figure 5A Related description.

[0149] In response to the user clicking the first speed control 504, the following is displayed: Fig. 5F The interface shown. Fig. 5F The various controls in can refer to Figure 5B The difference is that the third speed adjustment panel is used to adjust the speed ratio of the initial video clip (for example, implemented by the speed curve adjustment control 508). Figure 5B is an optional step. Fig. 5F The following are necessary steps.

[0150] For the speed curve adjustment control 508, the user can add or delete key frames (black or white points), and adjust the speed ratio of the key frames (the vertical coordinates of the black or white points) to adjust the curve shape. Fig. 5F As shown, in response to the user's operation of moving the black dot upward or downward, the shapes of the two curves on both sides of the black dot are adjusted to determine the third speed ratio. Optionally, the duration of the lower segment will also change accordingly with the change of the curve shape.

[0151] For example, Figure 5G As shown, the third adjustment speed change panel 506 displays the third speed change ratio (shown as a curve shape of the user's final adjustment). Figure 5G As shown, the duration of the video segment obtained after the initial video segment is speed-varied edited based on the speed-variation ratio corresponding to the current curve shape is 3 seconds.

[0152] In response to the user clicking the “√” control of the third speed adjustment panel 506, it is determined that the initial video segment is based on the third speed ratio (curve shape is as follows: Figure 5E As shown) generates a fourth video clip, showing Figure 5H The fourth video clip is displayed in the preview window 501. The fourth video clip is obtained by speed-changing the initial video clip based on the third speed-changing ratio.

[0153] In the above scheme, after performing the first speed change editing in the background, the user can make fine adjustments based on the curve shape of the first playback speed through the third speed adjustment panel. Compared with directly canceling the preset first speed change editing, the user is given the authority to adjust the speed ratio more accurately, further improving the user experience.

[0154] Optionally, in the second implementation of Example 5 above, Fig. 5F In the example, after the user makes adjustments based on the preset speed ratio curve shape, before clicking the "√" control, if he wants to restore the preset speed ratio curve shape, he can click the sixth sub-control of the current interface (such as the "Reset" control).

[0155] Fig.5I and Figure 5J Schematic diagram of another example of a user interface provided in an embodiment of the present application. Fig.5I As shown, the curve shape displayed by the speed curve adjustment control 508 is the curve shape adjusted by the user. In response to the user clicking the sixth sub-control, the curve shape displayed by the speed curve adjustment control 508 is restored to the curve shape of the preset speed ratio, such as Figure 5J As shown (same shape as the curve in 6F).

[0156] The above scheme provides the user with a control that can restore the preset speed ratio curve shape after adjusting the curve shape based on the preset speed ratio, thereby improving the user experience. In particular, for the case where the user still believes that the preset speed ratio is more appropriate after self-adjustment, the efficiency of the user's speed editing is improved.

[0157] Optionally, in the second implementation of Example 5 above, Figure 5H In the example, the user has adjusted the preset speed ratio to the third speed ratio. After the preview window 501 displays the fourth video clip, if the user still wants to restore the fourth video clip to the first video clip generated based on the preset speed ratio, the user can click the first speed control 504 of the current interface to enter the third speed adjustment panel 506, and click the sixth sub-control (for example, the "Reset" control) of the third speed adjustment panel 506.

[0158] Figure 5K to Figure 5N This is a schematic diagram of an example of restoring a preset speed ratio provided in an embodiment of the present application. Figure 5K As shown, in response to the user clicking the first speed control 504, the display is as follows Figure 5L interface. Figure 5L As shown, the preview window 501 plays the fourth video clip, and the curve shape displayed by the speed curve adjustment control 508 is the curve shape of the third speed ratio. Figure 5M In the interface shown, the curve shape displayed by the speed adjustment control 508 is updated to the curve shape of the preset speed ratio. Figure 5N As shown, in response to the user clicking the "√" control, the following is displayed: Figure 5A In the interface shown, the preview window 501 plays the first video clip.

[0159] The above solution provides the user with a function of being able to restore the first video segment after adjusting the fourth video segment based on the first video segment, thereby improving the user experience. In particular, when the user still thinks the first video segment is more suitable after self-adjustment, the efficiency of the user's variable speed editing is improved.

[0160] As mentioned above, the preview window can play the video clip currently being edited (or selected), or can play the video to be edited, which includes the video clip. Figure 2C Taking the left picture in as an example, the current thumbnail 2031a is selected, and the preview window 201 plays the first video clip corresponding to the thumbnail 2031a, or the preview window 201 plays the video to be edited, and the video to be edited includes the first video clip.

[0161] Optionally, the present application also provides the user with a function of controlling the playback content and playback status of the preview window. Examples of each sub-function are given below. Figure 2C The left figure in the figure is used as an example for explanation, but it does not limit the protection scope of the present application. The function provided by the present application is applicable to all the above embodiments.

[0162] Sub-function 1: In global playback mode (when the preview window plays the video to be edited), in response to the user clicking on the thumbnail of a video clip for the first time, the preview window pauses playing the video to be edited, and the playback progress pointer is positioned to the first frame of the video clip.

[0163] Fig. 6A and Figure 6B A schematic diagram of an example of a user interface for controlling the playback content and playback status of a preview window provided in an embodiment of the present application.

[0164] Fig. 6A The various controls can be seen in Figure 2C The relevant description of the left picture in . Fig. 6A In the interface shown, the preview window 211 plays the video to be edited (which can be called the global play mode), and the play progress control 215a shows that the total duration of the video to be edited is 15s. Figure 6B The interface shown.

[0165] like Figure 6B As shown, compared to Fig. 6A, the preview window 211 pauses playing the video, and the play progress control 215a is updated to the play progress control 215c. The play progress control 215c displays: Playback is paused, and the pointer indicating the play progress (for convenience of explanation, referred to as the play progress pointer) stays at the time point corresponding to the first frame of the first video segment. Accordingly, the preview screen displayed in the preview window 211 is the first frame of the first video segment.

[0166] Or, in Fig. 6A In response to the user clicking on the thumbnail 2032, the play progress pointer of the play progress control 215a will be positioned to the 12th second in the 15th second.

[0167] That is to say, in the global playback mode, when a user clicks on a thumbnail of a video clip, the preview window playback progress can be switched to the first frame of the video clip. Thus, the user can be automatically positioned to the time period corresponding to the video clip, further improving the efficiency of video editing and user experience.

[0168] Sub-function 2: in response to the user clicking on a thumbnail of a certain video clip for the second time, the preview window plays the video clip.

[0169] Figure 6C and Fig.6D A schematic diagram of another example of a user interface for controlling the playback content and playback status of a preview window provided in an embodiment of the present application.

[0170] Figure 6C The various controls can be seen in Figure 6B In response to the user clicking the thumbnail 2131a for the second time, the play progress pointer of the play progress control 215c starts to move backward, and the preview window 211 starts to play the first video clip, showing Fig.6D The interface shown.

[0171] Optionally, after the preview window plays the video clip once, the play progress pointer stops at the first frame of the video clip again. If it is detected that the user clicks the thumbnail of the video clip for the nth time, the preview window plays the video clip once, where n≥2 and n is an integer.

[0172] With the above solution, the user can watch a certain video clip repeatedly to confirm the editing effect of each video clip, thereby further improving the user's video editing efficiency and enhancing the user experience.

[0173] Sub-function three: when a video clip (referred to as video clip #A) is played in the preview window, in response to a user clicking on a thumbnail of another video clip (referred to as video clip #B), the video clip #A is paused, and the play progress pointer stays at a time point corresponding to the first frame of the video clip #B. Optionally, the preview screen of the preview window is the first frame of the video clip #B, or the preview screen of the preview window is the screen when the user clicks on the thumbnail.

[0174] Fig. 6E and Fig. 6F A schematic diagram of another example of a user interface for controlling the playback content and playback status of a preview window provided in an embodiment of the present application.

[0175] like Fig. 6A As shown, the preview window 211 is playing the first video clip, and in response to the user clicking on the thumbnail 2032, the display Fig. 6F The interface shown in the figure. Fig. 6F As shown, the first video clip is paused, the play progress pointer stays at the 12th second of the 15 second video, and the preview window 211 previews the first frame of the video corresponding to the thumbnail 2032 .

[0176] Optionally, referring to sub-function 2, in response to the user clicking the thumbnail of video segment #B for the nth time, the preview window plays video segment #B.

[0177] It is understandable that the above sub-functions 1 to 3 can be combined arbitrarily.

[0178] With the above solution, the user can flexibly switch previews for multiple video clips so as to confirm the editing effects of each video clip one by one, thereby further improving the user's video editing efficiency and enhancing the user experience.

[0179] Figure 7 A schematic diagram of a video processing method 100 provided in an embodiment of the present application.

[0180] S101, in response to a first operation of a user, displaying a first interface.

[0181] The first interface includes a preview window, a first video clip icon and a first speed control. Exemplarily, the first interface is a clip editing interface for editing video clips.

[0182] The first video clip is displayed in the preview window. The video clip indicated by the first video clip icon is the first video clip. The first video clip icon includes a speed change mark, which is used to indicate that the first video clip is obtained by first speed change editing in the background.

[0183] Exemplarily, the first video segment is obtained by performing a first speed change editing on the initial video segment based on a preset speed change ratio by the background. The initial video segment can refer to the above description.

[0184] Specifically, possible examples of determining the preset speed change ratio will be described below.

[0185] It is understandable that the first video clip displayed in the preview window may be playing or paused.

[0186] It can also be understood that the current preview window can display only the first video segment, or can display the entire video to be edited, which includes the first video segment.

[0187] Optionally, the speed change mark includes a pointer pattern, wherein the pointer pattern points to the upper right corner of the interface, and the speed change mark is also used to indicate that the playback speed of the first video clip is greater than the original playback speed; or, the pointer pattern points to the upper left corner of the interface, and the speed change mark is also used to indicate that the playback speed of the first video clip is less than the original playback speed.

[0188] S102: In response to a user clicking on a first speed change control, displaying a second video clip in a preview window.

[0189] Among them, the first video clip icon is updated to the second video clip icon, the first video clip icon is different from the second video clip icon, the first video clip and the second video clip have the same video content, and the first playback speed of the first video clip is different from the second playback speed of the second video clip.

[0190] It can be understood that in response to the user clicking the first speed change control, the electronic device performs speed change editing on the first video segment to obtain the second video segment.

[0191] In the above scheme, for the video that has been automatically speed-changed by the electronic device, the user can continue to perform speed-changed editing, thereby providing the user with the authority to perform speed-changed editing on the basis of reducing the editing burden of the user and improving the user experience.

[0192] Optionally, the first video clip icon also includes a first duration identifier, which is used to indicate the first duration of the first video clip; the second video clip icon also includes a first duration identifier, which is used to indicate the second duration of the second video clip; when the first playback speed is greater than the second playback speed, the first duration is less than the second duration; or, when the first playback speed is less than the second playback speed, the first duration is greater than the second duration.

[0193] Various possible examples are given below for the first speed change control unit and S102 .

[0194] Example 1: The first speed change control is specifically used to cancel the first speed change edit.

[0195] The second video clip icon does not include a speed change mark, and the second video clip icon is used to indicate that the second playback speed is the original playback speed. S102 also includes: in response to the user clicking the first speed change control, the first speed change control is updated to a second speed change control, and the second speed change control is used to restore the first speed change editing.

[0196] For details, please refer to Figure 2A Related description.

[0197] Optionally, method 100 may further include: in response to a user clicking on a second speed control, displaying the first video clip in the preview window, restoring the second speed control to the first speed control, and restoring the second video clip icon to the first video clip icon.

[0198] For details, please refer to Figure 2C Related description.

[0199] Example 2: The first speed control is used to enter a panel for adjusting a preset speed ratio (or adjusting the playback speed of the first video clip) (for example, called a first speed adjustment panel), or the first speed control is a functional entry for entering a panel for adjusting a preset speed ratio. The first speed adjustment panel is used to adjust whether to perform a first speed change editing on the initial video clip based on the preset speed ratio.

[0200] For example, the first speed adjustment panel includes a first sub-control and a second sub-control, which are respectively used to select a preset speed ratio or a first speed ratio. The first sub-control is used to indicate a first playback speed, the second sub-control is used to indicate a second playback speed, the first sub-control is selected, the second sub-control is not selected, and the first video clip is displayed in the preview window.

[0201] In response to the user clicking the second subcontrol, the state of the second subcontrol is updated to be selected, the state of the first subcontrol is updated to be unselected, and the second video clip is displayed in the preview window. The second video clip icon does not include a speed change mark, and the second video clip icon is used to indicate that the second playback speed is the original playback speed.

[0202] For details, please refer to FIG. 3A to FIG. 3D Related description.

[0203] Example 3: Based on Example 2, the first speed adjustment panel is also used to adjust the speed ratio of the second speed editing of the initial video clip, and the first speed editing is different from the second speed editing.

[0204] For example, the first speed adjustment panel further includes one or more third sub-controls, the third sub-control is used to select a second speed ratio, the second speed ratio is X times the preset speed ratio, wherein 0<X<1 or X>1. Or, the third sub-control is used to indicate a third playback speed, the third playback speed is X times the first playback speed, wherein 0<X<1 or X>1.

[0205] Optionally, method 100 also includes: in response to a user clicking on the third sub-control, the state of the third sub-control is updated to selected, the state of the first sub-control is updated to unselected, the third video clip is displayed in the preview window, the second video clip icon is updated to a third video clip icon, the third video clip icon is different from the second video clip icon, and the third video clip has the same video content as the second video clip.

[0206] For details, please refer to FIG. 3E to FIG. 3H Related description.

[0207] Example 4: When the first speed shift is edited as a normal speed shift, the first speed shift control is used to enter a panel for adjusting the speed ratio of a normal speed shift (for example, called a second speed adjustment panel), or the first speed shift control is a functional entrance to enter a panel for adjusting the speed ratio of a normal speed shift.

[0208] For example, S102 includes: in response to a user clicking on a first speed change control, a third interface is displayed, the third interface includes a preview window and a second speed adjustment panel, a first video clip is displayed in the preview window, the second speed adjustment panel displays a variety of speed ratios for the original playback speed that are available for the user to select, and the second speed adjustment panel also displays that the status of a preset speed ratio is selected, and the preset speed ratio is the rate of change of the first playback speed relative to the original playback speed; in response to the user's operation on the second speed adjustment panel, the second speed adjustment panel displays that the status of the first speed ratio is selected, and the second video clip is displayed in the preview window, and the first speed ratio is the rate of change of the second playback speed relative to the original playback speed.

[0209] For details, please refer to 4A to 4H Related description.

[0210] Optionally, when the first speed change ratio is one, the second video clip icon does not include a speed change mark, and the second video clip icon is used to indicate that the second playback speed is the original playback speed.

[0211] Example 5: When the first speed change edit is a curve speed change, the first speed change control is used to enter the fourth interface (for example, including the third speed adjustment panel), or the first speed change control is a function entrance to enter the fourth interface.

[0212] For example, S102 includes: in response to a user clicking on a first speed change control, displaying a fourth interface, the fourth interface including a preview window and a fourth sub-control, and displaying a first video clip in the preview window; in response to a user clicking on a fourth sub-control, displaying a second video clip in the preview window, the second video clip icon does not include a speed change mark, and the second video clip icon is used to indicate that the second playback speed is the original playback speed.

[0213] For details, please refer to FIG. 5A to FIG. 5D Related description.

[0214] For example, the fourth interface includes a third speed adjustment panel, the third speed adjustment panel includes a fourth sub-control and a speed curve adjustment control, and the speed curve adjustment control displays a first speed curve for performing a first speed change editing on the first video clip. The method 100 may also include: in response to a user operation on the speed curve adjustment control, the speed curve adjustment control displays a second speed curve, and the fourth video clip is displayed in the preview window, the second speed curve being a speed curve of the fourth video clip relative to the original playback speed.

[0215] For details, please refer to FIG. 5E to FIG. 5H Related description.

[0216] Optionally, S101 may include: in response to the first operation, displaying the first interface, the first interface including the preview window and the first speed change control, playing the video to be edited in the preview window, the video to be edited including the first video clip; in response to the user clicking the first video clip icon for the first time, pausing the video to be edited in the preview window, and updating the video playback progress of the preview window to the first frame of the first video clip; in response to the user clicking the first video clip icon for the second time, playing the first video clip in the preview window from the first frame.

[0217] For details, please refer to 6A to 6F Related description.

[0218] The following describes a method for determining the preset speed ratio.

[0219] For example, when the electronic device processes the film material imported by the user, it can play the video clips at a variable speed for the final film effect.

[0220] For example, in order to hit the beat of music, the video clip is normally sped up. For another example, when a user uploads a video, the background of the electronic device will identify high-value video clips (or highlight clips, or wonderful frames) and perform curve speed changes. For example, if a user uploads a video of playing basketball, the background will capture the video clip of the goal and play it at a variable speed.

[0221] For example, if the video material imported by the user is too short, for example, when the user only imports 0.3 seconds of material, the material will be played in slow motion to ensure the film effect. For another example, if the original material imported by the user is a photo and the "One-click Movie" function is selected, the photo can be processed into a video and played in slow motion.

[0222] Taking curve speed change editing of a video clip as an example, several possible examples are given below for determining a preset speed change ratio.

[0223] Example 1: Identify the highlight frames in a video clip and set the speed ratio of the highlight frames to be lower than that of other frames.

[0224] Step 1-a, identifying the wonderful frames (including one or more image frames) in the initial video clip.

[0225] Step 1-b, performing a first sub-speed editing on the highlight frame based on the first sub-ratio, and performing a second sub-speed editing on other frames (other image frames in the initial video clip except the highlight frame) based on the second sub-ratio, to obtain a first video clip.

[0226] The preset speed ratio includes a first sub-ratio and a second sub-ratio. The first video clip is subjected to the first speed editing, including respectively performing the first sub-speed editing and the second sub-speed editing on the highlight frame and other frames, the first sub-ratio is lower than the second sub-ratio, the first sub-ratio changes along the curve, and the second sub-ratio is one.

[0227] That is to say, when performing curve speed change, the wonderful frames are played slowly, while the playback speed of other frames remains unchanged, which can emphasize the wonderful frames, improve the effect of speed change editing, and enhance the user experience.

[0228] Example 2: Based on Example 1, the wonderful frame is further identified as a first subframe and a second subframe. The wonderful frame includes the first subframe and the second subframe, the second subframe is after the first subframe, the first sub-ratio includes the third sub-ratio and the fourth sub-ratio, the first sub-speed change editing includes the third sub-speed change editing and the fourth sub-speed change editing, and step 1-b includes:

[0229] Step 2-a, obtaining content information corresponding to the highlight frame, where the content information indicates that the sub-content displayed by the first sub-frame is used to trigger the sub-content displayed by the second sub-frame;

[0230] Step 2-b, performing third sub-speed editing on the first sub-frame based on the third sub-ratio, and performing fourth sub-speed editing on the second sub-frame based on the fourth sub-ratio, wherein the third sub-ratio gradually decreases from the second sub-ratio to the fourth sub-ratio, and the fourth sub-ratio is fixed.

[0231] FIG. 8A to FIG. 8FSchematic diagram of some examples of preset speed ratios provided in embodiments of the present application.

[0232] like Fig. 8A As shown, taking the example that the content information of the initial video clip mainly includes a person jumping high and landing, the image frames including the content information of the person jumping high and landing are identified as highlight frames, and the image frames that do not include such content information (for example, including the action before the jump and the action after the landing) are identified as other frames. The image frames within 200ms after the jump in the highlight frame are taken as the first subframe, and the image frames in the highlight frame that are after the first subframe and show the person jumping up and jumping to the highest point, and the image frames corresponding to the content of landing from the highest point are taken as the second subframe. The fourth sub-multiplier is 0.35x, and the third sub-multiplier is shown as the curve shape that gradually decreases from 1x to 0.35x.

[0233] like Figure 8B As shown, taking the case where the content information of the initial video clip mainly includes a person starting to run as an example, the image frames including the content information of the start are identified as highlight frames, and the image frames that do not include such content information (for example, including the action before the start) are identified as other frames. The image frames within 100ms after the start of the highlight frame are taken as the first subframe, and the image frames in the highlight frame that are after the first subframe and show that the person continues to run after the start are taken as the second subframe. The fourth sub-multiplier is 0.25x, and the third sub-multiplier is shown as a curve shape that gradually decreases from 1x to 0.25x.

[0234] like Figure 8C As shown, taking the content information of the initial video clip mainly including table tennis smash as an example, the image frames including the content information of hitting the table tennis ball are identified as highlight frames, and the image frames that do not include such content information (for example, including the action before the person raises the racket) are identified as other frames. The image frames within 100ms before hitting the ball in the highlight frame (showing the swing) are taken as the first subframe, and the image frames in the highlight frame after the first subframe and showing the action of hitting the ball are taken as the second subframe. The fourth sub-multiplier is 0.25x, and the third sub-multiplier is shown as a curve shape that gradually decreases from 1x to 0.25x.

[0235] like Fig.8D As shown, taking the case where the content information of the initial video clip mainly includes splashing water as an example, the image frames including the content information of splashing water and the water being splashed are identified as wonderful frames, and the image frames that do not include such content information (for example, including the action before a person lifts the basin filled with water) are identified as other frames. The image frames within 150ms after the start of splashing water in the wonderful frame are taken as the first subframe, and the image frames in the wonderful frame that are after the first subframe and show the water being splashed are taken as the second subframe. The fourth sub-ratio is 0.3x, and the third sub-ratio is shown as a curve shape that gradually decreases from 1x to 0.3x.

[0236] like Fig. 8EAs shown, taking the content information of the initial video clip mainly including throwing a frisbee as an example, the image frames including the content information of throwing a frisbee are identified as highlight frames, and the image frames that do not include such content information (for example, including the action before throwing the frisbee) are identified as other frames. The image frames within 100ms after the start of throwing in the highlight frame are taken as the first subframe, and the image frames in the highlight frame that are after the first subframe and show the action of throwing the frisbee are taken as the second subframe. The fourth sub-multiplier is 0.3x, and the third sub-multiplier is shown as a curve shape that gradually decreases from 1x to 0.3x.

[0237] like Figure 8F As shown, taking the example that the content information of the initial video clip mainly includes the small animal turning its head, the image frames including the content information of the small animal turning its head are identified as the wonderful frames, and the image frames that do not include such content information (for example, including the action of the small animal before entering the picture) are identified as other frames. The image frames within 100ms after the small animal starts to turn its head in the wonderful frame are taken as the first subframe, and the image frames in the wonderful frame that are after the first subframe and show the whole process of the small animal turning and the action of facing the camera after turning its head are taken as the second subframe. The fourth sub-multiplier is 0.3x, and the third sub-multiplier is shown as the curve shape that gradually decreases from 1x to 0.3x.

[0238] In other words, setting the speed ratio of the second subframe to the lowest and using the speed ratio of the first subframe as the transition between the second subframe and other frames can make the transition from other frames to the wonderful frames more natural while emphasizing the wonderful frames, thereby improving the effect of variable speed editing and enhancing user experience.

[0239] Example 3: Based on Example 2, the highlight frame further includes a third subframe. The sub-content displayed by the third subframe is used to terminate the content displayed by the highlight frame, the third subframe is after the second subframe, and the first sub-ratio further includes a fifth sub-ratio. Step 1-b also includes:

[0240] Step 2-c: performing a first variable speed editing on the third sub-frame based on a fifth sub-ratio, wherein the fifth sub-ratio gradually increases from the fourth sub-ratio to the second sub-ratio.

[0241] FIG. 8G to FIG. 8I Schematic diagrams of other examples of preset speed ratios provided in embodiments of the present application.

[0242] like Figure 8GAs shown, taking the case where the content information of the initial video clip mainly includes throwing darts at a target plate as an example, the image frames including the content information of throwing darts are identified as wonderful frames, and the image frames that do not include such content information (for example, including the actions before a person raises the dart) are identified as other frames. The image frames within 100ms before the start of throwing darts in the wonderful frames are taken as the first subframes; the image frames in the wonderful frames that are after the first subframe and display the content from the start of throwing darts to the darts hitting the target plate are taken as the second subframes; the image frames within 100ms after the darts hit the target plate after the second subframe are taken as the third subframes. The fourth sub-multiplier is 0.25x, and the third sub-multiplier is shown as a curve shape that gradually decreases from 1x to 0.25x; the fifth sub-multiplier is described as a curve shape that gradually increases from 0.25x to 1x.

[0243] like Figure 8H As shown, taking the example that the content information of the initial video clip mainly includes badminton smash, the image frames including the content information of swinging the racket, hitting the badminton and the badminton being knocked to the ground are identified as wonderful frames, and the image frames that do not include such content information (for example, including the action before the person lifts the racket) are identified as other frames. The image frames within 200ms before hitting the ball in the wonderful frame are used as the first subframe; the image frames in the wonderful frame after the first subframe and showing the content of the badminton falling to the ground after being hit are used as the second subframe; the image frames within 100ms after the second subframe and after the badminton falls to the ground are used as the third subframe. The fourth sub-multiplier is 0.3x, and the third sub-multiplier is shown as the curve shape gradually decreasing from 1x to 0.3x; the fifth sub-multiplier is described as the curve shape gradually increasing from 0.3x to 1x.

[0244] like Figure 8I As shown, taking the example of the initial video clip in which the content information mainly includes a girl looking back and smiling, the image frames including the content information of the beginning of the face showing and the partial or full frontal face showing are identified as the wonderful frames, and the image frames that do not include such content information (for example, including the movements before the person starts to turn his head) are identified as other frames. The image frames from the beginning of the face showing to the frontal face showing in the wonderful frame are taken as the first sub-frame; the image frames in the wonderful frame after the first sub-frame and showing the content after the frontal face is revealed are taken as the second sub-frame; the image frames after the second sub-frame and 100ms after the head starts to turn (turning to the back of the camera) are taken as the third sub-frame. The fourth sub-magnification is 0.3x, and the third sub-magnification gradually decreases from 1x to 0.3x ( Figure 8I The fifth sub-ratio is described as a curve shape gradually increasing from 0.3x to 1x.

[0245] In other words, setting the speed ratio of the second subframe to the lowest and using the speed ratio of the third subframe as the transition between the second subframe and other frames can emphasize the wonderful frames while naturally transitioning to other frames after the wonderful frames, thereby improving the effect of variable speed editing and enhancing user experience.

[0246] Optionally, the speed ratio of a segment of image frames before the first subframe in other frames may be increased to emphasize the wonderful frames. Figure 8I In the example, the 150ms between the start of turning the head and the start of showing the face is accelerated to 2x by a curve, so that the third sub-multiplier is shown as a curve shape that gradually decreases from 2x to 0.3x.

[0247] In addition, for the wonderful frames that are not distinguished from the first subframe to the third subframe, conventional speed change can be used for speed change editing. For example, the wonderful frame is a person running at a constant speed. Figure 8J A schematic diagram of another example of a preset speed ratio provided in an embodiment of the present application. In order to highlight the body movement during running, such as Figure 8J As shown, a regular speed change of 0.4x is used for the highlight frames.

[0248] See also Fig. 9 , Fig. 9 It is a software structure block diagram of a mobile phone provided by the implementation method of this application.

[0249] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the hardware abstraction layer (HAL) and the system layer. The embodiments of the present application mainly relate to the application layer 610, the application framework layer 620 and the hardware abstraction layer 630.

[0250] The application layer 610 may include a series of application packages.

[0251] like Fig. 9 As shown, the application package may include applications such as a gallery application and a video editing application.

[0252] The gallery application includes an interface display module and a media information library, wherein the media information library is used to provide basic information such as preview images, names, etc. of videos and pictures in the gallery application, and is used to send the basic information to the interface display module, and the interface display module is used to display the basic information for user viewing and operation.

[0253] The video editing application is used to provide functions related to video editing, such as video effects, filters, background music, clip editing, and other video editing functions, as well as video processing functions such as video saving and video playback.

[0254] Optionally, Fig. 9 In the case where the original material (video and / or image) is obtained by shooting with a camera application, the application layer 610 also includes a camera application ( Fig. 9 not shown).

[0255] The camera application includes a control module and a recording module, wherein the control module is used to provide control functions related to the camera application shooting, such as sending control instructions to the media recorder to control the media recorder to start recording video, and sending control instructions to the algorithm module to control the algorithm module to perform image recognition processing and feature recognition processing on the video, etc. The recording module is used to provide the camera's recording function.

[0256] The application framework layer 620 provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0257] like Fig. 9 As shown, the application framework layer may include a media provider and a media player, etc.

[0258] The media provider is used to provide the media information library with basic information of the video recorded by the media recorder, and the media player is used to play the video.

[0259] The HAL includes an algorithm module, which includes a preset speed-changing editing algorithm module, which is an algorithm module based on an artificial intelligence (AI) algorithm. The preset speed-changing editing algorithm module is used to determine a preset speed-changing ratio of an initial video segment, and perform speed-changing editing on the initial video segment based on the preset speed-changing ratio to obtain a first video segment.

[0260] Exemplarily, the electronic device obtains the original material. For example, a video and / or photo is taken through a camera application; or, a video and / or photo is obtained from the outside through a wireless network or Bluetooth or other means. After obtaining the original material, the media provider provides the original material and the corresponding basic information (including directory, name and preview image, etc.) to the media information library in the gallery application. The media information library sends the basic information of the original material to the interface display module, and the interface display module can display the basic information of the original material in the gallery application according to the user operation. For example, a preview interface of the original material is displayed, and the original material is displayed as being selected by the user, and a "one-key blockbuster" control is displayed, for example, to intelligently match the template according to the user's click operation on the "one-key blockbuster" control. After the intelligent matching module is completed, the gallery application transmits the initial video clip generated based on the template to the video editing application. The video editing application performs variable speed editing on the initial video clip based on the preset variable speed ratio based on the preset variable speed editing algorithm module of HAL to obtain a first video clip. In response to the user's operation, the first video clip can be variable speed edited in the clip editing interface in the video editing application. In addition, if the video editing application receives an instruction from the user to play a short video, the video editing application may also play the first video clip based on the video playing function through the media player.

[0261] Fig.10 A hardware system of an electronic device 700 suitable for the present application is shown.

[0262] The electronic device 700 can be a mobile phone, a smart screen, a tablet computer, a wearable electronic device, an in-vehicle electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a projector, etc. The embodiment of the present application does not impose any restrictions on the specific type of the electronic device 700.

[0263] The electronic device 700 may include at least one processor 710 , a display screen 720 , and a sensor 730 .

[0264] It should be noted that Fig.10 The structure shown does not constitute a specific limitation on the electronic device 700. In other embodiments of the present application, the electronic device 700 may include Fig.10 The electronic device 700 may include more or fewer components than those shown. Fig.10 Combinations of some of the components shown, or electronic device 700 may include Fig.10Subassemblies of some of the components shown. Fig.10 The components shown may be implemented in hardware, software, or a combination of software and hardware.

[0265] The processor 710 may include one or more processing units. For example, the processor 710 may include at least one of the following processing units: an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a memory, a controller, a video codec, a digital signal processor (DSP), a baseband processor, and a neural-network processing unit (NPU). Different processing units may be independent devices or integrated devices.

[0266] Exemplarily, in an embodiment of the present application, it can be executed in the processor 710, and for a video that has been automatically speed-changed by the electronic device, the user can continue to perform speed-changed editing, thereby providing the user with the authority to perform speed-changed editing on the basis of reducing the user's editing burden and improving the user's editing efficiency, thereby improving the user experience.

[0267] The processor 710 is configured to execute the method executed by the electronic device in the above embodiment.

[0268] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0269] Fig.10 The connection relationship between the modules shown is only a schematic illustration and does not constitute a limitation on the connection relationship between the modules of the electronic device 700. Optionally, the modules of the electronic device 700 may also adopt a combination of multiple connection modes in the above embodiments.

[0270] The electronic device 700 can realize the display function through the GPU, the display screen 720 and the application processor. The GPU is a microprocessor for image processing, connecting the display screen 720 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 710 may include one or more GPUs, which execute program instructions to generate or change display information.

[0271] Display screen 720 may be used to display images or videos.

[0272] Exemplarily, the digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 700 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0273] Memory is used to store instructions and data. In some embodiments, the memory in the processor 710 is a cache memory. The memory can save instructions or data that the processor 710 has just used or cyclically used. If the processor 710 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 710, and thus improves the efficiency of the system.

[0274] The sensor 730 may include a pressure sensor and a touch sensor.

[0275] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor can be set on the display screen 720. When a touch operation is applied to the display screen 720, the electronic device detects the touch operation intensity according to the pressure sensor. The electronic device can also calculate the touch position according to the detection signal of the pressure sensor. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions.

[0276] The touch sensor is also called a "touch panel". The touch sensor can be arranged on the display screen 720, and the touch sensor and the display screen 720 form a touch screen, also called a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 720. In other embodiments, the touch sensor can also be arranged on the surface of the electronic device, which is different from the position of the display screen 720.

[0277] In the present application, the sensor 730 is used to detect the user's operation (eg, clicking the first speed change control or the second speed change control, etc.).

[0278] In some embodiments, when the sensor 730 detects that the user clicks the first speed control, the processor 710 displays the second video clip in the preview window.

[0279] The embodiment of the present application provides a chip system, which includes one or more processors for calling and running instructions stored in the memory from the memory, so that the method of the embodiment of the present application is executed. The chip system can be composed of chips, or it can include chips and other discrete devices.

[0280] Among them, the chip system may include an input circuit or interface for sending information or data, and an output circuit or interface for receiving information or data.

[0281] The present application also provides a computer program product, which, when executed by a processor, implements the method described in any method embodiment of the present application.

[0282] The computer program product can be stored in a memory, and is finally converted into an executable target file that can be executed by a processor after preprocessing, compiling, assembling and linking.

[0283] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a computer, the method described in any method embodiment of the present application is implemented. The computer program can be a high-level language program or an executable target program.

[0284] The computer-readable storage medium may be a volatile memory or a nonvolatile memory, or may include both a volatile memory and a nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus random access memory (DR RAM).

[0285] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described devices and equipment and the technical effects produced can refer to the corresponding processes and technical effects in the aforementioned method embodiments, and will not be repeated here.

[0286] In several embodiments provided in the present application, the disclosed systems, devices and methods can be implemented in other ways. For example, some features of the method embodiments described above can be ignored or not performed. The device embodiments described above are merely schematic, and the division of units is only a logical function division. There may be other division methods in actual implementation, and multiple units or components may be combined or integrated into another system. In addition, the coupling between the units or the coupling between the components may be direct coupling or indirect coupling, and the above coupling includes electrical, mechanical or other forms of connection.

[0287] It should be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0288] It should be understood that the "plurality" mentioned in this application refers to two or more than two. The term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0289] The terms (or numbers) "first", "second", ..., etc. that appear in the embodiments of the present application are only used for descriptive purposes, that is, only to distinguish different objects, such as different "coordinates", etc., and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first", "second", ..., etc. may explicitly or implicitly include one or more features. In the description of the embodiments of the present application, "at least one (item)" refers to one or more. "Multiple" means two or more. "At least one of the following (items)" or similar expressions thereof refers to any combination of these items, including any combination of a single (item) or a plurality of (items).

[0290] In short, the above is only a preferred embodiment of the technical solution of this application, and is not intended to limit the protection scope of this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application should be included in the protection scope of this application.

Claims

1. A video processing method, applied to electronic equipment, characterized in that: The method comprises: In response to the user selecting a plurality of original materials and clicking a second operation of the "One-click Blockbuster" function entrance, a smart matching area is displayed, each of the original materials is an image or a video, the smart matching area indicates that a template is being smartly matched for the plurality of original materials, and the smart matching area also indicates a current matching progress, the template is used to smartly edit the plurality of original materials to obtain a video to be edited by the user, the video to be edited by the user includes a plurality of video clips and an ending, the plurality of video clips correspond to the plurality of original materials one by one, the plurality of video clips include a first video clip, the first video clip corresponds to a first original material among the plurality of original materials, the smart editing includes a first variable speed editing and adding the ending; Displaying a video editing interface, wherein the video editing interface includes a preview window, and the video that can be edited by the user is displayed in the preview window; In response to a first operation of the user on the video editing interface, a first interface is displayed, the first operation indicates editing the multiple video clips and the ending respectively, the first interface includes the preview window, icons of the multiple video clips, an icon of the ending and a first speed change control, the icons of the multiple video clips indicate the multiple video clips respectively, the icons of the multiple video clips include a first video clip icon, the icon of the ending indicates the ending, the first video clip icon indicates the first video clip, the first video clip icon displays a first speed change mark, the first speed change mark indicates that the first video clip is obtained by the electronic device automatically performing the first speed change editing based on the template, the first video clip icon is displayed as a selected state, and the first video clip is displayed in the preview window; In response to a user clicking on the first speed change control, the first video clip icon is updated to a second video clip icon, the second video clip icon indicates a second video clip, the second video clip icon is displayed as being selected, and the second video clip is displayed in the preview window, the first video clip and the second video clip have the same video content, and a first playback speed of the first video clip is different from a second playback speed of the second video clip; Among them, the second video clip icon displays a second speed change mark, and the playback speed of the second video clip is different from the original playback speed of the first original material; or, the second video clip icon does not display the second speed change mark, and the playback speed of the second video clip is the same as the original playback speed of the first original material.

2. The method according to claim 1, characterized in that In a case where the second video clip icon does not display a second speed change mark, the method further includes: In response to a user clicking the first speed shift control, the first speed shift control is updated to a second speed shift control.

3. The method according to claim 2, characterized in that The method further comprises: In response to the user clicking the second speed control, the first video clip is displayed in the preview window, the second speed control is restored to the first speed control, and the second video clip icon is restored to the first video clip icon.

4. The method according to claim 1, characterized in that In a case where the second video clip icon does not display the second speed change mark, in response to the user clicking the first speed change control, displaying the second video clip in the preview window includes: In response to a user clicking on the first speed change control, a second interface is displayed, the second interface includes the preview window and a first speed adjustment panel, the first speed adjustment panel includes a first sub-control and a second sub-control, the first sub-control is used to indicate the first playback speed, the second sub-control is used to indicate the second playback speed, the first sub-control is selected, the second sub-control is not selected, and the first video clip is displayed in the preview window; In response to the user clicking on the second sub-control, the state of the second sub-control is updated to be selected, the state of the first sub-control is updated to be unselected, and the second video clip is displayed in the preview window.

5. The method according to claim 4, characterized in that The first speed adjustment panel further includes a third sub-control, the third sub-control is used to indicate a third playback speed, the third playback speed is X times the first playback speed, wherein 0<X<1 or X>1, the method further includes: In response to a user clicking on the third sub-control, the state of the third sub-control is updated to selected, the state of the first sub-control is updated to unselected, the third video clip is displayed in the preview window, the second video clip icon is updated to a third video clip icon, the third video clip icon is different from the second video clip icon, and the third video clip has the same video content as the second video clip.

6. The method according to claim 1, characterized in that When the first speed change editing is a normal speed change, in response to the user clicking the first speed change control, displaying the second video clip in the preview window includes: In response to a user clicking on the first speed change control, a third interface is displayed, the third interface comprising the preview window and a second speed change adjustment panel, the first video clip is displayed in the preview window, the second speed change adjustment panel displays a plurality of speed change magnifications for the original playback speed that can be selected by the user, the second speed change adjustment panel also displays that a preset speed change magnification is selected, the preset speed change magnification is a magnification rate of the first playback speed relative to the original playback speed; In response to the user's operation on the second speed adjustment panel, the second speed adjustment panel displays the state of the first speed ratio as selected, and displays the second video clip in the preview window. The first speed ratio is the ratio of the second playback speed relative to the original playback speed.

7. The method according to claim 1, characterized in that When the second video clip icon does not display the second speed change mark and the first speed change is edited as a curve speed change, in response to the user clicking the first speed change control, displaying the second video clip in the preview window includes: In response to a user clicking the first speed change control, a fourth interface is displayed, the fourth interface includes the preview window and a fourth sub-control, and the first video clip is displayed in the preview window; In response to a user clicking on the fourth sub-control, the second video clip is displayed in the preview window.

8. The method according to claim 7, characterized in that The fourth interface includes a third speed adjustment panel, the third speed adjustment panel includes the fourth sub-control and a speed curve adjustment control, the speed curve adjustment control displays a first speed curve for performing the first speed editing on the first video clip, and the method further includes: In response to the user's operation on the speed curve adjustment control, the speed curve adjustment control displays a second speed curve, and displays the fourth video clip in the preview window, wherein the second speed curve is a speed curve of the fourth video clip relative to the original playback speed.

9. The method according to claim 1, characterized in that The first speed change mark includes a pointer pattern, wherein the pointer pattern points to the upper right corner of the interface, and the first speed change mark is also used to indicate that the playback speed of the first video clip is greater than the original playback speed; alternatively, the pointer pattern points to the upper left corner of the interface, and the first speed change mark is also used to indicate that the playback speed of the first video clip is less than the original playback speed.

10. The method according to claim 1, characterized in that The step of displaying a first interface in response to a first operation by a user includes: In response to the first operation, displaying the first interface, the first interface including the preview window and the first speed control, playing a video editable by a user in the preview window, the video editable by a user including the first video clip; In response to the user clicking the first video clip icon for the first time, pausing the playing of the video that can be edited by the user in the preview window, and updating the video playing progress of the preview window to the first frame of the first video clip; In response to the user clicking the first video clip icon for the second time, the first video clip is played in the preview window starting from the first frame.

11. The method according to any one of claims 1 to 10, characterized in that The first video segment icon further includes a first duration mark, and the duration mark is used to indicate a first duration of the first video segment; The second video segment icon further includes a first duration mark, and the duration mark is used to indicate a second duration of the second video segment; When the first playback speed is greater than the second playback speed, the first duration is less than the second duration; Alternatively, when the first playback speed is lower than the second playback speed, the first duration is greater than the second duration.

12. The method according to claim 1, characterized in that The first speed change editing includes a first sub-speed change editing and a second sub-speed change editing. When the first speed change editing is a curve speed change, the method further includes: Identify interesting frames in the initial video clip; The first sub-speed-variable editing is performed on the wonderful frame based on the first sub-ratio, and the second sub-speed-variable editing is performed on the other frames in the initial video clip except the wonderful frame based on the second sub-ratio, to obtain the first video clip, wherein the first sub-ratio is lower than the second sub-ratio, the first sub-ratio changes with a curve, and the second sub-ratio is one times.

13. The method according to claim 12, characterized in that The wonderful frame includes a first subframe and a second subframe, the second subframe is after the first subframe, the first sub-ratio includes a third sub-ratio and a fourth sub-ratio, the first sub-speed-changing editing includes a third sub-speed-changing editing and a fourth sub-speed-changing editing, and performing the first sub-speed-changing editing on the wonderful frame based on the first sub-ratio includes: Acquire content information corresponding to the wonderful frame, where the content information indicates that the sub-content displayed by the first sub-frame is used to trigger the sub-content displayed by the second sub-frame; The first sub-frame is subjected to the third sub-speed change editing based on the third sub-rate, and the second sub-frame is subjected to the fourth sub-speed change editing based on the fourth sub-rate, wherein the third sub-rate gradually decreases from the second sub-rate to the fourth sub-rate, and the fourth sub-rate is fixed.

14. The method according to claim 13, characterized in that The wonderful frame further includes a third subframe, and the sub-content displayed by the third subframe is used to terminate the content displayed by the wonderful frame. The third subframe is after the second subframe, and the first sub-ratio further includes a fifth sub-ratio. The performing the first sub-speed-variable editing on the wonderful frame based on the first sub-ratio also includes: The first variable speed editing is performed on the third sub-frame based on the fifth sub-rate, wherein the fifth sub-rate gradually increases from the fourth sub-rate to the second sub-rate.

15. An electronic device comprising a memory and one or more processors, characterized in that: The memory is used to store a computer program; the processor is used to call the computer program so that the electronic device executes the method according to any one of claims 1 to 14.

16. A computer storage medium, characterized in that: include: Computer instructions; when the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 14.

Images