Method, device and medium for speed adjustment of multimedia clip

Abstract

Embodiments of the present disclosure relate to a multimedia segment speed adjustment method and device, equipment and medium, wherein the method comprises: dividing a multimedia material segment into multiple intervals on an audio-video editing track; in response to a moving operation on a first control point, adjusting a speed change amount according to a position of the first control point on the editing track, controlling a video frame speed in a target interval to vary according to the adjusted speed change amount, and adjusting a display length of the target interval on the editing track according to a playing time length after the speed change; and in response to a moving operation on a second control point, adjusting a slope of a speed curve according to a position of the second control point on the target interval, and controlling the video frame speed in the target interval to vary according to the speed curve after the slope adjustment. Thus, fine adjustment of the video frame playing speed is achieved, and the accuracy and efficiency of the video frame playing speed adjustment are improved.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of video processing, and particularly relates to a speed adjustment method and device of multimedia segment, equipment and medium. BACKGROUND

[0002] With the popularity of audio and video, users often adjust the speed of audio and video segments according to their own needs. The commonly used speed adjustment methods include regular uniform speed and curve speed. Users select the required template from the preset speed templates in the application and apply it, which cannot well meet the personalized speed adjustment needs of users.

[0003] Currently, the adjustment process of the self-defined speed adjustment method is to adjust the speed curve by dragging several control points on the function panel. However, adjusting one control point will cause the speed curve of the two regions of the control point to change, resulting in low accuracy and poor efficiency of the speed adjustment of the audio and video segments. SUMMARY

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a speed adjustment method, device, equipment and medium of multimedia segment, to realize the fine adjustment of the video frame playing speed, and improve the accuracy and efficiency of the video frame playing speed adjustment.

[0005] The present disclosure provides a speed adjustment method of multimedia segment, the method comprising: dividing a multimedia material segment into a plurality of intervals on an audio and video editing track, wherein the plurality of intervals include a target interval, and the multimedia material segment is provided with a first control point and a second control point corresponding to the target interval; in response to a moving operation on the first control point, adjusting a speed change amount according to the position of the first control point on the editing track, controlling the speed of the video frames in the target interval to be varied according to the adjusted speed change amount, and adjusting the display length of the target interval on the editing track according to the playing time after the speed change; in response to a moving operation on the second control point, adjusting the slope of the speed curve according to the position of the second control point on the target interval, and controlling the speed of the video frames in the target interval to be varied according to the speed curve after the slope adjustment.

[0006] The embodiment of the present disclosure further provides a speed adjustment device of a multimedia segment, the device comprising: a division module, configured to divide a multimedia material segment into a plurality of intervals on an audio-video editing track, wherein the plurality of intervals comprise a target interval, and the multimedia material segment is provided with a first control point and a second control point corresponding to the target interval; a first speed control module, configured to, in response to a moving operation on the first control point, adjust a speed change amount according to a position of the first control point on the editing track, control a speed of a video frame in the target interval to change speed according to the adjusted speed change amount, and adjust a display length of the target interval on the editing track according to a playing time length after the speed change; and a second speed control module, configured to, in response to a moving operation on the second control point, adjust a slope of a speed curve according to a position of the second control point on the target interval, and control the speed of the video frame in the target interval to change speed according to the speed curve with the adjusted slope.

[0007] The embodiment of the present disclosure further provides an electronic device, comprising: a processor; a memory for storing executable instructions of the processor; and the processor is configured to read the executable instructions from the memory and execute the instructions to implement the speed adjustment method of the multimedia segment provided by the embodiment of the present disclosure.

[0008] The embodiment of the present disclosure further provides a computer readable storage medium, the storage medium storing a computer program, and the computer program is used to execute the speed adjustment method of the multimedia segment provided by the embodiment of the present disclosure.

[0009] Compared with the prior art, the technical scheme provided by the embodiment of the present disclosure has the following advantages:

[0010] The speed adjustment scheme of audio and video information provided by the embodiments of the present disclosure divides multimedia material segments into multiple intervals on an audio and video editing track, wherein the multiple intervals include a target interval, and a first control point and a second control point corresponding to the target interval are set on the multimedia material segment. In response to a moving operation on the first control point, the speed change amount is adjusted according to the position of the first control point on the editing track, the speed of the video frames in the target interval is controlled to be variable speed according to the adjusted speed change amount, and the display length of the target interval on the editing track is adjusted according to the playing time after the speed change. In response to a moving operation on the second control point on the target interval, the slope of the speed curve is adjusted according to the position of the second control point on the target interval, and the speed of the video frames in the target interval is controlled to be variable speed according to the speed curve after the slope adjustment. Therefore, by dividing the multimedia material into multiple intervals, the playback speed of the video frames between the multiple intervals is independently adjusted and not related to each other, and for the video frames in each interval, the overall adjustment of the playback speed can be realized based on the first control point, or the variable speed adjustment of the playback speed can be realized based on the second control point, so that the playback speed of different video frames in the same interval is different. Therefore, the fine adjustment of the playback speed of the video frames is realized, and the accuracy and efficiency of the playback speed adjustment of the video frames are improved. BRIEF DESCRIPTION OF DRAWINGS

[0011] The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent by describing in detail the following specific embodiments with reference to the attached drawings. Throughout the drawings, the same or similar reference numerals refer to the same or similar elements. It should be understood that the drawings are schematic, and the proportions of the elements and the sizes are not necessarily drawn to scale.

[0012] Figure 1 A flowchart of a speed adjustment method of a multimedia segment provided by the embodiments of the present disclosure;

[0013] Figure 2 A speed adjustment scene diagram of audio and video information provided by the embodiments of the present disclosure;

[0014] Figure 3A Another speed adjustment scene diagram of audio and video information provided by the embodiments of the present disclosure;

[0015] Figure 3B Another speed adjustment scene diagram of audio and video information provided by the embodiments of the present disclosure;

[0016] Figure 4A Another speed adjustment scene diagram of audio and video information provided by the embodiments of the present disclosure;

[0017] Figure 4B Another speed adjustment scene diagram of audio and video information provided by the embodiments of the present disclosure;

[0018] Figure 5A Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0019] Figure 5B Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0020] Figure 6A Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0021] Figure 6B Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0022] Figure 6C Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0023] Figure 7 Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0024] Figure 8A Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0025] Figure 8B Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0026] Figure 9A Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0027] Figure 9B Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0028] Figure 10A Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0029] Figure 10B Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0030] Figure 10C Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0031] Figure 11 Another speed adjustment scene of audio and video information provided by the embodiment of the present disclosure is shown in the figure;

[0032] Figure 12AAnother speed adjustment scene diagram of audio and video information provided by the embodiment of the present disclosure is shown in FIG. 6;

[0033] Figure 12B Another speed adjustment scene diagram of audio and video information provided by the embodiment of the present disclosure is shown in FIG. 6;

[0034] Figure 13A Another speed adjustment scene diagram of audio and video information provided by the embodiment of the present disclosure is shown in FIG. 6;

[0035] Figure 13B Another speed adjustment scene diagram of audio and video information provided by the embodiment of the present disclosure is shown in FIG. 6;

[0036] Figure 14 Another speed adjustment scene diagram of audio and video information provided by the embodiment of the present disclosure is shown in FIG. 6;

[0037] Figure 15 Another speed adjustment scene diagram of audio and video information provided by the embodiment of the present disclosure is shown in FIG. 6;

[0038] Figure 16 Another speed adjustment scene diagram of audio and video information provided by the embodiment of the present disclosure is shown in FIG. 6;

[0039] Figure 17 Another speed adjustment scene diagram of audio and video information provided by the embodiment of the present disclosure is shown in FIG. 6;

[0040] Figure 18 Another speed adjustment scene diagram of audio and video information provided by the embodiment of the present disclosure is shown in FIG. 6. DETAILED DESCRIPTION

[0041] Embodiments of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings. While several embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and fully convey the scope of the present disclosure to those skilled in the art. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.

[0042] It should be understood that the various steps of the method embodiments of the present disclosure can be performed in different orders and / or in parallel. In addition, the method embodiments can include additional steps and / or omit performing the steps shown. The scope of the present disclosure is not limited in this respect.

[0043] The term "include" and variations thereof, as used in this document, mean "to include, without limitation." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment." The term "another embodiment" means "at least one additional embodiment." The term "some embodiments" means "at least some embodiments." Related terms shall be construed accordingly. Other definitions will be apparent from the description that follows.

[0044] It should be noted that the terms "first", "second", etc. mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules or units.

[0045] It should be noted that the modification of "one" or "multiple" mentioned in the present disclosure is illustrative rather than limiting, and those skilled in the art should understand that unless otherwise explicitly indicated in the context, it should be understood as "one or more".

[0046] The names of the messages or information exchanged between the devices in the embodiments of the present disclosure are only for illustrative purposes, and are not intended to limit the scope of the messages or information.

[0047] To solve the above problems, the present disclosure provides a multimedia segment speed adjustment method, in which the multimedia material is divided into multiple intervals, the video frame playback speed between the multiple intervals is independently adjusted and not related to each other, and for the video frames in each interval, the overall adjustment of the playback speed can be realized based on the first control point, or the variable speed adjustment of the playback speed can be realized based on the second control point, so that the playback speeds of different video frames in the same interval are different, thereby realizing the fine adjustment of the video frame playback speed and improving the accuracy and efficiency of the video frame playback speed adjustment.

[0048] The method will be described below in conjunction with specific embodiments.

[0049] Figure 1 A flowchart of a multimedia segment speed adjustment method provided by the embodiments of the present disclosure is shown in the figure. The method can be executed by a multimedia segment speed adjustment device, which can be implemented by software and / or hardware and generally integrated in an electronic device. As shown in the figure, the method comprises the following steps. Figure 1

[0050] Step 101: dividing a multimedia material segment into multiple intervals on an audio / video editing track, wherein the multiple intervals include a target interval, and a first control point and a second control point corresponding to the target interval are set on the multimedia material segment.

[0051] ​It is easy to understand that, in order to facilitate the speed adjustment of multimedia materials such as audio and video information, an audio and video editing track is displayed on the visualization interface, wherein the audio and video editing track is mapped with the video stream to be adjusted, and different intervals on the track correspond to different video stream segments in the video stream. The display of the audio and video editing track can be pulled up by some shortcut keys, or can be pulled up by triggering a preset control, etc., which will not be listed here.

[0052] In an embodiment of the present disclosure, in order to realize the fine adjustment of the playing speed of the video frames in the video stream, the multimedia material is divided into different intervals on the audio and video editing track. The initial speed of the corresponding video frame playing in the interval can be the playing speed of the video stream before segmentation.

[0053] In actual execution process, in order to reduce the calculation pressure, etc., when the multimedia material segment is segmented into multiple intervals, it is also detected whether the number of video frames of the target interval is less than a preset video threshold, so as to avoid that the multimedia material such as video stream is divided into too small intervals, which not only affects the adjustment efficiency of the playing speed, but also causes the increase of the calculation pressure. The preset threshold can be calibrated according to experimental data, such as 3, etc. If it is detected that the number of video frames is less than the video threshold, a prompt information that the segmentation cannot be performed is displayed, such as a pop-up window displaying a message "interval is too small, cannot be added" and the like.

[0054] In an embodiment of the present disclosure, in order to more intuitively distinguish different intervals, the segmentation point can be used as the distinguishing identifier of different intervals, wherein the segmentation point can be any identifier indicating that the video stream is divided into different intervals, including but not limited to one or more of a character identifier, a letter identifier, a pattern identifier, a color identifier and the like.

[0055] In some possible embodiments, as shown in Figure 2 The segmentation point is two opposite trapezoidal patterns, and the corresponding video stream is divided into multiple intervals by the segmentation point, wherein the interval Q1 and Q2 include the segmentation point 1 in the middle, and the segmentation point 1 includes the corresponding two trapezoidal patterns a1 and a2.

[0056] In order to realize the separate adjustment of the playing speed of the video frames corresponding to different intervals, after the video stream is divided into different intervals by the segmentation point, part of the region of the segmentation point is used as the first control point of the adjacent target interval, and the first control point is used for segmenting the speed adjustment of the target interval and the speed adjustment of other intervals.

[0057] In actual implementation, to ensure the integrity of the display of the split point within the interval and avoid displaying the two parts of the split point separately, which would affect the segmented display effect of the interval, in response to turning on the first adsorption control switch on the target interval (this first adsorption control switch can be a control displayed on the visual interface, etc.), the end position of the first control point's movement on the editing track is obtained, and the end position is adsorbed and aligned with the split position of other adjacent intervals. In other words, the other split points and intervals on the audio and video editing track move in unison with the movement of the first control point.

[0058] That is, the first control point is solely used to control the playback speed of the video frames in the corresponding target interval. Different intervals correspond to different first control points, and the playback speed of the video frames in different intervals can be independently adjusted.

[0059] In different application scenarios, the first control points of adjacent target intervals are set at different locations:

[0060] In some possible embodiments, the first control point is set at the end position of the target interval. In this embodiment, if the interval is segmented based on the segmentation point, since the segmentation point usually defines the interval located between the left and right area parts by the left and right area parts, the left half area of ​​the segmentation point, that is, the segmentation point area corresponding to the end position of the target interval, can be used as the first control point of the target interval adjacent to the left, such as Figure 3A As shown, if the split point is as above Figure 2 As shown, for the segmentation point 1, the left half area - the trapezoidal pattern a1 can be used as the first control point, and the first control point is used to control the video frame playback speed of the left interval Q1 adjacent to the trapezoidal pattern a1.

[0061] In some other possible embodiments, the first control point is set at the starting position of the target interval. In this embodiment, if the interval is segmented based on the segmentation point, since the segmentation point usually defines the interval located between the left and right area parts by the left and right area parts, the left half area of ​​the segmentation point, that is, the segmentation point area corresponding to the starting position of the target interval, can be used as the first control point of the target interval adjacent to the left, such as Figure 3B As shown, if the split point is as above Figure 2 As shown, for the segmentation point 1, the right half area - the trapezoidal pattern a2 can be used as the first control point, and the first control point is used to control the video frame playback speed of the interval Q2 adjacent to the right side of the trapezoidal pattern a2.

[0062] In the embodiment, in addition to the first control point corresponding to the target interval being arranged on the multimedia material segment, a second control point is arranged, wherein the second control point is used to adjust the playing speed of the video frame in the target interval, and the second control point is described in subsequent embodiments.

[0063] In step 102, in response to the moving operation on the first control point, the speed variation amount is adjusted according to the position of the first control point on the edit track, the speed of the video frame in the target interval is controlled to be varied according to the adjusted speed variation amount, and the display length of the target interval on the edit track is adjusted according to the playing time after the speed variation.

[0064] As described above, the first control point is used to adjust the playing speed of the video frame in the target interval, and therefore, in response to the moving operation on the first control point, the playing speed of the video frame in the target interval can be controlled. The moving operation on the first control point can be triggered by dragging, voice triggering, etc., which are not listed here.

[0065] In the embodiment of the present disclosure, in response to the moving operation on the first control point, the first control point is controlled to move on the edit track, the speed variation amount is adjusted according to the position of the first control point on the edit track, and the speed of the video frame related to the target interval is controlled to be varied according to the adjusted speed variation amount.

[0066] That is, in the embodiment, the playing speed of the video frame contained in the target interval is controlled based on the first control point, and the degree of change of the overall speed depends on the length of the movement of the first control point on the edit track, etc.

[0067] In order to intuitively indicate the playing time of the video frame in the target interval, the display length of the target interval on the edit track can be adjusted according to the playing time after the speed variation, and in order to further improve the intuitiveness of the adjustment, the target interval being adjusted can also be visually enhanced, for example, the area of the current target interval on the audio and video edit track is framed with a rectangular frame, and the rectangular frame is highlighted, etc.

[0068] It should be noted that in different application scenarios, the way of adjusting the speed variation amount according to the position of the first control point on the edit track in response to the moving operation on the first control point is different, and examples are as follows:

[0069] In some possible embodiments, if the end position of the target interval is taken as the first control point of the target interval adjacent to the left, in response to the right moving operation on the first control point, the position of the end point of the target interval on the edit track is controlled to be stretched to the right, and the speed variation amount is reduced according to the position of the first control point on the edit track, wherein the position of the start point of the target interval on the edit track is unchanged.

[0070] That is to say, in the embodiment, the video frame corresponding to each target interval is invariable, adjusting the first control point to change the position of the end point of the target interval on the edit track, stretching the position of the end point of the target interval on the edit track to the right can be equivalent to prolonging the playing time of the video frame corresponding to the target interval, so as to be equivalent to reducing the playing speed of the video frame in the target interval, and the playing speed of the video frame in the target interval is reduced according to the position of the first control point on the edit track.

[0071] For example, as shown in FIG. 6, for the target interval Q3, in response to the right moving operation of the first control point, the position of the end point of the target interval on the edit track is stretched to the right, and the speed change amount is reduced according to the position of the first control point on the edit track, for example, the position of the end point of the target interval on the edit track is stretched to the right by L1, and the speed change amount is reduced by 0.5X, so that the playing speed of the video frame in the target interval is reduced from the original 1X to 0.5X. Figure 4A Alternatively, in the embodiment, in response to the left moving operation of the first control point, the position of the end point of the target interval on the edit track is shortened to the left, and the speed change amount is increased according to the position of the first control point on the edit track, wherein the position of the start point of the target interval on the edit track is invariable.

[0072] That is to say, in the embodiment, the video frame corresponding to each target interval is invariable, adjusting the first control point to change the position of the end point of the target interval on the edit track, shortening the position of the end point of the target interval on the edit track to the left can be equivalent to shortening the playing time of the video frame corresponding to the target interval, so as to be equivalent to improving the playing speed of the video frame in the target interval, and the playing speed of the video frame in the target interval is improved according to the position of the first control point on the edit track.

[0073] For example, as shown in FIG. 6, for the target interval Q3, in response to the left moving operation of the first control point, the position of the end point of the target interval on the edit track is shortened to the left, and the speed change amount is increased according to the position of the first control point on the edit track, for example, the position of the end point of the target interval on the edit track is shortened to the left by L2, and the speed change amount is increased by 0.25X, so that the playing speed of the video frame in the target interval is improved from the original 1X to 1.25X.

[0074] For example, as shown in FIG. 6, for the target interval Q3, in response to the left moving operation of the first control point, the position of the end point of the target interval on the edit track is shortened to the left, and the speed change amount is increased according to the position of the first control point on the edit track, for example, the position of the end point of the target interval on the edit track is shortened to the left by L2, and the speed change amount is increased by 0.25X, so that the playing speed of the video frame in the target interval is improved from the original 1X to 1.25X. Figure 4B

[0075] In some possible embodiments, if the starting position of the target interval is used as the first control point of the target interval adjacent to the right, then in response to the rightward movement operation of the first control point, the position of the starting point of the target interval on the editing track is controlled to be shortened to the right, and the speed change is increased according to the position of the first control point on the editing track, wherein the position of the end point of the target interval on the editing track remains unchanged.

[0076] That is to say, in this embodiment, the video frames corresponding to each target interval are unchanged, and the first control point is adjusted to change the position of the starting point of the target interval on the editing track. Shortening the position of the starting point of the target interval on the editing track to the right is equivalent to shortening the playback time of the video frames corresponding to the target interval. Therefore, it is equivalent to increasing the playback speed of the video frames in the target interval, and increasing the speed change according to the position of the first control point on the editing track to increase the playback speed of the video frames in the target interval.

[0077] For example, if Figure 5A As shown, for the target interval Q4, in response to the rightward movement operation of the first control point, the position of the starting point of the target interval on the editing track is shortened to the right, and the speed change is increased according to the position of the first control point on the editing track. For example, the position of the starting point of the target interval on the editing track is shortened to the right by L3, and the speed change is increased by 0.25X. As a result, the video frame playback speed in the target interval is increased from the original 1X to 1.25X.

[0078] Alternatively, in this embodiment, in response to the leftward movement operation of the first control point, the position of the starting point of the target interval on the editing track is controlled to stretch to the left, and the speed change is reduced according to the position of the first control point on the editing track, wherein the position of the end point of the target interval on the editing track remains unchanged.

[0079] That is to say, in this embodiment, the video frames corresponding to each target interval are unchanged, and adjusting the first control point to change the position of the target interval starting point on the editing track, and stretching the position of the target interval starting point on the editing track to the left can be equivalent to increasing the playback time of the video frames corresponding to the target interval, thereby being equivalent to reducing the playback speed of the video frames in the target interval, and reducing the speed change according to the position of the first control point on the editing track to reduce the playback speed of the video frames in the target interval.

[0080] For example, if Figure 5BAs shown, for the target interval Q4, in response to the leftward moving operation of the first control point, the position of the target interval start point on the edit track is stretched leftward, and the speed change amount is reduced according to the position of the first control point on the edit track, for example, if the position of the target interval start point on the edit track is stretched leftward by L4, the speed change amount is reduced by 0.25X, so that the playing speed of the video frames in the target interval is reduced from the original 1X to 0.75X.

[0081] In step 103, in response to the moving operation of the second control point on the target interval, the slope of the speed curve is adjusted according to the position of the second control point on the target interval, and the speed of the video frames in the target interval is controlled to vary according to the speed curve after the slope adjustment.

[0082] Since the first control point is only used to control the playing speed of the video frames in the target interval as a whole, for example, as shown in Figure 6A If the target interval contains 10 video frames, and the playing speed of the 10 video frames is the same, that is, the playing speed varies uniformly, the effect that can be achieved based on the first control point is to control the playing speed of the 10 video frames to increase or shorten as a whole, and the playing speed of each video frame is the same (in the figure, the display width of the video frame represents the playing speed of the video frame).

[0083] In actual application scenarios, if the user has a demand for speed adjustment of the video frames, the above-mentioned playing speed adjustment method based on only the first control point does not have a high degree of refinement, for example, as shown in Figure 6B If the target interval contains 10 video frames, and the user wants the playing speed of the 10 video frames to gradually decrease or gradually increase (in the figure, the display width of the video frame represents the playing speed of the video frame).

[0084] In an embodiment of the present disclosure, in order to meet the above-mentioned demand for speed adjustment of the video frames, a second control point for the target interval is also provided, which is visually displayed, including but not limited to one or more of a text mark, a letter mark, a pattern mark, a color mark, etc.

[0085] In this embodiment, the slope of the speed curve is adjusted according to the position of the second control point on the target interval, and the speed of the video frames in the target interval is controlled to vary according to the speed curve after the slope adjustment.

[0086] In this embodiment, as shown in Figure 7 The vertical axis of the speed curve corresponds to the playing speed, and the horizontal axis corresponds to the video frames of the target interval, so that the slope of the speed curve can determine the playing speed of the video frames in the target interval, and the speed adjustment of the playing speed can be refined to the video frames. For reference Figure 7The steeper the speed curve is, the greater the corresponding rate of change of the playback speed is. Conversely, the flatter the speed curve is, the lower the corresponding rate of change of the playback speed is.

[0087] In different application scenarios, the slope of the speed curve is adjusted differently according to the position of the second control point on the target interval. The specific adjustment method will be described in subsequent embodiments and will not be repeated here.

[0088] It should be emphasized here that, since the first control point is mainly used to control the overall playback speed of the video frame in the corresponding target interval, as mentioned above Figure 6A As shown, if the video frames in the target interval are played at a uniform speed, the speed of the video frames in the target interval is controlled to be faster or slower according to the adjusted speed variation for uniform playback.

[0089] However, if the video frames in the target interval have achieved speed changes through the control of the second control point, the effect achieved based on the first control point is also an overall change based on speed change, that is, when the video frames in the target interval are played at a non-uniform speed according to the speed curve, the speed of the video frames in the target interval is controlled to be played non-uniformly by speeding up or slowing down according to the adjusted speed change.

[0090] For example, Figure 6C As shown, if the target interval includes 10 video frames, the playback speed of these 10 video frames determined according to the speed curve gradually decreases. If the corresponding speed change determined based on the movement operation of the first control point is a speed reduction of 0.5X, then on the basis of maintaining the gradually decreasing playback speed of these 10 video frames, the overall playback speed is reduced according to the 0.5X.

[0091] In summary, the speed adjustment method for multimedia segments provided by the embodiments of the present disclosure divides the multimedia material segment into multiple intervals on the audio / video editing track, wherein the multiple intervals include a target interval, and the multimedia material segment is provided with a first control point and a second control point corresponding to the target interval. In response to the movement operation on the first control point, the speed change amount is adjusted according to the position of the first control point on the editing track, the speed of the video frames in the target interval is controlled to be variable according to the adjusted speed change amount, and the display length of the target interval on the editing track is adjusted according to the playing time after the speed change. In response to the movement operation on the second control point on the target interval, the slope of the speed curve is adjusted according to the position of the second control point on the target interval, and the speed of the video frames in the target interval is controlled to be variable according to the speed curve after the slope adjustment. Therefore, by dividing the multimedia material into multiple intervals, the playing speed of the video frames between the multiple intervals is independently adjusted and is not related to each other. For the video frames in each interval, the overall adjustment of the playing speed can be realized based on the first control point, and the variable speed adjustment of the playing speed can be realized based on the second control point. The playing speed of different video frames in the same interval is different. Therefore, the fine adjustment of the playing speed of the video frames is realized, and the accuracy and efficiency of the playing speed adjustment of the video frames are improved.

[0092] As embodied in the above figures, in order to ensure the intuitiveness of speed adjustment and improve the speed adjustment situation, a schematic diagram corresponding to the multimedia material segment can also be displayed in the functional panel area, wherein the schematic diagram includes a speed control identifier corresponding to the first control point and a schematic interval Qs' corresponding to the target interval Qs. The first control point a2s is taken as the speed control identifier of the adjacent schematic interval, and the speed adjusted according to the first control point on the target interval is displayed in the corresponding area of the schematic interval Qs'. In the figure, the adjusted speed is 0.5X.

[0093] For example, referring to Figure 8A In the functional panel area, a schematic diagram corresponding to the multimedia material segment is displayed, wherein the schematic diagram includes a speed control identifier corresponding to the first control point, a schematic interval Qs' corresponding to the target interval Qs, the first control point a2s is taken as the speed control identifier of the adjacent schematic interval, and the speed adjusted according to the first control point on the target interval is displayed in the corresponding area of the schematic interval Qs'. In the figure, the adjusted speed is 0.5X.

[0094] In an embodiment of the present disclosure, the rate adjusted according to the second control point is also displayed on the schematic diagram, that is, the slope of the speed curve is adjusted according to the position of the second control point on the target interval, and the speed curve after the slope adjustment and the speed interval value of the speed curve are displayed in the corresponding area of the schematic interval.

[0095] For example, referring to Figure 8BAs shown, the position of the second control point in the target interval Qs is moved from the center position to the end position of the target interval, and the speed curve S1 and the speed interval value obtained by adjusting the slope of the speed curve according to the position of the second control point in the target interval are shown in the figure. The user can intuitively see the speed adjustment result.

[0096] In one embodiment of the present disclosure, in response to the storage operation of the edited draft, the speeds corresponding to the adjacent speed control identifiers of the interval are compared. When the speed corresponding to the speed control identifier at the end position of the left interval is the same as the speed corresponding to the speed control identifier at the start position of the right interval, as shown in Figure 9A two speed control identifiers are stored as one speed control point for display on the mobile device. When the speed corresponding to the speed control identifier at the end position of the left interval is different from the speed corresponding to the speed control identifier at the start position of the right interval, as shown in Figure 9B two speed control identifiers are stored as two speed control points for display on the mobile device.

[0097] In actual execution, in order to further facilitate the convenience of user adjustment, after the sketch is stored as a draft, it can be displayed on other devices at the same time, such as displaying the sketch adjusted on the PC on the mobile device.

[0098] In one embodiment of the present disclosure, if the sketch is synchronized to the mobile terminal such as a mobile phone, the user can operate the sketch on the mobile terminal. If the first control point is identified by the partial area of the split point, for the split point containing two areas, in this embodiment, the mobile terminal can display other patterns, that is, the mobile terminal can display the conversion to adapt to the display rules of the mobile terminal.

[0099] For example, as shown in Figure 10A the different areas of the split point are displayed in the form of a dot on the mobile terminal. If it is detected that the user drags one of the dots, the x-axis coordinate of the dot can be changed, and the interval between the two dots is m pixels. If it is synchronized to the PC, the corresponding two dots display the different areas of the split point. However, because the interval between the different areas of the split point on the PC is 1 frame, and the number of the lowest video frames contained in the interval is also limited, for example, it cannot be less than 3 frames, when the x-axis corresponding to the dot dragged on the mobile terminal conflicts with the display rules of the PC, the dot can be discarded after interaction, and the split point area corresponding to the dot is not displayed on the PC.

[0100] In some possible embodiments, when the sketch adjusted on the mobile terminal is synchronized back to the PC, the x-axis interval = 1 frame, as shown in Figure 10BAs shown, the two points of the mobile end are combined to display as one complete split point, and the extra dot is not combined. For example, if the intervals between the three points a, b and c are all 1 frame, ab is combined to display as one complete split point, and c is independently displayed as a partial area of a split point. When the interval of the x-axis is not equal to 1 frame, one dot is displayed as a partial area of a split point. Figure 10C As shown, when the interval of the video frame is less than the preset minimum video frame number, the first split point area in the interval is retained, and other split point areas are deleted.

[0101] In summary, the speed adjustment method of the multimedia segment in the embodiment of the present disclosure is used to display a schematic diagram corresponding to the multimedia material segment in the functional panel area. The schematic diagram includes a schematic interval corresponding to the target interval, and the first control point and the second control point are displayed in the schematic interval corresponding area in the schematic diagram. The speed adjustment result of the target interval by the second control point is displayed, which improves the intuitiveness of the speed adjustment and improves the user experience of the speed adjustment.

[0102] Based on the above embodiment, the triggering operation of the second control point is used to control the speed change of the video frame in the target interval. The second control point determines the slope of the speed curve. The following is an example of how to adjust the slope of the speed curve according to the position of the second control point on the target interval:

[0103] In one embodiment of the present disclosure, in response to the triggering operation of the second control point on the target interval, the slope of the speed curve is adjusted according to the position of the second control point on the target interval, which includes:

[0104] In response to the adding operation of the second control point on the target interval, the slope of the speed curve is adjusted according to the adding position of the second control point on the target interval. In this embodiment, the second control point is set at different positions on the target interval, and the corresponding slope is different. For example, in response to the second control point being located at the middle position of the target interval, the slope of the speed curve is adjusted to zero to generate a uniform straight line matching the speed adjusted by the first control point, and then the speed of the video frame in the target interval is controlled to be played according to the uniform straight line.

[0105] For example, as shown in Figure 11 If the second control point is a "dot" displayed in the target interval, the position of the dot in the target interval determines the slope of the speed curve. If the "dot" is set at the middle position of the track corresponding to the target interval, the corresponding slope is 0, and at this time, the video frame in the target interval is played at a uniform speed.

[0106] If the "dot" moves to the right of the corresponding track in the target interval, the corresponding slope changes, for example, the average slope of the speed curve gradually increases, at this time, the video frame playback speed in the target interval changes with the change of the slope, realizing the adjustment of the playback speed; if the "dot" moves to the left of the corresponding track in the target interval, the corresponding slope changes, for example, the average slope of the speed curve gradually decreases, at this time, the video frame playback speed in the target interval changes with the change of the slope, realizing the adjustment of the playback speed.

[0107] In the embodiment, the slope of the speed curve can also be adjusted according to the moving position of the second control point on the target interval in response to the moving operation of the second control point. After the slope of the speed curve is adjusted according to the added position of the second control point on the target interval in response to the adding operation of the second control point on the target interval, the slope of the speed curve can be adjusted according to the moving position of the second control point on the target interval. For example, if the slope corresponding to the added position of the second control point on the target interval is 0, the slope of the speed curve can be adjusted in response to the right moving operation of the second control point or the left moving operation.

[0108] In the embodiment, the slope of the speed curve can also be adjusted according to the moving position of the second control point on the target interval in response to the moving operation of the second control point. After the slope of the speed curve is adjusted according to the added position of the second control point on the target interval in response to the adding operation of the second control point on the target interval, the slope of the speed curve can be adjusted according to the moving position of the second control point on the target interval. For example, if the slope corresponding to the added position of the second control point on the target interval is 0, the slope of the speed curve can be adjusted in response to the right moving operation of the second control point or the left moving operation.

[0109] In some possible embodiments, candidate position points of the second control point moving on the target interval are obtained, and a corresponding relationship between each candidate position point and a slope is constructed. The change of the slope between different candidate position points can be associated with the change of the position of the candidate position point, or can not be associated. This is not limited herein.

[0110] In the embodiment, the target position point to which the second control point moves is determined in response to the moving operation of the second control point, the corresponding slope of the target position point is determined by querying the corresponding relationship, and the slope of the speed curve is adjusted.

[0111] In another possible embodiment, the slope of the speed curve is adjusted to generate an ascending speed curve in response to the moving of the second control point between the intermediate position and the end position of the target interval. When the second control point is located at the end position of the target interval, the slope value of the speed curve corresponding thereto is maximum, that is, when the second control point is located at the end position of the target interval, the ascending speed curve is steeper as a whole, and the maximum slope value can be understood as the maximum average slope value of the speed curve.

[0112] It can be understood that in the embodiment, when the second control point is located at the end position of the target interval, the slope change rate from the start position to the center position of the target interval is maximum, and the playback speed of the video frame in the target interval is controlled to be played according to the ascending speed curve.

[0113] That is, it can be understood that, in the embodiment, the closer the second control point is to the end position of the target interval, the greater the increase in the slope of the corresponding rising speed curve from the start position to the center position. Associating the movement of the second control point with the increase in the slope improves the interactive feeling of the operation.

[0114] Wherein, when the second control point moves between the intermediate position and the end position of the target interval, the rising speed curve can be of any form, such as Figure 12A , the slope can be symmetrical about the center position, the slope from the start position to the center position of the target interval gradually increases, the slope from the center position to the end position of the target interval gradually decreases, etc. In the embodiment, continue to refer to Figure 12A , the rate of change of the slope from the start position to the center position of the target interval gradually increases as the degree of the second control point approaching the end position of the target interval, and if the second control point is at the end position of the target interval, the rate of change of the slope from the start position to the center position of the target interval is maximum, at this time, the corresponding slope value of the speed curve is maximum, and the speed curve is the most steep.

[0115] For example, as shown in Figure 12B , the slope can be a sine wave curve with a positive slope, and the slope of the speed curve gradually decreases from the start position to the end position of the target interval. Continue to refer to Figure 12B , the rate of change of the slope from the start position to the center position of the target interval gradually increases as the degree of the second control point approaching the end position of the target interval, and if the second control point is at the end position of the target interval, the slope value of the speed curve is maximum.

[0116] In one embodiment of the disclosure, in response to the second control point moving between the intermediate position and the start position of the target interval, the slope of the speed curve is adjusted to generate a falling speed curve, wherein the corresponding slope value of the speed curve is minimum when the second control point is at the start position of the target interval, and the playback speed of the video frames in the target interval is controlled to be played according to the falling speed curve. In the embodiment, since the slope of the falling speed curve is negative, the steeper the speed curve is when the corresponding slope value of the speed curve is minimum, wherein the minimum of the slope value at this time can be understood as the minimum of the average of the slope values of each point contained in the speed curve, etc.

[0117] That is, it can be understood that, in the embodiment, the closer the second control point is to the start position of the target interval, the greater the increase in the absolute value of the slope of the corresponding falling speed curve from the start position to the center position. Associating the movement of the second control point with the increase in the slope improves the interactive feeling of the operation.

[0118] Wherein, when the second control point moves from the middle position to the start position of the target interval, the descending speed curve can be in any form on the basis of ensuring the generation of a descending trend curve and the absolute value of the slope from the start position to the center position of the target interval gradually increases, such as, as shown in Figure 13A , the slope can be symmetrical about the center position, the absolute value of the slope from the start position to the center position of the target interval gradually increases, and the absolute value of the slope from the center position to the end position of the target interval gradually decreases, etc. In this embodiment, continue to refer to Figure 13A , the rate of change of the absolute value of the slope from the start position to the center position of the target interval gradually increases as the second control point approaches the start position of the target interval, and if the second control point is located at the start position of the target interval, the speed curve slope value with a negative value is the smallest, and the speed curve is the steepest.

[0119] For example, as shown in Figure 13B , the slope can be a sine wave curve with a negative slope, the absolute value of the slope of the speed curve gradually increases from the start position to the end position of the target interval, and continue to refer to Figure 13B , the rate of change of the absolute value of the slope from the start position to the center position of the target interval gradually increases as the second control point approaches the start position of the target interval, and if the second control point is located at the start position of the target interval, the speed curve slope value with a negative value is the smallest, and the speed curve is the steepest.

[0120] Wherein, in order to avoid the above-mentioned speed adjustment range being too large to cause the playing effect of the video frame to be poor, such as, it can cause the speed to change too fast or too slow, etc., in an embodiment of the present disclosure, the speed interval value of the speed curve is also limited, and the speed adjustment range is limited based on the speed interval value.

[0121] In this embodiment, according to the speed adjusted by the first control point and the preset speed range corresponding to the adjusted speed curve slope, the speed interval value of the adjusted speed curve is determined, and the speed interval value is displayed in a preset area of the target interval position of the second control point, wherein the display mode can be any form such as label display, floating display, etc., for indicating the adjustment speed range corresponding to the current second control point.

[0122] Wherein, when the interval speed is uniform speed, “variable speed n.nX” is displayed in the preset area of the target interval position, and when the interval speed is variable speed, “variable speed a.aX~b.bX” is displayed in the preset area of the target interval position, wherein a.a is the speed of the start position and b.b is the speed of the end position.

[0123] In some possible embodiments, the speed interval value of the adjusted speed curve can be determined according to the proximity of the speed adjusted by the first control point to the boundary value of the speed range corresponding to the speed curve slope, for example, taking the speed adjusted by the first control point as the center position and the proximate boundary value as one boundary of the speed interval.

[0124] For example, as shown in FIG. 6, if the speed adjusted by the first control point is 0.5X and the preset speed range is 0.1X-10X, the first multiple of 1X and the second multiple of 0.5X are calculated respectively, and the smaller multiple, i.e., the first multiple, corresponding to the boundary value 0.1X is determined based on the first multiple and the second multiple, and thus the speed interval value of the speed curve is determined as 0.1X-1X with 0.1X as the boundary value and 0.5X as the center value. Figure 14

[0125] In some possible embodiments, after the speed adjusted by the first control point is obtained, the sum value between the speed and the preset adjustment value and the difference value between the first control point and the preset adjustment value are calculated, and the sum value and the difference value are taken as the maximum interval boundary value and the minimum interval boundary value of the speed interval value respectively, to determine the speed interval value of the adjusted speed curve.

[0126] In some possible embodiments, if the difference value is less than the minimum value of the preset speed range corresponding to the slope of the adjusted speed curve, the minimum value of the speed range is taken as the minimum interval boundary value of the speed interval value, and similarly, if the sum value is greater than the maximum value of the preset speed range corresponding to the slope of the adjusted speed curve, the maximum value of the speed range is taken as the maximum interval boundary value of the speed interval value.

[0127] In the above slope adjustment based on the dragging operation of the second control point in the target interval, to improve the intuitiveness of the adjustment, the corresponding adjustment effect is also displayed in real time based on the video frames.

[0128] In this embodiment, in response to the dragging operation of the second control point in the target interval, the video frames in the target interval for speed adjustment are displayed in the speed adjustment state, the video frames in the target interval with slower speed are displayed in a widened manner, and the video frames in the target interval with faster speed are displayed in a narrowed manner, and the speed adjustment of the corresponding video frames is reflected by the width and the narrowness of the video frames. In actual implementation, after the adjustment is completed, the corresponding video frames can be displayed normally in a frame extraction manner, which is not limited herein.

[0129] For example, as shown in FIG. 6, if the speed adjusted by the first control point is 0.5X and the preset speed range is 0.1X-10X, the first multiple of 1X and the second multiple of 0.5X are calculated respectively, and the smaller multiple, i.e., the first multiple, corresponding to the boundary value 0.1X is determined based on the first multiple and the second multiple, and thus the speed interval value of the speed curve is determined as 0.1X-1X with 0.1X as the boundary value and 0.5X as the center value. Figure 15 ​As shown, if the second control point is at the middle of the target interval, the video frame playing speed is uniform 0.5X, and the width of each video frame is the same; if the user drags the second control point to the end of the target interval, the video frames in the target interval with a slow speed are displayed wider and the video frames in the target interval with a fast speed are displayed narrower according to the speed curve adjusted by the slope.

[0130] In addition, in actual implementation, in order to improve the smoothness of video playing, when the speed of the adjacent intervals in different intervals is close, the speed can be aligned.

[0131] In one embodiment of the present disclosure, in response to a second adsorption control opening operation, the second adsorption control switch can be a visualized control or the like, the speed curve adjusted by the slope is obtained according to the position of the second control point on the target interval, the playing speed of the end position of the target interval is determined according to the speed curve adjusted by the slope, and if the difference between the playing speed of the end position of the target interval and the playing speed of the start position of the adjacent interval is less than a preset threshold, the speed of the target interval end position and the adjacent interval start position is aligned, thereby meeting the personalized demand of the user for the playing speed and ensuring the smoothness of video playing.

[0132] For example, as shown in FIG. 6, if the difference between the playing speed of the end position o2 of the target interval Qi and the playing speed of the start position w1 of the adjacent interval Q(i+1) is less than the preset threshold, the speed of the target interval end position and the adjacent interval start position is aligned. Figure 16

[0133] In summary, the speed adjustment method of the multimedia segment in the embodiment of the present disclosure flexibly determines the slope of the speed curve according to the movement operation of the second control point according to different application scenarios, meets the variable speed adjustment demand of the playing speed of the video frame in the target interval, and improves the flexibility of adjustment.

[0134] In order to realize the above-mentioned embodiments, the present disclosure further provides a speed adjustment device of a multimedia segment.

[0135] Figure 17 A structural schematic diagram of a speed adjustment device of a multimedia segment provided by the embodiment of the present disclosure, which can be realized by software and / or hardware and can be integrated in an electronic device to adjust the speed of audio / video information. As shown in FIG. 7, the device includes a division module 1710, a first variable speed control module 1720 and a second variable speed control module 1730. Figure 17

[0136] ​​The dividing module 1710 is configured to divide a multimedia material segment into multiple intervals on an audio / video editing track, wherein the multiple intervals include a target interval, and a first control point and a second control point corresponding to the target interval are set on the multimedia material segment;

[0137] The first speed control module 1720 is configured to, in response to a moving operation on the first control point, adjust a speed change amount according to a position of the first control point on the editing track, control a speed of a video frame in the target interval to be changed according to the adjusted speed change amount, and adjust a display length of the target interval on the editing track according to a playing time length after the speed change.

[0138] The second speed control module 1730 is configured to, in response to a moving operation on the second control point, adjust a slope of a speed curve according to a position of the second control point on the target interval, and control a speed of a video frame in the target interval to be changed according to the speed curve with the adjusted slope.

[0139] The speed adjustment device for a multimedia segment provided by the embodiments of the present disclosure can execute the speed adjustment method for a multimedia segment provided by any of the embodiments of the present disclosure, and has the corresponding function modules and beneficial effects of the execution method.

[0140] In order to implement the above-mentioned embodiments, the present disclosure further proposes a computer program product, comprising computer programs / instructions, which, when executed by a processor, implement the speed adjustment method for a multimedia segment in the above-mentioned embodiments.

[0141] Figure 18 A structural schematic diagram of an electronic device provided by the embodiments of the present disclosure.

[0142] The following will be specifically described with reference to Figure 18 which shows a structural schematic diagram of an electronic device 1800 suitable for being used to implement the embodiments of the present disclosure. The electronic device 1800 in the embodiments of the present disclosure can include but is not limited to a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet Personal Computer), a PMP (Portable Multimedia Player), a vehicle terminal (such as a vehicle navigation terminal), and the like, and a fixed terminal such as a digital TV, a desktop computer, and the like. Figure 18 The electronic device shown is only an example, and should not bring any limitation to the functions and use range of the embodiments of the present disclosure.

[0143] As Figure 18As shown, the electronic device 1800 can include a processor (e.g., a central processing unit, a graphics processing unit, etc.) 1801 that can perform various suitable actions and processes according to programs stored in a read-only memory (ROM) 1802 or loaded into a random access memory (RAM) 1803 from a memory 1808. Various programs and data required for the operation of the electronic device 1800 are also stored in the RAM 1803. The processor 1801, the ROM 1802, and the RAM 1803 are connected to each other through a bus 1804. An input / output (I / O) interface 1805 is also connected to the bus 1804.

[0144] In general, the following devices can be connected to the I / O interface 1805: input devices 1806 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 1807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a memory 1808 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1809. The communication device 1809 can allow the electronic device 1800 to communicate wirelessly or wired with other devices to exchange data. Although Figure 18 The electronic device 1800 is shown with various devices, but it is understood that all of the shown devices are not required to be implemented or present. More or fewer devices can alternatively be implemented or present.

[0145] In particular, the processes described above with reference to the flowcharts can be implemented as a computer software program according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods illustrated by the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network through the communication device 1809, or installed from the memory 1808, or installed from the ROM 1802. When the computer program is executed by the processor 1801, the above-mentioned functions defined in the speed adjustment method of the multimedia segment according to embodiments of the present disclosure are performed.

[0146] It should be noted that the computer-readable medium described above can be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. The computer-readable storage medium, for example, can be, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any suitable combination of the foregoing. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program used by or in connection with an instruction execution system, apparatus or device. In the disclosure, the computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, in which the computer-readable program code is contained. Such a propagated data signal can take any of a variety of forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the foregoing. The computer-readable signal medium can also be any computer-readable medium that is not a storage medium and that can communicate, propagate or transport a program for use by or in connection with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including, but not limited to, wire, cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

[0147] In some embodiments, the client, server, or both can communicate using any current known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any current known or future developed networks.

[0148] The computer-readable medium described above can be included in the electronic device described above; or can exist separately from the electronic device described above.

[0149] The computer-readable medium described above carries one or more programs, when the one or more programs are executed by the electronic device, cause the electronic device to:

[0150] The multimedia material segment is divided into multiple intervals on an audio-video editing track, wherein the multiple intervals include a target interval, and the multimedia material segment is provided with a first control point and a second control point corresponding to the target interval, in response to a moving operation on the first control point, a speed change amount is adjusted according to a position of the first control point on the editing track, the speed of the video frame in the target interval is controlled to be changed according to the adjusted speed change amount, and the display length of the target interval on the editing track is adjusted according to the playing time after the speed change; in response to a moving operation on the second control point on the target interval, a slope of a speed curve is adjusted according to a position of the second control point on the target interval, and the speed of the video frame in the target interval is controlled to be changed according to the speed curve after the slope adjustment. Thus, by dividing the multimedia material into multiple intervals, the playing speed of the video frame between the multiple intervals is independently adjusted and is not associated with each other, and for the video frame in each interval, the overall adjustment of the playing speed can be realized based on the first control point, and the variable speed adjustment of the playing speed can be realized based on the second control point, so that the playing speed of different video frames in the same interval is different, thereby realizing the fine adjustment of the playing speed of the video frame, and improving the accuracy and efficiency of the playing speed adjustment of the video frame. Electronic devices can be written in one or more programming languages or combinations thereof including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as the "C" programming language or similar programming languages. Program code can be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, through the Internet using an Internet service provider).

[0151] The computer program product of the first aspect can include one or more non-transitory computer-readable media storing instructions that, when executed, cause one or more processors to perform the operations of the method of the first aspect. The computer program product of the first aspect can include a computer-readable medium storing instructions that, when executed, cause one or more processors to perform the operations of the method of the first aspect.

[0152] The units described in the embodiments of the present disclosure can be implemented by software, or by hardware, or by a combination of software and hardware. In some cases, the names of the units do not constitute a limitation on the units themselves.

[0153] The functions described in this document can be implemented in part or in whole using one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Program-specific Integrated Circuits (ASICs), Program-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0154] In the context of the present disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium will include one or more lines of electrical connections, portable computer disks, hard disk drives, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0155] The above description merely illustrates the preferred embodiment of the disclosure and a principle for applying the technologies. It should be understood by those skilled in the art that the disclosed scope of the disclosure is not limited to the technical solutions formed by the specific combinations of the technical features described above, and should also cover other technical solutions formed by the combinations of the technical features described above or their equivalent features without departing from the concept disclosed above. For example, the technical solutions formed by the mutual replacement of the above-described features and the technical features with similar functions disclosed in the disclosure (but not limited to) can be formed.

[0156] Further, although operations are depicted in a particular, chronological sequence, this should not be understood as requiring the operations to be performed in the order indicated, or sequentially. In some circumstances, multitasking and parallel processing can be advantageous. Likewise, although specific implementation details are contained in the above discussion, these should not be construed as limiting the scope of the disclosure. Some features described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment can also be implemented separately or in any suitable sub-combination.

[0157] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A method for speed adjustment of a multimedia clip, characterized in that, Comprising: segmenting a multimedia material segment on an audio-video editing track into a plurality of intervals, wherein the plurality of intervals include a target interval, and setting a first control point and a second control point corresponding to the target interval on the multimedia material segment; in response to a moving operation on the first control point, adjusting a speed change amount according to a position of the first control point on the editing track, controlling a speed of a video frame in the target interval to vary according to the adjusted speed change amount, and adjusting a display length of the target interval on the editing track according to a playing time length after the speed is changed; in response to a moving operation on the second control point, adjusting a slope of a speed curve according to a position of the second control point on the target interval, and controlling the speed of the video frame in the target interval to vary according to the slope-adjusted speed curve.

2. The method of claim 1, wherein the first control point is set at an ending position of the target interval, and the adjusting the speed change amount according to the position of the first control point on the editing track in response to the moving operation on the first control point comprises: in response to a right moving operation on the first control point, controlling a position of an ending point of the target interval on the editing track to stretch right, and decreasing the speed change amount according to the position of the first control point on the editing track, wherein a position of a starting point of the target interval on the editing track is unchanged, or in response to a left moving operation on the first control point, controlling the position of the ending point of the target interval on the editing track to shorten left, and increasing the speed change amount according to the position of the first control point on the editing track, wherein the position of the starting point of the target interval on the editing track is unchanged.

3. The method of claim 1, wherein the first control point is set at a starting position of the target interval, and the adjusting the speed change amount according to the position of the first control point on the editing track in response to the moving operation on the first control point comprises: in response to a right moving operation on the first control point, controlling a position of a starting point of the target interval on the editing track to shorten right, and increasing the speed change amount according to the position of the first control point on the editing track, wherein a position of an ending point of the target interval on the editing track is unchanged, or in response to a left moving operation on the first control point, controlling the position of the starting point of the target interval on the editing track to stretch left, and decreasing the speed change amount according to the position of the first control point on the editing track, wherein the position of the ending point of the target interval on the editing track is unchanged. the controlling the speed of the video frame in the target interval to vary according to the adjusted speed change amount comprises: in a case where the video frame in the target interval is played at a constant speed, controlling the speed of the video frame in the target interval to increase or decrease at the constant speed according to the adjusted speed change amount; or 4. The method of claim 1, wherein, in a case where the video frame in the target interval is played at a variable speed, controlling the speed of the video frame in the target interval to vary according to the adjusted speed change amount. ​ In the case that the video frames in the target interval are played at a non-uniform speed according to the speed curve, the speed of the video frames in the target interval is controlled to be increased or decreased at a non-uniform speed according to the adjusted speed variation.

5. The method of claim 1, wherein, Further comprising: When the multimedia material segment is divided into the plurality of intervals, it is detected whether the number of video frames in the target interval is less than a preset video threshold value; If it is detected that the number of video frames is less than the video threshold value, a prompt message indicating that the division is impossible is displayed.

6. The method of claim 1, wherein, Further comprising: In response to a first adsorption control opening operation, an end position of a moving operation of the first control point on the edit track is obtained, and the end position is adsorbed and aligned with a division position of an adjacent interval.

7. The method of claim 1, wherein, The speed of the video frames in the target interval is controlled to be played at a variable speed according to the speed curve with the adjusted slope according to the position of the second control point on the target interval, including: In response to the second control point being located at a middle position of the target interval, the slope of the speed curve is adjusted to zero to generate a uniform straight line matching the speed adjusted by the first control point, and then the speed of the video frames in the target interval is controlled to be played according to the uniform straight line.

8. The method of claim 7, wherein, Further comprising: In response to the second control point being moved between the middle position and an end position of the target interval, the slope of the speed curve is adjusted to generate an ascending speed curve, wherein when the second control point is located at the end position of the target interval, the corresponding slope value of the speed curve is maximum, and then the playing speed of the video frames in the target interval is controlled to be played according to the ascending speed curve.

9. The method of claim 7, wherein, Further comprising: In response to the second control point being moved between the middle position and a start position of the target interval, the slope of the speed curve is adjusted to generate a descending speed curve, wherein when the second control point is located at the start position of the target interval, the corresponding slope value of the speed curve is minimum, and then the playing speed of the video frames in the target interval is controlled to be played according to the descending speed curve.

10. The method of claim 1, wherein, Further comprising: According to the speed adjusted by the first control point and a preset speed range corresponding to the adjusted slope of the speed curve, a speed interval value of the adjusted speed curve is determined; The speed interval value is displayed in a preset area of the position of the second control point in the target interval.

11. The method of claim 1, wherein, Further comprising: In response to a dragging operation of the second control point in the target interval, a variable speed adjustment state of the video frames in the target interval for which the speed is adjusted is displayed; According to the speed curve with the adjusted slope, the video frames in the target interval with a decreased speed are displayed to be widened, and the video frames in the target interval with an increased speed are displayed to be narrowed.

12. The method of claim 1, wherein, Further comprising: In response to a second adsorption control opening operation, a speed curve with an adjusted slope is obtained according to the position of the second control point on the target interval; A playing speed of an end position of the target interval is determined according to the speed curve with the adjusted slope. If a difference between the playback speed of the target interval end position and the playback speed of the adjacent interval start position is less than a preset threshold, the speed adjustment of the target interval end position and the adjacent interval start position are aligned.

13. The method of claim 1, wherein, Further comprising: displaying a schematic diagram corresponding to the multimedia material segment in the functional panel area, wherein the schematic diagram comprises a schematic interval corresponding to the target interval, and a speed control identifier corresponding to the first control point, and displaying the adjusted speed of the target interval according to the first control point in the schematic interval corresponding area.

14. The method of claim 13, wherein, Further comprising: adjusting the slope of the speed curve according to the position of the second control point in the target interval, and displaying the speed curve after slope adjustment and the speed interval value of the speed curve in the schematic interval.

15. The method of claim 13, wherein, Further comprising: in response to a storage operation of the edit draft, comparing the speeds corresponding to the speed control identifiers of adjacent schematic intervals; when the speed corresponding to the speed control identifier of the left interval end position is the same as the speed corresponding to the speed control identifier of the right interval start position, merging the two speed control identifiers as one speed control point for display on the mobile device; when the speed corresponding to the speed control identifier of the left interval end position is different from the speed corresponding to the speed control identifier of the right interval start position, storing the two speed control identifiers as two speed control points for display on the mobile device.

16. An apparatus for speed adjustment of a multimedia segment, characterized by comprising: a division module, configured to divide a multimedia material segment into a plurality of intervals on an audio / video editing track, wherein the plurality of intervals comprises a target interval, and a first control point and a second control point corresponding to the target interval are set on the multimedia material segment; a first speed control module, configured to, in response to a moving operation on the first control point, adjust a speed change amount according to the position of the first control point on the editing track, control the speed of video frames in the target interval to vary according to the adjusted speed change amount, and adjust the display length of the target interval on the editing track according to the playback time length after speed change; a second speed control module, configured to, in response to a moving operation on the second control point, adjust the slope of a speed curve according to the position of the second control point on the target interval, and control the speed of video frames in the target interval to vary according to the speed curve after slope adjustment.

17. An electronic device, comprising: The electronic device comprises: a processor; a memory for storing executable instructions of the processor; the processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the speed adjustment method of the multimedia segment according to any one of claims 1-15.

18. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program for executing the speed adjustment method of the multimedia segment according to any one of claims 1-15. The computer readable storage medium stores a computer program for executing the speed adjustment method of the multimedia segment according to any one of claims 1-15.

Images