Multimedia processing method and device and terminal equipment

Abstract

The embodiment of the invention provides a multimedia processing method and device and terminal equipment, and the method comprises the steps: displaying a first toolbar on an interface, the first toolbar comprises one or more first controls, and the one or more first controls are used for editing multimedia; in response to selection of materials filled in the track of the multimedia, a second toolbar is further displayed on the interface, and the second toolbar comprises one or more second controls associated with editing of the materials; and in response to selection of one second control in the one or more second controls, editing the material.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of multimedia technology, and in particular to a multimedia processing method, apparatus, and terminal device. Background Art

[0002] Users can edit videos in the video editing interface. For example, users can add filters, stickers, and text to videos in the video editing interface.

[0003] Currently, the video editing page includes a toolbar that can be used to add materials to the video. When the user adjusts the added materials, the materials need to be manually operated. For example, when the user extends the material of the video material to the left, the user needs to drag the left side of the material to the extended position. However, in the above method, the complexity of editing the material is high, resulting in low efficiency of editing the material. Summary of the invention

[0004] The embodiments of the present disclosure provide a multimedia processing method, apparatus and terminal device, which are used to solve the technical problems in the prior art.

[0005] In a first aspect, an embodiment of the present disclosure provides a multimedia processing method, the multimedia processing method comprising:

[0006] Displaying a first toolbar on the interface, wherein the first toolbar includes one or more first controls, and the one or more first controls are used for editing multimedia;

[0007] In response to selection of the material filled in the track of the multimedia, a second toolbar is further displayed on the interface, wherein the second toolbar includes one or more second controls associated with editing of the material;

[0008] In response to selection of a second control of the one or more second controls, the material is edited.

[0009] In a second aspect, an embodiment of the present disclosure provides a multimedia processing device, the multimedia processing device comprising a display module and an editing module, wherein:

[0010] The display module is used to display a first toolbar on the interface, wherein the first toolbar includes one or more first controls, and the one or more first controls are used to edit multimedia;

[0011] The display module is further configured to, in response to selection of a material filled in the track of the multimedia, display a second toolbar on the interface, wherein the second toolbar includes one or more second controls associated with editing of the material;

[0012] The editing module is used for editing the material in response to selection of a second control among the one or more second controls.

[0013] In a third aspect, the present disclosure provides a terminal device including: a processor and a memory;

[0014] The memory stores computer-executable instructions;

[0015] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the multimedia processing method as described in the first aspect and various possible aspects of the first aspect.

[0016] In a fourth aspect, the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the multimedia processing method as described in the first aspect and various possible aspects of the first aspect are implemented.

[0017] In a fifth aspect, the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the multimedia processing method as described in the first aspect and various possible aspects of the first aspect.

[0018] The disclosed embodiments provide a multimedia processing method, apparatus, and terminal device, wherein the terminal device can display a first toolbar on an interface, wherein the first toolbar can include one or more first controls, and the one or more first controls are used to edit the multimedia, and in response to the selection of the material filled in the track of the multimedia, a second toolbar is also displayed on the interface, wherein the second toolbar can include one or more second controls associated with the editing of the material, and in response to the selection of one of the one or more second controls, the material is edited. In the above method, not only the first toolbar but also the second toolbar can be displayed in the interface, and since the second control in the second toolbar can be used to edit the material, the user can edit the material quickly and accurately based on the second control in the second toolbar, thereby improving the accuracy of editing the material and the efficiency of editing the material. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0020] Figure 1A schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0021] Figure 2 A flowchart of a multimedia processing method provided by an embodiment of the present disclosure;

[0022] Figure 3 A schematic diagram of a first toolbar provided in an embodiment of the present disclosure;

[0023] Figure 4 A schematic diagram of a process of displaying a second toolbar provided by an embodiment of the present disclosure;

[0024] Figure 5 A schematic diagram of a process of canceling display of a second toolbar provided in an embodiment of the present disclosure;

[0025] Figure 6 A schematic diagram of a process of editing a material provided by an embodiment of the present disclosure;

[0026] Figure 7 A schematic diagram of a method for determining a second control provided by an embodiment of the present disclosure;

[0027] Figure 8 A schematic diagram of a second toolbar provided in an embodiment of the present disclosure;

[0028] Fig. 9 A schematic diagram showing a second control provided by an embodiment of the present disclosure;

[0029] Fig.10 A schematic diagram of a second toolbar provided in an embodiment of the present disclosure;

[0030] Fig.11 A schematic diagram showing a second control provided by an embodiment of the present disclosure;

[0031] Fig.12 A schematic diagram of a method for editing a material provided by an embodiment of the present disclosure;

[0032] Fig.13 A schematic diagram of a process of editing a material provided by an embodiment of the present disclosure;

[0033] Fig.14 A schematic diagram of the structure of a multimedia processing device provided by an embodiment of the present disclosure;

[0034] Fig.15 A schematic diagram of the structure of a terminal device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0035] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0036] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0037] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as a terminal device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0038] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in the form of text. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the terminal device.

[0039] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0040] To facilitate understanding, the concepts involved in the embodiments of the present disclosure are explained below.

[0041] Terminal device: a device with wireless transceiver function. Terminal devices can be deployed on land, including indoors or outdoors, handheld, wearable or vehicle-mounted. The terminal device can be a mobile phone, a tablet computer, a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a vehicle-mounted terminal device, a wireless terminal in self-driving, a wireless terminal device in remote medical, a wireless terminal device in smart grid, a wireless terminal device in transportation safety, a wireless terminal device in smart city, a wireless terminal device in smart home, a wearable terminal device, etc. The terminal equipment involved in the embodiments of the present disclosure may also be referred to as a terminal, user equipment (UE), access terminal equipment, vehicle-mounted terminal, industrial control terminal, UE unit, UE station, mobile station, mobile station, remote station, remote terminal equipment, mobile equipment, UE terminal equipment, wireless communication equipment, UE agent or UE device, etc. The terminal equipment may also be fixed or mobile.

[0042] Next, combine Figure 1 , the application scenarios of the embodiments of the present disclosure are described.

[0043] Figure 1 A schematic diagram of an application scenario provided by an embodiment of the present disclosure. Figure 1 , including a terminal device. Among them, the interface displayed by the terminal device may be a video editing interface. The video editing interface may include a preview area, video materials, stickers and a timeline. When a user clicks on a sticker, the sticker may be highlighted. After the user clicks on the sticker, the user may drag the left side of the sticker to the left to increase the proportion of the sticker on the timeline (the duration of the sticker is longer than before dragging). When the user stops operating the sticker, the sticker may be unhighlighted. Among them, the proportion of the sticker on the timeline increases. In this way, the user can edit the sticker through manual operation.

[0044] It should be noted that Figure 1 The examples are merely examples of the embodiments of the present disclosure and are not limitations of the embodiments of the present disclosure.

[0045] In the related art, users can edit videos in the video editing interface. Figure 1In the embodiment shown, the user can add stickers to the video material in the video editing interface, and the user can also add filters, special effects and text to the video material in the video editing interface. Currently, the video editing page may include a toolbar, which can be used to add materials to the video. For example, in Figure 1 In the embodiment shown, when a user clicks on a video material, a toolbar may be displayed at the bottom of the video editing interface. The toolbar may include controls for adding filters, stickers, and special effects, etc. The user may click on the controls in the toolbar to add corresponding materials to the video material. After the user adds new materials to the video material, when the user edits the newly added materials, manual operations need to be performed on the materials. For example, Figure 1 In the embodiment shown, the user can increase the duration of the sticker by manually dragging the left side of the sticker. However, in the above method, there are many types of editing of the material (such as splitting, dragging and deleting), and the manual editing of the material is more complicated, resulting in low efficiency of editing the material.

[0046] In order to solve the technical problems in the related art, the embodiment of the present disclosure provides a multimedia processing method, wherein a terminal device can display a first toolbar on an interface, wherein a first control in the first toolbar can be used to edit multimedia, and in response to the selection of a material filled in a track of the multimedia, a second toolbar is also displayed on the interface, wherein the second toolbar can include one or more second controls associated with the editing of the material, and the one or more second controls are displayed in the window of the interface, and in response to the selection of one of the one or more second controls, the material is edited, and in response to the cancellation of the selection of the material, the terminal device can cancel the display of the second toolbar. In the above method, not only the first toolbar but also the second toolbar can be displayed in the interface, and since the second control in the second toolbar can be used to edit the material, the user can quickly and accurately edit the material based on the second control in the second toolbar, thereby improving the accuracy and efficiency of editing the material, and when the user cancels the selection of the material, the terminal device can cancel the display of the second toolbar, thereby improving the flexibility of the interface display.

[0047] The technical solution of the present invention and how the technical solution of the present invention solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0048] Figure 2 A flowchart of a multimedia processing method provided by an embodiment of the present disclosure. Figure 2 , the method may include:

[0049] S201. Display a first toolbar on the interface.

[0050] The execution subject of the embodiment of the present disclosure may be a terminal device, or a multimedia processing device arranged in the terminal device. The multimedia processing device may be implemented based on software, or may be implemented based on a combination of software and hardware, which is not limited in the embodiment of the present disclosure.

[0051] The interface may be used to edit the video. For example, the interface may be a video editing interface. For example, the terminal device may display a video editing interface, and the user may create a template in the video editing interface, wherein the template may include pre-designed animation effects, text styles, color combinations, transition effects, music, and other materials.

[0052] In some embodiments, the first toolbar may include one or more first controls. For example, the terminal device may display the first toolbar at the bottom of the interface, and the first toolbar may include one first control or multiple first controls, which is not limited in the embodiments of the present disclosure.

[0053] Among them, one or more first controls can be used to edit multimedia. For example, the first control can be used to add stickers, filters, special effects, etc. to the multimedia, and the first control can also be used to split, crop, and delete the multimedia. For example, the multimedia can be a video, or an audio, or an image, and the multimedia can also be a combination of one or more of video, audio, and image. For example, the multimedia can be a video combined with video and audio, the multimedia can also be a video combined with video and image, the multimedia can also be a video combined with image and audio, and the multimedia can also be a video combined with video, image, and audio.

[0054] In some embodiments, in response to the selection of multimedia, the terminal device may display a first toolbar. For example, when the user does not click on the video material in the interface, the first toolbar is not displayed at the bottom of the interface, and when the user clicks on the video material in the interface, the first toolbar may be displayed at the bottom of the interface.

[0055] Next, combine Figure 3 , a detailed description of the first toolbar is given.

[0056] Figure 3 A schematic diagram of a first toolbar provided in an embodiment of the present disclosure. Figure 3, including a terminal device. Among them, the interface displayed by the terminal device can be a video editing interface. The video editing interface may include a preview area and video materials, and the video materials are filled in the video track. When the user clicks on the video material, the terminal device can display a first toolbar at the bottom of the video editing interface, and the first control in the first toolbar includes a sticker control, a special effect control, and a filter control. When the user clicks on the sticker control, the terminal device can fill the sticker track (in the same timeline as the video track) with sticker materials, that is, the terminal device can add stickers to the video material.

[0057] In some embodiments, the first toolbar may be displayed at any position in the interface, which is not limited in the embodiments of the present disclosure.

[0058] In some embodiments, the background color of the first toolbar may be the same as the background color of the interface, or the background color of the first toolbar may be different from the background color of the interface, which is not limited in the embodiments of the present disclosure.

[0059] In some embodiments, in response to canceling the selection of the multimedia, the terminal device may cancel displaying the first toolbar. Figure 3 In the illustrated embodiment, when the user cancels the selection of a video material (eg, the user clicks again on an area without video material or video track), the first toolbar may be undisplayed at the bottom of the interface.

[0060] S202: In response to selection of the material filled in the multimedia track, a second toolbar is also displayed on the interface.

[0061] The material may be an object to be edited in an editing scene, and may include one or more of the following: video, image, audio, sticker, filter, special effect, text.

[0062] In some embodiments, in a video editing scenario, the material can be a video, or a video (picture-in-picture), audio, stickers, filters, special effects, images, text, etc. that will be applied to the video.

[0063] In some embodiments, in an image editing scenario, the material may be an image, or may be a video, audio, special effect, sticker, filter, text, etc. to be applied to the image.

[0064] In some embodiments, in an audio editing scenario, the material may be audio.

[0065] Exemplarily, the materials selected by the user may include audio, materials in the main track, picture-in-picture, graffiti pens, text, stickers, filters, global special effects, video special effects, makeup, face pinching, adjustment, 3D accessories, materials determined by artificial intelligence (such as digital human special effects), etc.

[0066] The multimedia track can be used to fill in materials. For example, the video track can be filled with video materials, the audio track can be filled with audio materials, the image track can be filled with image materials, the text track can be filled with text materials, the sticker track can be filled with stickers, etc.

[0067] In some embodiments, the track may include slots for filling materials. The terminal device can fill the materials in the slots, and when the materials grow (the duration of the materials increases), the slots corresponding to the materials can also grow synchronously. It should be noted that the slots filled with materials can be hidden, which can improve the simplicity of the interface.

[0068] The second toolbar includes one or more second controls associated with editing of the material. For example, when the user clicks on the material, the terminal device may display the second toolbar in the interface, and the second toolbar may include one or more second controls. When the user clicks on the second control, the material can be edited.

[0069] In some embodiments, the second control can be used to edit the material. For example, one or more second controls can be used to copy the material, split the material, delete the material, extend the material, etc. In this way, the user can edit the material quickly and accurately based on the second control, thereby improving the efficiency and accuracy of editing the material.

[0070] In some embodiments, one or more second controls are displayed in a window of the interface. This can improve the flexibility of the interface layout and the display effect of the interface. For example, the window can be displayed following the second toolbar. When the second toolbar is displayed, the window can be displayed synchronously, and when the second toolbar disappears, the window can disappear synchronously. For example, the terminal device can add a custom component for displaying the second toolbar.

[0071] In some embodiments, the background color of the window may be different from the background color of the interface. For example, the background color of the interface may be black, and the background color of the window may be gray, which may improve the display effect of one or more second controls in the interface, facilitate users to quickly find the second controls in the interface, and improve the user experience.

[0072] In some embodiments, the background color of the window and the background color of the interface may also be the same, which is not limited in the embodiments of the present disclosure.

[0073] In some embodiments, in response to canceling the selection of the material, the terminal device can cancel the display of the second toolbar. For example, after the user selects the material, when the user clicks on other areas outside the material or material track, the user can cancel the selection of the material, and the terminal device can also cancel the display of the second toolbar.

[0074] Next, combine Figure 4 , a process of displaying a second toolbar on an interface of a terminal device in response to a selection of material filled in a multimedia track is described.

[0075] Figure 4 A schematic diagram of a process of displaying a second toolbar provided by an embodiment of the present disclosure. Figure 4 , including: a terminal device. Among them, the interface displayed by the terminal device is a video editing interface. The video editing interface includes a preview area, video materials, stickers and a first toolbar. The first toolbar includes a sticker control, a special effect control and a filter control. When a user clicks a sticker, the terminal device can highlight the sticker and display a second toolbar on the upper side of the first toolbar. The background color of the second toolbar is different from the background color of the interface. The second control in the second toolbar includes a split control and a delete control.

[0076] Next, combine Figure 5 , a process is described in which the terminal device cancels display of the second toolbar in response to canceling selection of the material.

[0077] Figure 5 A schematic diagram of a process of canceling the display of the second toolbar provided in an embodiment of the present disclosure. Figure 5 , including a terminal device. The interface displayed by the terminal device is a video editing interface. The video editing interface includes a preview area, video materials, stickers, a first toolbar and a second toolbar. The first controls displayed on the first toolbar include sticker controls, special effects controls and filter controls. The second controls displayed on the second toolbar include split controls and delete controls. The sticker is highlighted (the user clicks on the sticker). After the user clicks on a blank area of ​​the video editing interface, the terminal device can determine that the user cancels the selection of the sticker, and the terminal device can cancel the display of the second toolbar in the video editing interface.

[0078] S203: In response to selection of a second control among the one or more second controls, edit the material.

[0079] The terminal device can edit the material based on the following feasible implementation: determine the editing function of the selected second control, and edit the material based on the editing function. In this way, the terminal device can accurately edit the material selected by the user based on the second control selected by the user, thereby improving the accuracy of editing the material.

[0080] Exemplarily, when the second control clicked by the user is used to copy the material, the terminal device can copy the material selected by the user; when the second control clicked by the user is used to split the material, the terminal device can split the material selected by the user; when the second control clicked by the user is used to delete the material, the terminal device can delete the material selected by the user; when the second control clicked by the user is used to extend the material, the terminal device can extend the material selected by the user.

[0081] Next, combine Figure 6 , a process of editing a material by a terminal device in response to a selection of a second control among one or more second controls is described.

[0082] Figure 6 A schematic diagram of a process of editing a material provided by an embodiment of the present disclosure. Figure 6 In the embodiment shown, the second control is used to delete the material to the left of the pointer, see Figure 6 , including: a terminal device. Among them, the interface displayed by the terminal device is a video editing interface. The video editing interface includes a preview area, video materials, stickers, a first toolbar, a second toolbar and a pointer. Among them, the first control displayed in the first toolbar includes a sticker control, a special effect control and a filter control. The sticker is highlighted. The second control displayed in the second toolbar includes a split control and a delete control. When the user clicks the delete control, the terminal device can delete the sticker selected by the user on the track. In this way, the user can edit the material quickly and accurately based on the second control in the second toolbar, thereby improving the accuracy and efficiency of editing the material.

[0083] The disclosed embodiment provides a multimedia processing method, in which a terminal device can display a first toolbar on an interface, and in response to a selection of a material filled in a multimedia track, the terminal device can display a second toolbar on the interface, and in response to a selection of one of the one or more second controls displayed on the second toolbar, the editing function of the selected second control is determined, and the material is edited based on the editing function. In the above method, since the second control in the second toolbar can be used to edit the material, the user can edit the material quickly and accurately based on the second control in the second toolbar, thereby improving the accuracy and efficiency of editing the material, and when the user cancels the selection of the material, the terminal device can cancel the display of the second toolbar, thereby improving the flexibility of the interface display.

[0084] exist Figure 2 Based on the embodiment shown, in the above multimedia processing method, the terminal device can also determine one or more second controls in the second toolbar. Figure 7, a method for determining one or more second controls in the second toolbar is described in detail.

[0085] Figure 7 A schematic diagram of a method for determining a second control provided by an embodiment of the present disclosure. Figure 7 The method flow includes:

[0086] S701: Determine the timing position of the pointer.

[0087] The interface may include a track, the material may be filled on the track, and the track may include a pointer. Figure 6 In the embodiment shown, video materials can be filled on the video track, stickers can be filled on the sticker track, and the interface can also hide the track, so as to avoid the track from interfering with video editing, thereby improving the simplicity of the interface and improving the user experience.

[0088] In some embodiments, the pointer may be a mark moving on the timeline, and the temporal position of the pointer may be the position of the pointer on the timeline. For example, the pointer may be a white vertical line, and the temporal position of the pointer on the timeline may indicate the current editing position, and the user may preview and edit different parts of the video by moving the pointer.

[0089] In some embodiments, the pointer can assist the user to accurately locate a specific frame in the material, so that the user can accurately edit the material. For example, the user can determine the exact location where the material needs to be split, deleted, or extended by moving the pointer.

[0090] In some embodiments, when the user previews the editing result, the pointer may continuously move to the right and indicate the current preview position of the editing result.

[0091] In some embodiments, the temporal position of the pointer may be the position of the editing operation. For example, when the user splits the material, the split position of the material may be the temporal position of the pointer, and when the user extends the material, the material may be extended to the temporal position of the pointer.

[0092] In some embodiments, the terminal device may monitor the timing position of the pointer sliding in real time, and the terminal device may also determine the timing position of the pointer based on any feasible implementation method, which is not limited in the embodiments of the present disclosure.

[0093] S702: Determine a second control based on the temporal position of the pointer and the effective time period of the material.

[0094] The effective time period of the material can indicate the position of the material playback. For example, the effective time period of the material is from the 5th second to the 10th second. When the terminal device previews the editing result, the material can be played from the 5th second to the 10th second. For example, the effective time period of the sticker is from the 5th second to the 15th second. The editing result is a 30-second video. When the terminal device plays the video, the sticker can be included from the 5th second to the 15th second of the video. In other playback periods of the video, the video does not include the sticker.

[0095] In some embodiments, the state of the pointer may indicate the relationship between the temporal position of the pointer and the effective time period of the material. For example, the terminal device may monitor the temporal position of the pointer in real time, and determine the state of the pointer by comparing the effective time period of the material, wherein the state of the pointer may be left, right, middle, head, and end, wherein when the state of the pointer is left, the pointer is located on the left side of the material, when the state of the pointer is right, the pointer is located on the right side of the material, when the state of the pointer is middle, the pointer is located in the material, when the state of the pointer is head, the pointer is located at the first frame of the material, and when the state of the pointer is end, the pointer is located at the last frame of the material.

[0096] The terminal device determines the second control based on the temporal position of the pointer and the short duration of the material, and there are two situations as follows:

[0097] Case 1: The temporal position of the pointer is within the effective time period of the material.

[0098] When the temporal position of the pointer is within the effective time period of the material, one or more second controls may be controls in the first set.

[0099] In some embodiments, the first set may include one or more of: a control for copying a material, a control for splitting a material, a control for deleting a material.

[0100] In some embodiments, the control for deleting the material includes one or more of the following: a control for deleting the material on the left side of the timing position, a control for deleting the material on the right side of the timing position, and a control for deleting the complete material. For example, when the user clicks on the control for deleting the material on the left side of the timing position, the terminal device can delete the material on the left side of the timing position, and when the user clicks on the control for deleting the material on the right side of the timing position, the terminal device can delete the material control on the right side of the timing position.

[0101] Next, combine Figure 8 , when the second control is a control in the first set, the second toolbar is described.

[0102] Figure 8 A schematic diagram of a second toolbar provided by an embodiment of the present disclosure. Figure 8, including: a second toolbar. The second controls displayed in the second toolbar include a copy control (used to copy material), a left delete control (used to delete material on the left side of the timing position), a split control (used to split material), a right delete control (used to delete material on the right side of the timing position) and a delete control (used to delete the complete material).

[0103] In some embodiments, when the temporal position of the pointer changes, some controls in the first set may be enabled, and another part of the controls may be disabled. For example, when the second control in the second toolbar is enabled, the second control is in a usable state, and when the second control is disabled, the second control may be in an unusable state, and when the second control is disabled, the second control may be grayed out.

[0104] In some embodiments, when the timing position of the pointer is not in the effective time period of the first frame and the last frame of the material, the controls for copying the material, the controls for splitting the material, and the controls for deleting the material are enabled; when the timing position of the pointer is in the effective time period of the first frame and the last frame of the material, the controls for copying the material and the controls for deleting the complete material are enabled, and the controls for splitting the material, the controls for deleting the material to the left of the timing position, and the controls for deleting the material to the right of the timing position are disabled.

[0105] Next, combine Fig. 9 , describe the second control displayed on the terminal device.

[0106] Fig. 9 A schematic diagram showing a second control provided by an embodiment of the present disclosure. Fig. 9 , including a terminal device. The interface displayed by the terminal device includes a preview area, video material, stickers, a pointer, a first toolbar and a second toolbar. The first toolbar includes a sticker control, a special effect control and a filter control. The second toolbar includes a copy control, a left delete control, a split control, a right delete control and a delete control.

[0107] See also Fig. 9 , when the pointer is in the sticker's active period, the Copy, Left Delete, Split, Right Delete, and Delete controls are enabled. When the pointer is in the sticker's first frame, the Copy and Delete controls are enabled, and the Left Delete, Split, and Right Delete controls are disabled. When the pointer is in the sticker's last frame, the Copy and Delete controls are enabled, and the Left Delete, Split, and Right Delete controls are disabled.

[0108] Case 2: The temporal position of the pointer is outside the effective time period of the material.

[0109] When the temporal position of the pointer is outside the effective time period of the material, the one or more second controls are controls in the second set.

[0110] In some embodiments, the second set may include one or more of: a control for duplicating the material, a control for deleting the complete material, a control for extending the material to a temporal position.

[0111] In some embodiments, the control for extending the material to the timing position includes one or more of the following: a control for extending the left side of the material, and a control for extending the right side of the material. For example, when the user clicks the control for extending the left side of the material, the terminal device can extend the left side of the material to the timing position, and when the user clicks the control for extending the right side of the material, the terminal device can extend the right side of the material to the timing position.

[0112] Next, combine Fig.10 , when the second control is a control in the second set, the second toolbar is described.

[0113] Fig.10 A schematic diagram of a second toolbar provided by an embodiment of the present disclosure. Fig.10 , including: a second toolbar. The second controls displayed in the second toolbar include a copy control, a left extension control (used to extend the left side of the material), a split control, a right extension control (used to extend the right side of the material) and a delete control.

[0114] In some embodiments, when the temporal position of the pointer changes, some of the controls in the second set may be enabled, and another part of the controls may be disabled.

[0115] In some embodiments, when the timing position of the pointer is on the left side of the material, controls for copying the material, controls for deleting the complete material, and controls for extending the left side of the material are enabled, and controls for extending the right side of the material are disabled; when the timing position of the pointer is on the right side of the material, controls for copying the material, controls for deleting the complete material, and controls for extending the right side of the material are enabled, and controls for extending the left side of the material are disabled.

[0116] Next, combine Fig.11 , describe the second control displayed on the terminal device.

[0117] Fig.11 A schematic diagram showing a second control provided by an embodiment of the present disclosure. Fig.11 , including a terminal device. The interface displayed by the terminal device includes a preview area, video material, stickers, a pointer, a first toolbar and a second toolbar. The first toolbar includes a sticker control, a special effect control and a filter control. The second toolbar includes a copy control, a left extension control, a split control, a right extension control and a delete control.

[0118] See also Fig.11, when the pointer is located on the left side of the sticker's active period, the copy control, left delay control and delete control can be enabled, and the right delay control and split control can be disabled. When the pointer is located on the right side of the sticker's active period, the copy control, right delay control and delete control can be enabled, and the left delay control and split control can be disabled. Optionally, when the pointer is located on the first frame or the last frame of the sticker, the copy control and delete control can be enabled, and the split control, left delay control and right delay control can be disabled. This can improve the flexibility of control display.

[0119] The disclosed embodiment provides a method for determining a second control, where a terminal device can determine the temporal position of a pointer. When the temporal position of the pointer is within the effective time period of the material, the terminal device can determine that one or more second controls can be controls in the first set. When the temporal position of the pointer is outside the effective time period of the material, the terminal device can determine that one or more second controls are controls in the second set. In the above method, the terminal device can flexibly determine the second control displayed in the second toolbar based on the relationship between the temporal position of the pointer and the effective time period of the material, and can also flexibly adjust the state (enabled or disabled) of the second control, thereby improving the flexibility of the control display, improving the accuracy of the control display, and improving the user experience.

[0120] Based on any of the above embodiments, Fig.12 , the method for the terminal device to edit the material in the above multimedia processing method is explained.

[0121] Fig.12 A schematic diagram of a method for editing a material provided by an embodiment of the present disclosure. Fig.12 The method flow includes:

[0122] S1201. Determine the editing function of the selected second control.

[0123] In some embodiments, the terminal device may pre-set the correspondence between each second control and the editing function, so that after the user selects the second control, the terminal device can quickly and accurately determine the editing function of the selected second control based on the correspondence. For example, the correspondence between the second control and the editing function is: second control 1-editing function A, second control 2-editing function B, second control 3-editing function C. When the second control selected by the user is second control 1, the terminal device can determine that the editing function is editing function A, when the second control selected by the user is second control 2, the terminal device can determine that the editing function is editing function B, and when the second control selected by the user is second control 3, the terminal device can determine that the editing function is editing function C.

[0124] Optionally, the terminal device may also determine the editing function of the selected second control based on any feasible implementation method, which is not limited in the embodiments of the present disclosure.

[0125] S1202. Edit the material based on the editing function.

[0126] Among them, the terminal device can edit the material based on the following feasible implementation method: determine whether the editing function of the selected second control is executable, if so, edit the material based on the editing function, if not, display a prompt message.

[0127] Among them, the prompt information may include the reason why the editing function cannot be executed. For example, the prompt information may include prompt information such as the current position cannot be split, the current position cannot be deleted, the current position cannot be dragged, the current track cannot be dragged, and the current track cannot be copied. For example, when the length of the material dragged is insufficient (such as the pointer is far away from the effective period of the material), the left delay control or the right delay control may be grayed out. After the user clicks the left delay control or the right delay control, the terminal device may display a prompt message that "the current position cannot be dragged". For example, when text is converted to audio binding, the left delay control or the right delay control is grayed out. When the user clicks the left delay control or the right delay control, the terminal device may display a prompt message that "the current track cannot be dragged". For example, when the makeup and music copy functions cannot be used normally, the copy control may be grayed out. When the user clicks the copy control, the terminal device may display a prompt message that "the current track cannot be copied".

[0128] In some embodiments, the terminal device can determine that an editing function is executable based on the following feasible implementation methods: when the track and the material are divisible, and the timing position of the pointer is within the effective time period of the material, and is not within the effective time period of the first frame or the last frame of the material, it is determined that the editing function for splitting the material is executable; when the timing position is within the effective time period of the material, and is not within the effective time period of the first frame or the last frame of the material, it is determined that the editing function for deleting the material to the left or right of the timing position is executable; when the timing position is outside the effective time period of the material and the material is extendable, it is determined that the editing function for extending the material to the pointer is executable.

[0129] Exemplarily, when the track and the material are split, and the timing position of the pointer is within the effective time period of the material and is not within the effective time period of the first frame or the last frame of the material, it means that the terminal device can split the material at this timing position. Therefore, the terminal device can determine that the editing function for splitting the material is executable, that is, the second control for splitting the material is enabled.

[0130] Exemplarily, when the timing position is within the effective time period of the material and is not within the effective time period of the first frame or the last frame of the material, it means that the terminal device can delete the material on the left or right at this timing position. Therefore, the terminal device can determine that the editing function for deleting the material on the left or right side of the timing position is executable, that is, the control for deleting the material on the left side of the timing position or the control for deleting the material on the right side of the timing position is enabled.

[0131] Exemplarily, when the timing position is outside the effective time period of the material and the material can be extended, it means that the terminal device can extend the material to the timing position. Therefore, the terminal device can determine that the editing function for extending the material to the pointer is executable, that is, the control for extending the left side of the material or the control for extending the right side of the material is enabled.

[0132] In some embodiments, when the editing function is executable, the terminal device edits the material based on the editing function, specifically: when the editing function is used to delete the material on the left side of the timing position, the material on the left side of the timing position is deleted on the track; when the editing function is used to delete the material on the right side of the timing position, the material on the right side of the timing position is deleted on the track; when the editing function is used to extend the material to the timing position, the side of the material close to the timing position is extended to the timing position on the track. The efficiency of editing the material is improved.

[0133] In some embodiments, when the editing function is used to copy materials, the terminal device can copy the user-selected materials on the track.

[0134] In some embodiments, when the editing function is used to delete the complete material, the terminal device can delete the user-selected material on the track.

[0135] In some embodiments, the terminal device can implement click processing of the second control in the second toolbar based on the proxy and policy mode. For example, the proxy class can be used to perform unified judgment processing on the click of the second control to determine whether the editing function of the current second control can be executed. When the editing function cannot be executed, the proxy class can perform a pre-interception operation. When the proxy class determines that the editing function can be executed, the proxy class can operate on the track where the material selected by the user is located.

[0136] In some embodiments, when the tracks are different, the logic for determining whether the editing function is executable is also different. The terminal device can configure corresponding judgment logic for the video track, audio track, and special effect track respectively. When the track where the material selected by the user is located changes, the judgment logic can also be changed synchronously. For example, the judgment logic of the video track may include that the video material cannot be split when performing task processing, and the judgment logic of the audio track may include that the audio cannot be extended when it is bound to the text, etc., which is not limited in the embodiments of the present disclosure.

[0137] Next, combine Fig.13 , explaining the process of editing materials by terminal devices.

[0138] Fig.13 A schematic diagram of a process of editing a material provided by an embodiment of the present disclosure. Fig.13 , including a terminal device. The interface displayed by the terminal device includes a preview area, a pointer, a video material, a sticker, a first toolbar and a second toolbar. The first toolbar includes a sticker control, a special effect control and a filter control. The second toolbar includes a copy control, a left delete control, a split control, a right delete control and a delete control. The user selects a sticker, and the pointer is located within the effective period of the sticker.

[0139] See also Fig.13 When the user clicks the copy control, the terminal device can copy an identical sticker at the end of the sticker. When the user clicks the split control, the terminal device can split the sticker selected by the user into two stickers at the time sequence position of the pointer. When the user selects the second sticker and the pointer is within the effective period of the second sticker, the user clicks the delete control, and the terminal device can delete the second sticker.

[0140] See also Fig.13 , the user selects the first sticker, the pointer is outside the effective period of the first sticker, and the second toolbar includes a copy control, a left extension control, a split control, a right extension control, and a delete control. When the user clicks the right extension control, the terminal device can extend the right side of the first sticker to the timing position of the pointer. When the user selects the second sticker and clicks the left extension control, the terminal device can extend the left side of the second sticker to the timing position of the pointer.

[0141] See also Fig.13 , after the pointer moves, the temporal position of the pointer is within the effective period of the second sticker, and the second toolbar can redisplay the copy control, left delete control, split control, right delete control and delete control. When the user clicks the left delete control, the terminal device can delete the part to the left of the temporal position of the pointer in the second sticker. After the pointer moves, when the user clicks the right delete control, the terminal device can delete the part to the right of the temporal position of the pointer in the second sticker. In this way, the terminal device can edit the material quickly and accurately, improving the accuracy and efficiency of editing the material.

[0142] The disclosed embodiment provides a method for editing a material. The terminal device can determine the editing function of the selected second control and determine whether the editing function is executable. If so, when the editing function is used to delete the material on the left side of the timing position, the material on the left side of the timing position is deleted on the track. When the editing function is used to delete the material on the right side of the timing position, the material on the right side of the timing position is deleted on the track. When the editing function is used to extend the material to the timing position, the side of the material close to the timing position on the track is extended to the timing position. If not, a prompt message is displayed. In this way, the terminal device can edit the material quickly and accurately, and the reliability of editing can be improved.

[0143] Fig.14 This is a schematic diagram of the structure of a multimedia processing device provided by an embodiment of the present disclosure. Fig.14 The multimedia processing device 1400 includes a display module 1401 and an editing module 1402, wherein:

[0144] The display module 1401 is used to display a first toolbar on the interface, where the first toolbar includes one or more first controls, and the one or more first controls are used to edit multimedia;

[0145] The display module 1401 is also used for, in response to the selection of the material filled in the track of the multimedia, displaying a second toolbar on the interface, wherein the second toolbar includes one or more second controls associated with the editing of the material;

[0146] The editing module 1402 is used for editing the material in response to selection of a second control among the one or more second controls.

[0147] According to one or more embodiments of the present disclosure, the display module 1401 is further used for:

[0148] In response to deselection of the material, the second toolbar is undisplayed.

[0149] According to one or more embodiments of the present disclosure, the one or more second controls are displayed in a window of the interface.

[0150] According to one or more embodiments of the present disclosure, the background color of the window is different from the background color of the interface.

[0151] According to one or more embodiments of the present disclosure, the interface includes a track, the material is filled on the track, and the track includes a pointer;

[0152] When the temporal position of the pointer is within the effective time period of the material, the one or more second controls are controls in the first set;

[0153] When the temporal position of the pointer is outside the effective time period of the material, the one or more second controls are controls in the second set.

[0154] According to one or more embodiments of the present disclosure, the first set includes one or more of the following: a control for copying the material, a control for splitting the material, and a control for deleting the material.

[0155] According to one or more embodiments of the present disclosure, the control for deleting the material includes one or more of the following: a control for deleting the material on the left side of the timing position, a control for deleting the material on the right side of the timing position, and a control for deleting the complete material.

[0156] According to one or more embodiments of the present disclosure, when the temporal position of the pointer is not in the effective time period of the first frame and the last frame of the material, the control for copying the material, the control for splitting the material, and the control for deleting the material are enabled;

[0157] When the timing position of the pointer is in the effective time period of the first frame and the last frame of the material, the controls for copying the material and deleting the complete material are enabled, and the controls for splitting the material, deleting the material on the left side of the timing position, and deleting the material on the right side of the timing position are disabled.

[0158] According to one or more embodiments of the present disclosure, the second set includes one or more of the following: a control for copying the material, a control for deleting the complete material, and a control for extending the material to the timing position.

[0159] According to one or more embodiments of the present disclosure, the control for extending the material to the temporal position includes one or more of the following: a control for extending the left side of the material, and a control for extending the right side of the material.

[0160] According to one or more embodiments of the present disclosure, when the temporal position of the pointer is on the left side of the material, the control for copying the material, the control for deleting the complete material, and the control for extending the left side of the material are enabled, and the control for extending the right side of the material is disabled;

[0161] When the temporal position of the pointer is on the right side of the material, the control for copying the material, the control for deleting the complete material, and the control for extending the right side of the material are enabled, and the control for extending the left side of the material is disabled.

[0162] According to one or more embodiments of the present disclosure, the editing module 1402 is specifically used for:

[0163] Determine whether the editing function of the selected second control is executable;

[0164] If yes, then based on the editing function, the material is edited;

[0165] If not, a prompt message is displayed, wherein the prompt message includes the reason why the editing function cannot be executed.

[0166] According to one or more embodiments of the present disclosure, the editing module 1402 is specifically used for:

[0167] When the editing function is used to delete the material on the left side of the timing position, the material on the left side of the timing position is deleted on the track;

[0168] When the editing function is used to delete the material on the right side of the timing position, the material on the right side of the timing position is deleted on the track;

[0169] When the editing function is used to extend the material to the timing position, the side of the material close to the timing position on the track is extended to the timing position.

[0170] According to one or more embodiments of the present disclosure, the editing module 1402 is specifically used for:

[0171] When the track and the material are divisible, and the time sequence position of the pointer is within the effective time period of the material, and is not within the effective time period of the first frame or the last frame of the material, determining that the editing function for dividing the material is executable;

[0172] When the time sequence position is within the effective time period of the material and is not within the effective time period of the first frame or the last frame of the material, determining that an editing function for deleting the material on the left or right side of the time sequence position is executable;

[0173] When the timing position is outside the effective time period of the material and the material can be extended, it is determined that an editing function for extending the material toward the pointer is executable.

[0174] According to one or more embodiments of the present disclosure, the material includes one or more of the following: video, image, audio, sticker, filter, special effect, and text.

[0175] The multimedia processing device provided in the embodiment of the present disclosure may be used to execute the technical solution of the above method embodiment, and its implementation principle and technical effect are similar, which will not be described in detail in this embodiment.

[0176] Fig.15 This is a schematic diagram of the structure of a terminal device provided by an embodiment of the present disclosure. Fig.15, which shows a schematic diagram of the structure of a terminal device 1500 suitable for implementing the embodiments of the present disclosure. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers, portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.15 The terminal device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0177] like Fig.15 As shown, the terminal device 1500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1502 or a program loaded from a storage device 1508 to a random access memory (RAM) 1503. Various programs and data required for the operation of the terminal device 1500 are also stored in the RAM 1503. The processing device 1501, the ROM 1502, and the RAM 1503 are connected to each other via a bus 1504. An input / output (I / O) interface 1505 is also connected to the bus 1504.

[0178] Typically, the following devices may be connected to the I / O interface 1505: input devices 1506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 1507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1508 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1509. The communication devices 1509 may allow the terminal device 1500 to communicate with other devices wirelessly or by wire to exchange data. Although Fig.15 The terminal device 1500 is shown as having various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0179] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 1509, or installed from a storage device 1508, or installed from a ROM 1502. When the computer program is executed by the processing device 1501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0180] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0181] The computer-readable medium may be included in the terminal device, or may exist independently without being installed in the terminal device.

[0182] The computer-readable medium carries one or more programs. When the one or more programs are executed by the terminal device, the terminal device executes the method shown in the above embodiment.

[0183] An embodiment of the present disclosure provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, various methods that may be involved in the above embodiments are implemented.

[0184] An embodiment of the present disclosure provides a computer program product, including a computer program, which implements various methods that may be involved in the above embodiments when executed by a processor.

[0185] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0186] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0187] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0188] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0189] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0190] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0191] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0192] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of the relevant laws and regulations. The data may include information, parameters and messages, such as flow switching indication information.

[0193] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0194] In addition, although each operation is depicted in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although several specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Certain features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination. Although the subject matter has been described in a language specific to structural features and / or method logic actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A multimedia processing method, characterized in that: include: Displaying a first toolbar on the interface, wherein the first toolbar includes one or more first controls, and the one or more first controls are used for editing multimedia; In response to selection of the material filled in the track of the multimedia, a second toolbar is further displayed on the interface, wherein the second toolbar includes one or more second controls associated with editing of the material; In response to selection of a second control of the one or more second controls, the material is edited.

2. The method according to claim 1, characterized in that The method further comprises: In response to deselection of the material, the second toolbar is undisplayed.

3. The method according to claim 1 or 2, characterized in that: The one or more second controls are displayed in a window of the interface.

4. The method according to claim 3, characterized in that The background color of the window is different from the background color of the interface.

5. The method according to any one of claims 1 to 4, characterized in that The interface includes a track, the material is filled on the track, and the track includes a pointer; When the temporal position of the pointer is within the effective time period of the material, the one or more second controls are controls in the first set; When the temporal position of the pointer is outside the effective time period of the material, the one or more second controls are controls in the second set.

6. The method according to claim 5, characterized in that The first set includes one or more of the following: a control for copying the material, a control for splitting the material, and a control for deleting the material.

7. The method according to claim 6, characterized in that The control for deleting the material includes one or more of the following: a control for deleting the material on the left side of the timing position, a control for deleting the material on the right side of the timing position, and a control for deleting the complete material.

8. The method according to claim 6 or 7, characterized in that: When the time sequence position of the pointer is not in the effective time period of the first frame and the last frame of the material, the control for copying the material, the control for splitting the material, and the control for deleting the material are enabled; When the timing position of the pointer is in the effective time period of the first frame and the last frame of the material, the controls for copying the material and deleting the complete material are enabled, and the controls for splitting the material, deleting the material on the left side of the timing position, and deleting the material on the right side of the timing position are disabled.

9. The method according to claim 5, characterized in that The second set includes one or more of the following: a control for duplicating the material, a control for deleting the complete material, a control for extending the material to the temporal position.

10. The method according to claim 9, characterized in that The control for extending the material to the timing position includes one or more of the following: a control for extending the left side of the material, and a control for extending the right side of the material.

11. The method according to claim 9 or 10, characterized in that: When the time sequence position of the pointer is on the left side of the material, the control for copying the material, the control for deleting the complete material, and the control for extending the left side of the material are enabled, and the control for extending the right side of the material is disabled; When the temporal position of the pointer is on the right side of the material, the control for copying the material, the control for deleting the complete material, and the control for extending the right side of the material are enabled, and the control for extending the left side of the material is disabled.

12. The method according to any one of claims 1 to 4, characterized in that: The editing of the material comprises: Determine whether the editing function of the selected second control is executable; If yes, then based on the editing function, the material is edited; If not, a prompt message is displayed, wherein the prompt message includes the reason why the editing function cannot be executed.

13. The method according to claim 12, characterized in that The editing of the material based on the editing function includes: When the editing function is used to delete the material on the left side of the timing position, the material on the left side of the timing position is deleted on the track; When the editing function is used to delete the material on the right side of the timing position, the material on the right side of the timing position is deleted on the track; When the editing function is used to extend the material to the timing position, the side of the material close to the timing position on the track is extended to the timing position.

14. The method according to claim 12, characterized in that Determining that the editing function is executable includes: When the track and the material are divisible, and the time sequence position of the pointer is within the effective time period of the material, and is not within the effective time period of the first frame or the last frame of the material, determining that the editing function for dividing the material is executable; When the time sequence position is within the effective time period of the material and is not within the effective time period of the first frame or the last frame of the material, determining that an editing function for deleting the material on the left or right side of the time sequence position is executable; When the timing position is outside the effective time period of the material and the material can be extended, it is determined that an editing function for extending the material toward the pointer is executable.

15. The method according to any one of claims 1 to 4, characterized in that: The material includes one or more of the following: video, image, audio, sticker, filter, special effect, and text.

16. A multimedia processing device, characterized in that: It includes display module and editing module, among which: The display module is used to display a first toolbar on the interface, wherein the first toolbar includes one or more first controls, and the one or more first controls are used to edit multimedia; The display module is further configured to, in response to selection of a material filled in the track of the multimedia, display a second toolbar on the interface, wherein the second toolbar includes one or more second controls associated with editing of the material; The editing module is used for editing the material in response to selection of a second control among the one or more second controls.

17. A terminal device, characterized in that: include: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor executes the multimedia processing method according to any one of claims 1 to 15.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When the processor executes the computer-executable instructions, the multimedia processing method according to any one of claims 1 to 15 is implemented.

19. A computer program product, characterized in that It comprises a computer program, which, when executed by a processor, implements the multimedia processing method according to any one of claims 1 to 15.

Images