Multimedia processing method and apparatus, and terminal device

Abstract

Embodiments of the present disclosure provide a multimedia processing method and apparatus, and a terminal device. The method comprises: displaying a first toolbar on an interface, the first toolbar comprising one or more first controls, and the one or more first controls being used for editing multimedia; in response to selection of an asset placed in a track of the multimedia, further displaying a second toolbar on the interface, the second toolbar comprising one or more second controls associated with editing of the asset; and in response to selection of one second control from among the one or more second controls, editing the asset.

Description

Multimedia processing methods, devices and terminal equipment

[0001] Cross-reference to related applications

[0002] This application claims priority to Chinese Patent Application No. 202411922403.1, filed on December 24, 2024, entitled "Multimedia Processing Method, Apparatus and Terminal Equipment", the entire disclosure of which is incorporated herein by reference. Technical Field

[0003] This disclosure relates to the field of multimedia technology, and in particular to a multimedia processing method, apparatus, and terminal device. Background Technology

[0004] Users can edit videos in the video editing interface. For example, users can add filters, stickers, and text to the video.

[0005] Currently, the video editing page includes a toolbar for adding footage to the video. However, adjusting added footage requires manual manipulation. For example, to extend video footage to the left, the user needs to drag the left side of the footage to the extended position. This method is complex and inefficient. Summary of the Invention

[0006] This disclosure provides a multimedia processing method, apparatus, and terminal device to solve technical problems in related technologies.

[0007] In a first aspect, embodiments of this disclosure provide a multimedia processing method, the multimedia processing method comprising:

[0008] A first toolbar is displayed on the interface, the first toolbar including one or more first controls, the one or more first controls being used for editing multimedia;

[0009] In response to the selection of material to fill the track of the multimedia, a second toolbar is also displayed on the interface, the second toolbar including one or more second controls associated with editing the material;

[0010] The material is edited in response to the selection of one of the one or more second controls.

[0011] Secondly, embodiments of this disclosure provide a multimedia processing apparatus, which includes a display module and an editing module, wherein:

[0012] The display module is used to display a first toolbar on the interface, the first toolbar including one or more first controls, the one or more first controls being used for editing multimedia;

[0013] The display module is also configured to, in response to the selection of material to fill the track of the multimedia, display a second toolbar on the interface, the second toolbar including one or more second controls associated with editing the material;

[0014] The editing module is used to edit the material in response to the selection of one of the one or more second controls.

[0015] Thirdly, this disclosure provides a terminal device including: a processor and a memory;

[0016] The memory stores computer-executed instructions;

[0017] The processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the multimedia processing methods described in the first aspect above and various possible aspects of the first aspect.

[0018] Fourthly, this disclosure provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the multimedia processing methods described in the first aspect and various possible aspects of the first aspect.

[0019] Fifthly, this disclosure provides a computer program product, including a computer program that, when executed by a processor, implements the multimedia processing methods described in the first aspect above and various possible aspects of the first aspect.

[0020] In a sixth aspect, this disclosure provides a computer program that, when executed by a processor, implements the multimedia processing methods described in the first aspect above and various possible aspects of the first aspect. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in the embodiments or related technologies of this disclosure, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 is a schematic diagram of an application scenario provided by an embodiment of this disclosure;

[0023] Figure 2 is a flowchart illustrating a multimedia processing method provided in an embodiment of this disclosure;

[0024] Figure 3 is a schematic diagram of a first toolbar provided in an embodiment of this disclosure;

[0025] Figure 4 is a schematic diagram of a process for displaying a second toolbar according to an embodiment of this disclosure;

[0026] Figure 5 is a schematic diagram of a process for canceling the display of the second toolbar according to an embodiment of this disclosure;

[0027] Figure 6 is a schematic diagram of a process for editing materials according to an embodiment of this disclosure;

[0028] Figure 7 is a schematic diagram of a method for determining a second control provided in an embodiment of this disclosure;

[0029] Figure 8 is a schematic diagram of a second toolbar provided in an embodiment of this disclosure;

[0030] Figure 9 is a schematic diagram of a second control provided in an embodiment of this disclosure;

[0031] Figure 10 is a schematic diagram of a second toolbar provided in an embodiment of this disclosure;

[0032] Figure 11 is a schematic diagram of a display of a second control provided in an embodiment of this disclosure;

[0033] Figure 12 is a schematic diagram of a method for editing materials provided in an embodiment of this disclosure;

[0034] Figure 13 is a schematic diagram of a process for editing materials according to an embodiment of this disclosure;

[0035] Figure 14 is a schematic diagram of the structure of a multimedia processing device provided in an embodiment of this disclosure;

[0036] Figure 15 is a schematic diagram of the structure of a terminal device provided in an embodiment of this disclosure. Detailed Implementation

[0037] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0038] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0039] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the terminal device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0040] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the terminal device.

[0041] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0042] For ease of understanding, the concepts involved in the embodiments of this disclosure will be explained below.

[0043] Terminal equipment: A device with wireless transceiver capabilities. Terminal equipment can be deployed on land, including indoors or outdoors, handheld, wearable, or vehicle-mounted. The terminal equipment can be a mobile phone, tablet computer, computer with wireless transceiver capabilities, virtual reality (VR) terminal equipment, augmented reality (AR) terminal equipment, wireless terminals in industrial control, vehicle-mounted terminal equipment, wireless terminals in self-driving vehicles, wireless terminal equipment in remote medical care, wireless terminal equipment in smart grids, wireless terminal equipment in transportation safety, wireless terminal equipment in smart cities, wireless terminal equipment in smart homes, wearable terminal equipment, etc. The terminal equipment involved in the embodiments of this disclosure can also be referred to as a terminal, user equipment (UE), access terminal equipment, vehicle-mounted terminal, industrial control terminal, UE unit, UE station, mobile station, mobile station, remote station, remote terminal equipment, mobile device, UE terminal equipment, wireless communication equipment, UE agent, or UE device, etc. Terminal devices can be fixed or mobile.

[0044] This disclosure provides a multimedia processing method, apparatus, and terminal device. The terminal device can display a first toolbar on an interface, wherein the first toolbar may include one or more first controls for editing multimedia. In response to the selection of materials filling the multimedia track, a second toolbar is also displayed on the interface, wherein the second toolbar may include one or more second controls associated with material editing. In response to the selection of one of the one or more second controls, material editing is performed. In the above method, the interface can display not only the first toolbar but also the second toolbar. Since the second controls in the second toolbar can be used to edit materials, users can quickly and accurately edit materials based on the second controls in the second toolbar, improving the accuracy and efficiency of material editing.

[0045] The application scenarios of the embodiments of this disclosure will now be described with reference to Figure 1.

[0046] Figure 1 is a schematic diagram of an application scenario provided by an embodiment of this disclosure. Referring to Figure 1, a terminal device is included. The interface displayed on the terminal device can be a video editing interface. This video editing interface can include a preview area, video footage, stickers, and a timeline. When the user clicks on a sticker, the sticker is highlighted. After clicking the sticker, the user can drag its left side to the left, increasing the sticker's proportion on the timeline (the sticker's duration is longer than before dragging). When the user stops operating on the sticker, the sticker is dehighlighted. The sticker's proportion on the timeline remains increased. In this way, the user can manually edit the sticker.

[0047] It should be noted that Figure 1 is merely an example of an embodiment of this disclosure and is not intended to limit the scope of this disclosure.

[0048] In related technologies, users can edit videos through a video editing interface. For example, as shown in the embodiment of Figure 1, users can add stickers to video footage in the video editing interface, and also add filters, effects, and text. Currently, the video editing page can include a toolbar for adding footage to the video. For example, in the embodiment shown in Figure 1, when a user clicks on a video clip, a toolbar can be displayed at the bottom of the video editing interface. This toolbar can include controls for adding filters, stickers, and effects, etc. Users can click on the controls in the toolbar to add corresponding footage to the video clip. After adding new footage to the video clip, users need to manually manipulate the footage when editing it. For example, as shown in the embodiment of Figure 1, users can increase the duration of a sticker by manually dragging its left side. However, in the above methods, there are many types of footage editing (e.g., splitting, dragging, and deleting), and the complexity of manually editing footage is high, resulting in low efficiency in editing footage.

[0049] To address the technical problems in related technologies, this disclosure provides a multimedia processing method. A terminal device can display a first toolbar on its interface, where first controls can be used to edit multimedia. In response to the selection of materials filling the multimedia track, a second toolbar is also displayed on the interface. This second toolbar may include one or more second controls associated with material editing, and these controls are displayed in a window of the interface. In response to the selection of one of the one or more second controls, material editing is performed. In response to deselecting material, the terminal device can dedisplay the second toolbar. In this method, the interface can display not only the first toolbar but also the second toolbar. Since the second controls in the second toolbar can be used to edit material, users can quickly and accurately edit material based on these controls, improving the accuracy and efficiency of material editing. Furthermore, the terminal device can dedisplay the second toolbar when the user deselects material, increasing the flexibility of the interface display.

[0050] The technical solutions of this disclosure and how they solve the aforementioned technical problems will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of this disclosure will now be described with reference to the accompanying drawings.

[0051] Figure 2 is a flowchart illustrating a multimedia processing method provided in an embodiment of this disclosure. Referring to Figure 2, the method may include:

[0052] S201. Display the first toolbar on the interface.

[0053] The execution entity of this disclosure can be a terminal device or a multimedia processing device installed in the terminal device. The multimedia processing device can be implemented in software, or it can be implemented using a combination of software and hardware; this disclosure does not limit this approach.

[0054] The interface can be used for video editing. For example, the interface can be a video editing interface. For instance, the terminal device can display a video editing interface where users can create templates. These templates can include pre-designed animation effects, text styles, color schemes, transition effects, music, and other materials.

[0055] In some embodiments, the first toolbar may include one or more first controls. For example, the terminal device may display the first toolbar at the bottom of the interface, which may include one or more first controls; this disclosure does not limit this.

[0056] One or more first controls can be used to edit multimedia. For example, the first controls can be used to add stickers, filters, effects, etc., to multimedia, and can also be used to split, crop, and delete multimedia. For example, multimedia can be video, audio, or images, and can also be a combination of one or more of video, audio, and images. For example, multimedia can be a video combining video and audio, a video combining video and images, a video combining images and audio, or a video combining video, images, and audio.

[0057] In some embodiments, the terminal device may display a first toolbar in response to a selection of multimedia. For example, the first toolbar is not displayed at the bottom of the interface when the user does not click on a video clip in the interface, but it may be displayed at the bottom of the interface when the user clicks on a video clip.

[0058] The first toolbar will now be explained in detail with reference to Figure 3.

[0059] Figure 3 is a schematic diagram of a first toolbar provided in an embodiment of this disclosure. Referring to Figure 3, a terminal device is included. The interface displayed on the terminal device can be a video editing interface. This video editing interface may include a preview area and video footage, which is filled into the video track. When the user clicks on the video footage, the terminal device can display a first toolbar at the bottom of the video editing interface. The first controls in this first toolbar include sticker controls, special effects controls, and filter controls. When the user clicks on the sticker control, the terminal device can fill the sticker track (which is on the same timeline as the video track) with sticker footage; that is, the terminal device can add stickers to the video footage.

[0060] In some embodiments, the first toolbar can be displayed at any position on the interface, and this disclosure does not limit this.

[0061] In some embodiments, the background color of the first toolbar may be the same as the background color of the interface, or the background color of the first toolbar may be different from the background color of the interface. This disclosure does not limit this aspect.

[0062] In some embodiments, in response to the deselection of multimedia, the terminal device can de-display the first toolbar. For example, as shown in the embodiment of FIG3, when the user deselects video material (e.g., the user clicks again on an area without video material or video track), the first toolbar can be de-displayed at the bottom of the interface.

[0063] S202. In response to the selection of materials to fill the multimedia track, a second toolbar is also displayed on the interface.

[0064] The materials can be objects to be edited within the editing scene. These materials can include one or more of the following: videos, images, audio, stickers, filters, effects, and text.

[0065] In some embodiments, in a video editing scenario, the material can be video, or it can be video (picture-in-picture), audio, stickers, filters, effects, images, and text applied to a video application.

[0066] In some embodiments, in an image editing scenario, the material can be an image, or it can be video, audio, effects, stickers, filters, and text that will be applied to the image.

[0067] In some embodiments, in an audio editing scenario, the source material can be audio.

[0068] For example, the materials selected by the user may include audio, materials in the main track, picture-in-picture, doodle pen, text, stickers, filters, global effects, video effects, makeup, face shaping, adjustments, 3D accessories, and materials determined by artificial intelligence (such as digital human effects).

[0069] The multimedia tracks can be used to fill content. For example, video tracks can be filled with video content, audio tracks with audio content, image tracks with image content, text tracks with text content, and sticker tracks with stickers, etc.

[0070] In some embodiments, the track may include slots for filling material. The terminal device can fill the slots with material, and as the material grows (the duration of the material increases), the slots corresponding to the material can also grow synchronously. It should be noted that the slots for filling material can be hidden, which can improve the simplicity of the interface.

[0071] The second toolbar includes one or more second controls associated with editing the material. For example, when a user clicks on a material, the terminal device can display the second toolbar on the interface. This second toolbar may include one or more second controls, which the user can click to edit the material.

[0072] In some embodiments, the second control can be used to edit the footage. For example, one or more second controls can be used to copy, split, delete, or extend footage, allowing users to quickly and accurately edit the footage based on the second control, thus improving the efficiency and accuracy of editing.

[0073] In some embodiments, one or more second controls are displayed in a window of the interface. This improves the flexibility of the interface layout and enhances the display effect. For example, the window can be displayed along with the second toolbar; the window can be displayed synchronously when the second toolbar is displayed and can disappear synchronously when the second toolbar disappears. For example, the terminal device can add a custom component to display the second toolbar.

[0074] In some embodiments, the background color of the window can be different from the background color of the interface. For example, the background color of the interface can be black, and the background color of the window can be gray. This can improve the display effect of one or more second controls in the interface, making it easier for users to quickly find the second controls in the interface and improving the user experience.

[0075] In some embodiments, the background color of the window may be the same as the background color of the interface, and this disclosure does not limit this.

[0076] In some embodiments, the terminal device can deselect a media item in response to deselection, thus deselecting the second toolbar. For example, after a user selects a media item, if the user clicks on the media item or an area outside the media track, the user can deselect the media item, and the terminal device can also deselect the second toolbar.

[0077] The process of displaying the second toolbar on the interface in response to the selection of materials to fill the multimedia track will be explained below with reference to Figure 4.

[0078] Figure 4 is a schematic diagram illustrating the process of displaying a second toolbar according to an embodiment of this disclosure. Referring to Figure 4, the device includes a terminal device. The interface displayed on the terminal device is a video editing interface. This video editing interface includes a preview area, video footage, stickers, and a first toolbar. The first toolbar includes sticker controls, special effects controls, and filter controls. When the user clicks a sticker, the terminal device can highlight the sticker and display a second toolbar above the first toolbar. The background color of the second toolbar is different from the background color of the interface. The second controls in the second toolbar include a split control and a delete control.

[0079] The following, with reference to Figure 5, explains the process by which the terminal device cancels the display of the second toolbar in response to the deselection of the material.

[0080] Figure 5 is a schematic diagram illustrating a process for canceling the display of the second toolbar according to an embodiment of this disclosure. Referring to Figure 5, a terminal device is included. The interface displayed on the terminal device is a video editing interface. This video editing interface includes a preview area, video footage, stickers, a first toolbar, and a second toolbar. The first controls displayed in the first toolbar include sticker controls, special effects controls, and filter controls. The second controls displayed in the second toolbar include split controls and delete controls. Stickers are highlighted (when the user clicks on a sticker). After the user clicks on a blank area of ​​the video editing interface, the terminal device can determine that the user has deselected a sticker, and the terminal device can cancel the display of the second toolbar in the video editing interface.

[0081] S203. In response to the selection of one of the one or more second controls, edit the material.

[0082] The terminal device can edit the materials using the following feasible implementation method: determine the editing function of the selected second control, and edit the materials based on the editing function. In this way, the terminal device can accurately edit the materials selected by the user based on the second control selected by the user, thereby improving the accuracy of material editing.

[0083] For example, when the second control clicked by the user is used to copy material, the terminal device can copy the material selected by the user; when the second control clicked by the user is used to split material, the terminal device can split the material selected by the user; when the second control clicked by the user is used to delete material, the terminal device can delete the material selected by the user; and when the second control clicked by the user is used to extend material, the terminal device can extend the material selected by the user.

[0084] The following, with reference to Figure 6, describes the process by which a terminal device edits materials in response to the selection of one of the one or more second controls.

[0085] Figure 6 is a schematic diagram of a process for editing materials according to an embodiment of this disclosure. In the embodiment shown in Figure 6, the second control is used to delete the material to the left of the pointer. Referring to Figure 6, the device includes a terminal device. The interface displayed on the terminal device is a video editing interface. This video editing interface includes a preview area, video materials, stickers, a first toolbar, a second toolbar, and a pointer. The first controls displayed on the first toolbar include sticker controls, effects controls, and filter controls. Stickers are highlighted. The second controls displayed on the second toolbar include a split control and a delete control. When the user clicks the delete control, the terminal device can delete the sticker selected by the user on the track. In this way, the user can quickly and accurately edit the materials based on the second controls in the second toolbar, improving the accuracy and efficiency of material editing.

[0086] This disclosure provides a multimedia processing method. A terminal device can display a first toolbar on its interface. In response to the selection of materials filling a multimedia track, the terminal device can display a second toolbar on its interface. In response to the selection of one of one or more second controls displayed on the second toolbar, the editing function of the selected second control is determined, and the materials are edited based on the editing function. In this method, since the second controls in the second toolbar can be used to edit materials, users can quickly and accurately edit materials based on the second controls in the second toolbar, improving the accuracy and efficiency of material editing. Furthermore, when the user deselects materials, the terminal device can de-display the second toolbar, improving the flexibility of the interface display.

[0087] Based on the embodiment shown in Figure 2, in the above multimedia processing method, the terminal device can also determine one or more second controls in the second toolbar. The method for determining one or more second controls in the second toolbar will be described in detail below with reference to Figure 7.

[0088] Figure 7 is a schematic diagram of a method for determining a second control according to an embodiment of this disclosure. Referring to Figure 7, the method flow includes:

[0089] S701. Determine the timing position of the pointer.

[0090] The interface can include a track, on which materials can be placed, and on which pointers can be placed. For example, as shown in the embodiment in Figure 6, video materials can be placed on the video track, stickers can be placed on the sticker track, and the interface can also hide the track to avoid interference with video editing, thereby improving the simplicity of the interface and enhancing the user experience.

[0091] In some embodiments, the pointer can be a marker that moves along the timeline, and the pointer's temporal position can be its location on the timeline. For example, the pointer can be a white vertical line, and its temporal position on the timeline can indicate the current editing position. Users can preview and edit different parts of the video by moving the pointer.

[0092] In some embodiments, the pointer can help users pinpoint specific frames within a clip, allowing for precise editing. For example, users can move the pointer to determine the exact location where clips need to be split, deleted, or extended.

[0093] In some embodiments, when a user previews the edited result, the pointer can move continuously to the right, indicating the current preview position of the edited result.

[0094] In some embodiments, the timing position of the pointer can be the position of the editing operation. For example, when a user splits a clip, the split position of the clip can be the timing position of the pointer; when a user extends a clip, the clip can be extended to the timing position of the pointer.

[0095] In some embodiments, the terminal device can monitor the timing position of the pointer slide in real time. The terminal device can also determine the timing position of the pointer based on any feasible implementation method. This disclosure does not limit this.

[0096] S702. Determine the second control based on the pointer's timing position and the material's effective time period.

[0097] The effective time period of a clip can indicate its playback position. For example, if the effective time period of a clip is from the 5th to the 10th second, the clip can be played during the preview of the edited result on the terminal device. Similarly, if the effective time period of a sticker is from the 5th to the 15th second, and the edited video is 30 seconds long, the sticker can be included during the 5th to 15th seconds of the video's playback on the terminal device; the sticker will not be included during other playback periods of the video.

[0098] In some embodiments, the pointer's state can indicate the relationship between the pointer's timing position and the time period of the footage. For example, the terminal device can monitor the pointer's timing position in real time and determine the pointer's state by comparing it with the time period of the footage. The pointer's state can be left, right, center, beginning, and end. When the pointer is left, it is located on the left side of the footage; when it is right, it is located on the right side; when it is center, it is located in the middle of the footage; when it is beginning, it is located in the first frame of the footage; and when it is end, it is located in the last frame of the footage.

[0099] In this case, the terminal device determines the second control based on the timing position of the pointer and the short duration of the material's effect, and there are two possible scenarios:

[0100] Case 1: The timing position of the pointer is within the time period of the material's effect.

[0101] When the pointer's timing position is within the effective time period of the material, one or more second controls can be controls from the first set.

[0102] In some embodiments, the first set may include one or more of the following: a control for copying materials, a control for splitting materials, and a control for deleting materials.

[0103] In some embodiments, the control for deleting media includes one or more of the following: a control for deleting media to the left of a time sequence position, a control for deleting media to the right of a time sequence position, and a control for deleting all media. For example, when a user clicks the control for deleting media to the left of a time sequence position, the terminal device can delete the media to the left of the time sequence position; when a user clicks the control for deleting media to the right of a time sequence position, the terminal device can delete the media control to the right of the time sequence position.

[0104] The second toolbar will now be described with reference to Figure 8, when the second control is a control from the first set.

[0105] Figure 8 is a schematic diagram of a second toolbar provided in an embodiment of this disclosure. Referring to Figure 8, it includes a second toolbar. The second toolbar displays second controls including a copy control (for copying footage), a left delete control (for deleting footage to the left of the time sequence position), a split control (for splitting footage), a right delete control (for deleting footage to the right of the time sequence position), and a delete control (for deleting complete footage).

[0106] In some embodiments, when the timing position of the pointer changes, some controls in the first set can be enabled, while others can be disabled. For example, when a second control in the second toolbar is enabled, the second control is usable; when the second control is disabled, the second control is unusable; and when the second control is disabled, it can be grayed out.

[0107] In some embodiments, when the pointer's timing position is not within the time period of the first and last frames of the footage, the controls for copying the footage, splitting the footage, and deleting the footage are enabled; when the pointer's timing position is within the time period of the first and last frames of the footage, the controls for copying the footage and deleting the complete footage are enabled, while the controls for splitting the footage, deleting the footage to the left of the timing position, and deleting the footage to the right of the timing position are disabled.

[0108] The second control displayed on the terminal device will now be explained with reference to Figure 9.

[0109] Figure 9 is a schematic diagram of a second control display provided by an embodiment of this disclosure. Referring to Figure 9, the device includes a terminal device. The interface displayed on the terminal device includes a preview area, video footage, stickers, a pointer, a first toolbar, and a second toolbar. The first toolbar includes sticker controls, special effects controls, and filter controls. The second toolbar includes copy controls, left delete controls, split controls, right delete controls, and delete controls.

[0110] Please refer to Figure 9. When the pointer is within the sticker's active time frame, the copy, left delete, split, right delete, and delete controls are enabled. When the pointer is at the first frame of the sticker, the copy and delete controls are enabled, while the left delete, split, and right delete controls are disabled. When the pointer is at the last frame of the sticker, the copy and delete controls are enabled, while the left delete, split, and right delete controls are disabled.

[0111] Case 2: The timing position of the pointer is outside the time period of the material.

[0112] When the pointer's timing position is outside the effective time period of the material, one or more second controls are controls in the second set.

[0113] In some embodiments, the second set may include one or more of the following: a control for copying material, a control for deleting complete material, and a control for extending material to a timing position.

[0114] In some embodiments, the controls for extending the clip to a timing position include one or more of the following: controls for extending the left side of the clip and controls for extending the right side of the clip. For example, when a user clicks the control for extending the left side of the clip, the terminal device can extend the left side of the clip to the timing position; when a user clicks the control for extending the right side of the clip, the terminal device can extend the right side of the clip to the timing position.

[0115] The second toolbar will now be described with reference to Figure 10, when the second control is a control in the second set.

[0116] Figure 10 is a schematic diagram of a second toolbar provided in an embodiment of this disclosure. Referring to Figure 10, the toolbar includes a second toolbar. The second controls displayed on the toolbar include a copy control, a left extension control (for extending the left side of the source material), a split control, a right extension control (for extending the right side of the source material), and a delete control.

[0117] In some embodiments, when the timing position of the pointer changes, some controls in the second set can be enabled and others can be disabled.

[0118] In some embodiments, when the pointer's timing position is on the left side of the material, the controls for copying the material, deleting the complete material, and extending the left side of the material are enabled, while the control for extending the right side of the material is disabled; when the pointer's timing position is on the right side of the material, the controls for copying the material, deleting the complete material, and extending the right side of the material are enabled, while the control for extending the left side of the material is disabled.

[0119] The second control displayed on the terminal device will now be explained with reference to Figure 11.

[0120] Figure 11 is a schematic diagram of a second control display provided by an embodiment of this disclosure. Referring to Figure 11, a terminal device is included. The interface displayed on the terminal device includes a preview area, video footage, stickers, a pointer, a first toolbar, and a second toolbar. The first toolbar includes sticker controls, special effects controls, and filter controls. The second toolbar includes copy controls, left-extend controls, split controls, right-extend controls, and delete controls.

[0121] Please refer to Figure 11. When the pointer is to the left of the sticker's effective period, the copy, left extension, and delete controls can be enabled, while the right extension and split controls can be disabled. When the pointer is to the right of the sticker's effective period, the copy, right extension, and delete controls can be enabled, while the left extension and split controls can be disabled. Optionally, when the pointer is to the first or last frame of the sticker, the copy and delete controls can be enabled, while the split, left extension, and right extension controls can be disabled. This improves the flexibility of control display.

[0122] This disclosure provides a method for determining a second control. The terminal device can determine the timing position of a pointer. When the pointer's timing position is within the effective time period of the content, the terminal device can determine that one or more second controls are controls from a first set. When the pointer's timing position is outside the effective time period of the content, the terminal device can determine that one or more second controls are controls from a second set. In this method, the terminal device can flexibly determine the second controls displayed in the second toolbar based on the relationship between the pointer's timing position and the effective time period of the content. Furthermore, it can flexibly adjust the state (enabled or disabled) of the second controls, improving the flexibility and accuracy of control display and enhancing the user experience.

[0123] Based on any of the above embodiments, the method for editing materials by a terminal device in the above multimedia processing method will be described below with reference to FIG12.

[0124] Figure 12 is a schematic diagram of a method for editing materials according to an embodiment of this disclosure. Referring to Figure 12, the method flow includes:

[0125] S1201. Confirm the editing function of the selected second control.

[0126] In some embodiments, the terminal device can pre-set a correspondence between each second control and an editing function. This allows the terminal device to quickly and accurately determine the editing function of the selected second control based on this correspondence after the user selects it. For example, the correspondence between the second controls and editing functions might be: second control 1 - editing function A, second control 2 - editing function B, second control 3 - editing function C. When the user selects second control 1, the terminal device can determine the editing function as editing function A; when the user selects second control 2, the terminal device can determine the editing function as editing function B; and when the user selects second control 3, the terminal device can determine the editing function as editing function C.

[0127] Optionally, the terminal device may also determine the editing function of the selected second control based on any feasible implementation method, and the embodiments of this disclosure are not limited in this regard.

[0128] S1202. Edit the materials based on the editing function.

[0129] The terminal device can edit the material based on the following feasible implementation method: determine whether the editing function of the selected second control is executable; if yes, then edit the material based on the editing function; if no, then display a prompt message.

[0130] The prompts can include reasons why editing functions cannot be executed. For example, prompts may include that the current position cannot be split, deleted, dragged, or copied. For instance, when the dragged length of the material is insufficient (e.g., the pointer is too far from the material's effective timeframe), the left or right extension control can be grayed out. After the user clicks the left or right extension control, the terminal device can display the prompt "Current position cannot be dragged." Similarly, when binding text to audio, the left or right extension control is grayed out, and when the user clicks it, the terminal device can display the prompt "Current track cannot be dragged." Likewise, when makeup or music copying functions are not working properly, the copy control can be grayed out, and when the user clicks it, the terminal device can display the prompt "Current track cannot be copied."

[0131] In some embodiments, the terminal device may determine that the editing function is executable based on the following feasible implementations: when the track and the material are separable, and the timing position of the pointer is within the effective time period of the material, but not within the effective time period of the first or last frame of the material, the editing function for splitting the material is determined to be executable; when the timing position is within the effective time period of the material, but not within the effective time period of the first or last frame of the material, the editing function for deleting the material to the left or right of the timing position is determined to be executable; when the timing position is outside the effective time period of the material, and the material can be extended, the editing function for extending the material to the pointer is determined to be executable.

[0132] For example, when the track and the footage are separable, and the timing position of the pointer is within the time period of the footage, but not within the time period of the first or last frame of the footage, it means that the terminal device can segment the footage at that timing position. Therefore, the terminal device can determine that the editing function for segmenting the footage is executable, that is, the second control for segmenting the footage is enabled.

[0133] For example, if the timing position is within the effective time period of the material, but not within the effective time period of the first or last frame of the material, it means that the terminal device can delete the material to the left or right at that timing position. Therefore, the terminal device can determine that the editing function for deleting the material to the left or right of the timing position is executable, that is, the control for deleting the material to the left of the timing position or the control for deleting the material to the right of the timing position is enabled.

[0134] For example, if the timing position is outside the effective time period of the material and the material can be extended, it means that the terminal device can extend the material to the timing position. Therefore, the terminal device can determine that the editing function for extending the material to the pointer is executable, that is, the control for extending the left side of the material or the control for extending the right side of the material is enabled.

[0135] In some embodiments, when the editing function is executable, the terminal device edits the footage based on the editing function. Specifically, when the editing function is used to delete footage to the left of a timing position, the footage to the left of the timing position is deleted on the track; when the editing function is used to delete footage to the right of a timing position, the footage to the right of the timing position is deleted on the track; when the editing function is used to extend footage towards a timing position, the footage is extended to the side of the timing position closest to the timing position on the track until the timing position is reached. This improves the efficiency of editing footage.

[0136] In some embodiments, when the editing function is used to copy footage, the terminal device can copy the footage selected by the user on a track.

[0137] In some embodiments, when the editing function is used to delete complete footage, the terminal device can delete user-selected footage on the track.

[0138] In some embodiments, the terminal device can implement click processing of the second control in the second toolbar based on a proxy and strategy pattern. For example, a proxy class can be used to perform unified judgment processing on clicks of the second control to determine whether the editing function of the current second control can be executed. When the editing function cannot be executed, the proxy class can perform a pre-interception operation. When the proxy class determines that the editing function can be executed, the proxy class can operate on the track where the user-selected material is located.

[0139] In some embodiments, the logic for determining whether the editing function can be executed differs depending on the track. The terminal device can configure corresponding judgment logic for video tracks, audio tracks, and effects tracks respectively. When the track containing the user-selected material changes, the judgment logic can also change synchronously. For example, the judgment logic for the video track may include the video material being unable to be split during task processing, and the judgment logic for the audio track may include the audio being unable to be extended when bound to text. This disclosure does not limit this aspect.

[0140] The following section, with reference to Figure 13, explains the process of editing materials on a terminal device.

[0141] Figure 13 is a schematic diagram of a material editing process provided by an embodiment of this disclosure. Referring to Figure 13, a terminal device is included. The interface displayed on the terminal device includes a preview area, a pointer, video material, stickers, a first toolbar, and a second toolbar. The first toolbar includes sticker controls, effects controls, and filter controls. The second toolbar includes copy controls, left delete controls, split controls, right delete controls, and delete controls. When the user selects a sticker, the pointer is positioned within the sticker's active period.

[0142] Please refer to Figure 13. When the user clicks the copy control, the terminal device can copy an identical sticker to the end of the selected sticker. When the user clicks the split control, the terminal device can split the selected sticker into two stickers at the specified pointer position. When the user selects the second sticker and the pointer is within the effective period of the second sticker, clicking the delete control will delete the second sticker.

[0143] Please refer to Figure 13. When the user selects the first sticker, the pointer is outside the effective period of the first sticker. The second toolbar includes a copy control, a left extension control, a split control, a right extension control, and a delete control. When the user clicks the right extension control, the terminal device can extend the right side of the first sticker to the pointer's position. When the user selects the second sticker and clicks the left extension control, the terminal device can extend the left side of the second sticker to the pointer's position.

[0144] Please refer to Figure 13. After the pointer moves, its position falls within the effective timeframe of the second sticker. The second toolbar can then redisplay the copy, left delete, split, right delete, and delete controls. When the user clicks the left delete control, the terminal device can delete the portion to the left of the pointer's position within the second sticker. After the pointer moves, when the user clicks the right delete control, the terminal device can delete the portion to the right of the pointer's position within the second sticker. This allows the terminal device to quickly and accurately edit materials, improving the accuracy and efficiency of material editing.

[0145] This disclosure provides a method for editing source material. The terminal device can determine the editing function of the selected second control and whether the editing function is executable. If so, when the editing function is used to delete source material to the left of a timing position, the source material to the left of the timing position is deleted on the track; when the editing function is used to delete source material to the right of a timing position, the source material to the right of the timing position is deleted on the track; when the editing function is used to extend source material to a timing position, the source material is extended to the side closest to the timing position on the track until the timing position is reached. If not, a prompt message is displayed. In this way, the terminal device can edit source material quickly and accurately, and the reliability of the editing can be improved.

[0146] Figure 14 is a schematic diagram of a multimedia processing device provided in an embodiment of this disclosure. Referring to Figure 14, the multimedia processing device 1400 includes a display module 1401 and an editing module 1402, wherein:

[0147] The display module 1401 is used to display a first toolbar on the interface, the first toolbar including one or more first controls, the one or more first controls being used for editing multimedia.

[0148] The display module 1401 is also configured to, in response to the selection of material to fill the track of the multimedia, further display a second toolbar on the interface, the second toolbar including one or more second controls associated with editing the material;

[0149] The editing module 1402 is used to edit the material in response to the selection of one of the one or more second controls.

[0150] According to one or more embodiments of this disclosure, the display module 1401 is further configured to:

[0151] In response to the deselection of the material, the second toolbar is de-displayed.

[0152] According to one or more embodiments of this disclosure, the one or more second controls are displayed in a window of the interface.

[0153] According to one or more embodiments of this disclosure, the background color of the window is different from the background color of the interface.

[0154] According to one or more embodiments of this disclosure, the interface includes a track, the material is filled on the track, and the track includes a pointer;

[0155] When the timing position of the pointer is within the effective time period of the material, the one or more second controls are controls in the first set;

[0156] When the timing position of the pointer is outside the effective time period of the material, the one or more second controls are controls in the second set.

[0157] According to one or more embodiments of this disclosure, the first set includes one or more of the following: a control for copying the material, a control for splitting the material, and a control for deleting the material.

[0158] According to one or more embodiments of this disclosure, the control for deleting the material includes one or more of the following: a control for deleting material to the left of the time sequence position, a control for deleting material to the right of the time sequence position, and a control for deleting complete material.

[0159] According to one or more embodiments of this disclosure, when the timing position of the pointer is not within the time period of the first and last frames of the material, the control for copying the material, the control for splitting the material, and the control for deleting the material are enabled;

[0160] When the timing position of the pointer is within the time period of the first and last frames of the material, the control for copying the material and the control for deleting the complete material are enabled, while the control for splitting the material, the control for deleting the material to the left of the timing position, and the control for deleting the material to the right of the timing position are disabled.

[0161] According to one or more embodiments of this disclosure, the second set includes one or more of the following: a control for copying the material, a control for deleting the complete material, and a control for extending the material to the timing position.

[0162] According to one or more embodiments of this disclosure, the control for extending the material to the timing position includes one or more of the following: a control for extending the left side of the material, and a control for extending the right side of the material.

[0163] According to one or more embodiments of this disclosure, when the timing position of the pointer is on the left side of the material, the control for copying the material, the control for deleting the complete material, and the control for extending the left side of the material are enabled, and the control for extending the right side of the material is disabled;

[0164] When the timing position of the pointer is to the right of the material, the control for copying the material, the control for deleting the complete material, and the control for extending the right side of the material are enabled, and the control for extending the left side of the material is disabled.

[0165] According to one or more embodiments of this disclosure, the editing module 1402 is specifically used for:

[0166] Determine if the editing function of the selected second control is executable;

[0167] If so, then the material is edited based on the aforementioned editing function;

[0168] If not, a prompt message will be displayed, which includes the reason why the editing function cannot be executed.

[0169] According to one or more embodiments of this disclosure, the editing module 1402 is specifically used for:

[0170] When the editing function is used to delete material to the left of the time sequence position, the material to the left of the time sequence position is deleted on the time track;

[0171] When the editing function is used to delete material to the right of the timing position, the material to the right of the timing position is deleted on the track;

[0172] When the editing function is used to extend the material to the time position, the material is extended to the side of the time position on the track.

[0173] According to one or more embodiments of this disclosure, the editing module 1402 is specifically used for:

[0174] When the track and the material are separable, and the timing position of the pointer is within the effective time period of the material, but not within the effective time period of the first or last frame of the material, it is determined that the editing function for separating the material is executable.

[0175] When the timing position is within the effective time period of the material, but not within the effective time period of the first or last frame of the material, the editing function for deleting the material to the left or right of the timing position is determined to be executable.

[0176] When the timing position is outside the effective time period of the material, and the material can be extended, it is determined that the editing function for extending the material to the pointer is executable.

[0177] According to one or more embodiments of this disclosure, the material includes one or more of the following: video, image, audio, sticker, filter, special effect, and text.

[0178] The multimedia processing apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be repeated here.

[0179] Figure 15 is a schematic diagram of the structure of a terminal device provided in an embodiment of this disclosure. Referring to Figure 15, it shows a schematic diagram of the structure of a terminal device 1500 suitable for implementing an embodiment of this disclosure. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), tablet computers, portable media players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The terminal device shown in Figure 15 is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of this disclosure.

[0180] As shown in Figure 15, the terminal device 1500 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 1501, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 1502 or a program loaded from storage device 1508 into random access memory (RAM) 1503. The RAM 1503 also stores various programs and data required for the operation of the terminal device 1500. The processing unit 1501, ROM 1502, and RAM 1503 are interconnected via a bus 1504. An input / output (I / O) interface 1505 is also connected to the bus 1504.

[0181] Typically, the following devices can be connected to I / O interface 1505: input devices 1506 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 1507 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1508 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1509. Communication device 1509 allows terminal device 1500 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 15 shows terminal device 1500 with various devices, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0182] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 1509, or installed from a storage device 1508, or installed from a ROM 1502. When the computer program is executed by the processing device 1501, it performs the functions defined in the methods of embodiments of this disclosure.

[0183] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0184] The aforementioned computer-readable medium may be included in the aforementioned terminal device; or it may exist independently and not assembled into the terminal device.

[0185] The aforementioned computer-readable medium carries one or more programs, which, when executed by the terminal device, cause the terminal device to perform the method shown in the above embodiments.

[0186] This disclosure provides a computer-readable storage medium storing computer-executable instructions. When a processor executes the computer-executable instructions, it implements various methods that may be involved in the above embodiments.

[0187] This disclosure provides a computer program product, including a computer program that, when executed by a processor, implements various methods that may be involved in the above embodiments.

[0188] This disclosure provides a computer program that, when executed by a processor, implements various methods that may be involved in the above embodiments.

[0189] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0190] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0191] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0192] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0193] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0194] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0195] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0196] It is understood that the data involved in this technical solution (including but not limited to the data itself, its acquisition, or its use) shall comply with the requirements of relevant laws, regulations, and provisions. Data may include information, parameters, and messages, such as flow control instructions.

[0197] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0198] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. Multitasking and parallel processing may be advantageous in certain environments. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments. Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely exemplary forms of implementing the claims.

Claims

1. A multimedia processing method, comprising: A first toolbar is displayed on the interface, the first toolbar including one or more first controls, the one or more first controls being used for editing multimedia; In response to the selection of material to fill the track of the multimedia, a second toolbar is also displayed on the interface, the second toolbar including one or more second controls associated with editing the material; The material is edited in response to the selection of one of the one or more second controls.

2. The method according to claim 1, further comprising: In response to the deselection of the material, the second toolbar is de-displayed.

3. The method of claim 1 or 2, wherein, The one or more second controls are displayed in the window of the interface.

4. The method of claim 3, wherein, The background color of the window is different from the background color of the interface.

5. The method of any one of claims 1-4, wherein, The interface includes a track, the material is filled on the track, and the track includes a pointer; When the timing position of the pointer is within the effective time period of the material, the one or more second controls are controls in the first set; When the timing position of the pointer is outside the effective time period of the material, the one or more second controls are controls in the second set.

6. The method of claim 5, wherein, The first set includes one or more of the following: a control for copying the material, a control for splitting the material, and a control for deleting the material.

7. The method of claim 6, wherein, The control for deleting the material includes one or more of the following: a control for deleting material to the left of the time sequence position, a control for deleting material to the right of the time sequence position, and a control for deleting complete material.

8. The method of claim 7, wherein, When the timing position of the pointer is not within the time period of the first and last frames of the material, the control for copying the material, the control for splitting the material, and the control for deleting the material are enabled; When the timing position of the pointer is within the time period of the first and last frames of the material, the control for copying the material and the control for deleting the complete material are enabled, while the control for splitting the material, the control for deleting the material to the left of the timing position, and the control for deleting the material to the right of the timing position are disabled.

9. The method of claim 5, wherein, The second set includes one or more of the following: a control for copying the material, a control for deleting the complete material, and a control for extending the material to the time position.

10. The method of claim 9, wherein, The control for extending the material to the timing position includes one or more of the following: a control for extending the left side of the material, and a control for extending the right side of the material.

11. The method of claim 10, wherein, When the timing position of the pointer is to the left of the material, the control for copying the material, the control for deleting the complete material, and the control for extending the left side of the material are enabled, and the control for extending the right side of the material is disabled; When the timing position of the pointer is to the right of the material, the control for copying the material, the control for deleting the complete material, and the control for extending the right side of the material are enabled, and the control for extending the left side of the material is disabled.

12. The method of any one of claims 1-11, wherein, The editing of the material includes: Determine if the editing function of the selected second control is executable; If so, the material is edited based on the aforementioned editing function; If not, a prompt message will be displayed, which includes the reason why the editing function cannot be executed.

13. The method of claim 12, wherein, The editing of the material based on the editing function includes: When the editing function is used to delete material to the left of the timing position, the material to the left of the timing position is deleted on the track; When the editing function is used to delete material to the right of the timing position, the material to the right of the timing position is deleted on the track; When the editing function is used to extend the material to the time position, the material is extended to the side of the time position on the track.

14. The method of claim 12, wherein, Determining that the editing function is executable includes: When the track and the material are separable, and the timing position of the pointer is within the effective time period of the material, but not within the effective time period of the first or last frame of the material, it is determined that the editing function for separating the material is executable. When the timing position is within the effective time period of the material, but not within the effective time period of the first or last frame of the material, the editing function for deleting the material to the left or right of the timing position is determined to be executable. When the timing position is outside the effective time period of the material, and the material can be extended, it is determined that the editing function for extending the material to the pointer is executable.

15. The method of any one of claims 1-14, wherein, The materials include one or more of the following: videos, images, audio, stickers, filters, special effects, and text.

16. A multimedia processing apparatus, comprising a display module and an editing module, wherein: The display module is used to display a first toolbar on the interface, the first toolbar including one or more first controls, the one or more first controls being used for editing multimedia; The display module is also configured to, in response to the selection of material to fill the track of the multimedia, display a second toolbar on the interface, the second toolbar including one or more second controls associated with editing the material; The editing module is used to edit the material in response to the selection of one of the one or more second controls.

17. A terminal device comprising: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the multimedia processing method as described in any one of claims 1-15.

18. A computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the multimedia processing method as described in any one of claims 1-15.

19. A computer program product comprising a computer program that, when executed by a processor, implements the multimedia processing method as described in any one of claims 1-15.

20. A computer program that, when executed by a processor, implements the multimedia processing method as described in any one of claims 1-15.

Images