Multimedia material editing method and device, electronic equipment and readable storage medium

Abstract

The invention relates to a multimedia material editing method and device, electronic equipment and a readable storage medium. The method comprises the steps that information of a first multimedia material is displayed in a first track according to the duration of the first multimedia material, information of a second multimedia material is displayed in a second track according to the duration of the second multimedia material, the first multimedia material and the second multimedia material are multimedia materials to be synthesized, and the information of the first multimedia material is displayed in the first track according to the duration of the second multimedia material. The duration of the first multimedia material is greater than or equal to that of the second multimedia material; a triggering operation of a user is received, and the triggering operation is used for triggering automatic selection of the information of the first multimedia material; a first selection area for automatically selecting the information of the first multimedia material is displayed in the first track, and the duration of the segment of the first multimedia material corresponding to the range of the first selection area is equal to the duration of the second multimedia material.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a method, device, electronic device and readable storage medium for editing multimedia materials. Background Art

[0002] Currently, when synthesizing multiple multimedia materials, the multimedia materials are usually of different lengths, and the user needs to manually cut the multiple multimedia materials to the same length before they can be synthesized. For example, when a user adds music to a video, if the length of the music is longer than the length of the video, the user needs to manually adjust the music to the same length and cut it before it can be synthesized with the video. Summary of the invention

[0003] This summary is provided to introduce concepts in a brief form that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0004] According to some embodiments of the present disclosure, a method for editing multimedia material is provided, comprising: displaying information of a first multimedia material in a first track according to the duration of the first multimedia material, and displaying information of a second multimedia material in a second track according to the duration of the second multimedia material, wherein the first multimedia material and the second multimedia material are multimedia materials to be synthesized, and the duration of the first multimedia material is greater than or equal to the duration of the second multimedia material; receiving a trigger operation of a user, wherein the trigger operation is used to trigger automatic selection of information of the first multimedia material; displaying a first selection area for automatic selection of information of the first multimedia material in the first track, wherein the range of the first selection area is aligned with the display range of information of the second multimedia material, and the duration of a segment of the first multimedia material corresponding to the range of the first selection area is equal to the duration of the second multimedia material.

[0005] According to some other embodiments of the present disclosure, a multimedia material editing device is provided, comprising: a receiving module and a display module, wherein: the display module is configured to display information of a first multimedia material in a first track according to the duration of the first multimedia material, and to display information of a second multimedia material in a second track according to the duration of the second multimedia material, wherein the first multimedia material and the second multimedia material are multimedia materials to be synthesized, the duration of the first multimedia material is greater than or equal to the duration of the second multimedia material, and the information of the first multimedia material and the information of the second multimedia material are displayed in time correspondence; the receiving module is configured to receive a trigger operation of a user, wherein the trigger operation is used to trigger automatic selection of information of the first multimedia material; the display module is also configured to display a first selection area for automatic selection of information of the first multimedia material in the first track, wherein the range of the first selection area is aligned with the display range of the information of the second multimedia material.

[0006] According to some further embodiments of the present disclosure, an electronic device is provided, comprising: a processor; and a memory coupled to the processor, for storing instructions, which, when executed by the processor, causes the processor to execute a method for editing multimedia materials as described in any of the aforementioned embodiments.

[0007] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, wherein when the program is executed by a processor, the method for editing multimedia materials of any of the aforementioned embodiments is implemented.

[0008] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The preferred embodiments of the present disclosure are described below with reference to the accompanying drawings. The drawings described herein are used to provide a further understanding of the present disclosure. Each of the drawings together with the following detailed description is included in this specification and forms a part of the specification, and is used to explain the present disclosure. It should be understood that the drawings described below only relate to some embodiments of the present disclosure and do not constitute a limitation on the present disclosure. In the drawings:

[0010] Figure 1 A schematic diagram showing a flow chart of a method for editing multimedia materials according to some embodiments of the present disclosure;

[0011] Figure 2 A schematic diagram showing an interface of some embodiments of the present disclosure;

[0012] Figure 3 Schematic diagrams showing interfaces of other embodiments of the present disclosure;

[0013] Figure 4Schematic diagrams showing interfaces of still other embodiments of the present disclosure;

[0014] Figure 5 Schematic diagrams showing interfaces of still further embodiments of the present disclosure;

[0015] Figure 6 A schematic diagram showing a flow chart of a method for editing multimedia materials according to other embodiments of the present disclosure;

[0016] Figure 7 A schematic flowchart of a method for editing multimedia materials according to yet other embodiments of the present disclosure is shown.

[0017] Figure 8 Schematic diagrams showing interfaces of still other embodiments of the present disclosure;

[0018] Fig. 9 A schematic diagram showing the structure of a multimedia material editing device according to some embodiments of the present disclosure;

[0019] Fig.10 A schematic diagram showing the structure of a multimedia material editing device according to another embodiment of the present disclosure;

[0020] Fig.11 A schematic structural diagram of a multimedia material editing device according to some further embodiments of the present disclosure is shown.

[0021] It should be understood that, for ease of description, the sizes of the various parts shown in the drawings are not necessarily drawn according to the actual proportional relationship. The same or similar reference numerals are used in the various drawings to represent the same or similar parts. Therefore, once an item is defined in one drawing, it may not be further discussed in subsequent drawings. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure, but it is obvious that the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. The following description of the embodiments is actually only illustrative and is by no means intended to limit the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein.

[0023] It should be understood that the various steps recorded in the method embodiments of the present disclosure can be performed in different orders, and / or performed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown in the execution. The scope of the present disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions and numerical values ​​of the parts and steps set forth in these embodiments should be interpreted as being merely exemplary and do not limit the scope of the present disclosure.

[0024] The term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". In addition, the term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". Therefore, include is synonymous with include. The term "based on" means "based at least in part on".

[0025] References throughout this specification to "one embodiment," "some embodiments," or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. For example, the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments." Furthermore, the appearances of the phrases "in one embodiment," "in some embodiments," or "in an embodiment" in various places throughout this specification do not necessarily all refer to the same embodiment, but may do so.

[0026] It should be noted that the concepts of "first", "second", etc. mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units. Unless otherwise specified, the concepts of "first", "second", etc. are not intended to imply that the objects described in this way must be in a given order in time, space, ranking, or any other manner.

[0027] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0028] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0029] The embodiments of the present disclosure are described in detail below in conjunction with the accompanying drawings, but the present disclosure is not limited to these specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. In addition, in one or more embodiments, specific features, structures or characteristics can be combined in any suitable manner that will be clear from the present disclosure by a person of ordinary skill in the art.

[0030] The inventors have found that it is difficult for users to quickly and accurately adjust multimedia materials to the same length by manually adjusting and cutting multimedia materials. In view of this, a technical problem to be solved by the present disclosure is how to more efficiently and accurately adjust the multimedia materials to be synthesized.

[0031] The present invention provides a method for editing multimedia materials. Figures 1 to 8 Give a description.

[0032] Figure 1 Flowcharts of some embodiments of the method for editing multimedia materials disclosed in the present invention. Figure 1 As shown, the method of this embodiment includes: steps S102 to S106.

[0033] In step S102, information of the first multimedia material is displayed in the first track according to the duration of the first multimedia material, and information of the second multimedia material is displayed in the second track according to the duration of the second multimedia material.

[0034] Before step S102, the method may further include receiving a trigger operation of the editing interface by the user. In some embodiments, the trigger operation of the editing interface is a trigger operation of displaying the editing interface after adding the second multimedia material for synthesis to the first multimedia material, or a trigger operation of displaying the editing interface after adding the first multimedia material for synthesis to the second multimedia material, or a trigger operation of displaying the editing interface after adding multiple multimedia materials, without limitation to the examples given.

[0035] For example, a user selects a first multimedia material for editing, information of the first multimedia material is displayed in a first track in an editing interface according to the length of the first multimedia material, an add operation by the user is received, candidate multimedia materials are displayed or a search interface is displayed, etc., a confirmation operation for a second multimedia material by the user is received, and an editing interface is displayed.

[0036] For another example, an operation of selecting a first multimedia material and a second multimedia material from candidate multimedia materials is received, prompt information indicating that the first multimedia material and the second multimedia material are selected is displayed, and an editing function triggering operation is received from the user, and an editing interface is displayed.

[0037] The user's operation in the present disclosure can be implemented in various forms such as clicking controls, voice operations, etc., which are not limited here.

[0038] For example, Figure 2 As shown, the starting ends of the first track and the second track are aligned and displayed in a parallel arrangement, and the upper and lower positions of the first track and the second track are not limited. The information of the first multimedia material in the first track and the information of the second multimedia material in the second track can be displayed in full, or can support sliding display. For example, when the information of the first multimedia material or the information of the second multimedia material exceeds the preset length, the part of the preset length is displayed, and the remaining part can be displayed by sliding. For example, the user can display the undisplayed part by sliding left and right, and can change the starting time of the playback of the first multimedia material.

[0039] The first multimedia material and the second multimedia material of the same duration have the same display length. At the same time, one or more time markers may be displayed corresponding to the first track and / or the second track, and the time markers may be used to indicate the duration of a partial segment or the complete duration of the first multimedia material and the second multimedia material. Figure 2 As shown, the editing interface may also include a preview area for the synthesized multimedia material and a play control, and the synthesized multimedia material may be played in the preview area by receiving a trigger operation of the play control by the user.

[0040] like Figure 2 As shown, the editing interface may also display an add control for adding multimedia material, receive a user's trigger operation on the add control, and display the information of the third multimedia material in the third track according to the duration of the third multimedia material. Multimedia material may also be added in other ways, not limited to the examples given.

[0041] like Figure 2As shown, at least one of a replacement control, a deletion control, and a volume control can also be displayed in the editing interface. The replacement control can be used to replace the added multimedia material, receive a user's trigger operation on the replacement control, display candidate multimedia materials, receive a user's selection operation on any multimedia material, and replace the added multimedia material. For example, in the case of adding a first multimedia material to a second multimedia material, the replacement control can be used to replace the first multimedia material. The deletion control can be used to delete the added multimedia material, receive a user's trigger operation on the deletion control, and delete the added multimedia material and the corresponding track. The deletion control can also be used to delete multiple multimedia materials at the same time. The volume control can be used to adjust the volume of the added multimedia material, or the volume control can be used to adjust the volume of the first multimedia material and / or the second multimedia material, or the volume control can be used to adjust the volume of the synthesized multimedia material. The editing interface can also include a speed adjustment control, which can adjust the speed of the added multimedia material, or the speed control can be used to adjust the speed of the first multimedia material and / or the second multimedia material, or the speed control can be used to adjust the speed of the synthesized multimedia material. The functions of these controls can be replaced by other forms, such as replacement by voice instructions, or double-clicking, pressing, and other operations to adjust the volume, speed, etc., but are not limited to the examples given.

[0042] In some embodiments, the first multimedia material and the second multimedia material are multimedia materials to be synthesized, the first multimedia material is a video, audio, image or special effect material, and the second multimedia material is a video, audio, image or special effect material. Special effect materials are, for example, subtitles, special effects, text, stickers, etc., but are not limited to the examples given. Synthesis and editing can be performed on multiple multimedia materials of any type.

[0043] In some embodiments, the information of the first multimedia material includes: one or more images and at least one item of text corresponding to the first multimedia material; the information of the second multimedia material includes: one or more images and at least one item of text corresponding to the second multimedia material.

[0044] For example, when the first multimedia material is audio, the information of the first multimedia material displayed in the first track is at least one of a waveform graph and a name text. For another example, when the second multimedia material is a video, the information of the second multimedia material displayed in the second track is a plurality of frames of images, which may be thumbnails of a plurality of frames of images extracted from the video at a preset sampling interval, for example, one frame of image is extracted every 0.1 seconds.

[0045] The first length of the information of the first multimedia material displayed in the first track is proportional to the first duration of the first multimedia material; the second length of the information of the second multimedia material displayed in the second track is proportional to the second duration of the second multimedia material, and the ratio of the first length to the first duration and the ratio of the second length to the second duration are equal.

[0046] In step S104, a trigger operation of the user is received.

[0047] For example, the trigger operation is used to trigger the automatic selection of information of the first multimedia material. Figure 2 As shown, an adjustment control may be set to receive a user's triggering operation on the adjustment control. Alternatively, a user's selection operation on the first multimedia material and a triggering operation on the adjustment control may be received. Alternatively, operations such as clicking or double-clicking the first track or the second track may be used as triggering operations, and the specific form of the triggering operation is not limited.

[0048] In step S106, a first selection area automatically selected for information of the first multimedia material is displayed in the first track, wherein the range of the first selection area is aligned with the display range of information of the second multimedia material, and the duration of the segment of the first multimedia material corresponding to the range of the first selection area is equal to the duration of the second multimedia material.

[0049] Aligning two ranges may mean that the two ranges have the same length and are displayed correspondingly.

[0050] Step S104 is optional. After receiving the user's trigger operation on the editing interface, the information of the first multimedia material can be displayed in the first track according to the duration of the first multimedia material, and the information of the second multimedia material can be displayed in the second track according to the duration of the second multimedia material, and a first selection area for automatically selecting the information of the first multimedia material can be displayed in the first track.

[0051] The duration of the first multimedia material is greater than or equal to the duration of the second multimedia material, that is, the display range of the information of the first multimedia material is greater than or equal to the display range of the information of the second multimedia material. The range of the first selection area is aligned with the display range of the information of the second multimedia material, and the duration of the segment of the first multimedia material corresponding to the range of the first selection area is equal to the duration of the second multimedia material. In the first track, the display range of the information of the first multimedia material that is aligned with the display range of the information of the second multimedia material is automatically selected as the first selection area.

[0052] In some embodiments, it is determined whether the first multimedia material is cropped; if the first multimedia material is not cropped, the starting point of the first multimedia material is used as the starting point of the first selection area, and the ending point of the first selection area is determined according to the ending point of the information of the second multimedia material; if the first multimedia material is cropped, the starting point of the first multimedia material after cropping is used as the starting point of the first selection area, and the ending point of the first selection area is determined according to the starting point of the first selection area and the duration of the second multimedia material; the first selection area is displayed based on the starting point and the ending point of the first selection area.

[0053] Whether the first multimedia material is cropped may be determined based on a record of whether the first selection area is adjusted or based on a cropping operation record of the user.

[0054] In some embodiments, the partial information of the first multimedia material in the first selection area and the partial information of the first multimedia material outside the first selection area are displayed with different display effects. For example, different transparency or different color masks are used in the first selection area and outside the first selection area. For another example, the first selection area can be displayed in the form of a window, a selection box, etc.

[0055] like Figure 3 As shown, taking the first multimedia material as audio and the second multimedia material as video as an example, when the duration of the audio is greater than the duration of the video, the first selection area is displayed in the first track, and the range of the first selection area is aligned with the display range of the video image. The first selection area and the second multimedia material can be fully displayed in the interface for easy viewing by the user. The information of the first multimedia material outside the first selection area can be partially displayed, and the information displayed in the first track can be adjusted as a whole through sliding operations. Figure 2 and Figure 3 It can be the same interface or different interfaces, and there is no limitation here. The editing interface is used for description in the subsequent embodiments, but those skilled in the art can understand that the first editing interface can be displayed before the trigger operation, and the second editing interface can be displayed after the trigger operation.

[0056] In some embodiments, a second selection area for selecting information of the second multimedia material is displayed in the second track, wherein a range of the first selection area is aligned with a range of the second selection area.

[0057] The second selection area can be selected according to the user's operation or automatically. When the second selection area is displayed in the second track, the range of the first selection area is aligned with the range of the second selection area. When the second selection area is not displayed in the second track, the range of the first selection area is aligned with the display range of the information of the second multimedia material. The range of the second selection area may include the entire display range or a part of the display range of the information of the second multimedia material. Figure 4 As shown, the range of the second selection area covers the entire display range of the information of the second multimedia material. Figure 5 As shown, the range of the second selection area covers a portion of the display range of the information of the second multimedia material.

[0058] In some embodiments, when the duration of the first multimedia material is equal to the duration of the second multimedia material, the second selection area is not displayed in the second track; when the duration of the first multimedia material is greater than the duration of the second multimedia material, the second selection area is displayed in the second track; when the duration of the first multimedia material is less than the duration of the second multimedia material, the second selection area is displayed in the second track.

[0059] In the case where the duration of the first multimedia material is shorter than that of the second multimedia material, the first selection area may not be displayed, and only the second selection area may be displayed, or the first selection area and the second selection area may be displayed simultaneously. The range of the first selection area is aligned with the range of the second selection area, and the range of the first selection area may include the entire display range or a partial display range of the information of the first multimedia material. For multimedia materials with shorter duration, they may be fully displayed in the corresponding track for easy viewing by users.

[0060] In the above embodiment, the first multimedia material may be one or more, and each of the first multimedia materials may correspond to display a first selection area, which will not be described in detail herein.

[0061] In the method of the above embodiment, the information of the first multimedia material is displayed in the first track, and the information of the second multimedia material is displayed in the second track, and the information of the first multimedia material and the information of the second multimedia material are displayed in time correspondence, a trigger operation of the user is received, the automatic selection of the information of the first multimedia material is triggered, and the first selection area of ​​the automatic selection of the information of the first multimedia material is displayed in the first track, and the first selection area is aligned with the display range of the information of the second multimedia material. Through the method of the above embodiment, the first selection area of ​​the same length as the shorter second multimedia material can be automatically selected and displayed in the longer first multimedia material, and aligned with the display range of the information of the second multimedia material, without the user manually adjusting the first multimedia material, and the length alignment of multiple multimedia materials can be achieved quickly and accurately, thereby improving the efficiency and accuracy of the adjustment of the multimedia materials to be synthesized.

[0062] Combine the following Figure 6 Other embodiments of the multimedia material editing method of the present disclosure are described.

[0063] Figure 6 Flowcharts of other embodiments of the method for editing multimedia materials disclosed herein. Figure 6 As shown, the method of this embodiment includes: steps S602 to S606.

[0064] In step S602, a first adjustment operation of a user on a range of a first selection area is received.

[0065] For example, a first adjustment operation of the user on the edge of the first selection area is received.

[0066] like Figure 4 and 5 As shown, an edge control can be set at the edge of the first selection area, and the range of the first selection area can be adjusted by operating the edge control; or the range of the first selection area can be adjusted by sliding the window or selection box corresponding to the first selection area; the range of the first selection area is adjusted, indicating that the starting position and / or ending position of the segment of the first multimedia material selected for synthesis is adjusted.

[0067] In some embodiments, in response to the user adjusting the edge of the first selection area to the edge of the information of the first multimedia material, a first prompt message is issued, wherein the first prompt message is used to prompt that the edge of the first selection area cannot exceed the edge of the information of the first multimedia material; and / or in response to the user adjusting the range of the first selection area to a first minimum range, a second prompt message is issued, wherein the second prompt message is used to prompt that the range of the first selection area cannot be reduced any further.

[0068] The first prompt information and the second prompt information can be in the form of text, sound, image or vibration, etc., not limited to the examples given. The maximum range of the first selection area is the complete display range of the information of the first multimedia material, and the minimum range of the first selection area can be preset, for example, the display range corresponding to 0.1 seconds.

[0069] In step S604, a second adjustment operation of the user on the range of the second selection area is received.

[0070] For example, a second adjustment operation of the user on the edge of the second selection area is received. For example, an edge control may be set on the edge of the second selection area, and the range of the first selection area may be adjusted by operating the edge control; or the range of the second selection area may be adjusted by sliding a window or a selection box corresponding to the second selection area; the range of the second selection area is adjusted, indicating that the start position and / or end position of the segment of the second multimedia material selected for synthesis is adjusted.

[0071] In some embodiments, in response to the user adjusting the edge of the second selection area to the edge of the information of the second multimedia material, a third prompt message is issued, wherein the third prompt message is used to prompt that the edge of the second selection area cannot exceed the edge of the information of the second multimedia material; in response to the user adjusting the range of the second selection area to the second minimum range, a fourth prompt message is issued, wherein the fourth prompt message is used to prompt that the range of the second selection area cannot be reduced any further.

[0072] The third prompt information and the fourth prompt information may be in the form of text, sound, image or vibration, etc., and are not limited to the examples given. The maximum range of the second selection area is the complete display range of the information of the second multimedia material, and the minimum range of the second selection area can be preset.

[0073] The adjustment methods of the range of the first selection area and the range of the second selection area can be set differently, for example, the edge of the first selection area is set with an edge control, and the corresponding window or selection box of the second selection area supports sliding operation, which is not limited to the examples given. The first selection area and the second selection area can be automatically adjusted together. During the adjustment process, the first selection area and the second selection area do not exceed their respective corresponding maximum range and minimum range.

[0074] In step S606, the dynamically adjusted first selection area is displayed in the first track, and the dynamically adjusted second selection area is displayed in the second track.

[0075] For example, when receiving a first adjustment operation from a user on the range of a first selection area, the adjusted first selection area is dynamically displayed in the first track following the first adjustment operation, and the second selection area dynamically adjusted along with the first selection area is displayed in the second track; when receiving a second adjustment operation from the user on the range of a second selection area, the adjusted second selection area is dynamically displayed in the second track following the second adjustment operation, and the first selection area dynamically adjusted along with the second selection area is displayed in the first track.

[0076] The range of the first selection area is dynamically aligned with the range of the second selection area. The first selection area and the second selection area can be dynamically adjusted and displayed together. If one of them is adjusted, the other area can be automatically adjusted together, and the two areas always keep their positions aligned.

[0077] The method of the above embodiment can dynamically adjust the first selection area and the second selection area by adjusting either the first selection area or the second selection area, thereby improving the efficiency and accuracy of adjusting the multimedia material to be synthesized.

[0078] In some embodiments, a user's operation of moving information of first multimedia material in a first track relative to a first selection area is received; and the information of the first multimedia material moved relative to the first selection area is dynamically displayed in the first track, wherein a position of the first selection area relative to the first track remains unchanged.

[0079] For example, if a sliding operation is performed on the information of the first multimedia material in the first track, and the position of the first selection area relative to the first track remains unchanged, the segment of the first multimedia material corresponding to the first selection area will change, that is, the selected segment of the first multimedia material will change. If the position of the first selection area relative to the first track remains unchanged, the position of the second selection area will also not change, so that only the segment of the first multimedia material corresponding to the first selection area can be changed, and the segment of the second multimedia material corresponding to the second selection area remains unchanged.

[0080] In some embodiments, a user's operation of moving information of second multimedia material in the second track relative to a second selection area is received; and the information of the second multimedia material moved relative to the second selection area is dynamically displayed in the second track, wherein the position of the second selection area relative to the second track remains unchanged.

[0081] For example, a sliding operation is performed on the information of the second multimedia material in the second track, and the position of the second selection area relative to the second track remains unchanged, then the segment of the second multimedia material corresponding to the second selection area will change, that is, the selected segment of the second multimedia material will change.

[0082] By adjusting the range of the first selection area or the range of the second selection area, and moving the information of the first multimedia material in the first track or the information of the second multimedia material in the second track, it is possible to combine and synthesize any fragment of the first multimedia material and any fragment of the second multimedia material, thereby improving the flexibility of multimedia material synthesis and the efficiency and accuracy of adjusting the multimedia material to be synthesized.

[0083] Combine the following Figure 7 Some further embodiments of the method for editing multimedia materials of the present disclosure are described.

[0084] Figure 7 Flowcharts of some other embodiments of the method for editing multimedia materials disclosed herein. Figure 7 As shown, the method of this embodiment includes: steps S702 to S710.

[0085] In step S702, a user triggering operation on a preview function is received.

[0086] like Figure 8 As shown, the user can trigger the preview function by clicking the play control, voice, etc.

[0087] In step S704, a multimedia material synthesized by a first segment of a first multimedia material corresponding to the range of the first selected area and a second segment of a second multimedia material corresponding to the range of the second selected area is played.

[0088] In some embodiments, when the second selection area is not displayed, that is, the second multimedia material is all used for synthesis, a user trigger operation for the play function is received; the first segment of the first multimedia material corresponding to the range of the first selection area and the multimedia material synthesized from the second multimedia material are played.

[0089] The synthesized multimedia material can be played in a loop. Figure 8 As shown, a preview area can also be displayed in the editing interface, and the synthesized multimedia material can be played in the preview area. The synthesized multimedia material can also be played in a new window, which is not limited to the examples given.

[0090] In step S706, the playing progress of the first segment is dynamically displayed in the first track, and the playing progress of the second segment is dynamically displayed in the second track.

[0091] Steps S704 and S706 may be performed in parallel.

[0092] For example, the playback progress can be displayed through animation or indicator. Figure 8As shown, the first multimedia material is audio, and the second multimedia material is video. The playback progress can be displayed in the form of a waveform animation in the first track, and the playback progress can be indicated by moving an indicator line in the second track.

[0093] In step S708, during the playback process, an adjustment operation of the user on the range of the first selection area or the range of the second selection area is received.

[0094] The adjustment operation of the range of the first selected area or the range of the second selected area may refer to the aforementioned embodiment, which will not be described in detail here.

[0095] In step S710, the playback is paused and the dynamically adjusted first selection area is displayed in the first track, and the dynamically adjusted second selection area is displayed in the second track, wherein the range of the second selection area is dynamically aligned with the range of the first selection area.

[0096] In some embodiments, during the playback process, a user moves the information of the first multimedia material in the first track, and the playback is paused. The information of the first multimedia material that is dynamically moved can be further displayed in the first track. The position of the first selection area relative to the first track remains unchanged. During the playback process, a user moves the information of the second multimedia material in the second track, and the playback is paused. The information of the second multimedia material that is dynamically moved can be further displayed in the second track.

[0097] In some embodiments, a triggering operation of a user on a function of adjusting the playback speed is received, and the synthesized multimedia material is played at the adjusted speed.

[0098] In some embodiments, a user trigger operation on a pause function is received, playback is paused, the playback position of the first segment at the time of pause is dynamically displayed in the first track, and the playback position of the second segment at the time of pause is dynamically displayed in the second track.

[0099] The method of the above embodiment allows the user to watch the effect of the synthesized multimedia material at any time, and can flexibly select the selected segments from the first multimedia material and the second multimedia material, thereby improving the efficiency and accuracy of the selection.

[0100] In some embodiments, a trigger operation of a save function by a user is received; and a multimedia material synthesized by a segment of the first multimedia material corresponding to the range of the first selection area and a segment of the corresponding second multimedia material is saved and displayed.

[0101] When the second selection area is displayed, the fragment of the second multimedia material corresponding to the range of the first selection area is the fragment of the second multimedia material corresponding to the range of the second selection area; when the second selection area is not displayed, the fragment of the second multimedia material corresponding to the range of the first selection area is the complete second multimedia material.

[0102] For example, in a scenario where a first multimedia material is added to a second multimedia material for synthesis, before the adding operation, the second multimedia material can be played in the original playback interface, and after the saving operation, the synthesized multimedia material can be returned to the original playback interface after exiting the editing interface. In the case where the synthesized multimedia material has been previewed and played in the editing interface, the current playback position is recorded, and the playback can be performed according to the current playback position after returning to the original playback interface. Since a portion of the synthesized multimedia material has been previewed, returning to the original playback interface to play the remaining playback can improve efficiency and enhance user experience. The original playback position of the second multimedia material in the original playback interface can be recorded, and playback can be started from the original playback position after returning to the original playback interface.

[0103] In some embodiments, a user trigger operation for a cancel function is received; and the synthesized multimedia material is deleted.

[0104] For example, in a scenario where the first multimedia material is added to the second multimedia material for synthesis, the second multimedia material can be played in the original playback interface before the adding operation, and after the operation is canceled, the original playback interface can be returned to after exiting the editing interface. The original playback position of the second multimedia material in the original playback interface can be recorded, and the second multimedia material can be played from the original playback position after returning to the original playback interface.

[0105] In some embodiments, a user trigger operation to exit the adjustment function is received, and information of the first multimedia material is displayed in the first track according to the duration of the first multimedia material, and information of the second multimedia material is displayed in the second track according to the duration of the second multimedia material. The user can re-execute the trigger operation to automatically select and display the first selection area again, or manually select and adjust the information of the first multimedia material in the first track.

[0106] In some embodiments, a trigger operation of exiting the adjustment function by the user is received, information of the first multimedia material in the first selection area is displayed in the first track, and information of the second multimedia material in the second selection area is displayed in the second track.

[0107] In some embodiments, the first multimedia material or the second multimedia material or the synthesized multimedia material supports full screen display.

[0108] Taking the first multimedia material as audio and the second multimedia material as video as an example, in the scenario of adding music to the video, if the length of the audio is greater than the length of the video, the method disclosed in the present invention can display the audio information in the first track and the video information in the second track, and can automatically display the first selected area of ​​the audio in the first track, which is equal to the length of the video, thereby improving the efficiency of adjusting the audio. In addition, the second selected area of ​​the video can be displayed in the second track, and by adjusting any one of the range of the first selected area and the range of the second selected area, the ranges of the two areas can be dynamically adjusted at the same time, and by moving the audio in the first track or the video in the second track, any audio segment and video segment can be made to correspond and flexibly adjusted, thereby improving the accuracy and efficiency of multimedia material merging.

[0109] The present disclosure also provides a multimedia material editing device, Fig. 9 Give a description.

[0110] Fig. 9 FIG. 1 is a structural diagram of some embodiments of the apparatus for editing multimedia materials disclosed in the present invention. Fig. 9 As shown, the device 90 of this embodiment includes: a receiving module 910 and a display module 920 .

[0111] The display module 920 is configured to display information of the first multimedia material in the first track according to the duration of the first multimedia material, and to display information of the second multimedia material in the second track according to the duration of the second multimedia material, wherein the first multimedia material and the second multimedia material are multimedia materials to be synthesized, the duration of the first multimedia material is greater than or equal to the duration of the second multimedia material, and the information of the first multimedia material and the information of the second multimedia material are displayed in correspondence in time.

[0112] The receiving module 910 is configured to receive a trigger operation of a user, wherein the trigger operation is used to trigger automatic selection of information of the first multimedia material;

[0113] The display module 920 is further configured to display a first selection area automatically selected for the information of the first multimedia material in the first track, wherein a range of the first selection area is aligned with a display range of the information of the second multimedia material.

[0114] In some embodiments, the receiving module 910 is also configured to receive a first adjustment operation of the user on the range of the first selection area; the display module 920 is also configured to dynamically display the adjusted first selection area in the first track following the first adjustment operation, and display the second selection area dynamically adjusted along with the first selection area in the second track, wherein the range of the second selection area is dynamically aligned with the range of the first selection area.

[0115] In some embodiments, the display module 920 is further configured to display a second selection area for selecting information of the second multimedia material in the second track, wherein a range of the first selection area is aligned with a range of the second selection area.

[0116] In some embodiments, the receiving module 910 is also configured to receive a second adjustment operation of the user on the range of the second selection area; the display module 920 is also configured to dynamically display the adjusted second selection area in the second track following the second adjustment operation, and display the first selection area dynamically adjusted along with the second selection area in the first track, wherein the range of the first selection area is dynamically aligned with the range of the second selection area.

[0117] In some embodiments, the receiving module 910 is also configured to receive a user's operation of moving information of the first multimedia material in the first track relative to the first selection area; the display module 920 is also configured to dynamically display the information of the first multimedia material moved relative to the first selection area in the first track, wherein the position of the first selection area relative to the first track remains unchanged.

[0118] In some embodiments, the receiving module 910 is also configured to receive a user's operation of moving information of the second multimedia material in the second track relative to the second selection area; the display module 920 is also configured to dynamically display information of the second multimedia material moved relative to the second selection area in the second track, wherein the position of the second selection area relative to the second track remains unchanged.

[0119] In some embodiments, the display module 920 is configured to determine whether the first multimedia material is cropped; if the first multimedia material is not cropped, the starting point of the first multimedia material is used as the starting point of the first selection area, and the ending point of the first selection area is determined according to the ending point of the information of the second multimedia material; if the first multimedia material is cropped, the starting point of the first multimedia material after cropping is used as the starting point of the first selection area, and the ending point of the first selection area is determined according to the starting point of the first selection area and the duration of the second multimedia material; the first selection area is displayed based on the starting point and ending point of the first selection area.

[0120] In some embodiments, the display module 920 is configured to display the partial information of the first multimedia material within the first selection area and the partial information of the first multimedia material outside the first selection area with different display effects.

[0121] In some embodiments, the receiving module 910 is further configured to receive a user trigger operation on a preview function; the display module 920 is further configured to play a multimedia material synthesized from a first segment of the first multimedia material and a second multimedia material corresponding to a range of the first selection area.

[0122] In some embodiments, the receiving module 910 is also configured to receive a user trigger operation on the preview function; the display module 920 is also configured to play a multimedia material synthesized from a first segment of the first multimedia material corresponding to the range of the first selection area and a second segment of the second multimedia material corresponding to the range of the second selection area.

[0123] In some embodiments, the display module 920 is further configured to dynamically display the playback progress of the first segment in the first track; and dynamically display the playback progress of the second segment in the second track.

[0124] In some embodiments, the receiving module 910 is also configured to receive a user's adjustment operation on the range of the first selection area or the range of the second selection area during playback; the display module 920 is also configured to pause playback and display the dynamically adjusted first selection area in the first track, and display the dynamically adjusted second selection area in the second track, wherein the range of the second selection area is dynamically aligned with the range of the first selection area.

[0125] In some embodiments, the device 90 also includes: a prompt module 930, which is configured to issue a first prompt message in response to the user adjusting the edge of the first selection area to the edge of the information of the first multimedia material; and / or issue a second prompt message in response to the user adjusting the range of the first selection area to the first minimum range; and / or issue a third prompt message in response to the user adjusting the edge of the second selection area to the edge of the information of the second multimedia material; and / or issue a fourth prompt message in response to the user adjusting the range of the second selection area to the second minimum range.

[0126] In some embodiments, the device 90 also includes: a storage module 940; the receiving module 910 is also configured to receive a user's trigger operation on a save function; the storage module 940 is configured to save the multimedia material synthesized from the fragments of the first multimedia material corresponding to the range of the first selection area and the corresponding fragments of the second multimedia material; the display module 920 is also configured to display the multimedia material synthesized from the fragments of the first multimedia material corresponding to the range of the first selection area and the corresponding fragments of the second multimedia material.

[0127] In some embodiments, the first multimedia material is a video, audio, image or special effect material, and the second multimedia material is a video, audio, image or special effect material.

[0128] In some embodiments, the information of the first multimedia material includes: one or more images and at least one item of text corresponding to the first multimedia material; the information of the second multimedia material includes: one or more images and at least one item of text corresponding to the second multimedia material.

[0129] It should be noted that the above-mentioned units are only logical modules divided according to the specific functions implemented by them, and are not used to limit the specific implementation methods. For example, they can be implemented in software, hardware, or a combination of software and hardware. In actual implementation, the above-mentioned units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (CPU or DSP, etc.), an integrated circuit, etc.). In addition, the above-mentioned units are shown with dotted lines in the drawings to indicate that these units may not actually exist, and the operations / functions implemented by them can be implemented by the processing circuit itself.

[0130] In addition, although not shown, the device may also include a memory, which may store various information generated by the device, various units contained in the device during operation, programs and data for operation, data to be sent by the communication unit, etc. The memory may be a volatile memory and / or a non-volatile memory. For example, the memory may include, but is not limited to, a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a read-only memory (ROM), and a flash memory. Of course, the memory may also be located outside the device. Optionally, although not shown, the device may also include a communication unit, which may be used to communicate with other devices. In one example, the communication unit may be implemented in a suitable manner known in the art, such as including communication components such as an antenna array and / or a radio frequency link, various types of interfaces, communication units, etc. It will not be described in detail here. In addition, the device may also include other components not shown, such as a radio frequency link, a baseband processing unit, a network interface, a processor, a controller, etc. It will not be described in detail here.

[0131] Some embodiments of the present disclosure also provide an electronic device. Fig.10 Block diagrams of some embodiments of the electronic device of the present disclosure are shown. For example, in some embodiments, the electronic device 10 can be various types of devices, for example, can include but are not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. For example, the electronic device 10 can include a display panel for displaying data and / or execution results used in the scheme of the present disclosure. For example, the display panel can be in various shapes, such as a rectangular panel, an elliptical panel, or a polygonal panel, etc. In addition, the display panel can be not only a flat panel, but also a curved panel, or even a spherical panel.

[0132] like Fig.10As shown, the electronic device 10 of this embodiment includes: a memory 101 and a processor 102 coupled to the memory 101. It should be noted that Fig.10 The components of the electronic device 100 shown are only exemplary and non-limiting. The electronic device 100 may also have other components according to actual application requirements. The processor 102 may control other components in the electronic device 100 to perform desired functions.

[0133] In some embodiments, the memory 101 is used to store one or more computer-readable instructions. When the processor 102 is used to execute the computer-readable instructions, the computer-readable instructions are executed by the processor 102 to implement the method according to any of the above embodiments. For the specific implementation of each step of the method and related explanations, please refer to the above embodiments, and the repetitions will not be repeated here.

[0134] For example, the processor 102 and the memory 101 may communicate with each other directly or indirectly. For example, the processor 102 and the memory 101 may communicate with each other through a network. The network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 102 and the memory 101 may also communicate with each other through a system bus, which is not limited in the present disclosure.

[0135] For example, the processor 102 may be embodied as various appropriate processors, processing devices, etc., such as a central processing unit (CPU), a graphics processing unit (GPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The central processing unit (CPU) may be an X86 or ARM architecture, etc. For example, the memory 101 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The memory 101 may include, for example, a system memory, which may store, for example, an operating system, an application, a boot loader, a database, and other programs. Various applications and various data may also be stored in the storage medium.

[0136] In addition, according to some embodiments of the present disclosure, various operations / processes according to the present disclosure, when implemented by software and / or firmware, can be transmitted from a storage medium or a network to a computer system having a dedicated hardware structure, such as Fig.11 The computer system 1100 shown is installed with the programs constituting the software. When the various programs are installed, the computer system can perform various functions, including the functions described above. Fig.11 is a block diagram illustrating an example structure of a computer system that can be employed in an embodiment according to the present disclosure.

[0137] exist Fig.11 In the embodiment, a central processing unit (CPU) 1101 performs various processes according to a program stored in a read-only memory (ROM) 1102 or a program loaded from a storage section 1108 to a random access memory (RAM) 1103. In the RAM 1103, data required when the CPU 1101 performs various processes, etc., is also stored as needed. The central processing unit is merely exemplary, and it may also be other types of processors, such as the various processors described above. The ROM 1102, the RAM 1103, and the storage section 1108 may be various forms of computer-readable storage media, as described below. It should be noted that although Fig.11 ROM 1102, RAM 1103, and storage device 1108 are shown separately in FIG. 1 , but one or more of them may be combined or located in the same or different memory or storage modules.

[0138] The CPU 1101, the ROM 1102, and the RAM 1103 are connected to one another via a bus 1104. To the bus 1104, an input / output interface 1105 is also connected.

[0139] The following components are connected to the input / output interface 1105: an input portion 1106, such as a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output portion 1107, including a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage portion 1108, including a hard disk, a magnetic tape, etc.; and a communication portion 1109, including a network interface card such as a LAN card, a modem, etc. The communication portion 1109 allows communication processing to be performed via a network such as the Internet. It is easy to understand that although Fig.11 The various devices or modules in the electronic device 1100 are shown to communicate via the bus 1104, but they may also communicate via a network or other means, wherein the network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network.

[0140] A drive 1110 is also connected to the input / output interface 1105 as needed. A removable medium 1111 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is mounted on the drive 1110 as needed so that a computer program read therefrom is installed into the storage section 1108 as needed.

[0141] In the case where the above-described series of processing is implemented by software, a program constituting the software can be installed from a network such as the Internet or a storage medium such as the removable medium 1111 .

[0142] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 609, or installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the CPU 601, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0143] It should be noted that in the context of the present disclosure, a computer-readable medium may be a tangible medium that may contain or store a program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer-readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by an instruction execution system, device or device or used in combination with it. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0144] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0145] In some embodiments, a computer program is further provided, comprising: instructions, which, when executed by a processor, cause the processor to execute any of the methods of the above embodiments. For example, the instructions may be embodied as computer program codes.

[0146] In embodiments of the present disclosure, computer program codes for performing the operations of the present disclosure may be written in one or more programming languages ​​or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In situations involving a remote computer, the remote computer may be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet).

[0147] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0148] The modules, components or units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the names of the modules, components or units do not, in some cases, limit the modules, components or units themselves.

[0149] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0150] According to some embodiments of the present disclosure, a method for editing multimedia material is provided, comprising: displaying information of a first multimedia material in a first track according to the duration of the first multimedia material, and displaying information of a second multimedia material in a second track according to the duration of the second multimedia material, wherein the first multimedia material and the second multimedia material are multimedia materials to be synthesized, and the duration of the first multimedia material is greater than or equal to the duration of the second multimedia material; receiving a trigger operation of a user, wherein the trigger operation is used to trigger automatic selection of information of the first multimedia material; displaying a first selection area for automatic selection of information of the first multimedia material in the first track, wherein the range of the first selection area is aligned with the display range of information of the second multimedia material, and the duration of a segment of the first multimedia material corresponding to the range of the first selection area is equal to the duration of the second multimedia material.

[0151] In some embodiments, the method also includes: receiving a first adjustment operation of the user on the range of the first selection area; dynamically displaying the adjusted first selection area in the first track following the first adjustment operation, and displaying the second selection area dynamically adjusted along with the first selection area in the second track, wherein the range of the second selection area is dynamically aligned with the range of the first selection area.

[0152] In some embodiments, the method further includes: displaying a second selection area for selecting information of the second multimedia material in the second track, wherein a range of the first selection area is aligned with a range of the second selection area.

[0153] In some embodiments, the method also includes: receiving a second adjustment operation of the user on the range of the second selection area; dynamically displaying the adjusted second selection area in the second track following the second adjustment operation, and displaying the first selection area dynamically adjusted along with the second selection area in the first track, wherein the range of the first selection area is dynamically aligned with the range of the second selection area.

[0154] In some embodiments, the method also includes: receiving a user's operation of moving information of the first multimedia material in the first track relative to the first selection area; dynamically displaying the information of the first multimedia material moved relative to the first selection area in the first track, wherein the position of the first selection area relative to the first track remains unchanged.

[0155] In some embodiments, the method also includes: receiving a user's operation of moving information of the second multimedia material in the second track relative to the second selection area; dynamically displaying the information of the second multimedia material moved relative to the second selection area in the second track, wherein the position of the second selection area relative to the second track remains unchanged.

[0156] In some embodiments, displaying the first selection area includes: determining whether the first multimedia material is cropped; if the first multimedia material is not cropped, using the starting point of the first multimedia material as the starting point of the first selection area, and determining the ending point of the first selection area according to the ending point of the information of the second multimedia material; if the first multimedia material is cropped, using the starting point of the cropped first multimedia material as the starting point of the first selection area, and determining the ending point of the first selection area according to the starting point of the first selection area and the duration of the second multimedia material; and displaying the first selection area based on the starting point and ending point of the first selection area.

[0157] In some embodiments, the first selection area for automatically selecting information of the first multimedia material in the first track includes: partial information of the first multimedia material in the first selection area and partial information of the first multimedia material outside the first selection area are displayed with different display effects.

[0158] In some embodiments, the method further includes: receiving a user trigger operation for a preview function; and playing a multimedia material synthesized from a first segment of the first multimedia material and a second multimedia material corresponding to a range of the first selection area.

[0159] In some embodiments, the method further includes: receiving a user trigger operation for a preview function; playing a multimedia material synthesized from a first segment of a first multimedia material corresponding to a range of a first selection area and a second segment of a second multimedia material corresponding to a range of a second selection area.

[0160] In some embodiments, the method includes at least one of the following: dynamically displaying the playback progress of the first segment in the first track; and dynamically displaying the playback progress of the second segment in the second track.

[0161] In some embodiments, the method also includes: during playback, receiving a user adjustment operation on the range of the first selection area or the range of the second selection area; pausing playback and displaying the dynamically adjusted first selection area in the first track, and displaying the dynamically adjusted second selection area in the second track, wherein the range of the second selection area is dynamically aligned with the range of the first selection area.

[0162] In some embodiments, the method further includes at least one of the following: in response to the user adjusting the edge of the first selection area to the edge of the information of the first multimedia material, issuing a first prompt message; in response to the user adjusting the range of the first selection area to the first minimum range, issuing a second prompt message.

[0163] In some embodiments, the method further includes at least one of the following: issuing a third prompt message in response to the user adjusting the edge of the second selection area to the edge of the information of the second multimedia material; issuing a fourth prompt message in response to the user adjusting the range of the second selection area to the second minimum range.

[0164] In some embodiments, the method further includes: receiving a user trigger operation for a save function; and saving and displaying a multimedia material synthesized from a segment of the first multimedia material corresponding to the range of the first selection area and a segment of the corresponding second multimedia material.

[0165] In some embodiments, the first multimedia material is a video, audio, image or special effect material, and the second multimedia material is a video, audio, image or special effect material.

[0166] In some embodiments, the information of the first multimedia material includes: one or more images and at least one item of text corresponding to the first multimedia material; the information of the second multimedia material includes: one or more images and at least one item of text corresponding to the second multimedia material.

[0167] According to some other embodiments of the present disclosure, a multimedia material editing device is provided, comprising: a receiving module and a display module, wherein: the display module is configured to display information of a first multimedia material in a first track according to the duration of the first multimedia material, and to display information of a second multimedia material in a second track according to the duration of the second multimedia material, wherein the first multimedia material and the second multimedia material are multimedia materials to be synthesized, the duration of the first multimedia material is greater than or equal to the duration of the second multimedia material, and the information of the first multimedia material and the information of the second multimedia material are displayed in time correspondence; the receiving module is configured to receive a trigger operation of a user, wherein the trigger operation is used to trigger automatic selection of information of the first multimedia material; the display module is also configured to display a first selection area for automatic selection of information of the first multimedia material in the first track, wherein the range of the first selection area is aligned with the display range of the information of the second multimedia material.

[0168] According to some further embodiments of the present disclosure, an electronic device is provided, comprising: a processor; and a memory coupled to the processor, for storing instructions, which, when executed by the processor, causes the processor to execute a method for editing multimedia materials as described in any of the aforementioned embodiments.

[0169] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, wherein when the program is executed by a processor, the method for editing multimedia materials of any of the aforementioned embodiments is implemented.

[0170] According to some further embodiments of the present disclosure, a computer program is provided, comprising: instructions, which, when executed by a processor, cause the processor to execute the method for editing multimedia materials of any embodiment of the present disclosure.

[0171] According to some embodiments of the present disclosure, a computer program product is provided, comprising instructions, which, when executed by a processor, implement the method for editing multimedia materials of any embodiment of the present disclosure.

[0172] The above descriptions are only some embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, a technical solution formed by replacing the above features with the technical features with similar functions disclosed in the present disclosure (but not limited to).

[0173] In the description provided herein, many specific details are set forth. However, it is understood that embodiments of the present invention can be implemented without these specific details. In other cases, well-known methods, structures, and techniques are not presented in detail in order not to obscure the understanding of the description.

[0174] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0175] Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A method for editing multimedia material, comprising: Displaying information of the first multimedia material in a first track according to the duration of the first multimedia material, and displaying information of the second multimedia material in a second track according to the duration of the second multimedia material, wherein the first multimedia material and the second multimedia material are multimedia materials to be synthesized, and the duration of the first multimedia material is greater than or equal to the duration of the second multimedia material; Receiving a trigger operation from a user, wherein the trigger operation is used to trigger automatic selection of information of the first multimedia material; A first selection area automatically selected for information of the first multimedia material is displayed in the first track, wherein the range of the first selection area is aligned with the display range of information of the second multimedia material, and the duration of the segment of the first multimedia material corresponding to the range of the first selection area is equal to the duration of the second multimedia material.

2. The editing method according to claim 1, further comprising: receiving a first adjustment operation of the user on the range of the first selection area; A first selection area that is dynamically adjusted following the first adjustment operation is displayed in the first track, and a second selection area that is dynamically adjusted following the first selection area is displayed in the second track, wherein a range of the second selection area is dynamically aligned with a range of the first selection area.

3. The editing method according to claim 1, further comprising: A second selection area for selecting information of the second multimedia material is displayed in the second track, wherein a range of the first selection area is aligned with a range of the second selection area.

4. The editing method according to claim 3, further comprising: receiving a second adjustment operation of the user on the range of the second selection area; A second selection area that is dynamically adjusted following the second adjustment operation is displayed in the second track, and a first selection area that is dynamically adjusted following the second selection area is displayed in the first track, wherein a range of the first selection area is dynamically aligned with a range of the second selection area.

5. The editing method according to claim 1, further comprising: receiving a moving operation by the user on the information of the first multimedia material in the first track relative to the first selection area; The information of the first multimedia material moving relative to the first selection area is dynamically displayed in the first track, wherein the position of the first selection area relative to the first track remains unchanged.

6. The editing method according to claim 3, further comprising: receiving a moving operation by the user on the information of the second multimedia material in the second track relative to the second selection area; The information of the second multimedia material moving relative to the second selection area is dynamically displayed in the second track, wherein the position of the second selection area relative to the second track remains unchanged.

7. The editing method according to claim 1, wherein: The displaying of the first selection area comprises: Determining whether the first multimedia material is cropped; In the case where the first multimedia material has not been cut, taking the starting point of the first multimedia material as the starting point of the first selection area, and determining the ending point of the first selection area according to the ending point of the information of the second multimedia material; In the case where the first multimedia material is cropped, taking the starting point of the first multimedia material after cropping as the starting point of the first selection area, and determining the ending point of the first selection area according to the starting point of the first selection area and the duration of the second multimedia material; The first selection area is displayed based on the start point and the end point of the first selection area.

8. The editing method according to claim 1, wherein: The first selection area for automatically selecting information of the first multimedia material displayed in the first track includes: Part of the information of the first multimedia material within the first selection area and part of the information of the first multimedia material outside the first selection area are displayed with different display effects.

9. The editing method according to claim 1, further comprising: Receiving a trigger operation of the preview function by the user; Play the multimedia material synthesized from the first segment of the first multimedia material and the second multimedia material corresponding to the range of the first selection area.

10. The editing method according to any one of claims 2 to 4, further comprising: Receiving a trigger operation of the preview function by the user; Play the multimedia material synthesized by the first segment of the first multimedia material corresponding to the range of the first selection area and the second segment of the second multimedia material corresponding to the range of the second selection area.

11. The editing method according to claim 10, further comprising at least one of the following: Dynamically displaying the playback progress of the first segment in the first track; The playing progress of the second segment is dynamically displayed in the second track.

12. The editing method according to claim 11, further comprising: During the playback process, receiving an adjustment operation of the user on the range of the first selection area or the range of the second selection area; Pause the playback and display a dynamically adjusted first selection area in the first track, and display a dynamically adjusted second selection area in the second track, wherein the range of the second selection area is dynamically aligned with the range of the first selection area.

13. The editing method according to claim 2, further comprising at least one of the following: In response to the user adjusting the edge of the first selection area to the edge of the information of the first multimedia material, issuing a first prompt message; In response to the user adjusting the range of the first selection area to a first minimum range, a second prompt message is issued.

14. The editing method according to claim 4, further comprising at least one of the following: In response to the user adjusting the edge of the second selection area to the edge of the information of the second multimedia material, issuing a third prompt message; In response to the user adjusting the range of the second selection area to a second minimum range, a fourth prompt message is issued.

15. The editing method according to any one of claims 1 to 9, further comprising: Receiving a trigger operation of the user on a save function; The multimedia material synthesized by the segment of the first multimedia material corresponding to the range of the first selection area and the segment of the second multimedia material corresponding to the first selection area is saved and displayed.

16. The editing method according to any one of claims 1 to 9, wherein: The first multimedia material is a video, audio, image or special effect material, and the second multimedia material is a video, audio, image or special effect material.

17. The editing method according to any one of claims 1 to 9, wherein: The information of the first multimedia material includes: at least one of one or more images and texts corresponding to the first multimedia material; The information of the second multimedia material includes: at least one of one or more images and texts corresponding to the second multimedia material.

18. A multimedia material editing device, comprising: A receiving module and a display module, wherein: The display module is configured to display information of the first multimedia material in a first track according to the duration of the first multimedia material, and to display information of the second multimedia material in a second track according to the duration of the second multimedia material, wherein the first multimedia material and the second multimedia material are multimedia materials to be synthesized, the duration of the first multimedia material is greater than or equal to the duration of the second multimedia material, and the information of the first multimedia material and the information of the second multimedia material are displayed correspondingly in time; The receiving module is configured to receive a trigger operation of a user, wherein the trigger operation is used to trigger automatic selection of information of the first multimedia material; The display module is further configured to display a first selection area automatically selected for the information of the first multimedia material in the first track, wherein a range of the first selection area is aligned with a display range of the information of the second multimedia material.

19. An electronic device comprising: processor; as well as A memory coupled to the processor is used to store instructions, and when the instructions are executed by the processor, the processor executes the multimedia material editing method as described in any one of claims 1-17.

20. A computer-readable storage medium having a computer program stored thereon, wherein: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 17 are implemented.

Images