Composite fragment generation method and device, electronic equipment and readable medium

Abstract

The invention discloses a composite fragment generation method and device, electronic equipment and a readable medium, and the method comprises the steps: displaying a plurality of media fragments on a multimedia editing page; in response to a compound operation on the multiple media segments, generating a second draft and editing attribute information in the first draft of the multimedia editing, the editing attribute information being used for indicating an editing operation on the multiple media segments in the second draft; and on a multimedia editing page, presenting the second draft as the first composite fragment according to the editing attribute information, and replacing the plurality of media fragments. Therefore, the plurality of media segments are compounded into one composite segment by defining the bearing mode, namely sub-draft + editing attribute information, of the composite segment compounded by the plurality of media segments in a large draft of multimedia editing, and the composite segment replaces the plurality of media segments to be displayed on a page of multimedia editing. And convenience is provided for the user to realize uniform and rapid multimedia editing of a plurality of media segments.

Description

Technical Field

[0001] The present application relates to the field of media processing technology, and in particular to a method, device, electronic device and readable medium for generating a composite fragment. Background Art

[0002] In the process of multimedia editing, there is a need to perform unified operations on multiple media segments, for example, overall cropping, speed-doubling, etc. Current multimedia editing tools cannot perform unified operations on multiple media segments in the process of multimedia editing.

[0003] Based on this, there is an urgent need to provide a technical solution that can solve the problem of unified operation of multiple media segments during multimedia editing, so as to facilitate users to achieve fast multimedia editing. Summary of the invention

[0004] In order to solve the above technical problems, the present application provides a method, device, electronic device and readable medium for generating a composite fragment, which can combine multiple media fragments into a composite fragment. The composite fragment exists as a sub-draft and editing attribute information in the draft corresponding to the multimedia editing, so that it is possible to achieve unified operation of the multiple media fragments included in the composite fragment through operation on the composite fragment, which facilitates users to achieve fast multimedia editing.

[0005] In order to achieve the above objectives, the technical solutions provided by this application are as follows:

[0006] In a first aspect, the present application provides a method for generating a composite fragment, comprising:

[0007] Display multiple media clips on a multimedia editing page;

[0008] In response to the composite operation on the plurality of media segments, generating a second draft and editing attribute information in the first draft of the multimedia editing, wherein the editing attribute information is used to indicate the editing operation on the plurality of media segments in the second draft;

[0009] On the multimedia editing page, the second draft is presented as a first composite segment according to the editing attribute information, and replaces the multiple media segments.

[0010] In one implementation, the editing attribute information is carried in first segment information corresponding to the first composite segment, and the first segment information also includes a first material identifier, and the first material identifier is used to indicate the second draft in the material pool of the first draft.

[0011] In one implementation, the editing attribute information includes at least one of the following information: start time, end time, cropping, speed multiple, or displacement.

[0012] In one implementation, the method further includes:

[0013] In response to an editing operation on the first composite fragment, updating the editing attribute information;

[0014] On the multimedia editing page, the second draft is presented as a second composite segment according to the updated editing attribute information, and the first composite segment is replaced. The second composite segment is the same as the composite segment obtained by compounding the multiple media segments after the editing operation is performed.

[0015] In one implementation, the method further includes:

[0016] If it is determined that the first fragment information to which the editing attribute information belongs corresponds to a compound fragment, the editing effect screen corresponding to the first compound fragment is displayed on the player of the multimedia editing page based on the compound fragment editor, the editing attribute information and the second draft. The editing effect screen is used to reflect the effect after the first compound fragment is exported, and the compound fragment editor is a tool for rendering the second draft according to the editing attribute information.

[0017] In one implementation, the plurality of media segments include a plurality of single material segments;

[0018] Alternatively, the plurality of media segments include at least one single material segment and at least one composite segment;

[0019] Alternatively, the plurality of media segments include a plurality of composite segments.

[0020] In one implementation, the method further includes:

[0021] In response to the un-combining operation on the first composite segment, the multiple media segments are displayed on the multimedia editing page, and the first composite segment is replaced.

[0022] In a second aspect, the present application also provides a composite fragment generation device, comprising:

[0023] A first display unit, used for displaying a plurality of media clips on a multimedia editing page;

[0024] a generating unit, configured to generate, in response to a composite operation on the plurality of media segments, a second draft and editing attribute information in the first draft of the multimedia editing, wherein the editing attribute information is used to indicate the editing operation on the plurality of media segments in the second draft;

[0025] The second display unit is used to present the second draft as a first composite segment on the multimedia editing page according to the editing attribute information, and replace the multiple media segments.

[0026] In one implementation, the editing attribute information is carried in first segment information corresponding to the first composite segment, and the first segment information also includes a first material identifier, and the first material identifier is used to indicate the second draft in the material pool of the first draft.

[0027] In one implementation, the editing attribute information includes at least one of the following information: start time, end time, cropping, speed multiple, or displacement.

[0028] In one implementation, the device further includes:

[0029] an updating unit, configured to update the editing attribute information in response to an editing operation on the first composite fragment;

[0030] The third display unit is used to present the second draft as a second composite fragment on the multimedia editing page according to the updated editing attribute information, and replace the first composite fragment, wherein the second composite fragment is the same as the composite fragment obtained by compounding the multiple media fragments after the editing operation is implemented.

[0031] In one implementation, the device further includes:

[0032] The fourth display unit is used to display the editing effect screen corresponding to the first compound fragment on the player of the multimedia editing page based on the compound fragment editor, the editing attribute information and the second draft if it is determined that the first fragment information belonging to the editing attribute information corresponds to a compound fragment. The editing effect screen is used to reflect the effect of the first compound fragment after being exported, and the compound fragment editor is a tool for rendering the second draft according to the editing attribute information.

[0033] In one implementation, the plurality of media segments include a plurality of single material segments;

[0034] Alternatively, the plurality of media segments include at least one single material segment and at least one composite segment;

[0035] Alternatively, the plurality of media segments include a plurality of composite segments.

[0036] In one implementation, the device further includes:

[0037] A fifth display unit is used to display the multiple media segments on the multimedia editing page and replace the first composite segment in response to the uncomposite operation on the first composite segment.

[0038] It should be noted that the specific implementation method of the device and the technical effects achieved can refer to the relevant description of the method provided in the first aspect or any implementation method of the first aspect.

[0039] In a third aspect, the present application further provides an electronic device, the electronic device comprising: a processor and a memory;

[0040] The memory is used to store instructions or programs;

[0041] The processor is used to execute the instructions or programs in the memory so that the electronic device executes the method provided by the above-mentioned target aspect or any one of the implementations of the target aspect.

[0042] In a fourth aspect, the present application also provides a readable medium, in which instructions or programs are stored. When the instructions or programs are executed on a processor, the processor executes the method provided by the above-mentioned target aspect or any one of the implementations of the target aspect.

[0043] Compared with the prior art, the embodiments of the present application have at least the following advantages:

[0044] In the technical solution provided by the present application, a method for generating a composite segment is provided, which method may include, for example: displaying multiple media segments on a multimedia editing page; generating a second draft and editing attribute information in a first draft of the multimedia editing in response to a composite operation on the multiple media segments, the editing attribute information being used to indicate an editing operation on the multiple media segments in the second draft; presenting the second draft as a first composite segment on the multimedia editing page according to the editing attribute information, and replacing the multiple media segments. The second draft may be understood as a sub-draft nested in the first draft. In this way, by defining the carrying mode of the composite segment after the composite of multiple media segments in the large draft of the multimedia editing - sub-draft + editing attribute information, the multiple media segments displayed on the multimedia editing page can be composited into a composite segment, and the multiple media segments can be replaced on the multimedia editing page. Thus, the user can realize the unified operation of the multiple media segments included in the composite segment on the multimedia editing page by operating the composite segment, which provides convenience for the user to realize the unified and fast multimedia editing of multiple media segments. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0046] Figure 1 A schematic diagram of a multimedia editing page provided in an embodiment of the present application;

[0047] Figure 2 A schematic diagram of a process for generating a composite fragment provided in an embodiment of the present application;

[0048] Figure 3 A schematic diagram of another multimedia editing page provided in an embodiment of the present application;

[0049] Figure 4 A schematic diagram of the structure of a composite fragment generation device 400 provided in an embodiment of the present application;

[0050] Figure 5 A schematic diagram of the structure of an electronic device 500 provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] With the development of the Internet, the spread of multimedia files has enriched people's work and life. Before the spread of multimedia files, people usually use tools with multimedia editing functions to perform multimedia editing on the original media materials, for example, adding stickers, subtitles, background music, etc. to the original media materials, and for example, cutting and arranging each of the original multiple materials to obtain a better quality multimedia file and play the high-quality multimedia file.

[0052] In the process of multimedia editing, multiple media clips are usually displayed on the multimedia editing page, for example, see Figure 1 The multimedia editing page shown may include a title area, an editing area, and a player, wherein in the editing area, the first track includes text 1 or sticker 1, the second track includes background music 1 and background music 2, and the third track includes video 1. The title area may display, for example, the name of the multimedia editing tool and / or the name of the multimedia editing task, such as Figure 1As shown, the title area may display "Multimedia Editing Tool A. The player is used to display the editing effect screens of various materials, and the editing effect screens are used to reflect the effects of various materials after being exported. Currently, users can edit each media segment separately. However, in many scenarios, users need to perform unified operations on multiple media segments displayed on the page, for example, to uniformly speed up text 1 (or sticker 1), background music 1, background music 2, and video 1. According to the current multimedia editing method, text 1 (or sticker 1), background music 1, background music 2, and video 1 need to be speeded up separately, and the operation steps are numerous, which is not convenient for users.

[0053] Based on this, an embodiment of the present application provides a method for generating a composite segment, which may include, for example: displaying multiple media segments on a multimedia editing page; in response to a composite operation on the multiple media segments, generating a second draft and editing attribute information in a first draft of the multimedia editing, the editing attribute information being used to indicate an editing operation on the multiple media segments in the second draft; on the multimedia editing page, presenting the second draft as a first composite segment according to the editing attribute information, and replacing the multiple media segments. The second draft may be understood as a sub-draft nested in the first draft.

[0054] In this way, by defining the carrying mode of the composite segment after combining multiple media segments in the large draft of multimedia editing - sub-draft + editing attribute information, multiple media segments displayed on the multimedia editing page can be combined into one composite segment, and multiple media segments can be replaced and displayed on the multimedia editing page. Therefore, the user can realize unified operation of the multiple media segments included in the composite segment on the multimedia editing page by operating the composite segment, which provides convenience for the user to realize unified and fast multimedia editing of multiple media segments.

[0055] Still Figure 1Taking the multimedia editing page shown as an example, through the method provided in the embodiment of the present application, the user only needs to perform a composite operation on text 1 (or sticker 1), background music 1, background music 2 and video 1, obtain a composite segment 1 displayed on track n, and speed up the composite segment 1, so as to achieve a unified speed for text 1 (or sticker 1), background music 1, background music 2 and video 1, which is convenient for users to operate in multimedia editing. Track n can be the first track, the second track or the third track mentioned above, or any other track except the first track, the second track and the third track. Among them, the composite segment 1 is embodied in the draft 1 corresponding to the multimedia editing through sub-draft 2 and editing attribute information 2 and other information, and the sub-draft 2 includes the segment information corresponding to text 1 (or sticker 1), background music 1, background music 2 and video 1, and the editing attribute information 2 indicates the unified applicable editing operations of text 1 (or sticker 1), background music 1, background music 2 and video 1, such as speed, displacement, cropping, etc.

[0056] It should be noted that the subject implementing the composite segment generation method may be the composite segment generation device provided in the embodiment of the present application. The composite segment generation device may be carried in an electronic device or a functional module of an electronic device. The composite segment generation device may be a functional module on a tool with multimedia editing function (such as a multimedia editing client or website) that can implement the composite segment generation function provided in the embodiment of the present application.

[0057] Figure 2 The present invention provides a schematic flow chart of a method for generating a composite fragment according to an embodiment of the present invention. The method can be applied to a composite fragment generating device, which can be, for example, Figure 4 The composite fragment generating device 400 is shown.

[0058] like Figure 2 As shown, the method may include, for example, the following S101 to S103:

[0059] S101, displaying a plurality of media clips on a multimedia editing page.

[0060] Multimedia editing refers to the process in which a user edits original media materials (such as video or audio) to obtain a media file to be played. Multimedia editing may include but is not limited to editing at least one of the following materials: video, audio, text or stickers. Multimedia editing is usually achieved by a user performing editing operations in a multimedia editing task on a tool with multimedia editing functions (such as a video editing client). A multimedia editing page may refer to an editing page presented to a user by a tool with multimedia editing functions in a multimedia editing task.

[0061] In the multimedia editing tool, the user can create a multimedia editing task and open the corresponding multimedia editing page. The multimedia editing tool generates a project file in response to the creation of the multimedia editing task. The project file can be called a large draft (e.g., the first draft in S102). Then, the user can import multiple media clips on the same or different tracks of the multimedia editing page according to the editing needs of the multimedia editing task.

[0062] The multiple media segments may include multiple single material segments; the single material segments may include but are not limited to: video, audio, text or sticker. Alternatively, the multiple media segments may include at least one single material segment and at least one composite segment. Alternatively, the multiple media segments include multiple composite segments. In the embodiment of the present application, the composite segment may also be used as a material type to participate in the multimedia editing task.

[0063] On the multimedia editing page, users can edit each multimedia clip individually. Figure 1 Taking the multimedia editing page shown in the figure as an example, assuming that the first track includes text 1, at this time, the first draft corresponding to the multimedia editing task can be expressed as:

[0064] First Draft

[0065] material pool {

[0066] text1{materialid1:path1};

[0067] sticker1{materialid2:path2};

[0068] Background music 1{material id 3: path 3};

[0069] Background music 2 {material id4: path 4};

[0070] Video1{materialid5:path5}};

[0071] First track {

[0072] Segment 1 corresponding to text 1 {edit attribute information 1, material id: 1}};

[0073] Second track

[0074] Clip 3 corresponding to background music 1 {edit attribute information 3, material id: 3};

[0075] Clip 4 corresponding to background music 2 {edit attribute information 4, material id: 4}};

[0076] The third track

[0077] Clip 5 corresponding to video 1 {edit attribute information 5, material id: 5}}

[0078] }.

[0079] The segment information corresponding to the segment includes editing attribute information and material (identifier, id). The editing attribute information may be the editing operation of the corresponding segment indicated by the user. The editing attribute information may include, but is not limited to, at least one of the following information: start time, end time, cropping, speed or displacement. The material id is used to index in the material pool, obtain the path corresponding to the material id, and thus obtain the corresponding material from the path. The path may be, for example, a local path or a network path. If the material is stored locally, then the path corresponds to the local path where the material is stored; if the material corresponds to an online resource, then the path corresponds to the online acquisition link of the material, such as the uniform resource locator (Uniform Resource Locator, URL) for downloading or pulling the online resource.

[0080] It should be noted that at least two media segments among the multiple media segments are required to participate in the generation of the composite segment. The number of media segments participating in the generation of the composite segment does not affect the implementation of the composite segment generation method. The following description will be made by taking the above-mentioned multiple media segments in S101 all participating in the generation of the composite segment as an example.

[0081] It can be seen that in S101, multiple media segments are presented on the multimedia editing page, and all or part of these multimedia segments can be used as the data basis for generating a composite segment in the embodiment of the present application.

[0082] S102, in response to a compound operation on the multiple media segments, generating a second draft and editing attribute information in the first draft of the multimedia editing, wherein the editing attribute information is used to indicate the editing operation on the multiple media segments in the second draft.

[0083] In a possible implementation, the composite operation can be implemented by a control on the multimedia editing page corresponding to the composite function provided in the embodiment of the present application, and the control can be, for example, a "composite" button on the multimedia editing page. In one case, the user can click on the control to trigger S102 to perform a composite operation on multiple media segments displayed on the multimedia editing page, and then the composite operation can correspond to clicking on the control. In another case, the user can first select at least two media segments participating in the composite among the multiple media segments displayed on the multimedia editing page, and then click on the control to trigger S102 to perform a composite operation on the multiple media segments displayed on the multimedia editing page, and then the composite operation can correspond to selecting at least two media segments participating in the composite + clicking on the control.

[0084] In another possible implementation, the composite operation can be implemented by a shortcut key of the multimedia editor. In one case, the user can directly use the shortcut key to trigger S102 to perform a composite operation on multiple media segments displayed on the multimedia editor's page, and then the composite operation can correspond to the shortcut key. In another case, the user can first select at least two media segments participating in the composite among the multiple media segments displayed on the multimedia editor's page, and then use the shortcut key to trigger S102 to perform a composite operation on the multiple media segments displayed on the multimedia editor's page, and then the composite operation can correspond to selecting at least two media segments participating in the composite + using the shortcut key.

[0085] As an example, when it is determined that a composite operation of multiple media segments occurs, the composite segment generation device in the embodiment of the present application can generate the first segment information and the second draft corresponding to the first composite segment after the composite operation of the multiple media segments in the first draft. The second draft is a sub-draft of the first composite segment in the first draft, and the second draft includes the segment information of each media segment in the multiple media segments. The second draft can also include a material pool composed of the materials involved in the multiple media segments. The first segment information can include the editing attribute information of the first composite segment and the first material identifier, and the first material identifier is used to indicate the second draft in the material pool.

[0086] by Figure 1 Taking the multimedia editing page shown in the figure as an example, assuming that the first track includes text 1, when a composite operation is performed on multiple media segments, a composite segment 1 is obtained. In this case, the first draft corresponding to the multimedia editing task can be expressed as:

[0087] First Draft

[0088] material pool {

[0089] text1{materialid1:path1};

[0090] sticker1{materialid2:path2};

[0091] Background music 1{material id 3: path 3};

[0092] Background music 2 {material id4: path 4};

[0093] Video 1 {material id 5: path 5};

[0094] Draft {Material id 6: Second Draft};

[0095] Second Draft

[0096] Material pool {text1{material id 1: path1};

[0097] Background music 1{material id 3: path 3};

[0098] Background music 2 {material id4: path 4};

[0099] Video1{materialid5:path5}};

[0100] Segment 1 corresponding to text 1 {edit attribute information 1, material id: 1};

[0101] Clip 3 corresponding to background music 1 {edit attribute information 3, material id: 3};

[0102] Clip 4 corresponding to background music 2 {edit attribute information 4, material id: 4};

[0103] Clip 5 corresponding to video 1 {editing attribute information 5, material id: 5};

[0104] }};

[0105] First track {

[0106] Segment 1 corresponding to text 1 {edit attribute information 1, material id: 1}};

[0107] Second track

[0108] Clip 3 corresponding to background music 1 {edit attribute information 3, material id: 3};

[0109] Clip 4 corresponding to background music 2 {edit attribute information 4, material id: 4}};

[0110] The third track

[0111] Clip 5 corresponding to video 1 {edit attribute information 5, material id: 5}};

[0112] Track n {

[0113] Compound fragment 1 {edit attribute information 6, material id: 6}};

[0114] }.

[0115] The composite segment 1 includes editing attribute information 6 and material id 6. The editing attribute information 6 can be used to indicate the editing operation of each media segment in the second draft indicated by the material id 6. The editing attribute information 6 can include, for example, the start time, end time, cropping, multiple speed or displacement. The editing attribute information 6 can correspond to each media segment in the composite segment 1 respectively, which is equivalent to a unified definition of each media segment. The material id 6 is indexed in the material pool to obtain the second draft. Compared with a single material segment, the material id in the segment information of a single material segment is indexed in the material pool to obtain a path rather than a draft. The second draft can at least include the segment information of each media segment in the composite segment 1. In addition, it can also include a material pool composed of the materials involved in each media segment.

[0116] S103: On the multimedia editing page, present the second draft as a first composite segment according to the editing attribute information, and replace the multiple media segments.

[0117] After executing S102, for the multimedia editing page, the multiple composited media segments are replaced with the first composite segment, that is, the first composite segment is displayed on the multimedia editing page, and the multiple media segments are not displayed. As an example, on the multimedia editing page, the second draft can be presented as the first composite segment according to the editing attribute information of the first composite segment.

[0118] Corresponding to S101 Figure 1 For example, the multimedia editing page corresponding to S103 can be found in Figure 3 As shown, the first composite fragment (ie Figure 3 The first composite segment 1) is not displayed, and the plurality of media segments are not displayed. The first composite segment can be displayed on any track on the multimedia editing page, and the track can be preset, random, or determined based on a preset type of media segment (such as video) among the plurality of media segments. Figure 3 The first composite fragment is displayed in track n (i.e. Figure 1 The second track in () is used as an example to illustrate.

[0119] In some possible implementations, after the first composite segment is displayed on the multimedia editing page, the method can also implement unified operations on the multiple media segments by editing the first composite segment. As an example, after S103, the method can also include: in response to the editing operation on the first composite segment, updating the editing attribute information of the first composite segment; on the multimedia editing page, presenting the second draft as a second composite segment according to the updated editing attribute information, and replacing the first composite segment, the second composite segment is the same as the composite segment obtained by compounding the multiple media segments after the editing operation is performed. The editing operation on the first composite segment can include but is not limited to any one of the following operations: modifying the start time, modifying the end time, modifying the cropping parameters, modifying the speed parameters, or modifying the displacement parameters. It should be noted that the editing operation on the first composite segment can be implemented by the action layer of the tool that provides multimedia editing functions.

[0120] For example, assuming that the first compound fragment corresponds to the compound fragment 1 mentioned above, the editing operation on the first compound fragment causes the editing attribute information of the first compound fragment to be updated from editing attribute information 6 to editing attribute information 7 (such as changing the speed in editing attribute information 6 from 2 to 1.5), and the second compound fragment corresponds to the compound fragment 2 including the editing attribute information 7, then, compared with the first draft including the compound fragment 1 mentioned above, the first draft including the compound fragment 2 only modifies the content in the track n to: compound fragment 2 {editing attribute information 7, material id: 6}.

[0121] In some possible implementations, after the first compound segment is displayed on the multimedia editing page, the method can also release the first compound segment back into the multiple media segments by de-compounding the first compound segment. As an example, after S103, the method can also include: in response to the de-compounding operation on the first compound segment, displaying the multiple media segments on the multimedia editing page and replacing the first compound segment. In this way, in many scenarios, for example, when the user does not need to perform unified operations on the first compound segment, or when it is necessary to re-select more suitable media segments for compounding, the user is provided with the function of de-compounding the compound segment, so as to facilitate the user to better complete the multimedia editing task. It should be noted that the de-compounding operation on the first compound segment can be implemented by the Action layer of the tool that provides multimedia editing functions.

[0122] In some possible implementations, after the first composite fragment is displayed on the multimedia editing page, the method may further include: the driver layer renders the first composite fragment according to the second draft and the editing property information of the first composite fragment, so as to achieve the purpose of displaying the editing effect screen of the first composite fragment. In an embodiment of the present application, the tool providing multimedia editing functions may include a composite fragment editor for rendering composite fragments in addition to an editor for rendering single material fragments. As an example, after S103, the method may further include: if it is determined that the first fragment information to which the editing property information corresponding to the fragment to be rendered belongs corresponds to a composite fragment, then based on the composite fragment editor, the editing property information and the second draft, the editing effect screen corresponding to the first composite fragment is displayed on the player of the multimedia editing page, the editing effect screen is used to reflect the effect after the first composite fragment is exported, and the composite fragment editor is used to render the second draft according to the editing property information corresponding to the fragment to be rendered. If it is determined that the segment information corresponding to the editing attribute information of the segment to be rendered corresponds to a single material segment, then based on the editor corresponding to the single material segment, the editing attribute information and the material indicated by the path, the editing effect screen corresponding to the single material segment is displayed on the player of the multimedia editing page. The editing effect screen is used to reflect the effect after the single material segment is exported, and the editor corresponding to the single material segment is used to render the single material according to the editing attribute information corresponding to the segment to be rendered. The player of the multimedia editing page can be, for example, Figure 1 or Figure 3 The player indicated in .

[0123] It should be noted that to determine whether the fragment to be rendered is a composite fragment, the material identifier in the fragment information of the fragment to be rendered can be read, and whether the material identifier corresponds to a path or a draft in the material pool can be determined to determine whether the fragment to be rendered is a composite fragment. If the material identifier corresponds to a path in the material pool, it can be determined that the fragment to be rendered is a single material fragment. If the material identifier corresponds to a draft in the material pool, it can be determined that the fragment to be rendered is a composite fragment.

[0124] It can be seen that in this method, by defining the carrying mode of the composite segment after the composite of multiple media segments in the large draft of multimedia editing (i.e., sub-draft + editing attribute information), multiple media segments displayed on the multimedia editing page can be composited into one composite segment, and multiple media segments can be replaced and displayed on the multimedia editing page. Thus, the user can realize unified operation of the multiple media segments included in the composite segment on the multimedia editing page by operating the composite segment, which provides convenience for the user to realize unified and fast multimedia editing of multiple media segments.

[0125] Accordingly, the embodiment of the present application also provides a composite fragment generation device 400. Figure 4 As shown, the apparatus 400 may include:

[0126] A first display unit 401 is used to display multiple media clips on a multimedia editing page;

[0127] A generating unit 402, configured to generate a second draft and editing attribute information in the first draft of the multimedia editing in response to the composite operation on the plurality of media segments, wherein the editing attribute information is used to indicate the editing operation on the plurality of media segments in the second draft;

[0128] The second display unit 403 is used to present the second draft as a first composite segment on the multimedia editing page according to the editing attribute information, and replace the multiple media segments.

[0129] In one implementation, the editing attribute information is carried in first segment information corresponding to the first composite segment, and the first segment information also includes a first material identifier, and the first material identifier is used to indicate the second draft in the material pool of the first draft.

[0130] In one implementation, the editing attribute information includes at least one of the following information: start time, end time, cropping, speed multiple, or displacement.

[0131] In one implementation, the apparatus 400 further includes:

[0132] an updating unit, configured to update the editing attribute information in response to an editing operation on the first composite fragment;

[0133] The third display unit is used to present the second draft as a second composite fragment on the multimedia editing page according to the updated editing attribute information, and replace the first composite fragment, wherein the second composite fragment is the same as the composite fragment obtained by compounding the multiple media fragments after the editing operation is implemented.

[0134] In one implementation, the apparatus 400 further includes:

[0135] The fourth display unit is used to display the editing effect screen corresponding to the first compound fragment on the player of the multimedia editing page based on the compound fragment editor, the editing attribute information and the second draft if it is determined that the first fragment information belonging to the editing attribute information corresponds to a compound fragment. The editing effect screen is used to reflect the effect of the first compound fragment after being exported, and the compound fragment editor is a tool for rendering the second draft according to the editing attribute information.

[0136] In one implementation, the plurality of media segments include a plurality of single material segments;

[0137] Alternatively, the plurality of media segments include at least one single material segment and at least one composite segment;

[0138] Alternatively, the plurality of media segments include a plurality of composite segments.

[0139] In one implementation, the apparatus 400 further includes:

[0140] A fifth display unit is used to display the multiple media segments on the multimedia editing page and replace the first composite segment in response to the uncomposite operation on the first composite segment.

[0141] It should be noted that the specific implementation method of the device 400 and the technical effects achieved can be found in Figure 2 Description of the method shown.

[0142] In addition, an embodiment of the present application also provides an electronic device, which includes a processor and a memory: the memory is used to store instructions or computer programs; the processor is used to execute the instructions or computer programs in the memory, so that the electronic device executes any implementation of the method provided in the embodiment of the present application.

[0143] See also Figure 5 , which shows a schematic diagram of the structure of an electronic device 500 suitable for implementing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0144] like Figure 5As shown, the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0145] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 5 The electronic device 500 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0146] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0147] The electronic device provided by the embodiment of the present disclosure and the method provided by the above embodiment belong to the same inventive concept, and the technical details not fully described in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0148] The embodiment of the present application also provides a computer-readable medium, in which instructions or computer programs are stored. When the instructions or computer programs are executed on a device, the device executes any implementation of the method provided in the embodiment of the present application.

[0149] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0150] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (Hyper Text Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0151] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0152] The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device can execute the method.

[0153] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0154] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0155] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit / module does not, in some cases, constitute a limitation on the unit itself.

[0156] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0157] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0158] It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. For the system or device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description.

[0159] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0160] It should also be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0161] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0162] It should be noted that in the embodiments of the present application, user sensitive information is not involved, and user-related information is obtained, used and determined after user authorization. In one example, before obtaining user-related information, the corresponding interface displays prompt information related to obtaining data use authorization. The prompt information is based on relevant laws and regulations in an appropriate manner to inform the user of the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure, so that the user can determine whether to agree to the authorization based on the prompt information. It can be understood that the above notification and the process of obtaining user authorization are only illustrative and do not constitute a limitation on the implementation method of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation method of the present disclosure.

[0163] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for generating a composite fragment, characterized in that: include: Display multiple media clips on a multimedia editing page; In response to the composite operation on the plurality of media segments, generating a second draft and editing attribute information in the first draft of the multimedia editing, wherein the editing attribute information is used to indicate the editing operation on the plurality of media segments in the second draft; On the multimedia editing page, the second draft is presented as a first composite segment according to the editing attribute information, and replaces the multiple media segments.

2. The method according to claim 1, characterized in that The editing attribute information is carried in the first segment information corresponding to the first composite segment. The first segment information also includes a first material identifier, and the first material identifier is used to indicate the second draft in the material pool of the first draft.

3. The method according to claim 1 or 2, characterized in that: The editing attribute information includes at least one of the following information: start time, end time, cropping, speed or displacement.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: In response to an editing operation on the first composite fragment, updating the editing attribute information; On the multimedia editing page, the second draft is presented as a second composite segment according to the updated editing attribute information, and the first composite segment is replaced. The second composite segment is the same as the composite segment obtained by compounding the multiple media segments after the editing operation is performed.

5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: If it is determined that the first fragment information to which the editing attribute information belongs corresponds to a compound fragment, the editing effect screen corresponding to the first compound fragment is displayed on the player of the multimedia editing page based on the compound fragment editor, the editing attribute information and the second draft. The editing effect screen is used to reflect the effect after the first compound fragment is exported, and the compound fragment editor is a tool for rendering the second draft according to the editing attribute information.

6. The method according to any one of claims 1 to 5, characterized in that: The plurality of media segments include a plurality of single material segments; Alternatively, the plurality of media segments include at least one single material segment and at least one composite segment; Alternatively, the plurality of media segments include a plurality of composite segments.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: In response to the un-combining operation on the first composite segment, the multiple media segments are displayed on the multimedia editing page, and the first composite segment is replaced.

8. A composite fragment generating device, characterized in that: include: A first display unit, used for displaying a plurality of media clips on a multimedia editing page; a generating unit, configured to generate, in response to a composite operation on the plurality of media segments, a second draft and editing attribute information in the first draft of the multimedia editing, wherein the editing attribute information is used to indicate the editing operation on the plurality of media segments in the second draft; The second display unit is used to present the second draft as a first composite segment on the multimedia editing page according to the editing attribute information, and replace the multiple media segments.

9. An electronic device, characterized in that: The electronic device comprises: a processor and a memory; The memory is used to store instructions or programs; The processor is used to execute the instructions or programs in the memory so that the electronic device executes the method according to any one of claims 1 to 7.

10. A readable medium, characterized in that: The readable medium stores instructions or programs, and when the instructions or programs are executed on a processor, the processor is enabled to execute the method according to any one of claims 1 to 7.

Images