Multimedia resource processing method, device, equipment, medium and program product

Abstract

The present disclosure relates to a multimedia resource processing method, apparatus, device, storage medium, and program product, the method comprising: obtaining first multimedia data; wherein the first multimedia data comprises a first multimedia material and a second multimedia material; in response to a setting operation of an editing template, processing the first multimedia data to generate editing template data; the editing template data is used to generate second multimedia data based on a third multimedia material; the second multimedia data comprises the third multimedia material, the second multimedia material, and second editing information; wherein the third multimedia material is used to replace the first multimedia material; and the second editing information is used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to a target display position. The embodiments of the present disclosure improve the versatility of the template by setting the display effect of the second multimedia material.

Description

Technical Field

[0001] The present disclosure relates to the field of computer processing technology, and in particular to a multimedia resource processing method, apparatus, device, storage medium, and program product. Background Art

[0002] With the continuous development of computer technology, video editing technology has also been developing. Currently, a common way of video editing is to use a pre-released editing template on a video editing platform and directly apply the editing template to a user-uploaded main video to obtain a target video that interacts with the material in the editing template and the user-uploaded main video.

[0003] However, when creating the material elements in the editing template, they are customized according to the original video content of the editing template, and the main content of the video uploaded by the user is difficult to keep highly consistent with the original template, resulting in mismatched effects and greatly reducing the versatility of the editing template. Summary of the Invention

[0004] In order to solve the above technical problems, the embodiments of the present disclosure provide a multimedia resource processing method, device, equipment, medium and program product to add intelligent effect settings to the materials in the editing template and improve the versatility of the template.

[0005] In a first aspect, an embodiment of the present disclosure provides a multimedia resource processing method, including:

[0006] Acquiring first multimedia data; wherein the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information; the first editing information is used to at least indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track;

[0007] In response to the setting operation of the editing template, processing the first multimedia data to generate editing template data;

[0008] Wherein, the setting operation includes at least a first operation and a second operation;

[0009] The first operation is used to instruct to set the first multimedia material as a replaceable material;

[0010] The second operation is used to instruct to set the display position of the second multimedia material to be determined based on the recognition position of the target object;

[0011] The editing template data is used to generate second multimedia data based on a third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to a target display position, the target display position being determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponding to the first editing track segment, and the fourth editing track segment corresponding to the second editing track segment.

[0012] In a second aspect, an embodiment of the present disclosure provides a multimedia resource processing method, including:

[0013] Obtaining editing template data; wherein the editing template data is generated by processing the first multimedia data in response to a setting operation of the editing template; the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information; the editing information is used to at least indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track; the setting operation includes at least a first operation and a second operation; the first operation is used to indicate setting the first multimedia material as a replaceable material; the second operation is used to indicate setting a display position of the second multimedia material to be determined based on an identified position of a target object;

[0014] In response to an import operation of a third multimedia material, generating second multimedia data based on the third multimedia material and the editing template data;

[0015] Among them, the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0016] In a third aspect, an embodiment of the present disclosure provides a multimedia resource processing device, including:

[0017] A first multimedia data acquisition module is configured to acquire first multimedia data; wherein the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information; the first editing information is configured to at least indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material at an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track;

[0018] an editing template data generating module, configured to process the first multimedia data and generate editing template data in response to an editing template setting operation;

[0019] Wherein, the setting operation includes at least a first operation and a second operation;

[0020] The first operation is used to instruct to set the first multimedia material as a replaceable material;

[0021] The second operation is used to instruct to set the display position of the second multimedia material to be determined based on the recognition position of the target object;

[0022] The editing template data is used to generate second multimedia data based on a third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to a target display position, the target display position being determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponding to the first editing track segment, and the fourth editing track segment corresponding to the second editing track segment.

[0023] In a fourth aspect, an embodiment of the present disclosure provides a multimedia resource processing device, including:

[0024] An editing template data acquisition module is configured to acquire editing template data; wherein the editing template data is generated by processing the first multimedia data in response to an editing template setting operation; the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information; the editing information is configured to at least indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material at an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track; the setting operation includes at least a first operation and a second operation; the first operation is configured to indicate setting the first multimedia material as a replaceable material; and the second operation is configured to indicate setting a display position of the second multimedia material to be determined based on an identified position of a target object;

[0025] a second multimedia data generating module configured to generate second multimedia data based on the third multimedia material and the editing template data in response to an import operation of the third multimedia material;

[0026] Among them, the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0027] In a fifth aspect, an embodiment of the present disclosure provides an electronic device, comprising:

[0028] one or more processors;

[0029] a storage device for storing one or more programs;

[0030] When the one or more programs are executed by the one or more processors, the one or more processors implement the multimedia resource processing method as described in any one of the first aspects or the multimedia resource processing method as described in any one of the second aspects.

[0031] In a sixth aspect, an embodiment of the present disclosure provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, it implements the multimedia resource processing method as described in any one of the first aspects or the multimedia resource processing method as described in any one of the second aspects.

[0032] In the seventh aspect, an embodiment of the present disclosure provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, it implements the multimedia resource processing method as described in any one of the first aspect or the multimedia resource processing method as described in any one of the second aspect.

[0033] The embodiments of the present disclosure provide a multimedia resource processing method, apparatus, device, storage medium and program product, the method comprising: acquiring first multimedia data; wherein the first multimedia data comprises a first multimedia material, a second multimedia material and first editing information; the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, and the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track; in response to an editing template setting operation, processing the first multimedia data to generate editing template data; wherein the setting operation comprises at least a first operation and a second operation; the first operation is used to indicate that the first multimedia material is set as a replaceable material; the The second operation is used to indicate that the display position of the second multimedia material is set to be determined based on the identification position of the target object; the editing template data is used to generate the second multimedia data based on the third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment. The embodiment of the present disclosure adjusts the first multimedia data in response to the setting operation of the editing template, sets the display effect for the second multimedia material in the first multimedia data, thereby adding intelligent effect settings to the materials in the editing template and improving the versatility of the template. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0035] Figure 1 The following diagram shows an architecture diagram of a video production scenario provided by an embodiment of the present disclosure. Figure 2 A flowchart of a multimedia resource processing method according to an embodiment of the present disclosure;

[0036] Figure 3a A schematic diagram of multimedia material replacement settings in an embodiment of the present disclosure;

[0037] Figure 3b A schematic diagram of selecting a second multimedia material in an embodiment of the present disclosure;

[0038] Figure 4 A schematic diagram of selecting a display effect setting method in an embodiment of the present disclosure;

[0039] Figure 5 A schematic diagram of selecting a second target object in an embodiment of the present disclosure;

[0040] Figure 6a A schematic diagram of target key frame selection in an embodiment of the present disclosure;

[0041] Figure 6b A schematic diagram of the first target object selected in the embodiment of the present disclosure;

[0042] Figure 7a A schematic diagram showing a trajectory when it is a target key frame in an embodiment of the present disclosure;

[0043] Figure 7b A schematic diagram showing trajectories for multiple target key frames in an embodiment of the present disclosure;

[0044] Figure 8 A flowchart of a multimedia resource processing method according to an embodiment of the present disclosure;

[0045] Figure 9 Schematic diagram of the structure of a multimedia resource processing device according to an embodiment of the present disclosure;

[0046] Figure 10 Schematic diagram of the structure of a multimedia resource processing device according to an embodiment of the present disclosure;

[0047] Figure 11 Schematic diagram of the structure of an electronic device in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0048] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0049] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0050] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0051] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0052] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0053] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0054] Before further describing the embodiments of the present disclosure in detail, the nouns and terms involved in the embodiments of the present disclosure are explained. The nouns and terms involved in the embodiments of the present disclosure are subject to the following interpretations.

[0055] In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed can be in real time or with a set delay. Unless otherwise specified, there is no restriction on the order of execution of the multiple operations executed.

[0056] Figure 1FIG. 1 is a schematic diagram of a scenario that can be used to implement the multimedia resource processing method provided by the embodiment of the present disclosure. Figure 1 As shown, the system 100 may include multiple user terminals 110, a network 120, a server 130, and a database 140. For example, the system 100 may be used to implement the information delivery method described in any embodiment of the present disclosure.

[0057] It is understood that the user terminal 110 can be any other type of electronic device capable of performing data processing, which may include but is not limited to: mobile phones, stations, units, devices, multimedia computers, multimedia tablets, Internet nodes, communicators, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video equipment, etc.

[0058] Video players, digital cameras / camcorders, pointing devices, television receivers, radio broadcast receivers, e-reading devices, gaming devices, or any combination thereof, including accessories and peripherals for these devices, or any combination thereof.

[0059] The user can operate through the application installed on the user terminal 110, and the application transmits the user behavior data to the server 130 via the network 120. The user terminal 110 can also receive the data transmitted by the server 130 via the network 120. The embodiments of the present disclosure have no restrictions on the hardware system and software system of the user terminal 110. For example, the user terminal 110 can be based on a processor such as ARM or X86, can have input / output devices such as a camera, a touch screen, and a microphone, and can run an operating system such as Windows, iOS, Linux, Android, or Hongmeng OS.

[0060] User terminal 110 can implement the media resource processing method provided by the embodiments of the present disclosure by running a process or thread. In some examples, user terminal 110 can use its built-in application to execute the information delivery method. In other examples, user terminal 110 can execute the media resource processing method by calling an application stored externally on user terminal 110.

[0061] The network 120 may be a single network or a combination of at least two different networks. For example, the network 120 may include, but is not limited to, a local area network, a wide area network, a public network, a private network, or a combination of several thereof. The network 120 may be a computer network such as the Internet and / or various telecommunication networks (e.g., 3G / 4G / 5G mobile communication networks, Wi-Fi, Bluetooth, ZigBee, etc.), and the embodiments of the present disclosure are not limited thereto.

[0062] The server 130 can be a single server, a server group, or a cloud server, wherein the servers within the server group are connected via a wired or wireless network. A server group can be centralized, such as a data center, or distributed. The server 130 can be local or remote. The server 130 can communicate with the user terminal 110 via a wired or wireless network. The embodiments of the present disclosure do not limit the hardware system and software system of the server 130.

[0063] The database 140 can generally refer to a device with a storage function. The database 140 is mainly used to store various data used, generated and output by the user terminal 110 and the server 130 during work. The database 140 can be local or remote. The database 140 can include various memories, such as random access memory (RAM), read-only memory (ROM), etc. The storage devices mentioned above are just some examples, and the storage devices that can be used by the system 100 are not limited to these. The embodiments of the present disclosure do not limit the hardware system and software system of the database 140. For example, it can be a relational database or a non-relational database.

[0064] The database 140 may be connected or communicated with the server 130 or a portion thereof via the network 120 , or directly connected or communicated with the server 130 , or a combination of the two.

[0065] In some examples, database 140 may be a standalone device. In other examples, database 140 may be integrated into at least one of user terminal 110 and server 130. For example, database 140 may be located on user terminal 110 or on server 130. In another example, database 140 may be distributed, with a portion located on user terminal 110 and another portion located on server 130.

[0066] The multimedia resource processing method proposed in the embodiment of the present application will be described in detail below with reference to the accompanying drawings.

[0067] Figure 2 This is a flowchart of a multimedia resource processing method in an embodiment of the present disclosure. This embodiment is applicable to the case of generating a video editing template. The method can be executed by a multimedia resource processing device. The multimedia resource processing device can be implemented in software and / or hardware. The multimedia resource processing method can be performed by Figure 1 In the electronic device described in.

[0068] like Figure 2As shown, the multimedia resource processing method provided by the embodiment of the present disclosure mainly includes steps S101-S102.

[0069] S101. Obtain first multimedia data; wherein, the first multimedia data includes a first multimedia material, a second multimedia material and first editing information; the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, and the first editing track segment and the second editing track segment overlap in the timeline position of the video editing track.

[0070] In the disclosed embodiment, the first multimedia data can be understood as a video editing template draft generated by manual editing in a multi-track editor. The first multimedia data can be a template draft published by the platform or a template draft generated by a template creator through manual editing in a multi-track editor.

[0071] The first multimedia data includes a first multimedia material, a second multimedia material, and first editing information. The first multimedia material can be understood as background material included in the first multimedia data. In one possible embodiment of the present disclosure, the first multimedia material is a background video. The editing track containing the first multimedia material is the first editing track.

[0072] In one embodiment of the present disclosure, the second multimedia material includes stickers, picture-in-picture, and other materials, and the editing track where the second multimedia material resides is called the second editing track. The first multimedia data includes one or more second multimedia materials, for example, multiple stickers are added to a background video. Furthermore, each second multimedia material corresponds to a second editing track. If the first multimedia data includes multiple second multimedia materials, there are multiple second editing tracks.

[0073] In one embodiment of the present disclosure, the first editing information refers to a manual editing operation in a multi-track editor. Specifically, the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to the initial display position. Furthermore, the first editing information may also include speed changes, color adjustments, special effects, display positions, display tracks, and the like of the multimedia material. Among them, the initial display position is the position where the second multimedia material first appears in the first multimedia material. Furthermore, the time node corresponding to the initial display position in the first editing track segment is used as the start time of the second editing track segment corresponding to the second multimedia material.

[0074] In one embodiment of the present disclosure, the first editing track segment and the second editing track segment overlap in the timeline of the video editing track. Specifically, the timeline of the second editing track segment in the video editing track is shorter than the timeline of the first editing track segment in the video editing track. Furthermore, the timeline of the second editing track segment in the video editing track is a portion of the timeline of the first editing track segment in the video editing track.

[0075] S102: In response to the setting operation of the editing template, adjust the first multimedia data to generate editing template data.

[0076] In the disclosed embodiment, the above-mentioned editing template setting operation can be understood as an operation for setting the first editing information included in the first multimedia data. The setting operation in the editing template can adjust the first multimedia material in the first multimedia data, and can also set the display effect of the second multimedia material (stickers, picture-in-picture), etc. added to the first multimedia data. The editing template data refers to the editing template data obtained after the user adjusts the first editing information in the first multimedia data. The setting operation includes at least the first operation and the second operation.

[0077] In one embodiment of the present disclosure, the first operation is used to instruct to set the first multimedia material as a replaceable material, wherein the replaceable material can be understood as a method in which a user can delete the first multimedia material and then add a new multimedia material during the process of editing template data.

[0078] In an application scenario of the present disclosure, after deleting the first multimedia material (background video) included in the editing template data, a new multimedia material may be added as a new background video.

[0079] In one embodiment of the present disclosure, the editing template data is used to generate second multimedia data based on a third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to a target display position, the target display position being determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponding to the first editing track segment, and the fourth editing track segment corresponding to the second editing track segment.

[0080] The third multimedia material refers to the multimedia material imported by the user and intended for video editing, and the second multimedia data is multimedia data generated based on the third multimedia material and editing template data.

[0081] In one embodiment of the present disclosure, the display position of the second multimedia material in the video screen corresponding to the third multimedia material is determined by a target object in the third multimedia material, wherein the target determination is indicated by the second operation.

[0082] In the embodiment of the present disclosure, after the template creator manually edits the template draft in the multi-track editor, the template editing control is displayed in the template creation completion page, and in response to the trigger operation on the template editing control, the template editing page is displayed. Figure 3a As shown, the template editing page 20 includes a picture display area 21 and a material selection area 22. The picture display area 21 is used to display the video picture corresponding to the first multimedia material. The material selection area 22 is used to display all multimedia materials included in the first multimedia data, such as Figure 2 As shown, it may include background video, picture-in-picture material 1, picture-in-picture material 2, and picture-in-picture material 3.

[0083] In the embodiment of the present disclosure, in response to the user's selection operation on the material selection area 22, the material corresponding to the selection operation is used as the material for which the effect needs to be set for this editing; in response to the user's deletion operation on the material selection area 22, the second multimedia material corresponding to the deletion operation is deleted from the first multimedia data.

[0084] In the disclosed embodiment, in response to the template creator's selection operation for the second multimedia material (picture-in-picture material 1, picture-in-picture material 2, picture-in-picture material 3) in the material selection area 22, picture-in-picture material 1, picture-in-picture material 2, picture-in-picture material 3 are used as the second multimedia material for which the effect needs to be set for this template editing.

[0085] It should be noted that the "Display Effect Settings" entry is permanently displayed in the material selection area 22. This entry is displayed regardless of whether the replaceable picture-in-picture material clip or sticker clip is selected. Clicking this entry will enter the Display Effect Settings page. Furthermore, for users who have never clicked on "Display Effect Settings", a yellow dot will appear in the upper right corner of the "Display Effect Settings" entry. After clicking on it, the yellow dot disappears.

[0086] In the disclosed embodiment, the template creator can determine which multimedia materials can be set with effects, which multimedia materials can be replaced, and which multimedia materials cannot be set with effects based on their own choices. For example, in the disclosed embodiment, the main video can be replaced. Picture-in-picture material 1, picture-in-picture material 2, and picture-in-picture material 3 can be set with effects. Picture-in-picture materials not selected in the material selection area 22 cannot be set with effects.

[0087] In one embodiment of the present disclosure, in response to the operation of completing the material selection, at least one or more second multimedia materials (such as Figure 3b As shown, picture-in-picture material 1, picture-in-picture material 2, picture-in-picture material 3).

[0088] In one embodiment of the present disclosure, the second operation is used to indicate that the display position of the second multimedia material is set to be determined based on the identification position of the target object; the second operation is used to indicate that the display effect set for the second multimedia material in the first multimedia data is adjusted so that the display effect of the second multimedia material in the editing template data is set to be determined based on the identification position of the target object.

[0089] In an embodiment of the present disclosure, the second operation includes a second multimedia material selection operation and a display track adjustment operation. The second multimedia material selection operation is used to indicate a target second multimedia material whose display track needs to be adjusted from multiple second multimedia materials. The display track adjustment operation is used to indicate that the display track set for the target second multimedia material is adjusted.

[0090] like Figure 3b As shown, the template editing page displays the effects required for setting Picture-in-Picture (PIP) material 1, Picture-in-Picture (PIP) material 2, and Picture-in-Picture (PIP) material 3. The second multimedia material selection operation is used to select the second multimedia material for the effect currently being set. For example, in response to the selection operation for PIP material 1, PIP material 1 is selected as the target second multimedia material for adjusting the display trajectory. Then, a display trajectory adjustment operation is performed on PIP material 1 to adjust the display effect of PIP material 1.

[0091] like Figure 3b As shown, all the PIP material clips are displayed in a tiled manner in the material selection area 22, and a prompt text "You can add smart effects to the following materials" is displayed. By default, the first PIP material is selected as the PIP material to be set with the effect.

[0092] In one embodiment of the present disclosure, the second operation is specifically used to instruct to select a first method to process the second media material, wherein the first method refers to performing key frame animation processing on the second multimedia material.

[0093] In one embodiment of the present disclosure, the second operation is specifically used to indicate selecting a second method to process the second media material, wherein the second method refers to setting the display position of the second multimedia material to the identification position of the target object in the third multimedia material.

[0094] In the embodiment of the present disclosure, Figure 3b As shown, after selecting the picture-in-picture material 1 whose display effect needs to be adjusted, in response to the triggering operation of the display effect setting control, two selectable display effect setting modes are displayed (such as Figure 4 Furthermore, in response to a triggering operation on the display effect setting control, a smart effect selection panel is pulled up from the bottom, and the smart effect selection panel includes two selectable display effect setting methods. The smart effect selection panel also includes a prompt text and a close control. The prompt text reads "Select a smart effect for the current material" and the close control is used to collapse the current panel in response to the user operation.

[0095] In response to the selection operation for the first method, a key frame material editing page is displayed. In the key frame material editing page, the display effect set for the second multimedia material in the first multimedia data is adjusted by performing key frame animation processing on the second multimedia material.

[0096] Among them, the panel corresponding to the first method also includes a prompt text "Applicable to materials with added keyframes, set the motion path of the keyframes", and its display logic is: if there is no keyframe in the currently set second multimedia material, the setting panel will not be displayed; if there is a keyframe in the currently set second multimedia material, the setting panel will be displayed.

[0097] In response to the selection operation for the second mode, a material follow editing page is displayed, and in the material follow editing page, the display position of the second multimedia material in the third multimedia material is set to the recognition position of the target object in the third multimedia material.

[0098] Among them, the corresponding panel of the second method also includes a prompt text "Applicable to materials that need to continuously track the main body of the picture, set the object tracking object", and the display logic is: regardless of whether the currently set second multimedia material has key frames, the setting item will be displayed.

[0099] In one embodiment of the present disclosure, a second method for adjusting the display position of the second multimedia material is described in detail.

[0100] like Figure 5 As shown, the material follow editing page includes a target object selection area 51, and displays multiple objects that can be selected in the material follow editing page, for example: Figure 5 The cats and dogs described in the above can be selected as objects.

[0101] In one embodiment of the present disclosure, the second operation is specifically used to instruct to set the display position of the second multimedia material to the recognition position of the target object; the target display position is the recognition position of the target object in the third multimedia material.

[0102] In the embodiment of the present disclosure, template data of the intelligent tracking algorithm is set on the publishing side, and the algorithm needs to be applied to the picture-in-picture material and the video body set with the intelligent effect.

[0103] In the embodiment of the present disclosure, the intelligent tracking algorithm identifies the target object in the third multimedia material, and uses the identified position of the target object as the display position of the second multimedia material in the third multimedia material.

[0104] In one embodiment of the present disclosure, in response to a selection operation on an initial object, the initial object corresponding to the selection operation is determined as a target object. Specifically, multiple initial objects may be displayed, such as "cat," "dog," "pig," etc. In response to a user selecting "cat," "cat" is determined as the target object.

[0105] In one embodiment of the present disclosure, the location of a "cat" in the third multimedia material is identified and used as the display location of the second multimedia material. Specifically, for example, if the second multimedia material is a "crown," the "crown" is displayed at the location of the "cat" in the third multimedia material. As the location of the "cat" in the third multimedia material continues to move, the "crown" continues to move in line with the location of the "cat."

[0106] In the embodiment of the present disclosure, Figure 5 In response to the second target object setting completion operation, it is determined that the display effect setting of the second multimedia material is completed, and the page is jumped to the template editing page as shown in FIG3 , and the next second multimedia material for which the display effect needs to be set is selected.

[0107] In one embodiment of the present disclosure, a method for setting a display effect for the second multimedia material in the first multimedia data in a first manner is introduced.

[0108] In one embodiment of the present disclosure, the second editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the initial display position at the specified key frame; the second operation is specifically used to instruct that the display position of the second media material at the specified key frame is set to be determined based on the identification position of the target object; the fourth editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the target display position at the specified key frame.

[0109] The second editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on first display positions at multiple keyframes, wherein the multiple keyframes include designated keyframes and other keyframes, and the first display position at the designated keyframe is the initial display position;

[0110] In one embodiment of the present disclosure, the second operation is specifically used to instruct to select a target object from the multiple initial objects and set the display position of the second media material at the designated key frame to be determined based on the recognition position of the target object.

[0111] In the embodiment of the present disclosure, Figure 6a As shown, the keyframe material editing page includes a second editing track corresponding to the second multimedia material. In response to a selection operation on the second editing track, a specified keyframe is selected from the second editing track. After the specified keyframe is selected, multiple initial objects that can be selected are displayed in the keyframe material editing page, for example: Figure 6b The head and feet described in the above can both be selected as the initial object. Furthermore, for the selected object selection operation, the selected initial object is used as the target object, and the display position of the second multimedia material is set to the position where the target object is identified. For example, if the second multimedia material is a football and the target object is a foot, the display position of the football in the second multimedia material is set to the position of the foot in the specified keyframe.

[0112] Further, after the display position of the second multimedia material in the set key frame is set, jump to the Figure 6a In the keyframe selection page shown, reselect a new keyframe as the designated keyframe and perform subsequent setting operations.

[0113] In the disclosed embodiment, the keyframe selection page displays a prompt texting "Select a keyframe that touches the main image and set its position." When a specific keyframe is selected in the timeline, the keyframe is highlighted and automatically adsorbed and vibrated. The logic of the remaining tracks and the corresponding relationship in the preview area remain consistent with the editing project. When a specific keyframe is not selected in the timeline, the button is grayed out and unclickable. After releasing the button, the button automatically adsorbs to the nearest keyframe and selects it. After the target keyframe is selected, the corresponding image position of the specified keyframe is displayed.

[0114] In the embodiment of the present disclosure, Figure 6b As shown, the panel sets the position of the second multimedia material corresponding to the specified key frame in the picture (for example, feet). After setting, the display position of the second multimedia material in the specified key frame is the position of the target object in the specified key frame.

[0115] In one embodiment of the present disclosure, the second operation is specifically used to instruct that the designated key frame be selected from the multiple key frames and the display position of the second media material at the designated key frame be set to be determined based on the recognized position of the target object;

[0116] The fourth editing track fragment is specifically a fragment formed by performing key frame animation processing on the second multimedia material based on the second display positions at the multiple key frames, wherein the second display position at the specified key frame is the target display position, and the second display position at the other key frames is the first display position at the other key frames.

[0117] In one embodiment of the present disclosure, if the number of designated key frames for displaying the position is set to 1, it is only necessary to retain the key frame positions of the "starting point", "position setting point" and "end point", and the second multimedia material in each key frame can be moved at a constant speed between the key frames. Figure 7a If the number of key frames of the smart effect is set to > 1, the screen position information of all key frames must be retained, as shown below Figure 7b shown.

[0118] In one embodiment of the present disclosure, Figure 7a As shown, in the case of including multiple key frames, only one designated key frame is included, wherein the display position of the second multimedia material in the designated key frame is determined by the identification position of the target object in the third multimedia material, and the display positions in other key frames can be set voluntarily, for example: Figure 7aAs shown, the second multimedia material is displayed as "the location of the cat in the user's screen at the intelligent recognition point" in the designated keyframe. During video playback, the second multimedia material is moved at a constant speed from the starting point to the "location of the cat in the user's screen at the intelligent recognition point", and then to the "end point" at a constant speed. The "starting point" and "end point" are both locations outside the video screen.

[0119] In one embodiment of the present disclosure, Figure 7b As shown, in the case of including multiple key frames, only three designated key frames are included, wherein the display position of the second multimedia material in the designated key frames is determined by the identification position of the target object in the third multimedia material, for example: Figure 7b As shown, the display positions of the second multimedia material in the specified keyframe are the positions of the numbers 2, 3, and 4. During video playback, the second multimedia material is moved at a constant speed from the starting position to the position of the number 2, then to the position of the number 3, then to the position of the number 4, and finally to the "end point" position. The "starting point" and "end point" are both positions outside the video screen.

[0120] In the disclosed embodiment, after the target object selects a head, the preview area automatically switches to a video background of "people," and the location of the second multimedia material is displayed in the preview area. The second multimedia material is automatically positioned at the center of the "head" in the video background. In the disclosed embodiment, after the first target object selects a dog, the preview area automatically switches to a video background of "dog," and the second multimedia material is automatically positioned at the center of the "dog" in the video background. Furthermore, the duration of the playback progress bar in the preview area remains consistent with the duration of the current picture-in-picture material.

[0121] In the embodiment of the present disclosure, as shown in FIG7 , it is determined that the display effect setting of the second multimedia material is completed, and the page is jumped to the template editing page as shown in FIG3 , and the next second multimedia material for which the display effect needs to be set is selected.

[0122] In one embodiment of the present disclosure, the setting operation of the editing template also includes an editing information copying operation, and the editing information copying operation is used to indicate that the second editing information corresponding to the second multimedia material is copied to at least one or more fourth multimedia materials, so that the at least one or more fourth multimedia materials have the same editing information as the second multimedia material.

[0123] In the disclosed embodiment, if a display effect has been added to the second multimedia material, a list of display effects is displayed, with the display effect names including the first display effect and the second display effect. Added display effects can be deleted or copied to other second multimedia materials. The fourth multimedia material can be another multimedia material included in the first multimedia data that can be set with an effect, in addition to the second multimedia material.

[0124] In the embodiment of the present disclosure, when entering the smart effect setting page, the original video background of the template is displayed by default. Clicking the entrance (triggering operation for adding controls to the video) can pull up the switching list to select different video backgrounds. The duration of the sample video needs to be aligned with the original video through loop playback. If the second multimedia material does not add smart effects, the switching entrance will not be displayed, and only "My Video" will be displayed, where "My Video" is the main video in the first multimedia data, also known as the background video. Switching to the character video will replace the original template main video with the built-in character video. Switching to the cat video will replace the original template main video with the built-in pet cat video. Switching to the dog video will replace the original template main video with the built-in pet dog video.

[0125] In the disclosed embodiment, click the button to save the setting parameters, close the setting smart effect page, and return to the template editing page.

[0126] In the disclosed embodiment, two videos are prepared for each example video (one horizontal screen and one vertical screen). When switching, the example video of the corresponding proportion needs to be selected and displayed according to the horizontal and vertical screens of the template.

[0127] Among them, the automatic playback logic is that after switching the video, the preview area needs to automatically play the timeline content corresponding to the currently selected picture-in-picture material once.

[0128] In an embodiment of the present disclosure, the second multimedia data may be template draft data obtained by adjusting the first multimedia data. In another embodiment, the second multimedia data may be template draft data obtained by adjusting the first multimedia data, in response to video data generated based on the template draft data.

[0129] The present disclosure relates to a multimedia resource processing method, apparatus, device, storage medium and program product, the method comprising: acquiring first multimedia data; wherein the first multimedia data comprises a first multimedia material, a second multimedia material and first editing information; the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track; in response to an editing template setting operation, processing the first multimedia data to generate editing template data; wherein the setting operation comprises at least a first operation and a second operation; the first operation is used to indicate that the first multimedia material is set as a replaceable material; the second operation The operation is used to indicate that the display position of the second multimedia material is set to be determined based on the identification position of the target object; the editing template data is used to generate the second multimedia data based on the third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment. The embodiment of the present disclosure adjusts the first multimedia data in response to the setting operation of the editing template, sets the display effect for the second multimedia material in the first multimedia data, thereby adding intelligent effect settings to the materials in the editing template and improving the versatility of the template.

[0130] Figure 8 This is a flowchart of a multimedia resource processing method in an embodiment of the present disclosure. This embodiment is applicable to the case of using video templates to edit videos. The method can be executed by a multimedia resource processing device, which can be implemented in software and / or hardware. Figure 1 In the electronic device described in.

[0131] like Figure 8 As shown, the multimedia resource processing method provided in the embodiment of the present disclosure includes steps S201-S202.

[0132] S201. Obtain editing template data; wherein, the editing template data is generated by processing the first multimedia data in response to a setting operation of the editing template; the first multimedia data includes a first multimedia material, a second multimedia material and a first editing information; the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, and the first editing track segment and the second editing track segment overlap in the timeline position of the video editing track; the setting operation includes at least a first operation and a second operation; the first operation is used to indicate that the first multimedia material is set to be a replaceable material; the second operation is used to indicate that the display position of the second multimedia material is set to be determined based on the identification position of the target object.

[0133] In one embodiment of the present disclosure, the editing template data includes the editing template data generated as in the above embodiment. For the description of the editing template data, reference may be made to the description in the above embodiment, which will not be repeated in the embodiment of the present disclosure.

[0134] In one embodiment of the present disclosure, the editing template data is template data publicly released by the editing template data producer. The method of obtaining the editing template data includes: the user obtains the published editing template data from a public platform and imports the editing template data into the video editor.

[0135] S202: In response to an import operation of a third multimedia material, second multimedia data is generated based on the third multimedia material and the editing template data. The third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information; the second editing information is used to indicate at least a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material at a target display position, the target display position being determined based on the identified position of the target object in the third multimedia material; the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0136] In one embodiment of the present disclosure, the third multimedia material is a multimedia material imported by a user and intended to be edited.

[0137] In one embodiment of the present disclosure, the second editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the initial display position at the specified key frame; the second operation is specifically used to instruct that the display position of the second media material at the specified key frame is set to be determined based on the identification position of the target object; the fourth editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the target display position at the specified key frame.

[0138] In one embodiment of the present disclosure, the identification position of the target object in the designated key of the third multimedia material is identified, and the identification position of the target object is set as the position of the second multimedia material in the first editing track segment. Figure 7a As shown, the second multimedia material is displayed at the position of the number 3 in the designated keyframe. In the fourth editing track segment, the second multimedia material is moved at a constant speed from the starting position to the position of the number 3, and then to the "end point" position. The "starting point" and "end point" are both locations outside the video screen.

[0139] In one embodiment of the present disclosure, the second operation is specifically used to instruct to set the display position of the second multimedia material to the recognition position of the target object; the target display position is the recognition position of the target object in the third multimedia material.

[0140] In one embodiment of the present disclosure, the position of a target object in the third multimedia material is identified and used as the display position of the second multimedia material. Specifically, if the second multimedia material is a "crown," the "crown" is displayed at the position of the "cat" in the third multimedia material. As the position of the "cat" in the third multimedia material continues to move, the "crown" continues to move in line with the position of the "cat."

[0141] Figure 9 This is a schematic diagram of the structure of a multimedia resource processing device in an embodiment of the present disclosure. This embodiment is applicable to the case of generating video templates. The multimedia resource processing device can be implemented in software and / or hardware. The multimedia resource processing device can be configured to Figure 1 In the electronic device described in.

[0142] like Figure 9 As shown, the multimedia resource processing device 90 provided by the embodiment of the present disclosure mainly includes: a first multimedia data acquisition module 91 and an editing template data generation module 92.

[0143] Among them, the first multimedia data acquisition module 91 is used to acquire first multimedia data; wherein, the first multimedia data includes a first multimedia material, a second multimedia material and a first editing information; the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, and the first editing track segment and the second editing track segment overlap in the timeline position of the video editing track; the editing template data generation module 92 is used to process the first multimedia data in response to the setting operation of the editing template and generate editing template data; wherein, the setting operation includes at least a first operation and a second operation; the first operation is used to indicate that the first multimedia material is set as a replaceable material; the second operation is used to indicate that the first multimedia material is set as a replaceable material; In the indication, the display position of the second multimedia material is set to be determined based on the identification position of the target object; the editing template data is used to generate second multimedia data based on the third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0144] In one embodiment of the present disclosure, the second editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the initial display position at the specified key frame; the second operation is specifically used to instruct that the display position of the second media material at the specified key frame is set to be determined based on the identification position of the target object; the fourth editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the target display position at the specified key frame.

[0145] In one embodiment of the present disclosure, the second editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the first display positions at multiple key frames, wherein the multiple key frames include designated key frames and other key frames, and the first display position at the designated key frame is the initial display position; the second operation is specifically used to indicate that the designated key frame is selected from the multiple key frames and the display position of the second media material at the designated key frame is set to be determined based on the identification position of the target object; the fourth editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the second display positions at the multiple key frames, wherein the second display position at the designated key frame is the target display position, and the second display position at the other key frames is the first display position at the other key frames.

[0146] In one embodiment of the present disclosure, the second operation is specifically used to instruct to select a first method to process the second media material, wherein the first method refers to performing key frame animation processing on the second multimedia material.

[0147] In one embodiment of the present disclosure, the second operation is specifically used to instruct to set the display position of the second multimedia material to the recognition position of the target object; the target display position is the recognition position of the target object in the third multimedia material.

[0148] In one embodiment of the present disclosure, the second operation is specifically used to indicate selecting a second method to process the second media material, wherein the second method refers to setting the display position of the second multimedia material to the identification position of the target object in the third multimedia material.

[0149] In one embodiment of the present disclosure, the second operation is specifically used to instruct to select a target object from the multiple initial objects and set the display position of the second media material at the designated key frame to be determined based on the recognition position of the target object.

[0150] In one embodiment of the present disclosure, the setting operation of the editing template also includes an editing information copying operation, and the editing information copying operation is used to indicate that the second editing information corresponding to the second multimedia material is copied to at least one or more fourth multimedia materials, so that the at least one or more fourth multimedia materials have the same editing information as the second multimedia material.

[0151] The multimedia resource processing device provided in the embodiment of the present disclosure can execute the steps executed in the multimedia resource processing method provided in the method embodiment of the present disclosure, and the execution steps and beneficial effects are not repeated here.

[0152] Figure 10 This is a structural diagram of a multimedia resource processing device in an embodiment of the present disclosure. This embodiment is applicable to the case where a video template is used to edit a video. The multimedia resource processing device can be implemented in software and / or hardware. The multimedia resource processing device can be configured to Figure 1 In the electronic device described in.

[0153] like Figure 10 As shown, the multimedia resource processing device provided in the embodiment of the present disclosure mainly includes: an editing template data acquisition module 101 and a second multimedia data generation module 102.

[0154] Among them, the editing template data acquisition module 101 is used to obtain editing template data; wherein, the editing template data is generated by processing the first multimedia data in response to the setting operation of the editing template; the first multimedia data includes a first multimedia material, a second multimedia material and a first editing information; the editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to the initial display position, and the first editing track segment and the second editing track segment overlap in the timeline position of the video editing track; the setting operation includes at least a first operation and a second operation; the first operation is used to indicate that the first multimedia material is set to be a replaceable material; the second operation is used to indicate that the display position of the second multimedia material is set to be based on The identification position of the target object is determined; a second multimedia data generation module is used to generate second multimedia data based on the third multimedia material and the editing template data in response to the import operation of the third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0155] In one embodiment of the present disclosure, the second editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the initial display position at the specified key frame; the second operation is specifically used to instruct that the display position of the second media material at the specified key frame is set to be determined based on the identification position of the target object; the fourth editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the target display position at the specified key frame.

[0156] In one embodiment of the present disclosure, the second operation is specifically used to instruct to set the display position of the second multimedia material to the recognition position of the target object; the target display position is the recognition position of the target object in the third multimedia material.

[0157] The multimedia resource processing device provided in the embodiment of the present disclosure can execute the steps executed in the multimedia resource processing method provided in the method embodiment of the present disclosure, and the execution steps and beneficial effects are not repeated here.

[0158] Figure 11 This is a schematic diagram of the structure of an electronic device in the embodiment of the present disclosure. Figure 11 , which shows a schematic structural diagram of an electronic device 1100 suitable for implementing the embodiments of the present disclosure. The electronic device 1100 in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), wearable terminal devices, and the like, as well as fixed terminals such as digital TVs, desktop computers, smart home devices, and the like. Figure 11 The electronic device shown is only an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0159] like Figure 11 As shown, the electronic device 1100 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1101, which can perform various appropriate actions and processes to implement the multimedia resource processing method of the embodiment described in the present disclosure according to the program stored in the read-only memory (ROM) 1102 or the program loaded from the storage device 1108 to the random access memory (RAM) 1103. Various programs and data required for the operation of the terminal device 1100 are also stored in the RAM 1103. The processing device 1101, the ROM 1102, and the RAM 1103 are connected to each other via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0160] Typically, the following devices may be connected to the I / O interface 1105: an input device 1106 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1107 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1108 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1109. The communication device 1109 may allow the terminal device 1100 to communicate with other devices wirelessly or by wire to exchange data. Figure 11 The terminal device 1100 is shown as having various devices, but it should be understood that it is not required to implement or possess all of the devices shown, and more or fewer devices may be implemented or possessed instead.

[0161] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart, thereby implementing the multimedia resource processing method as described above. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1109, or installed from the storage device 1108, or installed from the ROM 1102. When the computer program is executed by the processing device 1101, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0162] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0163] In some embodiments, the client and server can communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0164] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0165] The computer-readable medium carries one or more programs, and when the one or more programs are executed by the terminal device, the terminal device is enabled to: obtain first multimedia data; wherein the first multimedia data includes a first multimedia material, a second multimedia material and first editing information; the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, and the first editing track segment and the second editing track segment overlap in the timeline position of the video editing track; in response to an editing template setting operation, the first multimedia data is processed to generate editing template data; wherein the setting operation includes at least a first operation and a second operation; the first operation is used to indicate that the first multimedia material is set as a replaceable material ; The second operation is used to indicate that the display position of the second multimedia material is set to be determined based on the identification position of the target object; the editing template data is used to generate second multimedia data based on the third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0166] Optionally, when the above one or more programs are executed by the terminal device, the terminal device may also execute other steps described in the above embodiment.

[0167] The computer-readable medium carries one or more programs, and when the one or more programs are executed by the terminal device, the terminal device is enabled to: obtain editing template data; wherein the editing template data is generated by processing the first multimedia data in response to the setting operation of the editing template; the first multimedia data includes a first multimedia material, a second multimedia material and a first editing information; the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, and the first editing track segment and the second editing track segment overlap in the timeline position of the video editing track; the setting operation includes at least a first operation and a second operation; the first operation is used to indicate that the first multimedia material is set as a replaceable material; the second operation is used to indicate that Indicates that the display position of the second multimedia material is set to be determined based on the identification position of the target object; in response to the import operation of the third multimedia material, second multimedia data is generated based on the third multimedia material and the editing template data; wherein, the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0168] Optionally, when the above one or more programs are executed by the terminal device, the terminal device may also execute other steps described in the above embodiment.

[0169] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0170] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0171] The units involved in the embodiments described in this disclosure may be implemented in software or hardware, wherein the name of a unit does not necessarily limit the unit itself.

[0172] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0173] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0174] According to one or more embodiments of the present disclosure, the present disclosure provides a multimedia resource processing method, comprising: acquiring first multimedia data; wherein the first multimedia data comprises a first multimedia material, a second multimedia material and first editing information; the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track; in response to an editing template setting operation, processing the first multimedia data to generate editing template data; wherein the setting operation comprises at least a first operation and a second operation; the first operation is used to indicate that the first multimedia material is set as a replaceable material; the second operation Used to indicate that the display position of the second multimedia material is set to be determined based on the identification position of the target object; the editing template data is used to generate second multimedia data based on the third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0175] According to one or more embodiments of the present disclosure, the present disclosure provides a multimedia resource processing method, comprising: obtaining editing template data; wherein the editing template data is generated by processing the first multimedia data in response to a setting operation of the editing template; the first multimedia data comprises a first multimedia material, a second multimedia material and first editing information; the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track; the setting operation comprises at least a first operation and a second operation; the first operation is used to indicate that the first multimedia material is set as a replaceable material; the second operation is used to indicate that the first multimedia material is set as a replaceable material The display position of the second multimedia material is set to be determined based on the identification position of the target object; in response to the import operation of the third multimedia material, the second multimedia data is generated based on the third multimedia material and the editing template data; wherein, the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0176] According to one or more embodiments of the present disclosure, the present disclosure provides a multimedia resource processing device, comprising: a first multimedia data acquisition module for acquiring first multimedia data; wherein the first multimedia data includes a first multimedia material, a second multimedia material and first editing information; the first editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, and the first editing track segment and the second editing track segment overlap in the timeline position of a video editing track; an editing template data generation module for processing the first multimedia data in response to an editing template setting operation to generate editing template data; wherein the setting operation includes at least a first operation and a second operation; the first operation is used to indicate setting the first multimedia material to is a replaceable material; the second operation is used to indicate that the display position of the second multimedia material is set to be determined based on the identification position of the target object; the editing template data is used to generate second multimedia data based on the third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0177] According to one or more embodiments of the present disclosure, the present disclosure provides a multimedia resource processing device, including: an editing template data acquisition module for acquiring editing template data; wherein the editing template data is generated by processing the first multimedia data in response to a setting operation of the editing template; the first multimedia data includes a first multimedia material, a second multimedia material and a first editing information; the editing information is at least used to indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, and the first editing track segment and the second editing track segment overlap in the timeline position of the video editing track; the setting operation includes at least a first operation and a second operation; the first operation is used to indicate that the first multimedia material is set as a replaceable material; the second operation is used to indicate that the second The display position of the multimedia material is set to be determined based on the identification position of the target object; the second multimedia data generation module is used to generate second multimedia data based on the third multimedia material and the editing template data in response to the import operation of the third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

[0178] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, including:

[0179] one or more processors;

[0180] a memory for storing one or more programs;

[0181] When the one or more programs are executed by the one or more processors, the one or more processors implement any multimedia resource processing method provided in the present disclosure.

[0182] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any multimedia resource processing method provided by the present disclosure.

[0183] An embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are executed by a processor, the multimedia resource processing method described above is implemented.

[0184] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0185] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0186] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A multimedia resource processing method, characterized in that: include: Acquiring first multimedia data; wherein the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information; the first editing information is used to at least indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track; In response to the setting operation of the editing template, processing the first multimedia data to generate editing template data; Wherein, the setting operation includes at least a first operation and a second operation; The first operation is used to instruct to set the first multimedia material as a replaceable material; The second operation is used to instruct to set the display position of the second multimedia material to be determined based on the recognition position of the target object; The editing template data is used to generate second multimedia data based on a third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to a target display position, the target display position being determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponding to the first editing track segment, and the fourth editing track segment corresponding to the second editing track segment.

2. The method according to claim 1, characterized in that The second editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the initial display position at the designated keyframe; The second operation is specifically used to instruct to set the display position of the second multimedia material at the specified key frame to be determined based on the recognition position of the target object; The fourth editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the target display position at the designated keyframe.

3. The method according to claim 2, characterized in that The second editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on first display positions at multiple keyframes, wherein the multiple keyframes include designated keyframes and other keyframes, and the first display position at the designated keyframe is the initial display position; The second operation is specifically used to instruct to select the designated key frame from the multiple key frames and set the display position of the second multimedia material at the designated key frame to be determined based on the recognition position of the target object; The fourth editing track fragment is specifically a fragment formed by performing key frame animation processing on the second multimedia material based on the second display positions at the multiple key frames, wherein the second display position at the specified key frame is the target display position, and the second display position at the other key frames is the first display position at the other key frames.

4. The method according to claim 2, characterized in that The second operation is specifically used to instruct to select a first method to process the second multimedia material, wherein the first method refers to performing key frame animation processing on the second multimedia material.

5. The method according to claim 1, wherein The second operation is specifically used to instruct to set the display position of the second multimedia material to the recognition position of the target object; The target display position is the identification position of the target object in the third multimedia material.

6. The method according to claim 5, characterized in that The second operation is specifically used to instruct to select a second method to process the second multimedia material, wherein the second method refers to setting the display position of the second multimedia material to the identification position of the target object in the third multimedia material.

7. The method according to claim 1, characterized in that The second operation is specifically used to indicate that a target object is selected from multiple initial objects and a display position of the second multimedia material at a specified key frame is set to be determined based on the recognition position of the target object.

8. The method according to claim 1, characterized in that The setting operation of the editing template also includes an editing information copying operation, which is used to instruct to copy the second editing information corresponding to the second multimedia material to at least one or more fourth multimedia materials, so that the at least one or more fourth multimedia materials have the same editing information as the second multimedia material.

9. A multimedia resource processing method, characterized in that: include: Obtaining editing template data; wherein the editing template data is generated by processing first multimedia data in response to a setting operation of the editing template; the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information; the first editing information is used to at least indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material according to an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track; the setting operation includes at least a first operation and a second operation; the first operation is used to indicate setting the first multimedia material as a replaceable material; the second operation is used to indicate setting a display position of the second multimedia material to be determined based on an identified position of a target object; In response to an import operation of a third multimedia material, generating second multimedia data based on the third multimedia material and the editing template data; Among them, the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

10. The method according to claim 9, characterized in that The second editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the initial display position at the designated keyframe; The second operation is specifically used to instruct to set the display position of the second multimedia material at the specified key frame to be determined based on the recognition position of the target object; The fourth editing track segment is specifically a segment formed by performing keyframe animation processing on the second multimedia material based on the target display position at the designated keyframe.

11. The method according to claim 9, characterized in that The second operation is specifically used to instruct to set the display position of the second multimedia material to the recognition position of the target object; The target display position is the identification position of the target object in the third multimedia material.

12. A multimedia resource processing device, characterized in that: include: A first multimedia data acquisition module is configured to acquire first multimedia data; wherein the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information; the first editing information is configured to at least indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material at an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track; an editing template data generating module, configured to process the first multimedia data and generate editing template data in response to an editing template setting operation; Wherein, the setting operation includes at least a first operation and a second operation; The first operation is used to instruct to set the first multimedia material as a replaceable material; The second operation is used to instruct to set the display position of the second multimedia material to be determined based on the recognition position of the target object; The editing template data is used to generate second multimedia data based on a third multimedia material; wherein the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to a target display position, the target display position being determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponding to the first editing track segment, and the fourth editing track segment corresponding to the second editing track segment.

13. A multimedia resource processing device, characterized in that: include: An editing template data acquisition module is configured to acquire editing template data; wherein the editing template data is generated by processing first multimedia data in response to an editing template setting operation; the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information; the editing information is configured to at least indicate a first editing track segment formed based on the first multimedia material and a second editing track segment formed based on the second multimedia material at an initial display position, wherein the first editing track segment and the second editing track segment overlap in a timeline position of a video editing track; the setting operation includes at least a first operation and a second operation; the first operation is configured to indicate setting the first multimedia material as a replaceable material; and the second operation is configured to indicate setting a display position of the second multimedia material to be determined based on an identified position of a target object; a second multimedia data generating module configured to generate second multimedia data based on the third multimedia material and the editing template data in response to an import operation of the third multimedia material; Among them, the third multimedia material is used to replace the first multimedia material; the second multimedia data includes the third multimedia material, the second multimedia material and the second editing information; the second editing information is at least used to indicate a third editing track segment formed based on the third multimedia material and a fourth editing track segment formed based on the second multimedia material according to the target display position, the target display position is determined based on the identification position of the target object in the third multimedia material, the third editing track segment corresponds to the first editing track segment, and the fourth editing track segment corresponds to the second editing track segment.

14. An electronic device, characterized in that: The electronic device comprises: one or more processors; a storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the multimedia resource processing method according to any one of claims 1 to 11.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the multimedia resource processing method according to any one of claims 1 to 11 is implemented.

16. A computer program product, comprising a computer program or instructions, wherein when the computer program or instructions are executed by a processor, the method for processing multimedia resources according to any one of claims 1 to 11 is implemented.

Images