Multimedia resource processing method, apparatus, device, medium and program product

Abstract

The present disclosure provides a multimedia resource processing method, apparatus, device, storage medium and program product, the method including: acquiring first multimedia data, the first multimedia data including a first multimedia material and a second multimedia material; processing the first multimedia data to generate editing template data in response to an editing template setting operation; and editing the template data to generate second multimedia data based on a third multimedia material, the second multimedia data including a third multimedia material, a second multimedia material and a second editing information, the third multimedia material is used to replace the first multimedia material, and the second editing information is used to indicate a third editing track clip formed based on the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material. The embodiments of the present disclosure improve the versatility of the template by setting the display effect of the second multimedia material.

Description

Technical Field

[0001] [Cross - Reference to Related Applications] This application was filed on April 4, 2023, and claims the priority of a Chinese patent application for invention with the title "Multimedia Resource Processing Method, Apparatus, Device, Medium and Program Product" and application number 202310355910.0. All the contents of the said application are incorporated herein by reference.

[0002] [Technical Field] The present disclosure relates to the technical field of computer processing, and particularly to a multimedia resource processing method, apparatus, device, storage medium and program product.

Background Art

[0003] With the continuous development of computer technology, video editing technology has also been continuously evolving. Currently, commonly used video editing is to use editing templates published on a video editing platform, directly apply the editing template to the target video uploaded by the user, and obtain a target video in which the materials in the editing template interact with the target video uploaded by the user.

[0004] However, since the material elements included in the editing template are customized according to the original video content at the time of creating the editing template, it is difficult to maintain a high consistency between the main content of the video uploaded by the user and the original template. As a result, the effect cannot be obtained correctly, and there is a problem that the versatility of the editing template is greatly reduced.

Summary of the Invention

[0005] To solve the above technical problems, embodiments of the present disclosure provide a multimedia resource processing method, apparatus, device, medium and program product, which can add intelligent effect settings to the materials in the editing template and improve the versatility of the template.

[0006] According to a first aspect, an embodiment of the present disclosure provides a multimedia resource processing method, obtaining first multimedia data, wherein the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, the first editing information is used to indicate a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, and the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track; responding to a setting operation of an editing template, processing the first multimedia data to generate editing template data. The setting operation includes at least a first operation and a second operation. The first operation is used to indicate setting the first multimedia material as a replaceable material. The second operation is used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object. The editing template data is used to generate second multimedia data based on a third multimedia material, the third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, the second editing information is used to indicate a third editing track clip formed based on at least the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on the recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0007] According to a second aspect, embodiments of the present disclosure provide a multimedia resource processing method, acquiring editing template data, where the editing template data is generated by processing the first multimedia data in response to a setting operation of an editing template, the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, the editing information is used to indicate a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track, the setting operation includes at least a first operation and a second operation, the first operation is used to indicate setting the first multimedia material as a replaceable material, and the second operation is used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object; and generating second multimedia data based on the third multimedia material and the editing template data in response to an introduction operation of a third multimedia material. The third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, the second editing information is used to indicate a third editing track clip formed based on at least the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on a recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0008] According to a third aspect, an embodiment of the present disclosure provides a multimedia resource processing apparatus, a first multimedia data acquisition module for acquiring first multimedia data, where the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, and the first editing information is used to indicate a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, and the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track, the first multimedia data acquisition module; an editing template data generation module for processing the first multimedia data in response to a setting operation of an editing template to generate editing template data. The setting operation includes at least a first operation and a second operation. The first operation is used to indicate setting the first multimedia material as a replaceable material. The second operation is used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object. The editing template data is used to generate second multimedia data based on third multimedia materials. The third multimedia materials are used to replace the first multimedia materials. The second multimedia data includes the third multimedia materials, the second multimedia materials, and second editing information. The second editing information is used to instruct a third editing track clip formed based at least on the third multimedia materials and a fourth editing track clip formed according to a target display position based on the second multimedia materials. The target display position is determined based on a recognition position of a target object in the third multimedia materials. The third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0009] According to a fourth aspect, an embodiment of the present disclosure provides a multimedia resource processing apparatus, an editing template data acquisition module for acquiring editing template data, where the editing template data is generated by processing the first multimedia data in response to a setting operation of an editing template. The first multimedia data includes a first multimedia material, a second multimedia material, and first editing information. The editing information is used to instruct a first editing track clip formed based at least on the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material. The first editing track clip and the second editing track clip overlap at a timeline position of a video editing track. The setting operation includes at least a first operation and a second operation. The first operation is used to instruct setting the first multimedia material as a replaceable material. The second operation is used to instruct setting to determine a display position of the second multimedia material based on a recognition position of a target object. In response to an operation for introducing a third multimedia material, a second multimedia data generation module for generating second multimedia data based on the third multimedia material and the editing template data, and the third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, the second editing information is used to indicate at least a third editing track clip formed based on the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on a recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0010] According to a fifth aspect, an embodiment of the present disclosure provides an electronic device, and the electronic device includes one or more processors, and a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors are caused to execute the multimedia resource processing method described in any one of the first aspects or the multimedia resource processing method described in any one of the second aspects.

[0011] According to a sixth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which a computer program is stored, and when the program is executed by a processor, the multimedia resource processing method described in any one of the first aspects or the multimedia resource processing method described in any one of the second aspects is implemented.

[0012] According to a seventh aspect, an embodiment of the present disclosure provides a computer program product, the computer program product including a computer program or instructions, and when the computer program or instructions are executed by a processor, the multimedia resource processing method described in any one of the first aspects or the multimedia resource processing method described in any one of the second aspects is implemented.

[0013] Embodiments of the present disclosure provide a multimedia resource processing method, apparatus, device, storage medium, and program product. The method includes: obtaining first multimedia data, where the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, and the first editing information is used to indicate a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, and the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track; in response to a setting operation of an editing template, processing the first multimedia data to generate editing template data, where the setting operation includes at least a first operation and a second operation, the first operation is used to indicate setting the first multimedia material as a replaceable material, and the second operation is used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object. The editing template data is used to generate second multimedia data based on a third multimedia material, where the third multimedia material is used to replace the first multimedia material, and the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information. The second editing information is used to indicate a third editing track clip formed based on at least the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on the recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.Embodiments of the present disclosure can set a display effect for a second multimedia material in the first multimedia data by adjusting the first multimedia data in response to a setting operation of an editing template, add an intelligent effect setting to the materials in the editing template, and improve the versatility of the template.

Brief Description of the Drawings

[0014] In conjunction with the accompanying drawings, by referring to the following specific embodiments, the above and other features, advantages and aspects of each embodiment of the present disclosure will become clearer. Throughout the accompanying drawings, the same or similar reference numerals indicate the same or similar elements. It should be understood that the accompanying drawings are schematic diagrams and the devices and elements are not necessarily drawn to scale.

[0015]

Figure 1

Figure 2

Figure 3a

Figure 3b

Figure 4

Figure 5

Figure 6a

Figure 6b

Figure 7a

Figure 7b

Figure 8

Figure 9

Figure 10

Figure 11

Embodiments for Carrying Out the Invention

[0016] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the accompanying drawings, the present disclosure can be implemented in various forms and is not limited to the embodiments here. It should be understood that these embodiments are used to more thoroughly and completely understand the present disclosure. It should be understood that the accompanying drawings and embodiments of the present disclosure are only used for illustrative purposes and are not intended to limit the protection scope of the present disclosure.

[0017] It should be understood that each step described in the method embodiments of the present disclosure may be executed in a different order and / or in parallel. Furthermore, method embodiments can add steps and / or omit the steps shown. The scope of the present disclosure is not particularly limited in this regard.

[0018] The term "including" and its variants used in this specification are open-ended, that is, it means "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment", the term "another embodiment" means "at least one other embodiment", and the term "some embodiments" means "at least some embodiments". Related definitions of other terms are shown in the following description.

[0019] It should be noted that concepts such as "first" and "second" mentioned in the present disclosure are used to distinguish different devices, modules or units, and are not used to define the order or interdependence of functions executed by these devices, modules or units.

[0020] It should be noted that the modifiers "one" and "a plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that they should be understood as "one or more" unless otherwise explicitly stated in the context.

[0021] The names of messages or information that interact between multiple devices in the embodiments of the present disclosure are used only for illustrative purposes and are not intended to limit the scope of these messages or information.

[0022] Before explaining the embodiments of the present disclosure in more detail, nouns and terms related to the embodiments of the present disclosure will be explained, and the nouns and terms related to the embodiments of the present disclosure may be applied to the following interpretations.

[0023] Correspondingly, the dependent conditions or states of the executed operations are displayed, and when the dependent conditions or states are satisfied, one or more of the executed operations may be in real time or there may be a set delay. Unless otherwise specified, the order of the multiple executed operations is not particularly limited.

[0024] FIG. 1 is a schematic scenario diagram of a multimedia resource processing method provided by an embodiment that may be applied to the implementation of the present disclosure. As shown in FIG. 1, the system 100 may include a plurality of user terminals 110, a network 120, a server 130, and a database 140. For example, the system 100 may be used to implement the information distribution method described in any embodiment of the present disclosure.

[0025] Note that the user terminal 110 may be any other type of electronic device capable of executing data processing, including but not limited to mobile phones, stations, units, devices, multimedia computers, multimedia tablets, Internet nodes, communicators, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / video cameras, locator devices, television receivers, radio broadcast receivers, e-book devices, game devices, or any combination thereof, accessories and peripheral devices including those devices, or any combination thereof.

[0026] The user can operate through the application program installed on the user terminal 110. The application program transmits the user's operation data to the server 130 through the network 120, and the user terminal 110 can also receive the data transmitted from the server 130 through the network 120. In the embodiments of the present disclosure, the hardware system and software system of the user terminal 110 are not particularly limited. For example, the user terminal 110 may be based on a processor such as ARM or X86, and may be provided with input / output devices such as a camera, a touch screen, and a microphone. It may also operate on an operating system such as Windows, iOS, Linux (registered trademark), Android, or Harmony OS.

[0027] The user terminal 110 can implement the media resource processing method provided by the embodiments of the present disclosure by executing a process or a thread. In some examples, the user terminal 110 can execute an information distribution method by means of a built-in application program. In some other examples, the user terminal 110 can call an application program stored outside the user terminal 110 to execute the media resource processing method.

[0028] The network 120 may be a single network or a combination of at least two different networks. For example, the network 120 includes, but is not limited to, one or a combination of a local area network, a wide area network, a public network, and a private network. The network 120 may be a computer network of the Internet and / or various telecommunication networks (such as 3G / 4G / 5G mobile communication networks, WIFI, Bluetooth (registered trademark), ZigBee, etc.), and is not particularly limited in the embodiments of the present disclosure.

[0029] The server 130 may be a single server, a server cluster, or a cloud server. Each server in the server cluster may be connected via a wired or wireless network. The server cluster may be centralized such as a data center or decentralized. The server 130 may be local or remote. The server 130 can communicate with the user terminal 110 via a wired or wireless network. In the embodiments of the present disclosure, the hardware system and software system of the server 130 are not limited.

[0030] Database 140 may generally refer to a device having a storage function. Database 140 is mainly used to store various data that the user terminal 110 and the server 130 utilize, generate, and output during their operations. Database 140 may be local or remote. Database 140 may include various memories such as Random Access Memory (RAM) and Read Only Memory (ROM). The above-described storage devices are merely examples, and the storage devices that can be used in the system 100 are not limited thereto. In the embodiments of the present disclosure, the hardware system and software system of the database 140 are not limited, and for example, it may be a relational database or a non-relational database.

[0031] Database 140 may be connected or communicate with the server 130 or a part thereof via the network 120, or may be directly connected or communicate with the server 130, or may be a combination thereof.

[0032] In some examples, database 140 may be an independent device. In some other examples, database 140 may be integrated into at least one of the user terminal 110 and the server 130. For example, database 140 may be set in the user terminal 110 or may be set in the server 130. Also, for example, database 140 may be distributed such that a part of it is set in the user terminal 110 and another part is set in the server 130.

[0033] Hereinafter, with reference to the accompanying drawings, the multimedia resource processing method provided by the embodiments of the present application will be described in detail.

[0034] FIG. 2 is a flowchart of a multimedia resource processing method according to an embodiment of the present disclosure. This embodiment may be applicable when generating a video editing template. The method may be executed by a multimedia resource processing device, which may be implemented by software and / or hardware. The multimedia resource processing method may also be executed by the electronic device described in FIG. 1.

[0035] As shown in FIG. 2, the multimedia resource processing method provided by the embodiment of the present disclosure mainly includes steps S101 to S102.

[0036] S101. Obtain first multimedia data, where the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information. The first editing information is used to instruct a first editing track clip formed based at least on the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material. The first editing track clip and the second editing track clip overlap at a timeline position of a video editing track.

[0037] In the embodiment of the present disclosure, the above first multimedia data may be understood as a draft of a video editing template generated by a manual editing operation in a multi-track editor. The above first multimedia data may be a template draft posted by a platform, or may be a template draft generated by a manual editing operation of a template creator in a multi-track editor.

[0038] The first multimedia data includes a first multimedia material, a second multimedia material, and first editing information. The first multimedia material may be understood as a background material included in the first multimedia data. In a possible embodiment of the present disclosure, the first multimedia material is a background video. The editing track where the first multimedia material is located is the first editing track.

[0039] In an embodiment of the present disclosure, the second multimedia material includes materials such as stickers and picture-in-picture. The editing track where the second multimedia material is located is the second editing track. The first multimedia data includes one or more second multimedia materials. For example, a plurality of stickers are added to the background video. Further, one second multimedia material corresponds to one second editing track. When the first multimedia data includes a plurality of second multimedia materials, there are a plurality of second editing tracks.

[0040] In an embodiment of the present disclosure, the first editing information refers to a manual editing operation in a multi-track editor. Specifically, the first editing information is used to instruct a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to the initial display position based on the second multimedia material. Further, the first editing information may include speed change, color mixing, special effects, display position, display track, etc. of the multimedia material. The initial display position refers to the position of the second multimedia material that first appears in the first multimedia material. Further, the time node corresponding to the initial display position in the first editing track clip is used as the start time of the second editing track clip corresponding to the second multimedia material.

[0041] In one embodiment of the present disclosure, the first editing track clip and the second editing track clip overlap at the timeline position of the video editing track. Specifically, the timeline of the second editing track clip in the video editing track is smaller than the timeline of the first editing track clip in the video editing track. Further, the timeline of the second editing track clip in the video editing track is a part of the timeline of the first editing track clip in the video editing track.

[0042] S102. In response to the setting operation of the editing template, adjust the first multimedia data to generate editing template data.

[0043] In an embodiment of the present disclosure, it may be understood that the above setting operation of the editing template is an operation set for the first editing information included in the first multimedia data. The setting operation in the editing template may be an operation for adjusting the first multimedia material in the first multimedia data, or may be an operation for setting display effects such as the second multimedia material (sticker, picture-in-picture) added to the first multimedia data. The editing template data is editing template data obtained by the user adjusting the first editing information in the first multimedia data. The setting operation includes at least a first operation and a second operation.

[0044] In one embodiment of the present disclosure, the first operation is used to instruct to set the first multimedia material as a replaceable material. The replaceable material may be understood as a new multimedia material that may be added after the first multimedia material is deleted during the process of the user using the editing template data.

[0045] In one application scenario of the present disclosure, after deleting the first multimedia material (background video) included in the editing template data, a new multimedia material may be added as a new background video.

[0046] In one embodiment of the present disclosure, the editing template data is used to generate second multimedia data based on third multimedia materials, the third multimedia materials are used to replace the first multimedia materials, the second multimedia data includes the third multimedia materials, the second multimedia materials and second editing information, and the second editing information is used to indicate at least a third editing track clip formed based on the third multimedia materials and a fourth editing track clip formed according to a target display position based on the second multimedia materials. The target display position is determined based on the recognition position of the target object in the third multimedia materials. The third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0047] The third multimedia materials are multimedia materials introduced by a user for the purpose of video editing, and the second multimedia data is multimedia data generated based on the third multimedia materials and editing template data.

[0048] In one embodiment of the present disclosure, the display position of the second multimedia materials in the video screen corresponding to the third multimedia materials is determined by the target object in the third multimedia materials. The target determination is indicated by a second operation.

[0049] In an embodiment of the present disclosure, after a template creator generates a template draft through a manual editing operation in a multi-track editor, a template editing control is displayed on a template creation completion page, and in response to a trigger operation on the template editing control, a template editing page is displayed. As shown in FIG. 3a, the template editing page 20 includes a screen display area 21 and a material selection area 22. The screen display area 21 is used to display a video screen corresponding to a first multimedia material. The material selection area 22 is used to display all multimedia materials included in the first multimedia data, and as shown in FIG. 2, may include a background video, picture-in-picture material 1, picture-in-picture material 2, and picture-in-picture material 3.

[0050] In an embodiment of the present disclosure, in response to a user's selection operation on the material selection area 22, the material corresponding to the selection operation is used as a material that needs to set an effect in the current editing, and in response to a user's deletion operation on the material selection area 22, the second multimedia material corresponding to the deletion operation is deleted from the first multimedia data.

[0051] In an embodiment of the present disclosure, in response to a selection operation of the template creator on the second multimedia materials (picture-in-picture material 1, picture-in-picture material 2, picture-in-picture material 3) in the material selection area 22, picture-in-picture material 1, picture-in-picture material 2, and picture-in-picture material 3 are used as the second multimedia materials that need to set an effect in the current template editing.

[0052] In addition, the "Display Effect Setting" entry is fixedly displayed in the material selection area 22. Regardless of whether a replaceable picture-in-picture material clip or sticker clip is checked, the entry is displayed. Click on the entry to enter the display effect setting page. Further, for a user who has not clicked on "Display Effect Setting", a yellow dot is displayed in the upper right corner of the "Display Effect Setting" entry, and the yellow dot disappears after clicking on the entry to enter it.

[0053] In the embodiments of the present disclosure, according to the selection of the template creator, it is possible to determine which multimedia material to set an effect on, which multimedia material to replace, and which multimedia material not to set an effect on. For example, in the embodiments of the present disclosure, the main video can be replaced. Effects can be set on picture-in-picture material 1, picture-in-picture material 2, and picture-in-picture material 3. Effects cannot be set on picture-in-picture materials not selected in the material selection area 22.

[0054] In one embodiment of the present disclosure, in response to an operation of completing the material selection, at least one or a plurality of second multimedia materials (picture-in-picture material 1, picture-in-picture material 2, picture-in-picture material 3 as shown in FIG. 3b) selected in the material selection area 22 and which need to have an effect set are displayed.

[0055] In one embodiment of the present disclosure, the second operation is used to instruct to set the display position of the second multimedia material based on the recognition position of the target object, and the second operation is used to adjust the display effect set on the second multimedia material in the first multimedia data, and the display effect of the second multimedia material in the edited template data is set to be determined based on the recognition position of the target object.

[0056] In an embodiment of the present disclosure, the second operation includes a second multimedia material selection operation and a display track adjustment operation. The second multimedia material selection operation is an operation for selecting a target second multimedia material for which it is necessary to adjust the display track from a plurality of second multimedia materials, and the display track adjustment operation is used to adjust the display track set for the target second multimedia material.

[0057] As shown in FIG. 3b, on the template editing page, picture-in-picture material 1, picture-in-picture material 2, and picture-in-picture material 3 for which it is necessary to set effects are displayed. The second multimedia material selection operation is an operation for selecting a second multimedia material for which it is necessary to set a current effect. For example, in response to a selection operation on picture-in-picture material 1, picture-in-picture material 1 is used as a target second multimedia material for which it is necessary to adjust the display track. Thereafter, for picture-in-picture material 1, a display track adjustment operation is executed to adjust the display effect of picture-in-picture material 1.

[0058] As shown in FIG. 3b, in the material selection area 22, all picture-in-picture material clips are displayed flat, and prompt text "Intelligent effects can be added to the following materials" is displayed. By default, the first picture-in-picture material is selected as the picture-in-picture material for which it is necessary to set an effect.

[0059] In one embodiment of the present disclosure, the second operation is specifically used to instruct to select a first method to process the second multimedia material, and the first method is to perform keyframe animation processing on the second multimedia material.

[0060] In one embodiment of the present disclosure, the second operation is specifically used to select a second method and instruct to process the second multimedia material, and the second method is a method of setting the display position of the second multimedia material as the recognition position of the target object in the third multimedia material.

[0061] In an embodiment of the present disclosure, as shown in FIG. 3b, after selecting the picture-in-picture material 1 for which the display effect needs to be adjusted, in response to a trigger operation on the display effect setting control, selectable display effect setting methods are displayed (shown in FIG. 4). Further, in response to a trigger operation on the display effect setting control, an intelligent effect selection panel is pulled up from bottom to top, and the intelligent effect selection panel includes two selectable display effect setting methods. The intelligent effect selection panel includes a prompt text and a close control, the prompt text is "Select the intelligent effect of the current material", and the close control is used to close the current panel in response to a user operation.

[0062] In response to the selection operation of the first method, a keyframe material editing page is displayed. On the keyframe material editing page, the display effect set for the second multimedia material in the first multimedia data is adjusted by a method of performing keyframe animation processing on the second multimedia material.

[0063] The corresponding panel of the first method further includes a prompt text "Apply to the material with added keyframes and set the motion path of the keyframes", and its display logic is that if there are no keyframes in the currently set second multimedia material, the setting panel is not displayed, and if there are keyframes in the currently set second multimedia material, the setting panel is displayed.

[0064] In response to the selection operation of the second method, a material tracking editing page is displayed. On the material tracking editing page, the display position of the second multimedia material in the third multimedia material is set as the recognition position of the target object in the third multimedia material.

[0065] The corresponding panel of the second method further includes prompt text "Apply to materials that need to continuously follow the screen body and set the object tracking target", and its display logic is to display the setting item regardless of whether there is a keyframe in the currently set second multimedia material.

[0066] In an embodiment of the present disclosure, a second method for adjusting the display position of the second multimedia material will be described in detail.

[0067] As shown in FIG. 5, the material tracking editing page includes a target object selection area 51, and a plurality of selectable objects are displayed on the material tracking editing page. For example, the cat and dog shown in FIG. 5 can be selected as selectable objects.

[0068] In an embodiment of the present disclosure, the second operation is specifically used to instruct to set the display position of the second multimedia material as the recognition position of the target object, and the target display position is the recognition position of the target object in the third multimedia material.

[0069] In an embodiment of the present disclosure, template data of an intelligent tracking algorithm is set on the posting side, and it is necessary to apply the algorithm to the picture-in-picture material and the video body with the intelligent effect set.

[0070] In an embodiment of the present disclosure, the intelligent tracking algorithm recognizes the target object in the third multimedia material and uses the recognition position of the target object as the display position of the second multimedia material in the third multimedia material.

[0071] In one embodiment of the present disclosure, in response to a selection operation on an initial target, the initial target corresponding to the selection operation is determined as the target object. Specifically, a plurality of initial targets, for example, "cat", "dog", "pig", etc. may be displayed. In response to a user's selection operation on "cat", the "cat" is used as the target object.

[0072] In one embodiment of the present disclosure, the position where "cat" is located in the third multimedia material is recognized, and the position where "cat" is located is used as the display position of the second multimedia material. Specifically, taking the case where the second multimedia material is "crown" as an example, "crown" is displayed at the position where "cat" is located in the third multimedia material, and as the position of "cat" in the third multimedia material moves, "crown" follows and moves to the position of "cat".

[0073] In an embodiment of the present disclosure, in FIG. 5, in response to the completion operation of setting the second target object, it is determined that the setting of the display effect of the second multimedia material is completed, and it jumps to the template editing page shown in FIG. 3 to select the next second multimedia material for which the display effect needs to be set.

[0074] In one embodiment of the present disclosure, a first method for setting the display effect of the second multimedia material in the first multimedia data is described.

[0075] In one embodiment of the present disclosure, the second editing track clip is specifically a clip formed by performing keyframe animation processing on the second multimedia material based on the initial display position at a specified keyframe. The second operation is specifically used to instruct to set the display position of the second multimedia material at the specified keyframe based on the recognition position of the target object. The fourth editing track clip is specifically a clip formed by performing keyframe animation processing on the second multimedia material based on the target display position at the specified keyframe.

[0076] Specifically, the second edit track clip is a clip formed by performing keyframe animation processing on the second multimedia material based on the first display positions at a plurality of keyframes. The plurality of keyframes include a specified keyframe and other keyframes, and the first display position at the specified keyframe is the initial display position.

[0077] In an embodiment of the present disclosure, specifically, the second operation is used to select a target object from the plurality of initial objects and to instruct to set the display position at the specified keyframe of the second multimedia material based on the recognition position of the target object.

[0078] In an embodiment of the present disclosure, as shown in FIG. 6a, a keyframe material editing page includes a second edit track corresponding to a second multimedia material. In response to a selection operation on the second edit track, a specified keyframe is selected from the second edit track. After selecting the specified keyframe, a plurality of selectable initial objects are displayed on the keyframe material editing page. For example, as shown in FIG. 6b, a head and feet are displayed as selectable initial objects. Further, for a selection operation of a selectable object, with the selectable initial object as the target object, the display position of the second multimedia material is set to the position recognized by the target object. For example, taking the case where the second multimedia material is a soccer ball as an example, if the target object is a foot, the display position of the soccer ball of the second multimedia material is set to the position where the foot is located at the specified keyframe.

[0079] Furthermore, after the display position setting of the second multimedia material at the set keyframe is completed, jump to the keyframe selection page shown in FIG. 6a, select a new keyframe as the specified keyframe again, and execute subsequent setting operations.

[0080] In an embodiment of the present disclosure, on the key frame selection page, prompt text "Select the key frame in contact with the screen body and set the key frame position" is displayed. When a specified key frame is selected on the timeline, the key frame is highlighted and automatically adsorbed and vibrated. The correspondence relationships of other track logics and preview areas are the same as those in the editing process. When the specified key frame is not selected on the timeline, the button becomes gray and cannot be clicked. When the button is released, it is automatically adsorbed to and selected by the nearest key frame. After the target key frame is selected, the screen position corresponding to the specified key frame is displayed.

[0081] In an embodiment of the present disclosure, as shown in FIG. 6b, in the panel, the position (such as the foot) of the second multimedia material corresponding to the specified key frame on the screen is set. After the setting, the display position of the second multimedia material at the specified key frame is the position where the target object is located at the specified key frame.

[0082] In one embodiment of the present disclosure, the second operation is specifically used to instruct to select the specified key frame from the plurality of key frames and set to determine the display position of the second multimedia material at the specified key frame based on the recognition position of the target object.

[0083] The fourth editing track clip is specifically a clip formed by performing key frame animation processing on the second multimedia material based on the second display positions at the plurality of key frames. The second display position at the specified key frame is the target display position, and the second display positions at the other key frames are the first display positions at the other key frames.

[0084] In one embodiment of the present disclosure, as shown in FIG. 7a, when the number of designated keyframes for the display position is set to 1, only the keyframe screen positions of "starting point", "position setting point", and "ending point" are retained, and the second multimedia material in each keyframe may move at a uniform speed between each keyframe. As shown in FIG. 7b, when the number of keyframes for the intelligent effect is set to be more than 1, it is necessary to retain the screen position information of all keyframes.

[0085] In one embodiment of the present disclosure, as shown in FIG. 7a, when multiple keyframes are included, only one designated keyframe is included, and the display position of the second multimedia material in the designated keyframe is determined by the recognition position of the target object in the third multimedia material. The display positions in other keyframes are set by the user themselves. For example, as shown in FIG. 7a, the display in the designated keyframe of the second multimedia material is "the position of the cat on the user screen at the intelligent recognition point". During video playback, the second multimedia material moves from the starting point position at a uniform speed to "the position of the cat on the user screen at the intelligent recognition point", and then moves at a uniform speed to the position where the "ending point" is located. Both the "starting point" and the "ending point" are positions outside the video screen display.

[0086] In one embodiment of the present disclosure, as shown in FIG. 7b, when multiple keyframes are included, only three designated keyframes are included, and the display position of the second multimedia material in the designated keyframe is determined by the recognition position of the target object in the third multimedia material. For example, as shown in FIG. 7b, the display position in the designated keyframe of the second multimedia material is the position where the numbers 2, 3, and 4 are located. During video playback, the second multimedia material moves from the starting point position at a uniform speed to the position where the number 2 is located, then moves at a uniform speed to the position where the number 3 is located, and then moves at a uniform speed to the position where the number 4 is located, and then moves at a uniform speed to the position where the "ending point" is located. Both the "starting point" and the "ending point" are positions outside the video screen display.

[0087] In an embodiment of the present disclosure, after the target object selects the head, the preview area screen is automatically switched to the video background of "character", and at the same time, the position of the second multimedia material is displayed in the preview area. The second multimedia material is automatically positioned at the center of the "head" in the video background. In an embodiment of the present disclosure, after the first target object selects a dog, the preview area screen is automatically switched to the video background of "dog", and at the same time, the second multimedia material is automatically positioned at the center of the "dog" in the video background. Further, the playback progress bar time of the preview area coincides with the current picture-in-picture material time.

[0088] In an embodiment of the present disclosure, as shown in FIG. 7, when it is determined that the display effect setting of the second multimedia material is completed, jump to the template editing page shown in FIG. 3, and select the next second multimedia material for which the display effect needs to be set.

[0089] In one embodiment of the present disclosure, the setting operation of the editing template further includes an editing information copying operation, and the editing information copying operation is used to instruct to copy the second editing information corresponding to the second multimedia material to at least one or a plurality of fourth multimedia materials so that the at least one or a plurality of fourth multimedia materials have the same editing information as the second multimedia material.

[0090] In an embodiment of the present disclosure, when a display effect is added to the second multimedia material, a display effect list is displayed, and the names of the display effects include the first display effect and the second display effect. The added display effect may be deleted, or the added display effect may be copied to other second multimedia materials. The fourth multimedia material may be other multimedia materials capable of effect setting other than the second multimedia material included in the first multimedia data.

[0091] In an embodiment of the present disclosure, when entering the intelligent effect setting page, by default, the template original video background is displayed. When clicking an entry (a trigger operation to add controls to the video), a pull-up switch list is presented. When selecting a different video background, it is necessary to adjust the time of the exemplary video to match the original video through cyclic playback. When no intelligent effect is added to the second multimedia material, no switching entry is displayed, and only "My Video" is shown. In "My Video", the main video in the first multimedia data is displayed, which is also called the background video. When switching to the character video, the built-in character video replaces the original template main video. When switching to the cat video, the built-in pet cat video replaces the original template main video. When switching to the dog video, the built-in pet dog video replaces the original template main video.

[0092] In an embodiment of the present disclosure, click the button, save the setting parameters, close the intelligent effect setting page, and return to the template editing page.

[0093] In an embodiment of the present disclosure, for each exemplary video, two videos (one landscape and one portrait) are prepared. When switching, it is necessary to select and display the exemplary video with the corresponding scale according to the landscape and portrait of the template.

[0094] The automatic playback logic requires automatically playing the timeline content corresponding to the currently selected picture-in-picture material in the preview area once after switching the video.

[0095] In an embodiment of the present disclosure, the second multimedia data may be template draft data obtained by adjusting the first multimedia data. In another embodiment, the second multimedia data may be template draft data obtained by adjusting the first multimedia data, and video data generated in response to the template draft data.

[0096] The present disclosure relates to a multimedia resource processing method, apparatus, device, storage medium, and program product. The method includes: obtaining first multimedia data, where the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, and the first editing information is used to indicate a first edited track clip formed based on at least the first multimedia material and a second edited track clip formed according to an initial display position based on the second multimedia material, and the first edited track clip and the second edited track clip overlap at a timeline position of a video editing track; processing the first multimedia data in response to a setting operation of an editing template to generate editing template data, where the setting operation includes at least a first operation and a second operation, the first operation is used to indicate setting the first multimedia material as a replaceable material, and the second operation is used to indicate setting to determine the display position of the second multimedia material based on a recognition position of a target object. The editing template data is used to generate second multimedia data based on a third multimedia material, where the third multimedia material is used to replace the first multimedia material, and the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, and the second editing information is used to indicate a third edited track clip formed based on at least the third multimedia material and a fourth edited track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on the recognition position of the target object in the third multimedia material, the third edited track clip corresponds to the first edited track clip, and the fourth edited track clip corresponds to the second edited track clip.In an embodiment of the present disclosure, in response to a setting operation of an editing template, the first multimedia data is adjusted, and a display effect is set for a second multimedia material in the first multimedia data, so as to add an intelligent effect setting to the materials in the editing template and improve the versatility of the template.

[0097] FIG. 8 is a flowchart of a multimedia resource processing method according to an embodiment of the present disclosure. This embodiment is applicable to the case of editing a video by a video template. The method may be executed by a multimedia resource processing device, and the multimedia resource processing device may be implemented by software and / or hardware. The multimedia resource processing method may also be implemented by the electronic device described in FIG. 1.

[0098] As shown in FIG. 8, the multimedia resource processing method provided by the embodiment of the present disclosure includes steps S201 to S202.

[0099] S201. Obtain editing template data, where the editing template data is generated by processing the first multimedia data in response to a setting operation of an editing template. The first multimedia data includes a first multimedia material, a second multimedia material, and first editing information. The first editing information is used to indicate a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material. The first editing track clip and the second editing track clip overlap at a timeline position of a video editing track. The setting operation includes at least a first operation and a second operation. The first operation is used to indicate setting the first multimedia material as a replaceable material, and the second operation is used to indicate setting the display position of the second multimedia material to be determined based on a recognition position of a target object.

[0100] In one embodiment of the present disclosure, the editing template data includes the editing template data generated in the above embodiment. For the description of the editing template data, reference may be made to the description of the above embodiment, and it will not be repeated in the embodiments of the present disclosure.

[0101] In one embodiment of the present disclosure, the editing template data is template data publicly posted by the creator of the editing template data. The method for obtaining the editing template data includes the user obtaining the publicly available editing template data from a public platform and introducing the editing template data into a video editor.

[0102] S202. In response to the introduction operation of the third multimedia material, generate second multimedia data based on the third multimedia material and the editing template data. The third multimedia material is used to replace the first multimedia material. The second multimedia data includes the third multimedia material, the second multimedia material, and second editing information. The second editing information is used to indicate at least a third editing track clip formed based on the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material. The target display position is determined based on the recognition position of the target object in the third multimedia material. The third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0103] In one embodiment of the present disclosure, the third multimedia material is a multimedia material that the user needs to introduce and perform an editing operation on.

[0104] In one embodiment of the present disclosure, the second edited track clip is specifically a clip formed by performing keyframe animation processing on the second multimedia material based on the initial display position at the specified keyframe, and the second operation is specifically used to instruct to set the display position at the specified keyframe of the second multimedia material based on the recognition position of the target object. The fourth edited track clip is specifically a clip formed by performing keyframe animation processing on the second multimedia material based on the target display position at the specified keyframe.

[0105] In one embodiment of the present disclosure, the recognition position of the specified key target object in the third multimedia material is recognized, and the recognition position of the target object is set as the position of the second multimedia material in the first edited track clip. As shown in FIG. 7a, the display of the second multimedia material at the specified keyframe is the position where the number 3 is located. In the fourth edited track clip, the second multimedia material moves from the starting point position to the position where the number 3 is located at a uniform speed, and then moves to the position where the "end point" is located at a uniform speed. Both the "starting point" and the "end point" are positions other than the video screen display.

[0106] In one embodiment of the present disclosure, the second operation is specifically used to instruct to set the display position of the second multimedia material as the recognition position of the target object, and the target display position is the recognition position of the target object in the third multimedia material.

[0107] In one embodiment of the present disclosure, the recognition position of the target object in the third multimedia material is recognized, and the recognition position is set as the display position of the second multimedia material. Specifically, taking the case where the second multimedia material is "crown" as an example, the "crown" is displayed at the position where the "cat" is located in the third multimedia material, and as the position of the "cat" in the third multimedia material moves, the "crown" moves following the position of the "cat".

[0108] FIG. 9 is a schematic structural diagram of a multimedia resource processing apparatus according to an embodiment of the present disclosure. This embodiment is applicable when generating a video template. The multimedia resource processing apparatus may be implemented by software and / or hardware, and the multimedia resource processing apparatus may be arranged in the electronic device described in FIG. 1.

[0109] As shown in FIG. 9, the multimedia resource processing apparatus 90 provided by the embodiment of the present disclosure mainly includes a first multimedia data acquisition module 91 and an editing template data generation module 92.

[0110] The first multimedia data acquisition module 91 is used to acquire first multimedia data, and the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information. The first editing information is used to instruct a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material. The first editing track clip and the second editing track clip overlap at the timeline position of the video editing track. The editing template data generation module 92 is used to process the first multimedia data to generate editing template data in response to a setting operation of the editing template. The setting operation includes at least a first operation and a second operation. The first operation is used to instruct setting the first multimedia material as a replaceable material. The second operation is used to instruct setting to determine the display position of the second multimedia material based on the recognition position of the target object. The editing template data is used to generate second multimedia data based on a third multimedia material. The third multimedia material is used to replace the first multimedia material. The second multimedia data includes the third multimedia material, the second multimedia material, and second editing information. The second editing information is used to instruct a third editing track clip formed based on at least the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material. The target display position is determined based on the recognition position of the target object in the third multimedia material. The third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0111] In one embodiment of the present disclosure, the second editing track clip is specifically a clip formed by performing keyframe animation processing on the second multimedia material based on the initial display position at a specified keyframe. The second operation is specifically used to instruct to set the display position of the second multimedia material at the specified keyframe based on the recognition position of the target object. The fourth editing track clip is specifically a clip formed by performing keyframe animation processing on the second multimedia material based on the target display position at the specified keyframe.

[0112] In one embodiment of the present disclosure, the second editing track clip is specifically a clip formed by performing keyframe animation processing on the second multimedia material based on the first display positions at a plurality of keyframes. The plurality of keyframes includes a specified keyframe and other keyframes. The first display position at the specified keyframe is the initial display position. The second operation is specifically used to instruct to select the specified keyframe from the plurality of keyframes and set the display position of the second multimedia material at the specified keyframe based on the recognition position of the target object. The fourth editing track clip is specifically a clip formed by performing keyframe animation processing on the second multimedia material based on the second display positions at the plurality of keyframes. The second display position at the specified keyframe is the target display position, and the second display positions at the other keyframes are the first display positions at the other keyframes.

[0113] In one embodiment of the present disclosure, the second operation is specifically used to instruct to select a first method to process the second multimedia material. The first method is to perform keyframe animation processing on the second multimedia material.

[0114] In one embodiment of the present disclosure, the second operation is specifically used to instruct to set the display position of the second multimedia material as the recognition position of the target object, and the target display position is the recognition position of the target object in the third multimedia material.

[0115] In one embodiment of the present disclosure, the second operation is specifically used to instruct to select a second method to process the second multimedia material, and the second method is a method of setting the display position of the second multimedia material as the recognition position of the target object in the third multimedia material.

[0116] In one embodiment of the present disclosure, the second operation is specifically used to instruct to select a target object from the plurality of initial objects and set to determine the display position of the second multimedia material at the specified key frame based on the recognition position of the target object.

[0117] In one embodiment of the present disclosure, the setting operation of the editing template further includes an editing information copying operation, and the editing information copying operation is used to instruct to copy the second editing information corresponding to the second multimedia material to at least one or more fourth multimedia materials so that the at least one or more fourth multimedia materials have the same editing information as the second multimedia material.

[0118] The multimedia resource processing apparatus provided by the embodiments of the present disclosure may execute the steps executed by the multimedia resource processing method provided by the method embodiments of the present disclosure, and the execution of the steps and the beneficial effects will not be repeated here.

[0119] FIG. 10 is a schematic structural diagram of a multimedia resource processing apparatus according to an embodiment of the present disclosure. This embodiment is applicable when editing a video according to a video template. The multimedia resource processing apparatus may be implemented by software and / or hardware, and the multimedia resource processing apparatus may be arranged in the electronic device described in FIG. 1.

[0120] As shown in FIG. 10, the multimedia resource processing apparatus provided by the embodiment of the present disclosure mainly includes an editing template data acquisition module 101 and a second multimedia data generation module 102.

[0121] The editing template data acquisition module 101 is used to acquire editing template data. The editing template data is generated by processing the first multimedia data in response to a setting operation of the editing template. The first multimedia data includes a first multimedia material, a second multimedia material, and first editing information. The editing information is used to indicate a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material. The first editing track clip and the second editing track clip overlap at a timeline position of a video editing track. The setting operation includes at least a first operation and a second operation. The first operation is used to indicate setting the first multimedia material as a replaceable material. The second operation is used to indicate setting to determine the display position of the second multimedia material based on the recognition position of the target object. The second multimedia data generation module is used to generate second multimedia data based on the third multimedia material and the editing template data in response to an introduction operation of the third multimedia material. The third multimedia material is used to replace the first multimedia material. The second multimedia data includes the third multimedia material, the second multimedia material, and second editing information. The second editing information is used to indicate a third editing track clip formed based on at least the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material. The target display position is determined based on the recognition position of the target object in the third multimedia material. The third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0122] In one embodiment of the present disclosure, the second edited track clip is specifically a clip formed by performing keyframe animation processing on the second multimedia material based on the initial display position at the specified keyframe, and the second operation is specifically used to instruct to set the display position at the specified keyframe of the second multimedia material based on the recognition position of the target object, and the fourth edited track clip is specifically a clip formed by performing keyframe animation processing on the second multimedia material based on the target display position at the specified keyframe.

[0123] In one embodiment of the present disclosure, the second operation is specifically used to instruct to set the display position of the second multimedia material as the recognition position of the target object, and the target display position is the recognition position of the target object in the third multimedia material.

[0124] The multimedia resource processing device provided by the embodiments of the present disclosure may execute the steps executed by the multimedia resource processing method provided by the method embodiments of the present disclosure, and the execution of the steps and the beneficial effects will not be repeated here.

[0125] FIG. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. Hereinafter, specifically referring to FIG. 11, it is a schematic structural diagram of an electronic device 1100 suitable for the implementation of the embodiments of the present disclosure. The electronic device 1100 according to the embodiments of the present disclosure includes, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (tablet computers), PMPs (Portable Multimedia Players), in-vehicle terminals (such as in-vehicle navigation terminals), wearable terminal devices, and fixed terminals such as digital TVs, desktop computers, and smart home devices. The electronic device shown in FIG. 11 is merely an example and does not limit the functions and usage ranges of the embodiments of the present disclosure in any way.

[0126] As shown in FIG. 11, the electronic device 1100 includes a processing device (e.g., a central processing unit, a graphics processor, etc.) 1101 that can execute various appropriate operations and processes according to a program stored in a read-only memory (ROM) 1102 or a program loaded from a storage device 1108 into a random access memory (RAM) 1103. Various programs and data necessary for the operation of the terminal device 1100 are further stored in the RAM 1103. The processing device 1101, the ROM 1102, and the RAM 1103 are connected to each other via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0127] Normally, the I / O interface 1105 is connected to an input device 1106 such as a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, an output device 1107 such as a liquid crystal display (LCD), a speaker, a vibrator, a storage device 1108 such as a magnetic tape, a hard disk, and a communication device 1109. The communication device 1109 enables the terminal device 1100 to communicate with other devices wirelessly or wiredly to exchange data. Although FIG. 11 illustrates a terminal device 1100 equipped with various devices, it should be understood that it is not necessary to implement or include all the illustrated devices. Alternatively, more or fewer devices may be implemented or included.

[0128] In particular, according to the embodiments of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, the embodiments of the present disclosure provide a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program including program code for executing the method shown in the flowchart to implement the multimedia resource processing method as described above. In such an embodiment, the computer program may be downloaded from a network via the communication device 1109 and installed, or may be installed from the storage device 1108, or may be installed from the ROM 1102. When the computer program is executed by the processing device 1101, the above functions defined in the method of the embodiments of the present disclosure are realized.

[0129] Note that the computer-readable medium described in the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may be, but not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that includes or stores a program, which may be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier, carrying computer-readable program code. Such a propagated data signal may include, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium that transmits, propagates, or transfers a program used by or in combination with an instruction execution system, apparatus, or device. The program code included in the computer-readable medium may be transferred by any suitable medium, such as, but not limited to, a wire, an optical fiber cable, RF (radio frequency), or any suitable combination of the above.

[0130] In some embodiments, the client and the server may communicate using any currently known or future-developed network protocol, such as HTTP (HyperText Transfer Protocol), and may be interconnected with digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), and any currently known or future-developed network.

[0131] The computer-readable medium may be included in the electronic device or may be separate and not incorporated into the electronic device.

[0132] The computer-readable medium stores one or more programs, and when the one or more programs are executed by an electronic device, the terminal device is caused to perform a step of acquiring first multimedia data, where the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, and the first editing information is used to indicate a first edited track clip formed based at least on the first multimedia material and a second edited track clip formed according to an initial display position based on the second multimedia material, and the first edited track clip and the second edited track clip overlap at a timeline position of a video editing track; a step of processing the first multimedia data in response to a setting operation of an editing template to generate editing template data, where the setting operation includes at least a first operation and a second operation, the first operation is used to indicate setting the first multimedia material as a replaceable material, the second operation is used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object, the editing template data is used to generate second multimedia data based on a third multimedia material, the third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, the second editing information is used to indicate a third edited track clip formed based at least on the third multimedia material and a fourth edited track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on the recognition position of the target object in the third multimedia material, the third edited track clip corresponds to the first edited track clip, and the fourth edited track clip corresponds to the second edited track clip.

[0133] Optionally, when the one or more programs are executed by the terminal device, the terminal device may execute other steps described in the above embodiments.

[0134] One or more programs are stored in the computer-readable medium, and when the one or more programs are executed by the terminal device, the terminal device is caused to perform a step of acquiring editing template data, where the editing template data is generated by processing the first multimedia data in response to a setting operation of an editing template, the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, the first editing information is used to indicate a first editing track clip formed based at least on the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track, the setting operation includes at least a first operation and a second operation, the first operation is used to indicate setting the first multimedia material as a replaceable material, and the second operation is used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object; a step of generating second multimedia data based on the third multimedia material and the editing template data in response to an introduction operation of a third multimedia material, where the third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, the second editing information is used to indicate a third editing track clip formed based at least on the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on a recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0135] Optionally, when the one or more programs are executed by the terminal device, the terminal device may execute other steps described in the above embodiments.

[0136] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof, and the programming languages include, but are not limited to, object-oriented programming languages (such as Java, Smalltalk, C++), and conventional procedural programming languages (such as the "C" language or similar programming languages). The program code may be executed entirely on the user's computer, partially by the user's computer, as a stand-alone software package, partially by the user's computer and partially by a remote computer, or entirely by a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, such as a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., connected via the Internet using an Internet service provider).

[0137] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, program segment, or portion of code that includes one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions shown in the boxes may occur in a different order than that shown in the accompanying drawings. For example, two boxes shown consecutively may actually be executed substantially in parallel, or depending on the related functions, may be executed in the reverse order. Also, it should be noted that each box in the block diagrams and / or flowcharts, and combinations of boxes in the block diagrams and / or flowcharts, may be implemented in a dedicated hardware-based system for performing the specified functions or operations, or may be implemented in a combination of dedicated hardware and computer instructions.

[0138] The units described in the embodiments of the present disclosure may be implemented by software or by hardware. Here, the name of the unit does not constitute a limitation of the unit itself in a given situation.

[0139] The functions described above in this specification may be at least partially executed by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), application specific standard products (ASSP), system on a chip (SOC), complex programmable logic devices (CPLD), and the like.

[0140] In the context of the present disclosure, a machine-readable medium may be a tangible medium that includes or stores a program for use by or in combination with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium includes, but is not limited to, electronics, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. More specific examples of the machine-readable storage medium include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.

[0141] According to one or more embodiments of the present disclosure, the present disclosure provides a multimedia resource processing method, including the step of obtaining first multimedia data, where the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, the first editing information is used to indicate a first editing track clip formed based at least on the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, and the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track; a step of processing the first multimedia data in response to a setting operation of an editing template to generate editing template data, where the setting operation includes at least a first operation and a second operation, the first operation is used to indicate setting the first multimedia material as a replaceable material, the second operation is used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object, the editing template data is used to generate second multimedia data based on a third multimedia material, the third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, the second editing information is used to indicate a third editing track clip formed based at least on the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on the recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0142] According to one or more embodiments of the present disclosure, the present disclosure provides a multimedia resource processing method, including the step of obtaining editing template data, where the editing template data is generated by processing the first multimedia data in response to a setting operation of an editing template, the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, the first editing information is used to indicate a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track, the setting operation includes at least a first operation and a second operation, the first operation is used to indicate setting the first multimedia material as a replaceable material, and the second operation is used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object; and the step of generating second multimedia data based on the third multimedia material and the editing template data in response to an introduction operation of a third multimedia material, where the third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, the second editing information is used to indicate a third editing track clip formed based on at least the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on the recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0143] According to one or more embodiments of the present disclosure, the present disclosure provides a multimedia resource processing apparatus, including a first multimedia data acquisition module for acquiring first multimedia data, where the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, the first editing information is used to indicate a first editing track clip formed based at least on the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, and the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track; an editing template data generation module for processing the first multimedia data to generate editing template data in response to a setting operation of an editing template, where the setting operation includes at least a first operation and a second operation, the first operation is used to indicate setting the first multimedia material as a replaceable material, the second operation is used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object, the editing template data is used to generate second multimedia data based on a third multimedia material, the third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, the second editing information is used to indicate a third editing track clip formed based at least on the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on the recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0144] According to one or more embodiments of the present disclosure, the present disclosure includes a multimedia resource processing apparatus, and an editing template data acquisition module for acquiring editing template data. The editing template data is generated by processing the first multimedia data in response to a setting operation of the editing template. The first multimedia data includes a first multimedia material, a second multimedia material, and first editing information. The editing information is used to indicate a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material. The first editing track clip and the second editing track clip overlap at a timeline position of a video editing track. The setting operation includes at least a first operation and a second operation. The first operation is used to indicate setting the first multimedia material as a replaceable material. The second operation is used to indicate setting to determine the display position of the second multimedia material based on the recognition position of the target object. An editing template data acquisition module, and a second multimedia data generation module for generating second multimedia data based on the third multimedia material and the editing template data in response to an introduction operation of the third multimedia material. The third multimedia material is used to replace the first multimedia material. The second multimedia data includes the third multimedia material, the second multimedia material, and second editing information. The second editing information is used to indicate a third editing track clip formed based on at least the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material. The target display position is determined based on the recognition position of the target object in the third multimedia material. The third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

[0145] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, one or more processors, a memory for storing one or more programs, and when the one or more programs are executed by the one or more processors, cause the one or more processors to execute any one of the multimedia resource processing methods provided by the present disclosure.

[0146] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium storing a computer program, and when the program is executed by a processor, any one of the multimedia resource processing methods provided by the present disclosure is realized.

[0147] Embodiments of the present disclosure further provide a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the multimedia resource processing method described above may be realized.

[0148] The above description is an exemplary description of the preferred embodiments of the present disclosure and the adopted technical principles. It should be understood by those skilled in the art that the disclosure scope related to the present disclosure is not limited to the technical solutions formed by the specific combinations of the above technical features, and other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosure scope should also be covered. For example, technical solutions formed by replacing the above-described features with technical features having the same functions disclosed in the present disclosure (not limited thereto) are also covered.

[0149] Further, although each operation is depicted using a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or sequentially. Multitasking and parallel processing may be advantageous in certain environments. Similarly, although some specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Specific features described in the context of a single embodiment may also be implemented in combination within a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented separately, or in any suitable sub-combination, in multiple embodiments.

[0150] The subject matter has been described in language specific to structural features and / or methodological logic acts, but it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely exemplary forms of implementing the claims.

Claims

1. A multimedia resource processing method, the multimedia resource processing method comprising: obtaining first multimedia data, the first multimedia data including a first multimedia material, a second multimedia material, and first editing information, the first editing information being used to indicate a first editing track clip formed based at least on the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, the first editing track clip and the second editing track clip overlapping at a timeline position of a video editing track; processing the first multimedia data in response to a setting operation of an editing template to generate editing template data; the setting operation including at least a first operation and a second operation; the first operation being used to indicate setting the first multimedia material as a replaceable material; the second operation being used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object; the editing template data being used to generate second multimedia data based on a third multimedia material, the third multimedia material being used to replace the first multimedia material, the second multimedia data including the third multimedia material, the second multimedia material, and second editing information, the second editing information being used to indicate a third editing track clip formed based at least on the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position being determined based on a recognition position of the target object in the third multimedia material, the third editing track clip corresponding to the first editing track clip, and the fourth editing track clip corresponding to the second editing track clip.

2. The second editing track clip is a clip formed by performing keyframe animation processing on the second multimedia material based on the initial display position at a specified keyframe. The second operation is used to instruct to set the display position of the second multimedia material at the specified key frame based on the recognition position of the target object. The fourth editing track clip is a clip formed by performing key frame animation processing on the second multimedia material based on the target display position at the specified key frame. The method according to claim 1. **Claim 3** The second editing track clip is a clip formed by performing key frame animation processing on the second multimedia material based on the first display positions at a plurality of key frames. The plurality of key frames include a specified key frame and other key frames. The first display position at the specified key frame is the initial display position. The second operation is used to select the specified key frame from the plurality of key frames and to instruct to set the display position of the second multimedia material at the specified key frame based on the recognition position of the target object. The fourth editing track clip is a clip formed by performing key frame animation processing on the second multimedia material based on the second display positions at the plurality of key frames. The second display position at the specified key frame is the target display position, and the second display position at the other key frames is the first display position at the other key frames. The method according to claim 2. **Claim 4** The second operation is used to instruct to select a first method to process the second multimedia material. The first method is to perform key frame animation processing on the second multimedia material. The method according to claim 2. **Claim 5** The second operation is used to instruct to set the display position of the second multimedia material as the recognition position of the target object. The target display position is the recognition position of the target object in the third multimedia material. The method according to claim 1. **Claim 6** The second operation is used to instruct to select a second method to process the second multimedia material. The second method is a method of setting the display position of the second multimedia material as the recognition position of the target object in the third multimedia material. The method according to claim 5. **Claim 7** The method according to claim 2, wherein the second operation is used to select a target object from a plurality of initial objects and to set an instruction to determine a display position of the second multimedia material at the designated key frame based on a recognized position of the target object.

8. The setting operation of the editing template further includes an editing information copying operation, and the editing information copying operation is used to instruct to copy second editing information corresponding to the second multimedia material to at least one or a plurality of fourth multimedia materials so that the at least one or a plurality of fourth multimedia materials have the same editing information as the second multimedia material. The method according to claim 1.

9. A multimedia resource processing method, the multimedia resource processing method comprising: A step of obtaining editing template data, wherein the editing template data is generated by processing first multimedia data in response to a setting operation of an editing template, the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, and the first editing information is used to instruct a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track, the setting operation includes at least a first operation and a second operation, the first operation is used to instruct to set the first multimedia material as a replaceable material, and the second operation is used to instruct to set to determine a display position of the second multimedia material based on a recognized position of a target object. A step, A step of generating second multimedia data based on the third multimedia material and the editing template data in response to an introduction operation of the third multimedia material. The third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material and second editing information, the second editing information is used to instruct a third editing track clip formed based at least on the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on a recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip, method.

10. The second editing track clip is a clip formed by performing keyframe animation processing on the second multimedia material based on the initial display position at a specified keyframe, The second operation is used to instruct setting to determine a display position at the specified keyframe of the second multimedia material based on a recognition position of the target object, The method according to claim 9, wherein the fourth editing track clip is a clip formed by performing keyframe animation processing on the second multimedia material based on the target display position at the specified keyframe.

11. The second operation is used to instruct setting a display position of the second multimedia material as a recognition position of a target object, The method according to claim 9, wherein the target display position is a recognition position of the target object in the third multimedia material.

12. A multimedia resource processing apparatus, the multimedia resource processing apparatus is A first multimedia data acquisition module for acquiring first multimedia data, wherein the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, and the first editing information is used to instruct a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, and the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track, and the first multimedia data acquisition module, An editing template data generation module for processing the first multimedia data in response to a setting operation of an editing template to generate editing template data, and the apparatus includes: The setting operation includes at least a first operation and a second operation, The first operation is used to instruct setting the first multimedia material as a replaceable material, The second operation is used to instruct setting to determine a display position of the second multimedia material based on a recognition position of a target object, The editing template data is used to generate second multimedia data based on a third multimedia material, the third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, and the second editing information is used to instruct a third editing track clip formed based on at least the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on the recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip, the apparatus.

13. A multimedia resource processing apparatus, wherein the multimedia resource processing apparatus is An editing template data acquisition module for acquiring editing template data, wherein the editing template data is generated by processing first multimedia data in response to a setting operation of an editing template, the first multimedia data includes a first multimedia material, a second multimedia material, and first editing information, the first editing information is used to indicate a first editing track clip formed based on at least the first multimedia material and a second editing track clip formed according to an initial display position based on the second multimedia material, the first editing track clip and the second editing track clip overlap at a timeline position of a video editing track, the setting operation includes at least a first operation and a second operation, the first operation is used to indicate setting the first multimedia material as a replaceable material, and the second operation is used to indicate setting to determine a display position of the second multimedia material based on a recognition position of a target object. The editing template data acquisition module; A second multimedia data generation module for generating second multimedia data based on the third multimedia material and the editing template data in response to an introduction operation of the third multimedia material, and The third multimedia material is used to replace the first multimedia material, the second multimedia data includes the third multimedia material, the second multimedia material, and second editing information, the second editing information is used to indicate a third editing track clip formed based on at least the third multimedia material and a fourth editing track clip formed according to a target display position based on the second multimedia material, the target display position is determined based on a recognition position of the target object in the third multimedia material, the third editing track clip corresponds to the first editing track clip, and the fourth editing track clip corresponds to the second editing track clip.

14. One or more processors; A storage device for storing one or more programs, and An electronic device that causes the one or more processors to execute the method according to any one of claims 1 to 11 when the one or more programs are executed by the one or more processors.

15. A computer-readable storage medium storing a computer program, wherein the method according to any one of claims 1 to 11 is executed when the computer program is executed by a processor.

16. A computer program including instructions or commands, wherein the method according to any one of claims 1 to 11 is executed when the instructions or commands are executed by a processor.

Images