Special effect processing method and device, equipment and medium

Abstract

The embodiment of the invention relates to a special effect processing method and device, equipment and a medium, and the method comprises the steps: obtaining a target special effect application request which carries a first template comprising at least one to-be-processed material, and the first template is represented by a unified template protocol; a target special effect template of the target special effect is acquired, and the target special effect template combines at least two special effect objects by using a unified template protocol; obtaining special effect resources of the target special effect; fusing the first template and the target special effect template to obtain a second template; and displaying a special effect draft based on the special effect resource and the second template, the special effect draft being a draft file after the at least two special effect objects are applied to the at least one to-be-processed material. Definitions of different special effect objects are unified based on the unified template protocol, interfaces or services of the different special effect objects are unified, combined use of the multiple special effect objects is automatically achieved, and the implementation efficiency of special effect combination is improved.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a special effects processing method, apparatus, device, and medium. Background Technology

[0002] With the development of image processing technology, various special effects can be added to images or videos. Different special effects depend on different definitions, interfaces, and services. When multiple special effects need to be combined, they need to be implemented manually, which is costly and inefficient and needs to be improved. Summary of the Invention

[0003] To address the aforementioned technical problems, this disclosure provides a special effects processing method, apparatus, device, and medium.

[0004] This disclosure provides a special effects processing method, the method comprising:

[0005] Obtain a target effect application request, wherein the target effect application request carries a first template including at least one material to be processed, the first template being characterized using a unified template protocol;

[0006] Obtain the target effect template for the target effect, wherein the target effect template combines at least two effect objects using the unified template protocol;

[0007] Obtain the special effects resources for the target special effects;

[0008] The first template and the target effect template are merged to obtain the second template;

[0009] Based on the special effects resources and the second template, a special effects draft is displayed, wherein the special effects draft is a draft file after applying the at least two special effects objects to the at least one material to be processed.

[0010] This disclosure also provides a special effects processing apparatus, the apparatus comprising:

[0011] The request module is used to obtain a target effect application request, wherein the target effect application request carries a first template including at least one material to be processed, and the first template is characterized using a unified template protocol.

[0012] The template module is used to obtain the target effect template for the target effect, wherein the target effect template combines at least two effect objects using the unified template protocol;

[0013] The resource module is used to acquire the special effects resources for the target special effects;

[0014] The fusion module is used to fuse the first template and the target effect template to obtain a second template;

[0015] The display module is used to display a special effects draft based on the special effects resource and the second template, wherein the special effects draft is a draft file after applying the at least two special effects objects to the at least one material to be processed.

[0016] This disclosure also provides an electronic device, the electronic device comprising: a processor; a memory for storing executable instructions of the processor; the processor being configured to read the executable instructions from the memory and execute the instructions to implement the special effects processing method provided in this disclosure.

[0017] This disclosure also provides a computer-readable storage medium storing a computer program for performing special effects processing methods as provided in this disclosure.

[0018] Compared with the prior art, the technical solution provided in this disclosure has the following advantages: The special effects processing solution provided in this disclosure obtains a target special effects application request, wherein the target special effects application request carries a first template including at least one material to be processed, and the first template is characterized by a unified template protocol; obtains a target special effects template for the target special effects, wherein the target special effects template combines at least two special effects objects using a unified template protocol; obtains special effects resources for the target special effects; merges the first template and the target special effects template to obtain a second template; and displays a special effects draft based on the special effects resources and the second template, wherein the special effects draft is a draft file after applying at least two special effects objects to at least one material to be processed. By adopting the above technical solution, since the target effect template combines multiple effect objects through a unified template protocol, when using the target effect, the target effect template can be merged with the template including the material to be processed to obtain a template of the material to be processed that applies multiple effect objects. Then, based on the effect resources of the target effect, a draft file with the effect of multiple effect objects can be quickly rendered and displayed. Compared with related technologies, it can unify the definition of different effect objects based on a unified template protocol, thereby unifying the interfaces or services of different effect objects, automatically realizing the combined use of multiple effect objects, reducing the cost of effect combination implementation, improving the efficiency of effect combination implementation, and thus improving the effect of users' use of effect. Attached Figure Description

[0019] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0020] Figure 1A flowchart illustrating a special effects processing method provided in an embodiment of this disclosure;

[0021] Figure 2 A schematic diagram of a resource package for a target special effect provided in an embodiment of this disclosure;

[0022] Figure 3 A schematic diagram of a target special effects template provided in an embodiment of this disclosure;

[0023] Figure 4 A schematic diagram of another target effect template provided in an embodiment of this disclosure;

[0024] Figure 5 A schematic diagram of a fusion process provided in an embodiment of this disclosure;

[0025] Figure 6 A schematic diagram illustrating another fusion process provided in an embodiment of this disclosure;

[0026] Figure 7 A schematic diagram illustrating a special effects processing procedure provided in an embodiment of this disclosure;

[0027] Figure 8 This is a schematic diagram of a template data processing procedure provided in an embodiment of the present disclosure;

[0028] Figure 9 A schematic diagram illustrating another special effects processing procedure provided in an embodiment of this disclosure;

[0029] Figure 10 A schematic diagram illustrating another special effects processing procedure provided in an embodiment of this disclosure;

[0030] Figure 11 This is a schematic diagram of the structure of a special effects processing device provided in an embodiment of the present disclosure;

[0031] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0032] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0033] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0034] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0035] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0036] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0037] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0038] Some special effects added to images or videos are processed locally, some are processed on the server side, and some are combined together. These different special effects depend on different interfaces and services. When multiple special effects need to be combined, business personnel usually adapt and implement them manually, which is costly and inefficient and needs to be improved.

[0039] To address the aforementioned problems, this disclosure provides a special effects processing method, which will be described below with reference to specific embodiments.

[0040] Figure 1 This is a flowchart illustrating a special effects processing method provided in an embodiment of this disclosure. The method can be executed by a special effects processing device, which can be implemented using software and / or hardware, and is generally integrated into an electronic device. Figure 1 As shown, the method includes:

[0041] Step 101: Obtain the target effect application request, wherein the target effect application request carries a first template including at least one material to be processed, and the first template is characterized using a unified template protocol.

[0042] The special effects processing method of this disclosure is applied to a client, which may include multiple software development kits (SDKs), such as a special effects processing SDK. The special effects processing SDK may be a unified interface for processing multiple special effects objects, which is a new feature of this disclosure. By processing the application requests of all special effects objects through the special effects processing SDK, the application of one special effects object or the combined application of multiple special effects objects can be realized.

[0043] The target effect application request can be a request sent by a user when triggering the use of the target effect through a trigger operation on the target effect's user interface in the client. The target effect can be a collective term for a combination of effects applied to at least two effect objects. Effect objects can be objects that can add special display effects to images or videos. Different effect objects can achieve different effect effects. This disclosure does not limit the specific effect objects; for example, effect objects can include at least one of makeup, filters, face-changing effects, stickers, text, camera movement, 3D segmentation, magnification, bounce / swing, zoom, etc.

[0044] The request for applying the desired special effect may include a first template, also known as a local editing template. This first template can be a template represented using a unified template protocol for at least one piece of material to be processed imported by the user on the editing page, and it can be read from memory. The unified template protocol can be a draft protocol for image or video editing based on a non-linear editing platform. This unified template protocol is used to define or represent information about one or more special effect objects, and can also represent at least one piece of material to be processed during editing. The entire data processing chain can be reused through this unified template protocol. The material to be processed can be any material for which special effects are to be applied, and this material can include images or videos, specifically, without limitation.

[0045] Specifically, in response to the user importing at least one material to be processed in the effects panel and triggering the control of the target effect, the client can obtain the target effect application request.

[0046] Step 102: Obtain the target effect template, wherein the target effect template combines at least two effect objects using a unified template protocol.

[0047] The target effect template can be a template defined using the aforementioned unified template protocol for the target effect. The target effect template can define one effect object or combine at least two effect objects, depending on the actual situation.

[0048] Specifically, the client can download the resource package of the target effect through the internally integrated download SDK, and then parse the target effect template from the resource package.

[0049] In some embodiments, obtaining the target effect template may include: obtaining a resource package of the target effect and extracting a first effect template from the resource package; performing deserialization on the first effect template to generate a second effect template; and determining the target effect template based on the second effect template.

[0050] The resource package for the target effect can include all the information required for the target effect to be used, as well as all the resources it depends on. This resource package can be a compressed file, and it can be automatically generated by a script. For example, Figure 2 A schematic diagram of a resource package for a target special effect provided in an embodiment of this disclosure, as shown below. Figure 2 As shown, the resource package of the target effect can specifically include a first effect template, business information, and built-in resources. The first effect template can be a template of the code format of the target effect represented by the aforementioned unified template protocol, such as JSON format. This first effect template cannot be read from memory. The business information can be used to identify the basic business information and dependent resources of the resource package. For example, the business information can indicate that the target effect can only be applied to image, audio, or video materials. The built-in resources can be the resource package or the address of the resource package that the effect object included in the first effect template depends on. The built-in resources are optional and can be set according to the actual situation.

[0051] The second effect template can be an in-memory instance object obtained by deserializing the first effect template. It can be read from memory; that is, the second effect template can be the first effect template expressed in a different way. The target effect template can be the template of the final determined target effect. It can be read from memory and has the same format as the first template mentioned above.

[0052] In this embodiment of the disclosure, when the client obtains the target effect template, it can first download the resource package of the target effect. The first effect template is obtained by parsing and extracting from the resource package using the effect processing SDK. Then, the first effect template is deserialized using the protocol processing SDK to obtain the second effect template. The protocol processing SDK can be used to process the template or protocol of the effect object or the target effect. The second effect template is processed by the effect processing SDK to obtain the target effect template after algorithm processing when it includes a preset effect object. When it does not include the preset effect object, the second effect template is directly determined as the target effect template.

[0053] Optionally, determining the target effect template based on the second effect template may include: if at least two effect objects are determined based on the second effect template to include a preset effect object, then at least one material to be processed is processed based on the algorithm of the preset effect object to obtain at least one effect material, and the second effect template with at least one effect material added is determined as the target effect template; if at least two effect objects do not include the preset effect object, then the second effect template is determined as the target effect template.

[0054] The preset special effects object can be a special effects object that needs to generate a new image or video based on an image or video. For example, it can be an image-to-image, image-to-video, or video-to-video conversion. The preset special effects object can include face-changing, camera movement, etc. The special effects material can be an image or video obtained by processing the material to be processed using the algorithm of the preset special effects object. When the client determines the target special effects template based on the second special effects template, it can first judge the at least two special effects objects included in the second special effects template. If the at least two special effects objects include a preset special effects object, the special effects processing SDK can call the algorithm of the preset special effects object to process at least one material to be processed corresponding to the preset special effects object, obtaining at least one special effects material. This at least one special effects material is then added to the second special effects template, replacing the original at least one material to be processed in the second special effects template, thus obtaining the target special effects template. If the at least two special effects objects do not include a preset special effects object, the second special effects template can be directly determined as the target special effects template.

[0055] For example, Figure 3 This is a schematic diagram of a target special effects template provided in an embodiment of the present disclosure, such as... Figure 3 As shown in the image, a target effect template consisting of only one effect object can be applied to this template. The effect object is 3D segmented as depicted in the image, and the empty slots on the main track can be used to import the material to be processed. For example... Figure 4 A schematic diagram of another target effect template provided in this disclosure embodiment, as shown below. Figure 4 As shown in the image, a target effect template includes three effect objects: effect object 1 is a bounce swing, effect object 2 is a bubble zoom, and effect object 3 is a combined video animation. The empty slots on the main track can be used to import footage to be processed. This is understandable. Figure 3 and Figure 4 The target effect templates shown are for illustrative purposes only and are not intended to be limiting.

[0056] Step 103: Obtain the special effects resources for the target special effects.

[0057] Among them, special effects resources can be all resources that the target special effects depend on when they are used, including resources, algorithms or models that at least two special effects objects in the target special effects template depend on.

[0058] After obtaining the target effect template, the client can obtain the resource package of at least two effect objects in the target effect template as the effect resources of the target effect.

[0059] In some embodiments, obtaining the special effects resources of the target special effects may include: obtaining the resource packages of at least two special effects objects based on the resource addresses of at least two special effects objects in the target special effects template, or extracting the resource packages of at least two special effects objects that have been pre-downloaded from the resource package of the target special effects; and determining the special effects resources of the target special effects from the resource packages of the at least two special effects objects.

[0060] The resource address can be a resource locator used to obtain the resource package of the effect object, such as a Uniform Resource Locator (URL). The client can first search in the resource package of the target effect. If at least two pre-downloaded effect object resource packages exist, they are extracted. If not, the SDK can download the resource package of each effect object based on the resource addresses of at least two effect objects defined in the target effect template. The resources of an effect object can include resources, algorithms, or models that the effect object depends on.

[0061] Step 104: Merge the first template and the target effect template to obtain the second template.

[0062] The second template can be a template or draft protocol obtained by merging or overlaying two first templates defined using a unified template protocol and the target effect template. This allows the resource information of the target effect to be merged with the location of the material to be processed, and then used to display the effect of the target effect in the future.

[0063] In this embodiment of the disclosure, the client can perform fusion processing on the first template and the target special effects template through the special effects processing SDK. Specifically, at the position of each material to be processed in the first template, the resource information and special effects material of the corresponding special effects object in the target special effects template can be merged to obtain the second template. The special effects material is generated when the special effects object is a preset special effects object. In the above scheme, one material to be processed corresponds to at least one special effects object, that is, one material to be processed applies the special effects of at least one special effects object.

[0064] For example, Figure 5 A schematic diagram of a fusion process provided in an embodiment of this disclosure, such as... Figure 5As shown in the figure, the process of merging the first template, which includes material 1 and material 2 in the figure, and the target effect template, which includes the effect material corresponding to the preset effect object, is illustrated. The target effect corresponds to material 2. The resource information and effect material of the corresponding preset effect object are merged at the position of material 2. Material 1 is retained to obtain the second template. In the second template, the rendering proxy of material 2 includes the effect material of the preset effect object.

[0065] For example, Figure 6 A schematic diagram of another fusion process provided in an embodiment of this disclosure, as shown below. Figure 6 As shown in the figure, the process of merging the first template, which includes material 3 and material 4 in the figure, and the target effect template, which includes two effect objects, stickers and filters, is illustrated. The target effect corresponds to material 4. The resource information of the corresponding sticker and filter effect objects is merged at the position of material 4. Material 3 is retained to obtain the second template. In the second template, material 4 is applied with the two effect objects, stickers and filters, which are included in the target effect.

[0066] Step 105: Display the special effects draft based on the special effects resources and the second template, wherein the special effects draft is a draft file after applying at least two special effects objects to at least one material to be processed.

[0067] The special effects draft can be a draft of an image or video material to be processed, which includes special effects applied to at least two special effects objects. The special effects draft supports editing and publishing operations. Editing can be done by editing the attributes of each special effects object in the special effects operation. After the special effects operation is published, the special effects work of the image or video can be obtained for other users besides the current user to view.

[0068] Specifically, based on the second template and the target effect's effect resources, the client can use the target effect's effect resources to perform visual processing based on the second template, generate an effect draft, and display the effect draft on the editing interface. This allows the current user to browse the draft file of the material to be processed, which applies the effect of at least two effect objects. Afterward, the client can respond to the user's operation by editing, publishing, and other operations on the effect.

[0069] In some embodiments, displaying a special effects draft based on special effects resources and a second template may include: when the second template includes special effects material, when displaying the special effects draft, using a rendering proxy, the special effects material is overlaid and displayed on top of the corresponding material to be processed based on the resource package of the preset special effects object corresponding to the special effects material in the special effects resources.

[0070] The render proxy is used to render the effect material of the material to be processed by the algorithm of the preset effect object, and retain the material for subsequent editing. When the client displays the effect draft, if the second template includes effect material, the render proxy can use the resource package of the preset effect object corresponding to the effect material in the effect resources of the target effect to render the effect material, and overlay the effect material on top of the corresponding material to be processed, so that the user can directly view the effect material when browsing the effect draft.

[0071] For example, see Figure 6 When the second template includes special effects assets, these assets can be rendered and overlaid on asset 2 using a rendering proxy, and asset 2 is retained for later editing. See also Figure 7 When the second template does not include special effects materials, the special effects resources of the two special effects objects, face changing and filter, included in the target special effects can be used to apply and display the special effects of material 4 in real time based on the second template.

[0072] The special effects processing scheme provided in this embodiment obtains a target special effects application request, wherein the target special effects application request carries a first template including at least one material to be processed, the first template being characterized using a unified template protocol; obtains a target special effects template for the target special effects, wherein the target special effects template combines at least two special effects objects using a unified template protocol; obtains special effects resources for the target special effects; merges the first template and the target special effects template to obtain a second template; and displays a special effects draft based on the special effects resources and the second template, wherein the special effects draft is a draft file after applying at least two special effects objects to at least one material to be processed. By adopting the above technical solution, since the target effect template combines multiple effect objects through a unified template protocol, when using the target effect, the target effect template can be merged with the template including the material to be processed to obtain a template of the material to be processed that applies multiple effect objects. Then, based on the effect resources of the target effect, a draft file with the effect of multiple effect objects can be quickly rendered and displayed. Compared with related technologies, it can unify the definition of different effect objects based on a unified template protocol, thereby unifying the interfaces or services of different effect objects, automatically realizing the combined use of multiple effect objects, reducing the cost of effect combination implementation, improving the efficiency of effect combination implementation, and thus improving the effect of users' use of effect.

[0073] In some embodiments, the special effects processing method may further include: in response to an editing operation on the special effects draft, editing the properties of at least two special effects objects.

[0074] The editing operation can be implemented through editing controls set up for special effects operations. This editing is used to edit the properties of the special effects objects included in the special effects operation. The properties of the special effects objects include the usage time and location of the special effects object in the material to be processed, and are not limited to these. After the client displays the special effects draft, it can receive the user's editing operations on the special effects draft, such as adding, modifying, and deleting the properties of at least two special effects objects corresponding to the special effects draft. After that, the edited special effects draft can be published. In the above solution, the support for further editing of special effects drafts generated using a unified template protocol better meets the user's actual special effects editing needs and improves the flexibility of special effects generation.

[0075] The special effects processing scheme of this disclosure embodiment will be further explained through a specific example below.

[0076] For example, Figure 7 This is a schematic diagram of a special effects processing procedure provided in an embodiment of the present disclosure, such as... Figure 7 As shown in the diagram, the complete process of special effects processing on the client side is illustrated. The download SDK, special effects processing SDK, and protocol processing SDK are all SDKs internally configured within the client. The specific special effects processing process can include: the client receiving the user's trigger operation for the target special effect through the special effects panel module, thereby obtaining the target special effects application request, and then sending the target special effects application request to the download SDK; the download SDK can download the resource package of the target special effect and verify whether the resource package is available, specifically through key verification. When the resource package is available, it returns availability information to the special effects panel module; the special effects panel module sends the resource package to the special effects processing SDK, and the special effects processing... The processing SDK extracts the first effect template from the resource package and sends it to the protocol processing SDK. The protocol processing SDK deserializes the first effect template to obtain the second effect template. Based on the second effect template, the effect processing SDK determines the target effect template for the target effect and downloads the resources from the target effect template to obtain the effect resources for the target effect. Then, it can perform a fusion process on the first template and the target effect template in the target effect application request to obtain the second template and return the second template to the effect panel module. The effect template module displays a draft of the effect after applying at least two effect objects to at least one material to be processed, based on the effect resources of the target effect and the second template.

[0077] For example, Figure 8 This is a schematic diagram of a template data processing procedure provided in an embodiment of the present disclosure, such as... Figure 8As shown in the diagram, the template data processing process of the special effects processing SDK can be divided into the following steps: reading the first special effects template; generating the second special effects template through deserialization using the protocol processing SDK; downloading the resources in the template; downloading the algorithm, special effects package, and model required for the target special effects; processing the algorithm of the preset special effects object to process at least one material to be processed, such as image-to-image, image-to-video, or video-to-video conversion; and filling / replacing the material by filling / replacing the special effects material processed by the algorithm of the preset special effects object into the second special effects template to obtain the target special effects template.

[0078] For example, Figure 9 A schematic diagram of another special effects processing procedure provided in this embodiment of the disclosure, as shown below. Figure 9 As shown in the figure, the processing process of the special effects processing SDK is illustrated in another way. The special effects processing SDK relies on the data processing link of the protocol SDK. The special effects processing SDK obtains the first template and the target special effects template. The target special effects template can be preprocessed, including verifying its usability and calling the protocol processing SDK to perform resource download, material compression and algorithm processing. Finally, the first template and the target special effects template are merged to obtain the second template.

[0079] For example, Figure 10 A schematic diagram illustrating another special effects processing procedure provided in this disclosure embodiment, as shown below. Figure 10 As shown in the figure, the special effects processing scheme of this disclosure embodiment is illustrated from the code perspective. Specifically, a unified external interface is set up to manage the application, removal, and cancellation of the application of target special effects. This unified external interface is specifically managed through a processor that can register different special effects objects. The processor includes a processing protocol for processing special effects objects. The processing protocol includes processing of preset special effects objects and / or processing of at least two special effects objects. The unified external interface enables one-click application of target special effects including special effects of at least two special effects objects.

[0080] This solution implements a unified template protocol and a unified external interface, and integrates the processing chain of one or more special effects objects internally. It can realize a long-term iterative special effects usage solution, meet the application of special effects object algorithms on the local or server side, and can meet the rapid application of combinations of at least two special effects objects as well as reserve the ability for secondary editing. This effectively improves the flexibility and diversity of special effects usage, thereby enhancing the effect of special effects.

[0081] Figure 11 This is a schematic diagram of a special effects processing device provided in an embodiment of this disclosure. The device can be implemented by software and / or hardware and is generally integrated into an electronic device. Figure 11 As shown, the device includes:

[0082] Request module 1101 is used to obtain a target effect application request, wherein the target effect application request carries a first template including at least one material to be processed, and the first template is characterized by a unified template protocol.

[0083] Template module 1102 is used to obtain a target effect template for a target effect, wherein the target effect template combines at least two effect objects using the unified template protocol;

[0084] Resource module 1103 is used to acquire the special effects resources of the target special effects;

[0085] The fusion module 1104 is used to fuse the first template and the target effect template to obtain a second template;

[0086] The display module 1105 is used to display a special effects draft based on the special effects resource and the second template, wherein the special effects draft is a draft file after applying the at least two special effects objects to the at least one material to be processed.

[0087] Optionally, template module 1102 includes:

[0088] The first unit is used to obtain the resource package of the target special effect and extract the first special effect template from the resource package;

[0089] The second unit is used to deserialize the first special effects template to generate a second special effects template.

[0090] The third unit is used to determine the target special effects template based on the second special effects template.

[0091] Optionally, the third unit is used for:

[0092] If it is determined based on the second special effect template that the at least two special effect objects include a preset special effect object, then the at least one material to be processed is processed based on the algorithm of the preset special effect object to obtain at least one special effect material, and the second special effect template with the at least one special effect material added is determined as the target special effect template;

[0093] If the preset effect object is not included among the at least two effect objects, then the second effect template is determined as the target effect template.

[0094] Optionally, resource module 1103 is used for:

[0095] Based on the resource addresses of at least two special effects objects in the target special effects template, obtain the resource packages of the at least two special effects objects, or extract the pre-downloaded resource packages of the at least two special effects objects from the resource package of the target special effects;

[0096] The resource packages of the at least two special effects objects are used to determine the special effects resources of the target special effect.

[0097] Optionally, the fusion module 1104 is used for:

[0098] At the positions of the materials to be processed in the first template, the resource information and special effects materials of the special effects objects corresponding to the materials to be processed in the target special effects template are merged to obtain the second template, wherein one material to be processed corresponds to at least one special effects object.

[0099] Optionally, the display module 1105 is used for:

[0100] When the second template includes special effects material, when displaying the special effects draft, the special effects material is overlaid on the corresponding material to be processed using a rendering proxy based on the resource package of the preset special effects object corresponding to the special effects material in the special effects resource.

[0101] Optionally, the device further includes an editing module for:

[0102] In response to the editing operation on the special effects draft, the properties of the at least two special effects objects are edited.

[0103] The special effects processing apparatus provided in this disclosure can execute the special effects processing methods provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the methods.

[0104] This disclosure also provides a computer program product, including a computer program / instructions, which, when executed by a processor, implement the special effects processing method provided in any embodiment of this disclosure.

[0105] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure.

[0106] The following is a detailed reference. Figure 12 The diagram illustrates a structural schematic suitable for implementing the electronic device 1200 in the embodiments of this disclosure. The electronic device 1200 in the embodiments of this disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 12The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0107] like Figure 12 As shown, the electronic device 1200 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 1201, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1202 or a program loaded from a storage device 1208 into a random access memory (RAM) 1203. The RAM 1203 also stores various programs and data required for the operation of the electronic device 1200. The processing unit 1201, ROM 1202, and RAM 1203 are interconnected via a bus 1204. An input / output (I / O) interface 1205 is also connected to the bus 1204.

[0108] Typically, the following devices can be connected to I / O interface 1205: input devices 1206 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1207 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1208 including, for example, magnetic tape, hard disk, etc.; and communication devices 1209. Communication device 1209 allows electronic device 1200 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 12 An electronic device 1200 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0109] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1209, or installed from storage device 1208, or installed from ROM 1202. When the computer program is executed by processing device 1201, it performs the functions defined in the meeting minutes processing method of embodiments of this disclosure.

[0110] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0111] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0112] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0113] The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: acquire a target effect application request, wherein the target effect application request carries a first template including at least one material to be processed, the first template being characterized using a unified template protocol; acquire a target effect template for the target effect, wherein the target effect template combines at least two effect objects using the unified template protocol; acquire the effect resources for the target effect; merge the first template and the target effect template to obtain a second template; and display an effect draft based on the effect resources and the second template, wherein the effect draft is a draft file after applying the at least two effect objects to the at least one material to be processed.

[0114] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0115] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0116] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0117] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0118] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0119] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0120] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0121] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0122] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A special effects processing method, characterized in that, include: Obtain a target effect application request, wherein the target effect application request carries a first template including at least one material to be processed, the first template being characterized using a unified template protocol; Obtain the target effect template for the target effect, wherein the target effect template combines at least two effect objects using the unified template protocol; Obtain the special effects resources for the target special effects; The first template and the target effect template are merged to obtain the second template; Based on the special effects resources and the second template, a special effects draft is displayed, wherein the special effects draft is a draft file after applying the at least two special effects objects to the at least one material to be processed.

2. The method according to claim 1, characterized in that, The target effect template for obtaining the target effect includes: Obtain the resource package of the target special effect, and extract the first special effect template from the resource package; The first special effects template is deserialized to generate the second special effects template; The target effect template is determined based on the second effect template.

3. The method according to claim 2, characterized in that, Determining the target special effects template based on the second special effects template includes: If it is determined based on the second special effect template that the at least two special effect objects include a preset special effect object, then the at least one material to be processed is processed based on the algorithm of the preset special effect object to obtain at least one special effect material, and the second special effect template with the at least one special effect material added is determined as the target special effect template; If the preset effect object is not included among the at least two effect objects, then the second effect template is determined as the target effect template.

4. The method according to claim 1, characterized in that, Acquiring the special effects resources for the target special effects includes: Based on the resource addresses of at least two special effects objects in the target special effects template, obtain the resource packages of the at least two special effects objects, or extract the pre-downloaded resource packages of the at least two special effects objects from the resource package of the target special effects; The resource packages of the at least two special effects objects are used to determine the special effects resources of the target special effect.

5. The method according to claim 1, characterized in that, The first template and the target effect template are merged to obtain a second template, including: At the positions of the materials to be processed in the first template, the resource information and special effects materials of the special effects objects corresponding to the materials to be processed in the target special effects template are merged to obtain the second template, wherein one material to be processed corresponds to at least one special effects object.

6. The method according to claim 1, characterized in that, Based on the aforementioned special effects resources and the second template, a draft of the special effects is displayed, including: When the second template includes special effects material, when displaying the special effects draft, the special effects material is overlaid on the corresponding material to be processed using a rendering proxy based on the resource package of the preset special effects object corresponding to the special effects material in the special effects resource.

7. The method according to claim 1, characterized in that, The method further includes: In response to the editing operation on the special effects draft, the properties of the at least two special effects objects are edited.

8. A special effects processing device, characterized in that, include: The request module is used to obtain a target effect application request, wherein the target effect application request carries a first template including at least one material to be processed, and the first template is characterized using a unified template protocol. The template module is used to obtain the target effect template of the target effect, wherein the target effect template combines at least two effect objects using the unified template protocol; The resource module is used to acquire the special effects resources for the target special effects; The fusion module is used to fuse the first template and the target effect template to obtain a second template; The display module is used to display a special effects draft based on the special effects resource and the second template, wherein the special effects draft is a draft file after applying the at least two special effects objects to the at least one material to be processed.

9. An electronic device, characterized in that, The electronic device includes: processor; Memory used to store the processor's executable instructions; The processor is configured to read the executable instructions from the memory and execute the instructions to implement the special effects processing method according to any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The storage medium stores a computer program for executing the special effects processing method described in any one of claims 1-7.

Images