Special effect rendering method and apparatus, electronic device, and storage medium

Abstract

Provided in the embodiments of the present disclosure are a special effect rendering method and apparatus, an electronic device, and a storage medium, the method comprising: loading a special effect data packet to generate a special effect rendering link, the special effect rendering link comprising at least two rendering execution units, and each rendering execution unit being used for generating a rendering special effect; after the first rendering execution unit in the special effect rendering link has performed execution, on the basis of the dependency relation between the second rendering execution unit following the first rendering execution unit and the first rendering execution unit, calling a target processing algorithm to recompute a rendering result output by the first rendering execution unit, so as to obtain an updated result; and, on the basis of the updated result, the second rendering execution unit performing execution to generate special effect media containing at least two rendering special effects. The present disclosure updates in real time rendering data in a composite special effect rendering process, so that the rendering data used by the second rendering execution unit is more accurate, thereby improving the rendering accuracy and rendering effect of the special effects.

Description

Special effects rendering method, device, electronic device and storage medium

[0001] This application claims priority to Chinese patent application No. 202311789641.5 filed on December 22, 2023, and the contents of the above-mentioned Chinese patent application disclosure are hereby cited in their entirety as part of this application. Technical Field

[0002] Embodiments of the present disclosure relate to a special effects rendering method, device, electronic device, and storage medium. Background Art

[0003] Currently, the special effects rendering function implemented in various applications usually obtains special effects data by loading the corresponding special effects data package, and then performs special effects rendering on the initial material selected by the user based on the special effects data, thereby generating special effects media containing special effects.

[0004] However, when a composite rendering effect consisting of two or more rendering effects needs to be added to the initial material, the rendering accuracy of the effect is reduced and the rendering effect is poor. Summary of the Invention

[0005] Embodiments of the present disclosure provide a special effects rendering method, device, electronic device, and storage medium to overcome the problems of reduced rendering accuracy and poor rendering effect.

[0006] In a first aspect, an embodiment of the present disclosure provides a special effects rendering method, comprising:

[0007] By loading a special effect data packet, a special effect rendering chain is generated, wherein the special effect rendering chain includes at least two rendering execution units, each of which is used to generate a rendering special effect; after the special effect rendering chain executes the first rendering execution unit, based on the dependency relationship between the second rendering execution unit following the first rendering execution unit and the first rendering execution unit, the target processing algorithm is called to recalculate the rendering result output by the first rendering execution unit to obtain an updated result; based on the updated result, the second rendering execution unit is executed to generate special effect media containing at least two rendering special effects.

[0008] In a second aspect, an embodiment of the present disclosure provides a special effects rendering device, comprising:

[0009] A loading module, configured to generate a special effect rendering chain by loading a special effect data packet, wherein the special effect rendering chain includes at least two rendering execution units, each of which is configured to generate a rendering special effect;

[0010] a processing module configured to, after the special effects rendering chain completes execution of a first rendering execution unit, call a target processing algorithm based on a dependency relationship between a second rendering execution unit following the first rendering execution unit and the first rendering execution unit to recalculate a rendering result output by the first rendering execution unit, thereby obtaining an updated result;

[0011] An execution module is configured to execute the second rendering execution unit based on the update result to generate special effect media including at least two rendering special effects.

[0012] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0013] The memory stores computer-executable instructions;

[0014] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the special effects rendering method described in the first aspect and various possible designs of the first aspect.

[0015] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the special effects rendering method described in the first aspect and various possible designs of the first aspect is implemented.

[0016] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the special effects rendering method described in the first aspect and various possible designs of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0018] FIG1 is a diagram showing an application scenario of the special effects rendering method provided by an embodiment of the present disclosure;

[0019] FIG2 is a flowchart diagram 1 of a special effects rendering method provided by an embodiment of the present disclosure;

[0020] FIG3 is a schematic diagram of a special effects rendering link provided by an embodiment of the present disclosure;

[0021] FIG4 is a flowchart of a specific implementation of step S101 in the embodiment shown in FIG2 ;

[0022] FIG5 is a flowchart of a specific implementation method of step S1013 in the embodiment shown in FIG4 ;

[0023] FIG6 is a schematic diagram of an entity group provided by an embodiment of the present disclosure;

[0024] FIG7 is a schematic diagram of generating an update result provided by an embodiment of the present disclosure;

[0025] FIG8 is a flowchart of a specific implementation method of obtaining the update result in step S101;

[0026] FIG9 is a second flow chart of a special effects rendering method provided by an embodiment of the present disclosure;

[0027] FIG10 is a structural block diagram of a special effects rendering device provided by an embodiment of the present disclosure;

[0028] FIG11 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure;

[0029] FIG12 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0031] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0032] The following explains the application scenarios of the embodiments of the present disclosure:

[0033] FIG1 is a diagram of an application scenario of the special effects rendering method provided by an embodiment of the present disclosure. The special effects rendering method provided by an embodiment of the present disclosure can be applied to an application with a media editing function, and more specifically, can be applied to an application scenario of adding special effects to images and videos. The execution subject of this embodiment can be a terminal device running the above-mentioned application with a media editing function, or a server deploying the server corresponding to the above-mentioned application, or other electronic devices that perform similar functions. Referring to FIG1 , taking a terminal device as an example, the terminal device runs, for example, video editing software, and the video editing software is pre-set with special effects props for adding video special effects to video materials. When the user loads the video material through the video editing software, clicking the control button corresponding to the special effects prop can achieve the effect of rendering the corresponding video special effects in the video material. Afterwards, the rendered video containing special effects can be first displayed in a preview window as shown in the figure, and then saved as a video file or uploaded to the server for publishing in response to the user's operation instructions.

[0034] In some embodiments, in the implementation scheme for adding special effects to media materials, independent rendering effects are usually added to the media materials. For example, a facial deformation rendering effect, an image style transfer rendering effect, etc. are added to the character objects in the video. At the same time, when adding more than two rendering effects, it is necessary to ensure that there is no mutual coupling or mutual dependence between different rendering effects. For example, a "facial makeup" rendering effect can be added to the face of the character in the video, and a "replace video background" rendering effect can be added to the background of the character in the video. The above two rendering effects will not affect each other, that is, they can be processed in parallel and then displayed by superimposing each other.

[0035] However, for composite rendering effects composed of more than two rendering effects, the solutions in some embodiments may lead to problems of reduced rendering accuracy and poor rendering effects. A composite rendering effect refers to an effect that includes at least two interdependent rendering effects. For example, first adding a "facial deformation" rendering effect to the face of a person in a video, and then adding a "facial makeup" rendering effect to the face of a person in the video, will lead to problems of reduced rendering accuracy and poor rendering effects. This is because, in some embodiments, the solutions use the same input to control the processing steps of different rendering effects, which results in that when there is a mutual dependence between the rendering effects, after the processing step of the previous special effect rendering is completed, the output rendering data and the original input parameters have changed, while the processing step of the next special effect rendering is still executed based on the original input parameters, resulting in problems of reduced rendering accuracy and poor rendering effects.

[0036] The embodiments of the present disclosure provide a special effects rendering method to solve the above problems.

[0037] Referring to FIG2 , FIG2 is a flow chart of a special effects rendering method provided by an embodiment of the present disclosure. The method of this embodiment can be applied in a terminal device, and the special effects rendering method includes:

[0038] Step S101: Generate a special effect rendering chain by loading a special effect data packet. The special effect rendering chain includes at least two rendering execution units, and each rendering execution unit is used to generate a rendering special effect.

[0039] Exemplarily, referring to the application scenario diagram shown in FIG1 , the terminal device loads a special effects data packet corresponding to the special effects prop by running an application (such as video editing software) and responding to the user's triggering operation on the special effects prop set in the application. The special effects prop can be used to implement a composite rendering special effect. For example, the name of the special effects prop is "one-click beauty makeup". After the special effects prop is triggered, it is used to add multiple beauty effects to the face of the character in the video at one time. For another example, the name of the special effects prop is "smiling cartoon image". After the special effects prop is triggered, it is used to add a smiling expression to the face of the character in the video and convert the video screen into a cartoon style. The special effects data packet contains the descriptive information required to implement the rendering effect corresponding to the above-mentioned special effects prop.

[0040] Furthermore, the description information in the special effect data packet can generate at least one special effect rendering chain, which includes at least two rendering execution units, each rendering execution unit is used to generate a rendering special effect, and at the same time, each rendering execution unit corresponds to a rendering node (EffectNode) for storing corresponding rendering data, and the rendering data may include rendering results and input parameters required for the rendering process. Exemplarily, the special effect rendering chain includes at least a first rendering execution unit and a second rendering execution unit, and the first rendering execution unit and the second rendering execution unit are used to execute corresponding rendering steps respectively to achieve corresponding rendering special effects. For example, the first rendering execution unit is used to stretch the coordinate points of the mouth of the portrait in the video screen, thereby achieving a rendering special effect of deforming the portrait mouth; and the second rendering execution unit is used to add a material map according to the coordinate points of the mouth of the portrait in the video screen, thereby achieving a rendering special effect of adding "lipstick" to the portrait mouth. The first rendering execution unit and the second rendering execution unit can be adjacent or non-adjacent. That is, other rendering execution units can be included between the first rendering execution unit and the second rendering execution unit. In addition, the special effects rendering chain may optionally include other rendering execution units, each rendering execution unit corresponding to a rendering effect, and after each rendering execution unit is executed in parallel or serially, the final rendering result, i.e., the special effects media, is obtained.

[0041] Figure 3 is a schematic diagram of a special effects rendering link provided by an embodiment of the present disclosure. As shown in Figure 3, after loading the special effects data packet Pack_1, the generated special effects rendering link L1 includes three rendering execution units, namely rendering execution unit A, rendering execution unit B, and rendering execution unit C (respectively shown as A, B, and C in the figure), wherein rendering execution unit A, rendering execution unit B, and rendering execution unit C are executed in sequence, wherein rendering execution unit A corresponds to rendering node EN_1, and is used to add a portrait mouth stretching special effect based on the initial material to generate image P1; rendering execution unit B corresponds to rendering node EN_2, and is used to add a "lipstick special effect" to the portrait mouth in image P1 on the basis of image P1 to generate image P2; rendering execution unit C corresponds to rendering node EN_3, and is used to add a "virtual fashion special effect" to the portrait legs in image P2 on the basis of image P2 to generate image P3.

[0042] Furthermore, the specific implementation of the special effects rendering link is further introduced below. For example, as shown in FIG4 , a possible implementation of step S101 includes:

[0043] Step S1011: obtaining special effect description information constructed based on the entity component system model in the special effect data packet.

[0044] Step S1012: Based on the special effect description information, at least two entity groups corresponding to the scene data are obtained, and the entity groups are used to implement the rendering special effects corresponding to the rendering execution units.

[0045] Step S1013: Construct a special effects rendering link through the entity group.

[0046] Exemplarily, first, the Entity-Component-System (ECS) pattern, also known as the Entity-Component-System framework, is a framework or pattern for building and managing scenes. Among them, the scene, that is, the scene data, is the smallest update unit under the Entity Component System framework. The Entity Component System framework is implemented by splitting the various elements of the scene into entity units, component units, and system units. Among them, entity is an abstract concept that represents an object or role in the scene. Components are attributes or features of an entity, such as position, rotation, material, etc. The system is an execution (code) module that processes and manages components, and is used to update and operate entity units and component units.

[0047] In the steps of this embodiment, by parsing the special effects data packet, the special effects description information constructed based on the entity component system model can be obtained, that is, the special effects information described based on the scene data. Subsequently, based on the functional units (entity units, component units, and system units) described in the entity component system model, the scene data is split into entity groups, each of which is used to implement the rendering special effects corresponding to the rendering execution unit. Because scene data in some embodiments is the smallest update unit in the entity component system model, a piece of scene data can only correspond to one input parameter, such as "portrait outline coordinates." Therefore, multiple consecutive rendering special effects corresponding to the scene data can only be rendered based on the same "portrait outline coordinates," leading to the aforementioned technical problems. In this embodiment, by parsing the scene data, at least two corresponding entity groups are obtained to implement the rendering special effects corresponding to the rendering execution units. Then, the special effects rendering chain is constructed based on the entity groups. As a result, during the execution of the special effects rendering chain, other processing algorithms can be called for recalculation after each rendering execution unit completes execution, thereby obtaining real-time updated and correct input parameters, achieving rendering accuracy and rendering results.

[0048] Furthermore, the entity group includes one or more component units, namely, a component unit group, and a corresponding system unit. The component unit group includes multiple component units based on the entity component system pattern. The component units in the component unit group are located under the root entity unit mounted by the corresponding rendering execution unit. As shown in FIG5 , the specific implementation of step S1013 includes:

[0049] Step S1013A: Generate a rendering node according to the component units in the entity group.

[0050] Step S1013B: Generate a rendering execution unit according to the system unit corresponding to the component unit.

[0051] Step S1013C: Arrange the rendering nodes and corresponding rendering execution units according to the logic information in the entity group to generate a special effect rendering link.

[0052] For example, an entity group is a unique data structure designed to implement the above-mentioned embodiment scheme and is the basic design for implementing local updates within the scene data. That is, the special effect description information in the special effect data packet is described based on the "entity group" method, and in this way, the "scene data" is replaced. In other words, in the steps of this embodiment, the special effect rendering chain is no longer constructed based on the "scene data", but is instead constructed based on the "entity group", thereby achieving real-time recalculation during the rendering process, that is, local updates within the scene data. Specifically, an entity group contains an independent set of component units and the system units managed by them. The division of entity groups is achieved based on special effect nodes (special effect execution units), that is, one entity group corresponds to one special effect node or special effect execution unit. Each entity group will contain all component units under the root entity mounted by its associated special effect node; the system units contained in an entity group are no longer global, but rather a collection of local system units focused on the corresponding component units.

[0053] Figure 6 is a schematic diagram of an entity group provided by an embodiment of the present disclosure. As shown in Figure 6, entity group #1 includes a root entity unit Entity_1, under which a rendering node EffectNode_1, a system unit Transform_1, and entities Entity2 and Entity3 are mounted. Among them, under entity Entity2, there are system unit Transform_2 and component unit JScript Component, and under entity Entity3, there are system unit Transform_3 and component unit Camera. Afterwards, according to the steps in the above embodiment, the component unit group is converted to generate the corresponding rendering execution unit. At the same time, the terminal device can obtain multiple entity groups through the above steps, such as entity group #2 shown in the figure, and each entity group implements a rendering execution unit, thereby realizing a special effect rendering link.

[0054] Specifically, rendering nodes are generated based on the component units in the entity group, and rendering execution units are generated based on the system units corresponding to the component units, thereby realizing the disassembly and conversion of the scene. Afterwards, according to the logical information in the entity group, each rendering node and the corresponding rendering execution unit are arranged to generate a special effect rendering chain. Among them, in one possible implementation method, the entity group includes a base entity group (Base Entity Group, BEG), which is used to execute logic or global system units across rendering special effects. The terminal device can obtain logical information through the base entity group, and then realize the construction of the special effect rendering chain. Among them, the base entity group is a special entity group that is responsible for executing logic or global system units across effects, such as the global System script part of EventSystem / ScriptSystem, etc. The base entity group contains all component units and system units within the scene data unit.

[0055] In another possible implementation, the special effect data packet includes at least two sub-special effect data packets, and the sub-special effect data packets include special effect description information constructed based on the entity component system model. The specific implementation of step S101 includes:

[0056] Step S1014: for each sub-effect data packet, based on the special effect description information in the sub-effect data packet, a target entity group corresponding to the scene data is obtained, and the target entity group is used to implement the rendering special effect corresponding to the rendering execution unit.

[0057] Step S1015: construct a special effect rendering link through the target entity group corresponding to each sub-special effect data packet.

[0058] For example, in the steps of this embodiment, the special effects data packet includes at least two sub-special effects data packets. The data structure of the sub-special effects data packets is similar to the sum data structure of the special effects data packets in the steps of the embodiment shown in FIG. 4 , which is equivalent to pre-dividing the special effects data packets. Each special effects data packet contains an entity group, namely a target entity group. Subsequently, the target entity groups corresponding to the sub-special effects data packets are assembled to obtain a special effects rendering chain. The implementation method for obtaining the corresponding target entity group based on the sub-special effects data packets is similar to the implementation method for obtaining the entity group in the embodiment shown in FIG. 4 and will not be repeated here.

[0059] Step S102: After the special effects rendering chain executes the first rendering execution unit, based on the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit, the target processing algorithm is called to recalculate the rendering result output by the first rendering execution unit to obtain an updated result.

[0060] Step S103: executing the second rendering execution unit based on the update result to generate special effect media including at least two rendering special effects.

[0061] Furthermore, in combination with the introduction to the special effects rendering link in the previous steps, in the process of executing the special effects rendering link to process the initial material, the first rendering execution unit and the second rendering execution unit will be executed in sequence. After the execution of the first rendering execution unit, a rendering result is generated. In one possible implementation method, the rendering result includes rendering data updated to the rendering node corresponding to the first rendering execution unit. Afterwards, based on the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit, the target processing algorithm is called to recalculate the rendering result output by the first rendering execution unit to obtain an updated result. Among them, the dependency relationship represents whether the input parameters of the second rendering execution unit are determined based on the rendering result of the first rendering execution unit. More specifically, the dependency relationship includes a first type of relationship and a second type of relationship, wherein the first type of relationship represents that the second rendering execution unit depends on the first rendering execution unit, and correspondingly, the second type of relationship represents that the second rendering execution unit does not depend on the first rendering execution unit.

[0062] More specifically, for example, referring to the schematic diagram of the special effects rendering link shown in Figure 3, the first rendering execution unit is, for example, the rendering execution unit A shown in Figure 3, and its corresponding rendering special effect is used to stretch the "portrait mouth" in the video screen to obtain an image P1 with a deformed portrait mouth contour. Afterwards, the second rendering execution unit is executed, such as the rendering execution unit B shown in Figure 3, to process the image P1, add a lipstick special effects map to the "portrait mouth" in the video screen, and generate an image P2. In this process, after the first rendering execution unit is executed, the "contour of the portrait's mouth" in the generated image P1 has changed. When the second rendering execution unit is subsequently executed, the "contour of the portrait's mouth" needs to be used as an input parameter to execute the rendering step, that is, the lipstick special effect map is added based on the "contour of the portrait's mouth". Therefore, the input parameters of the second rendering execution unit are determined based on the rendering result of the first rendering execution unit, that is, the second rendering execution unit after the first rendering execution unit depends on the first rendering execution unit. This is a manifestation of a dependency relationship (a first-class relationship). Under this dependency relationship, since the rendering data has changed, it is necessary to call the target processing algorithm to recalculate the rendering result output by the first rendering execution unit to obtain updated rendering data, that is, an updated result.

[0063] On the contrary, as shown in reference Figure 3, if the input parameters of the second rendering execution unit do not need to be determined based on the rendering results of the first rendering execution unit, that is, for example, after the rendering execution unit B (in this case, the rendering execution unit B corresponds to the first rendering execution unit) is executed, the "outline of the portrait's legs" in the generated image P2 does not change, then when the rendering execution unit C (corresponding to the second rendering execution unit) is subsequently executed, when the "outline of the portrait's legs" is required as an input parameter, there is no need to update the rendering data, but directly use the initial rendering data or the rendering result output by the previous rendering execution unit (obtained in a manner similar to the steps of this embodiment) as an input parameter to execute the rendering step. That is, in this case, the second rendering execution unit after the first rendering execution unit does not depend on the first rendering execution unit. This is another manifestation of a dependency relationship (a second type of relationship).

[0064] That is, in one possible implementation, the specific implementation of step S102 includes:

[0065] Step S1021: If the first rendering execution unit and the second rendering execution unit are in a first dependency relationship, then calling a target processing algorithm to recalculate the rendering result output by the first rendering step to obtain an updated result.

[0066] Step S1022: If the first rendering execution unit and the second rendering execution unit are in a second dependency relationship, then the rendering data in the preceding rendering node is obtained, and the rendering data is used as the update result.

[0067] Figure 7 is a schematic diagram of generating an update result provided by an embodiment of the present disclosure. As shown in Figure 7, exemplarily, after loading the special effect data packet Pack_2, the generated special effect rendering link L2 includes three rendering execution units, namely rendering execution unit A, rendering execution unit B, and rendering execution unit C, wherein rendering execution unit A, rendering execution unit B, and rendering execution unit C (shown as A, B, and C in the figure) are executed in sequence, wherein rendering execution unit A corresponds to rendering node EN_1, and is used to add a "smile stretching special effect" to the mouth of the portrait based on the initial material to generate image P1; rendering execution unit B corresponds to rendering node EN_2, and is used to add a "lipstick special effect" to the mouth of the portrait in image P1 on the basis of image P1 to generate image P2; rendering execution unit C corresponds to rendering node EN_3, and is used to replace the image background based on image P2. Based on the previous description, since the dependency between rendering execution unit A (equivalent to the first rendering execution unit) and rendering execution unit B (equivalent to the second rendering execution unit) is a first-class relationship, after the special effects rendering chain L2 completes the execution of rendering execution unit A, image P1 is recalculated by calling the target processing algorithm, where the target processing algorithm is, for example, a "mouth contour" detection algorithm. The detection result is then stored as an update result in the corresponding rendering node, thereby updating the rendering data (mouth contour). Rendering execution unit B, which follows rendering execution unit A, is then executed using the updated result as an input parameter to obtain the rendering result of rendering execution unit B.

[0068] After the execution of rendering execution unit B, since the dependency relationship between rendering execution unit B (equivalent to the first rendering execution unit) and rendering execution unit C (equivalent to the second rendering execution unit) is a second-type relationship, that is, rendering execution unit B causes the portrait torso contour required by rendering execution unit C to change, the image P2 output by rendering execution unit B is no longer recalculated. Instead, the rendering data (portrait torso contour) in the front rendering node EN_2 is directly obtained as the updated update result. Afterwards, the rendering execution unit C after rendering execution unit B and other subsequent rendering execution units are executed using the updated result obtained based on the rendering data of the front rendering node as an input parameter until the execution of all rendering execution units on the special effect rendering link L2 is completed, and at least two rendering special effects are generated, such as the "smile stretching special effect" corresponding to rendering execution unit A in this embodiment, the "lipstick special effect" corresponding to rendering execution unit B, and the "background replacement special effect" corresponding to rendering execution unit C.

[0069] Furthermore, the target processing algorithm called in the steps of the above embodiment can be implemented through a preset computing node. In one possible implementation, the special effects rendering link also includes at least one computing node for calling the processing algorithm, and the computing node and the rendering execution unit are arranged in order in the special effects rendering link. In the process of performing special effects rendering, the terminal device generates a special effects rendering link by loading a special effects data packet, and then executes the special effects rendering link. Based on the order of the link processing nodes in the special effects rendering link, the rendering execution unit and the computing node in the special effects rendering link are called in sequence, thereby realizing the call of the target processing algorithm.

[0070] Specifically, in a possible implementation, as shown in FIG8 , a specific implementation method for obtaining the update result includes:

[0071] Step S102A: acquiring a target computing node after the first rendering execution unit according to the sorting information in the special effects rendering link;

[0072] Step S102B: calling the target processing algorithm through the target computing node to recalculate the rendering result to obtain an updated result.

[0073] For example, the sorting information is used to record the execution order of each processing node (including rendering execution units and computing nodes) in the special effects rendering chain, and the execution of the special effects rendering chain is implemented based on this sorting information. According to the execution order of each processing node described by the sorting information, the next processing node after the first rendering execution unit, that is, the target computing node, can be obtained. After the first rendering execution unit is executed, the corresponding target processing algorithm is called through the target computing node to recalculate the rendering result to obtain an updated result.

[0074] In the disclosed embodiment, a special effect rendering link is generated by loading a special effect data packet. The special effect rendering link includes at least two rendering execution units, each of which is used to generate a rendering special effect. After the special effect rendering link executes the first rendering execution unit, the target processing algorithm is called to recalculate the rendering result output by the first rendering execution unit based on the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit to obtain an updated result. The second rendering execution unit is executed based on the updated result to generate special effect media containing at least two rendering special effects. In the process of executing the special effect rendering link, the corresponding target processing algorithm is called to recalculate the rendering result of the first rendering execution based on the dependency relationship between the subsequent second rendering execution unit and the preceding first rendering execution unit, thereby realizing real-time updating of the rendering data in the composite special effect rendering process, making the rendering data used by the second rendering execution unit more accurate, thereby improving the rendering accuracy and rendering effect of the special effect.

[0075] Referring to FIG9 , FIG9 is a second flow chart of a special effects rendering method provided by an embodiment of the present disclosure. Based on the embodiment shown in FIG2 , this embodiment further refines steps S101-S102 and adds a pre-step of generating initial input parameters. The special effects rendering method includes:

[0076] Step S201: Loading initial material.

[0077] Step S202: Generate a special effects rendering link and an algorithm processing link by loading a special effects data packet.

[0078] Step S203: Process the initial material through an algorithm processing link to generate initial input parameters of the special effects rendering link, wherein the algorithm processing link includes at least one computing node, and the computing node is used to call the processing algorithm to iteratively process the initial material.

[0079] For example, in combination with the application scenario diagram shown in FIG1 and the embodiment shown in FIG2, after the terminal device runs the application, it first loads the material to be added with special effects, such as videos, pictures, etc., that is, the initial material. Then, by triggering the special effects props, the special effects data packet is loaded. The special effects rendering link and the algorithm processing link can be generated through the description information contained in the special effects data packet. The special effects rendering link has been introduced in the previous embodiment and will not be repeated here. The algorithm processing link is equivalent to the front link of the special effects rendering link, which is used to process the initial material and generate the initial input parameters required for the special effects rendering link. The algorithm processing link contains at least one computing node, and each computing node corresponds to a processing algorithm, such as human body contour recognition for the image (initial material), AIGC image generation based on the image, etc. The computing node is used to call the processing algorithm to iteratively process the initial material, which means that the processing of the initial material starts with the first computing node, and the output of the previous computing node is used as the input of the next computing node for iterative processing, and finally the initial input parameters of the special effects rendering link are obtained.

[0080] Specifically, the initial material is first processed through the algorithm processing link to generate the initial input parameters of the special effects rendering link. The initial input parameters can be regarded as input parameters of the input special effects rendering link, which can be used by multiple processing nodes (rendering execution units, computing nodes) within the input special effects rendering link. It can also be regarded as input parameters of the first processing node of the input special effects rendering link, which is only used to execute the first processing node of the special effects rendering link. The specific implementation method is set according to needs and will not be repeated here.

[0081] Of course, in another possible implementation, the initial input parameter may also be fixed information preset in the special effects data packet, or information obtained by processing the initial material by executing other functional scripts. No specific limitation is made here.

[0082] Step S204: Execute the special effects rendering link based on the initial input parameters.

[0083] Step S205: After the special effect rendering chain completes executing the first rendering execution unit, a target special effect type corresponding to a second rendering execution unit following the first rendering execution unit is obtained.

[0084] Step S206: determining a dependency relationship between the second rendering execution unit and the first rendering execution unit according to the target special effect type and the rendering result output by the first rendering execution unit.

[0085] Exemplarily, thereafter, according to the initial input parameters obtained in the previous step, the special effects rendering chain is input, and the special effects rendering step is executed, wherein the special effects rendering chain includes at least a first rendering execution unit and a second rendering execution unit executed thereafter. Exemplarily, after executing the first rendering execution unit, the target special effect type corresponding to the second rendering execution unit is obtained, wherein the target special effect type is the type of rendering special effect implemented by the second rendering execution unit, such as "slim face special effect", "big eyes special effect", etc. The target special effect type can also refer to a type of special effect, such as "facial special effect", "torso special effect", etc.

[0086] Afterwards, based on the target special effect type and the rendering result output by the first rendering execution unit, the dependency relationship between the second rendering execution unit and the first rendering execution unit is determined, that is, whether the target special effect type (rendering special effect) depends on the rendering result output by the first rendering execution unit, wherein, for example, the rendering result output by the first rendering execution unit may include a special effect type identifier representing the special effect type, and may also include rendering the variable; specifically, for example, the target special effect type is "lipstick special effect", and the rendering result output by the first rendering execution unit is "mouth shape stretching" (special effect type identifier), then based on the preset judgment rule, the dependency relationship between the second rendering execution unit and the first rendering execution unit is a first-class relationship, that is, the second rendering execution unit depends on the first rendering execution unit. For another example, the target special effect type is "lipstick special effect", and the rendering result output by the first rendering execution unit is "mouth shape stretching" (special effect type identifier) ​​and 20 pixels (position offset), wherein the deformation variable 20 pixels is less than the preset value 30 pixels in the judgment rule. Based on the preset judgment rules, the dependency relationship between the second rendering execution unit and the first rendering execution unit is a second-type relationship, that is, although the input parameters of the second rendering execution unit will be affected by the rendering results of the first rendering execution unit, due to the smaller impact (for example, the position offset is small), no recalculation is performed, thereby improving processing efficiency.

[0087] Step S207: determining a target processing algorithm according to input features of the second rendering execution unit and / or the rendering result of the first rendering execution unit, wherein the input features include a target special effect type or input parameters of the second rendering execution unit.

[0088] Furthermore, after determining the dependency relationship between the second rendering execution unit and the first rendering execution unit, if the two are dependent, it is necessary to call the target processing algorithm to recalculate the rendering result, wherein the target processing algorithm can be determined based on at least one of the above factors, namely, the input parameters of the second rendering execution unit, the target special effect type of the second rendering execution unit, and the rendering result of the first rendering execution unit. This ensures that when the first rendering execution unit pollutes the preceding rendering data, the target algorithm is called for recalculation based on the data polluted by the first rendering execution unit and / or the data required by the second rendering execution unit. In one possible implementation method, the target processing algorithm is determined based on the input features of the second rendering execution unit and the input parameters of the second rendering execution unit.

[0089] Step S208: calling the target processing algorithm to recalculate the rendering result output by the first rendering execution unit to obtain an updated result.

[0090] Step S209 : executing the second rendering execution unit based on the update result to generate special effect media including at least two rendering special effects.

[0091] In this embodiment, the implementation of steps S201, S208-step S209 has been described in detail in the embodiment shown in FIG2 of the present disclosure, and will not be repeated here.

[0092] Corresponding to the special effects rendering method of the above embodiment, FIG10 is a structural block diagram of the special effects rendering device provided by the embodiment of the present disclosure. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Referring to FIG10, the special effects rendering device 3 includes:

[0093] A loading module 31 is configured to generate a special effect rendering chain by loading a special effect data packet. The special effect rendering chain includes at least two rendering execution units, each rendering execution unit being configured to generate a rendering special effect.

[0094] The processing module 32 is configured to, after the special effects rendering chain completes execution of the first rendering execution unit, call a target processing algorithm based on the dependency relationship between a second rendering execution unit following the first rendering execution unit and the first rendering execution unit to recalculate the rendering result output by the first rendering execution unit to obtain an updated result;

[0095] The execution module 33 is configured to execute the second rendering execution unit based on the update result to generate special effect media including at least two rendering special effects.

[0096] According to one or more embodiments of the present disclosure, the processing module 32 is further used to: obtain a target special effect type corresponding to the second rendering execution unit; determine a dependency relationship between the second rendering execution unit and the first rendering execution unit based on the target special effect type and the rendering result output by the first rendering execution unit; wherein the rendering result includes rendering data updated to the rendering node corresponding to the first rendering execution unit.

[0097] According to one or more embodiments of the present disclosure, the dependency relationship includes a first type of relationship, which represents the input parameters of the rendering execution unit of the target special effect type, and is determined based on the rendering result. The target processing algorithm is used to generate the input parameters of the rendering execution unit of the target special effect type; the processing module 32 calls the target processing algorithm to recalculate the rendering result output by the first rendering step based on the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit, and obtains an updated result. Specifically, it is used for: if the first rendering execution unit and the second rendering execution unit are in the first dependency relationship, then calling the target processing algorithm to recalculate the rendering result output by the first rendering step to obtain an updated result.

[0098] According to one or more embodiments of the present disclosure, the dependency relationship also includes a second type of relationship; the second type of relationship represents the input parameters of the rendering execution unit of the target special effect type, which is generated based on the rendering data in the front rendering node; the processing module 32 is also used to: if the first rendering execution unit and the second rendering execution unit are in a second dependency relationship, then obtain the rendering data in the front rendering node and use the rendering data as the update result.

[0099] According to one or more embodiments of the present disclosure, the processing module 32 is further used to determine a target processing algorithm based on input features of the second rendering execution unit and / or the rendering results of the first rendering execution unit, wherein the input features include a target special effect type or input parameters of the second rendering execution unit.

[0100] According to one or more embodiments of the present disclosure, the special effects rendering link also includes at least one computing node for calling a processing algorithm; when the processing module 32 calls the target processing algorithm to recalculate the rendering result output by the first rendering execution unit to obtain an updated result, it is specifically used to: obtain the target computing node after the first rendering execution unit according to the sorting information in the special effects rendering link; through the target computing node, call the target processing algorithm to recalculate the rendering result to obtain an updated result.

[0101] According to one or more embodiments of the present disclosure, the loading module 31 is further used to: load the initial material; process the initial material through an algorithm processing link to generate initial input parameters for the special effects rendering link, wherein the algorithm processing link includes at least one computing node, and the computing node is used to call the processing algorithm to iteratively process the initial material; the processing module 32 is further used to: execute the special effects rendering link based on the initial input parameters.

[0102] According to one or more embodiments of the present disclosure, the special effects data packet includes special effects description information constructed based on the entity component system model, and the loading module 31 is specifically used to: obtain at least two entity groups corresponding to the scene data based on the special effects description information, and the entity groups are used to implement the rendering special effects corresponding to the rendering execution unit; and construct a special effects rendering link through the entity groups.

[0103] According to one or more embodiments of the present disclosure, the entity group includes a component unit group and a system unit corresponding to the component unit group, and the component unit group includes multiple component units based on the entity component system pattern; the component units in the component unit group are located under the root entity unit mounted with the corresponding rendering execution unit; when the loading module 31 constructs a special effect rendering link through the entity group, it is specifically used to: generate rendering nodes according to the component units in the entity group; generate rendering execution units according to the system units corresponding to the component units; arrange each rendering node and the corresponding rendering execution unit according to the logical information in the entity group to generate a special effect rendering link.

[0104] According to one or more embodiments of the present disclosure, the entity group includes a basic entity group, which is used to execute logic or global system units across rendering effects; the loading module 31 is further used to obtain logic information based on the basic entity group.

[0105] According to one or more embodiments of the present disclosure, a special effect data packet includes at least two sub-special effect data packets, and the sub-special effect data packet includes special effect description information constructed based on the entity component system pattern. The loading module 31 is specifically used to: for each sub-special effect data packet, based on the special effect description information in the sub-special effect data packet, obtain a target entity group corresponding to the scene data, and the target entity group is used to implement the rendering special effect corresponding to the rendering execution unit; and construct a special effect rendering link through the target entity group corresponding to each sub-special effect data packet.

[0106] The loading module 31, processing module 32 and execution module 33 are connected in sequence. The special effect rendering device 3 provided in this embodiment can implement the technical solution of the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated in this embodiment.

[0107] FIG11 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. As shown in FIG12 , the electronic device 4 includes:

[0108] A processor 41, and a memory 42 communicatively connected to the processor 41;

[0109] Memory 42 stores computer-executable instructions;

[0110] The processor 41 executes the computer-executable instructions stored in the memory 42 to implement the special effects rendering method in the embodiments shown in FIG. 2 to FIG. 9 .

[0111] Optionally, the processor 41 and the memory 42 are connected via a bus 43 .

[0112] The relevant explanations can be understood by referring to the relevant descriptions and effects corresponding to the steps in the embodiments corresponding to Figures 2 to 9, and no further details will be given here.

[0113] An embodiment of the present disclosure provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are executed by a processor, they are used to implement the composite special effects rendering provided by any of the embodiments corresponding to Figures 2 to 9 of the present disclosure.

[0114] An embodiment of the present disclosure provides a computer program product, including a computer program. When the computer program is executed by a processor, it implements the composite special effects rendering provided by any one of the embodiments corresponding to Figures 2 to 9 of the present disclosure.

[0115] In order to implement the above embodiment, the embodiment of the present disclosure further provides an electronic device.

[0116] Referring to FIG12 , there is shown a schematic diagram of the structure of an electronic device 900 suitable for implementing an embodiment of the present disclosure. The electronic device 900 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG12 is merely an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.

[0117] As shown in FIG12 , the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. Various programs and data required for the operation of the electronic device 900 are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0118] Typically, the following devices may be connected to the I / O interface 905: an input device 906 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 908 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although FIG12 shows an electronic device 900 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0119] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 909, or installed from the storage device 908, or installed from the ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0120] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0121] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0122] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0123] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0124] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0125] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0126] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0127] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0128] In a first aspect, according to one or more embodiments of the present disclosure, a special effects rendering method is provided, comprising:

[0129] By loading a special effect data packet, a special effect rendering chain is generated, wherein the special effect rendering chain includes at least two rendering execution units, each of which is used to generate a rendering special effect; after the special effect rendering chain executes the first rendering execution unit, based on the dependency relationship between the second rendering execution unit following the first rendering execution unit and the first rendering execution unit, the target processing algorithm is called to recalculate the rendering result output by the first rendering execution unit to obtain an updated result; based on the updated result, the second rendering execution unit is executed to generate special effect media containing at least two rendering special effects.

[0130] According to one or more embodiments of the present disclosure, the method further includes: obtaining a target special effect type corresponding to the second rendering execution unit; determining a dependency relationship between the second rendering execution unit and the first rendering execution unit based on the target special effect type and the rendering result output by the first rendering execution unit; wherein the rendering result includes rendering data updated to the rendering node corresponding to the first rendering execution unit.

[0131] According to one or more embodiments of the present disclosure, the dependency relationship includes a first type of relationship, the first type of relationship represents the input parameters of the rendering execution unit of the target special effect type, and is determined based on the rendering result, the target processing algorithm is used to generate the input parameters of the rendering execution unit of the target special effect type; the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit, calling the target processing algorithm to recalculate the rendering result output by the first rendering step to obtain an updated result, including: if the first rendering execution unit and the second rendering execution unit are in a first dependency relationship, calling the target processing algorithm to recalculate the rendering result output by the first rendering step to obtain an updated result.

[0132] According to one or more embodiments of the present disclosure, the dependency relationship also includes a second type of relationship; the second type of relationship represents the input parameters of the rendering execution unit of the target special effect type, which is generated based on the rendering data in the front rendering node; the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit, calling the target processing algorithm to recalculate the rendering result output by the first rendering step to obtain an updated result, also includes: if the first rendering execution unit and the second rendering execution unit are in a second dependency relationship, obtaining the rendering data in the front rendering node, and using the rendering data as the updated result.

[0133] According to one or more embodiments of the present disclosure, the method further includes: determining the target processing algorithm based on the input characteristics of the second rendering execution unit and / or the rendering results of the first rendering execution unit, wherein the input characteristics include the target special effect type or the input parameters of the second rendering execution unit.

[0134] According to one or more embodiments of the present disclosure, the special effects rendering link also includes at least one computing node for calling a processing algorithm; the calling target processing algorithm recalculates the rendering result output by the first rendering execution unit to obtain an updated result, including: obtaining the target computing node after the first rendering execution unit according to the sorting information in the special effects rendering link; and calling the target processing algorithm through the target computing node to recalculate the rendering result to obtain an updated result.

[0135] According to one or more embodiments of the present disclosure, the method further includes: loading initial material; processing the initial material through an algorithm processing link to generate initial input parameters of the special effects rendering link, wherein the algorithm processing link includes at least one computing node, and the computing node is used to call a processing algorithm to iteratively process the initial material; and executing the special effects rendering link based on the initial input parameters.

[0136] According to one or more embodiments of the present disclosure, the special effects data packet includes special effects description information constructed based on an entity component system pattern, and the special effects rendering link is generated by loading the special effects data packet, including: based on the special effects description information, obtaining at least two entity groups corresponding to the scene data, and the entity groups are used to implement the rendering special effects corresponding to the rendering execution unit; and constructing the special effects rendering link through the entity groups.

[0137] According to one or more embodiments of the present disclosure, the entity group includes a component unit group and a system unit corresponding to the component unit group, the component unit group includes multiple component units based on the entity component system pattern; the component units in the component unit group are located under the root entity unit mounted with the corresponding rendering execution unit; the special effect rendering link is constructed through the entity group, including: generating rendering nodes according to the component units in the entity group; generating rendering execution units according to the system units corresponding to the component units; arranging each of the rendering nodes and the corresponding rendering execution units according to the logical information in the entity group to generate a special effect rendering link.

[0138] According to one or more embodiments of the present disclosure, the entity group includes a basic entity group, and the basic entity group is used to execute a logic or global system unit of a cross-rendering special effect; the method further includes: obtaining the logic information according to the basic entity group.

[0139] According to one or more embodiments of the present disclosure, the special effects data packet includes at least two sub-special effects data packets, and the sub-special effects data packets include special effects description information constructed based on the entity component system pattern. The special effects rendering link is generated by loading the special effects data packets, including: for each of the sub-special effects data packets, based on the special effects description information in the sub-special effects data packets, obtaining a target entity group corresponding to the scene data, the target entity group is used to implement the rendering special effect corresponding to the rendering execution unit; and constructing the special effects rendering link through the target entity groups corresponding to each of the sub-special effects data packets.

[0140] In a second aspect, according to one or more embodiments of the present disclosure, a special effects rendering device is provided, comprising:

[0141] A loading module, configured to generate a special effect rendering chain by loading a special effect data packet, wherein the special effect rendering chain includes at least two rendering execution units, each of which is configured to generate a rendering special effect;

[0142] a processing module configured to, after the special effects rendering chain completes execution of a first rendering execution unit, call a target processing algorithm based on a dependency relationship between a second rendering execution unit following the first rendering execution unit and the first rendering execution unit to recalculate a rendering result output by the first rendering execution unit, thereby obtaining an updated result;

[0143] An execution module is configured to execute the second rendering execution unit based on the update result to generate special effect media including at least two rendering special effects.

[0144] According to one or more embodiments of the present disclosure, the processing module is further used to: obtain a target special effect type corresponding to the second rendering execution unit; determine a dependency relationship between the second rendering execution unit and the first rendering execution unit based on the target special effect type and the rendering result output by the first rendering execution unit; wherein the rendering result includes rendering data updated to the rendering node corresponding to the first rendering execution unit.

[0145] According to one or more embodiments of the present disclosure, the dependency relationship includes a first type of relationship, the first type of relationship represents the input parameters of the rendering execution unit of the target special effect type, and is determined based on the rendering result. The target processing algorithm is used to generate the input parameters of the rendering execution unit of the target special effect type; the processing module calls the target processing algorithm to recalculate the rendering result output by the first rendering step based on the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit, and when obtaining an updated result, it is specifically used: if the first rendering execution unit and the second rendering execution unit are in a first dependency relationship, then call the target processing algorithm to recalculate the rendering result output by the first rendering step to obtain an updated result.

[0146] According to one or more embodiments of the present disclosure, the dependency relationship also includes a second type of relationship; the second type of relationship represents the input parameters of the rendering execution unit of the target special effect type, which is generated based on the rendering data in the front rendering node; the processing module is also used to: if the first rendering execution unit and the second rendering execution unit are in a second dependency relationship, obtain the rendering data in the front rendering node, and use the rendering data as the update result.

[0147] According to one or more embodiments of the present disclosure, the processing module is further used to: determine the target processing algorithm based on the input features of the second rendering execution unit and / or the rendering results of the first rendering execution unit, wherein the input features include the target special effect type or the input parameters of the second rendering execution unit.

[0148] According to one or more embodiments of the present disclosure, the special effects rendering link also includes at least one computing node for calling a processing algorithm; when the processing module calls the target processing algorithm to recalculate the rendering result output by the first rendering execution unit to obtain an updated result, it is specifically used to: obtain the target computing node after the first rendering execution unit according to the sorting information in the special effects rendering link; through the target computing node, call the target processing algorithm to recalculate the rendering result to obtain an updated result.

[0149] According to one or more embodiments of the present disclosure, the loading module is further used to: load initial material; process the initial material through an algorithm processing link to generate initial input parameters of the special effects rendering link, wherein the algorithm processing link includes at least one computing node, and the computing node is used to call a processing algorithm to iteratively process the initial material; the processing module is further used to: execute the special effects rendering link based on the initial input parameters.

[0150] According to one or more embodiments of the present disclosure, the special effects data packet includes special effects description information constructed based on an entity component system pattern, and the loading module is specifically used to: obtain at least two entity groups corresponding to the scene data based on the special effects description information, and the entity groups are used to implement the rendering special effects corresponding to the rendering execution unit; and construct the special effects rendering link through the entity groups.

[0151] According to one or more embodiments of the present disclosure, the entity group includes a component unit group and a system unit corresponding to the component unit group, and the component unit group contains multiple component units based on the entity component system pattern; the component units in the component unit group are located under the root entity unit mounted with the corresponding rendering execution unit; when the loading module constructs the special effect rendering link through the entity group, it is specifically used to: generate rendering nodes according to the component units in the entity group; generate rendering execution units according to the system units corresponding to the component units; arrange each of the rendering nodes and the corresponding rendering execution units according to the logical information in the entity group to generate a special effect rendering link.

[0152] According to one or more embodiments of the present disclosure, the entity group includes a basic entity group, which is used to execute logic or a global system unit across rendering effects; the loading module is further used to obtain the logic information based on the basic entity group.

[0153] According to one or more embodiments of the present disclosure, the special effect data packet includes at least two sub-special effect data packets, and the sub-special effect data packet includes special effect description information constructed based on the entity component system pattern. The loading module is specifically used to: for each of the sub-special effect data packets, based on the special effect description information in the sub-special effect data packet, obtain a target entity group corresponding to the scene data, and the target entity group is used to implement the rendering special effect corresponding to the rendering execution unit; and construct the special effect rendering link through the target entity group corresponding to each of the sub-special effect data packets.

[0154] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0155] The memory stores computer-executable instructions;

[0156] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the special effects rendering method described in the first aspect and various possible designs of the first aspect.

[0157] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the special effects rendering method described in the first aspect and various possible designs of the first aspect is implemented.

[0158] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the special effects rendering method described in the first aspect and various possible designs of the first aspect.

[0159] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0160] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0161] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A special effects rendering method, comprising: Generate a special effect rendering link by loading a special effect data packet, wherein the special effect rendering link includes at least two rendering execution units, each of which is used to generate a rendering special effect; After the special effect rendering link executes the first rendering execution unit, calling the target processing algorithm to recalculate the rendering result output by the first rendering execution unit according to the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit to obtain an updated result; The second rendering execution unit is executed based on the update result to generate special effect media including at least two rendering special effects.

2. The method according to claim 1, further comprising: Obtain the target special effect type corresponding to the second rendering execution unit; Determining a dependency relationship between the second rendering execution unit and the first rendering execution unit according to the target special effect type and the rendering result output by the first rendering execution unit; The rendering result includes rendering data updated in a rendering node corresponding to the first rendering execution unit.

3. The method according to claim 2, wherein: The dependency relationship includes a first type of relationship, the first type of relationship represents an input parameter of a rendering execution unit of the target special effect type, and the target processing algorithm is used to generate the input parameter of the rendering execution unit of the target special effect type based on the rendering result; The step of calling a target processing algorithm to recalculate the rendering result output by the first rendering step according to the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit to obtain an updated result includes: If the first rendering execution unit and the second rendering execution unit are in a first dependency relationship, a target processing algorithm is called to recalculate the rendering result output by the first rendering step to obtain an updated result.

4. The method according to claim 3, wherein: The dependency relationship also includes a second type of relationship; The second type of relationship represents the input parameters of the rendering execution unit of the target special effect type, which is generated based on the rendering data in the front rendering node; The method further includes calling a target processing algorithm to recalculate the rendering result output by the first rendering step according to the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit to obtain an updated result. If the first rendering execution unit and the second rendering execution unit are in a second dependency relationship, the rendering data in the front rendering node is obtained, and the rendering data is used as the update result.

5. The method according to any one of claims 2 to 4, further comprising: The target processing algorithm is determined according to input features of the second rendering execution unit and / or the rendering result of the first rendering execution unit, wherein the input features include the target special effect type or input parameters of the second rendering execution unit.

6. The method according to any one of claims 1 to 5, wherein: The special effects rendering link also includes at least one computing node for calling a processing algorithm; The calling target processing algorithm recalculates the rendering result output by the first rendering execution unit to obtain an updated result, including: According to the sorting information in the special effect rendering link, obtaining a target computing node after the first rendering execution unit; The target processing algorithm is called through the target computing node to recalculate the rendering result to obtain an updated result.

7. The method according to any one of claims 1 to 6, further comprising: Load the initial material; The initial material is processed through an algorithm processing link to generate initial input parameters of the special effect rendering link, wherein the algorithm processing link includes at least one computing node, and the computing node is used to call a processing algorithm to iteratively process the initial material; Based on the initial input parameters, the special effects rendering link is executed.

8. The method according to claim 1, wherein: The special effect data packet includes special effect description information constructed based on the entity component system mode, and the special effect rendering link is generated by loading the special effect data packet, including: Based on the special effect description information, at least two entity groups corresponding to the scene data are obtained, and the entity groups are used to implement the rendering special effects corresponding to the rendering execution unit; The special effects rendering link is constructed through the entity group.

9. The method according to claim 8, wherein: The entity group includes a component unit group and a system unit corresponding to the component unit group, wherein the component unit group includes a plurality of component units based on the entity component system mode; the component units in the component unit group are located under the root entity unit mounted by the corresponding rendering execution unit; The special effects rendering link is constructed through the entity group, including: Generate rendering nodes according to the component units in the entity group; Generate a rendering execution unit according to the system unit corresponding to the component unit; According to the logic information in the entity group, the rendering nodes and the corresponding rendering execution units are arranged to generate a special effect rendering link.

10. The method according to claim 9, wherein: The entity groups include a base entity group, and the base entity group is used to execute a logic or global system unit across rendering effects; The method further includes: obtaining the logic information according to the basic entity group.

11. The method according to claim 1, wherein: The special effect data packet includes at least two sub-special effect data packets, and the sub-special effect data packets include special effect description information constructed based on the entity component system mode. The special effect rendering link is generated by loading the special effect data packet, including: For each of the sub-effect data packets, based on the special effect description information in the sub-effect data packet, a target entity group corresponding to the scene data is obtained, wherein the target entity group is used to implement the rendering special effect corresponding to the rendering execution unit; The special effect rendering link is constructed through the target entity group corresponding to each of the sub-special effect data packets.

12. A special effects rendering device, comprising: A loading module is configured to generate a special effect rendering link by loading a special effect data packet, wherein the special effect rendering link includes at least two rendering execution units, each of which is used to generate a rendering special effect; a processing module configured to, after the special effect rendering link executes the first rendering execution unit, call a target processing algorithm to recalculate the rendering result output by the first rendering execution unit according to the dependency relationship between the second rendering execution unit after the first rendering execution unit and the first rendering execution unit, so as to obtain an updated result; The execution module is configured to execute the second rendering execution unit based on the update result to generate special effect media including at least two rendering special effects.

13. An electronic device comprising: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor executes the special effects rendering method according to any one of claims 1 to 11.

14. A computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when a processor executes the computer-executable instructions, the special effects rendering method according to any one of claims 1 to 11 is implemented.

15. A computer program product comprising a computer program, wherein: When the computer program is executed by a processor, the special effects rendering method according to any one of claims 1 to 11 is implemented.

Images