Special effect editing method and device, electronic equipment, storage medium and program product

Abstract

The embodiment of the invention provides a special effect editing method and device, electronic equipment, a storage medium and a program product. The method comprises the steps of displaying a special effect editing area and a visual programming area in response to a special effect editing operation; special effect processing information is added into the special effect editing area; in response to a node adding operation for the visual programming area, displaying an added first graphical programming node comprising a special effect processing editing item, the special effect processing editing item being used for configuring special effect processing information added in a special effect editing area for the first graphical programming node; and in response to a material configuration operation for the special effect processing editing item, configuring special effect processing information for the first graphical programming node, so that the first graphical programming node performs special effect rendering based on the configured special effect processing information. According to the technical scheme, on the basis of the existing special effect processing information, the special effect rendering effect is realized by calling the special effect processing information based on the graphical programming node.

Description

Technical Field

[0001] This disclosure relates to computer application technology, and more particularly to a special effects editing method, apparatus, electronic device, storage medium, and program product. Background Technology

[0002] In image processing and video production, special effects are highly favored by users. Special effects can be created using special effects creation tools. When a special effects creation tool contains multiple special effects editing areas related to special effects creation, the special effects processing information in different operation areas is often independent of each other.

[0003] In related technologies, when creating special effects using one of the special effects editing areas of a special effects creation tool, developers need to re-edit the special effects processing logic by writing code for special effects processing information not included in that area. Even if the special effects processing information is included in other special effects editing areas, it is often unusable. Moreover, this special effects editing method requires a high level of expertise from the user, has certain professional limitations, is time-consuming and laborious, and affects the special effects editing experience. Summary of the Invention

[0004] This disclosure provides a special effects editing method, apparatus, electronic device, storage medium, and program product to achieve a visual presentation of the special effects editing process. Furthermore, preset special effects processing information can be configured in a graphical programming node through simple interactive operations, enabling the graphical programming node to perform special effects rendering based on the special effects processing information.

[0005] In a first aspect, embodiments of this disclosure provide a special effects editing method, the method comprising:

[0006] In response to special effects editing operations, a special effects editing interface is displayed; wherein, the special effects editing interface includes a special effects editing area and a visual programming area; the special effects editing area adds special effects processing information to be applied;

[0007] In response to a node addition operation for the visual programming area, the added first graphical programming node is displayed in the visual programming area, wherein the first graphical programming node includes an editable special effects processing editing item, the special effects processing editing item being used to configure the special effects processing information already added in the special effects editing area for the first graphical programming node;

[0008] In response to the material configuration operation for the special effects processing editing item, the special effects processing information is configured for the first graphical programming node, so that the first graphical programming node performs special effects rendering based on the configured special effects processing information.

[0009] Secondly, this disclosure also provides a special effects editing device, which includes:

[0010] The editing interface display module is used to display the special effects editing interface in response to special effects editing operations; wherein, the special effects editing interface includes a special effects editing area and a visual programming area; the special effects editing area adds special effects processing information to be applied;

[0011] A programming node adding module is used to display the added first graphical programming node in the visual programming area in response to a node adding operation for the visual programming area. The first graphical programming node includes an editable special effects processing editing item, which is used to configure the special effects processing information already added in the special effects editing area for the first graphical programming node.

[0012] The node effects configuration module is used to configure the effects processing information for the first graphical programming node in response to the material configuration operation for the effects processing editing item, so that the first graphical programming node performs effects rendering based on the configured effects processing information.

[0013] Thirdly, embodiments of this disclosure also provide an electronic device, the electronic device comprising:

[0014] One or more processors;

[0015] Storage device for storing one or more programs.

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the special effects editing method as described in any of the embodiments of this disclosure.

[0017] Fourthly, embodiments of this disclosure also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform special effects editing methods as described in any of the embodiments of this disclosure.

[0018] Fifthly, this disclosure also provides a computer program product, which includes a computer program that, when executed by a processor, implements the special effects editing method described in any embodiment of the present invention.

[0019] The technical solution of this disclosure, by responding to special effects editing operations, displays a special effects editing interface including a special effects editing area and a visual programming area, which can visualize the special effects editing process, facilitating subsequent special effects editing operations. Since the special effects editing area adds special effects processing information to be applied, it provides a data foundation for subsequent special effects editing, improving the efficiency of special effects editing. Furthermore, by responding to a node addition operation in the visual programming area, a first graphical programming node is displayed in the visual programming area. Graphical programming nodes can be added to the programming area through simple interactive operations. The first graphical programming node includes editable special effects processing editing items, which are used to configure the special effects processing information already added in the special effects editing area for the first graphical programming node, reducing the operational difficulty of the special effects editing process and supporting graphical editing in the visual programming area. The process node configures special effects processing information in the special effects editing area; furthermore, in response to the material configuration operation for the special effects processing editing item, it configures special effects processing information for the first graphical programming node, so that the first graphical programming node performs special effects rendering based on the configured special effects processing information. This solves the technical problems of high professional requirements, time-consuming and laborious, and inability to reuse special effects processing information in different areas in related technologies. It realizes the visualization of the special effects editing process, and the special effects processing information in the special effects editing area can be configured in the graphical programming node through simple interactive operations, so that the graphical programming node performs special effects rendering based on the special effects processing information. That is, it realizes the reuse of special effects processing information in the special effects editing area in the visual programming area, saves special effects production costs, reduces the performance consumption of special effects editing, improves special effects editing efficiency, and enhances the special effects editing experience. Attached Figure Description

[0020] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0021] Figure 1 A flowchart illustrating a special effects editing method provided in an embodiment of this disclosure;

[0022] Figure 2 A schematic diagram illustrating the effect of a first graphical programming node provided in an embodiment of this disclosure;

[0023] Figure 3 This is a schematic diagram of the special effects editing interface provided in an embodiment of the present disclosure;

[0024] Figure 4A flowchart illustrating another special effects editing method provided in this embodiment of the disclosure;

[0025] Figure 5 A schematic diagram illustrating the effect of a second graphical programming node provided in an embodiment of this disclosure;

[0026] Figure 6 A schematic diagram of an operation interface for performing special effects editing in an embodiment of the present disclosure;

[0027] Figure 7 This is a schematic diagram of the structure of a special effects editing device provided in an embodiment of the present disclosure;

[0028] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0029] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0030] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0031] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0032] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0033] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0034] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0035] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0036] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0037] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0038] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0039] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0040] Figure 1 This is a flowchart illustrating a special effects editing method provided in an embodiment of the present disclosure. The embodiments of the present disclosure are applicable to situations where special effects are edited based on graphical programming elements. The method can be executed by a special effects editing device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, such as a mobile terminal, a PC, or a server.

[0041] like Figure 1 As shown, the method in this embodiment may specifically include:

[0042] S110. In response to the special effects editing operation, the special effects editing interface is displayed; wherein, the special effects editing interface includes a special effects editing area and a visual programming area; the special effects editing area adds special effects processing information to be applied.

[0043] In this context, the special effects editing operation can be understood as an operation that triggers the execution of subsequent special effects processing. Alternatively, the special effects editing operation can also be understood as an operation that edits the relevant special effects operation parameters in a special effect to execute the special effects processing operation. Optionally, the special effects editing operation may include at least one of the following: triggering a preset special effects editing control; receiving a special effects editing instruction; receiving audio information including trigger keywords associated with the special effects editing operation, etc. The special effects editing interface can be understood as a visual interface presented to the user for special effects editing and displaying screen content. The special effects editing area can be understood as a visual interface used to display and / or edit added special effects processing information. In this embodiment, the special effects editing area can at least be used to edit special effects processing information and display the special effects obtained after the special effects processing information is applied to a preset special effects resource. The preset special effects resource may include special effects rendering textures and / or special effects rendering materials. The special effects editing area may be a partial display area in the special effects editing interface. In this embodiment, the special effects editing area adds special effects processing information to be applied. The special effects processing information added in the special effects editing area can be special effects to be applied to the special effects editing process. The special effects processing information can include multiple pieces of information associated with the special effects processing process. The special effects processing information can at least include a virtual shooting device and a special effects processing object corresponding to the virtual shooting device. The virtual shooting device can be understood as a device that captures images of the corresponding special effects processing object during the special effects processing process. It should be noted that the virtual shooting device can correspond to a special effects. Specifically, in a special effects processing scene, when a special effect to be added is determined, the virtual shooting device corresponding to that special effect can capture images of the special effects processing object corresponding to that special effect. Furthermore, the special effects processing object corresponding to that special effect can be captured by the virtual shooting device so that the special effect can be accurately rendered onto the special effects processing object captured by the virtual shooting device. Optionally, the virtual shooting device can include a face stretching shooting device, a face mask shooting device, a pre-processing shooting device, and a post-processing shooting device, etc. A special effects processing object can be understood as an object associated with the special effects processing process. Optionally, the special effects processing object may include special effects elements and / or special effects processing logic. Special effects elements can be effects applied to an object, such as textures. Special effects processing logic may include one or more special effects processing operations. For example, in the case of a facial mask effect, the corresponding special effects processing object may include facial makeup, eye makeup, lip makeup, etc.; in the case of facial stretching effect, the corresponding special effects processing object may include liquefaction deformation and liquefaction, etc. The visual programming area can be understood as a visual interface that supports developers in programming through graphical programming nodes. The visual programming area may be a portion of the display area in the special effects editing interface.It is understandable that the visual programming area provides developers with an intuitive and easy-to-understand programming environment, allowing them to build program logic by dragging and dropping graphical programming nodes.

[0044] In this embodiment of the disclosure, upon detecting a special effects editing operation, in response to the special effects editing operation, a special effects editing interface is displayed. This special effects editing interface may include a special effects editing area and a visual programming area. Furthermore, at least one candidate special effects processing information is displayed. Furthermore, upon detecting an information selection operation for special effects processing information, the special effects processing information to be applied is determined based on the information selection operation, and the special effects processing information to be applied is added to the special effects editing area.

[0045] As an optional implementation of this embodiment, upon detecting a trigger operation on a preset special effects editing control, a special effects editing operation can be determined. Then, in response to the special effects editing operation, a special effects editing interface is displayed, which includes a special effects editing area and a visual programming area. Furthermore, at least one candidate special effects processing information can be displayed on the special effects editing interface. Subsequently, upon detecting an information selection operation for any special effects processing information, the selected special effects processing information can be added and displayed in the special effects editing area.

[0046] S120. In response to a node addition operation for the visual programming area, the added first graphical programming node is displayed in the visual programming area, wherein the first graphical programming node includes editable special effects processing edit items.

[0047] The node addition operation can be understood as adding a graphical programming node in the visual programming area. The node addition operation can include node display operations and node selection operations. In this embodiment, at least one candidate graphical programming node can be pre-set. Furthermore, upon detecting a node display operation for the visual programming area, at least one graphical programming node can be displayed. Further, upon detecting a node selection operation for any graphical programming node, the selected graphical programming node can be added and displayed in the visual programming area. It can be understood that graphical programming nodes can be visual components used in a graphical programming environment, representing various functions and operations in the program. Graphical programming nodes allow programmers to construct complete program logic through drag-and-drop and connection. The first graphical programming node can be a visual component for performing special effects processing operations. Optionally, the first graphical programming node can include physical programming nodes, audio programming nodes, scene object programming nodes, resource programming nodes, trigger and response programming nodes, artificial intelligence programming nodes, and subgraph asset programming nodes, etc. The first graphical programming node includes editable special effects processing editing items. Special effects processing editing items can be understood as an entry point supporting user editing of special effects processing information. The special effects editing item can be used to configure the special effects processing information already added to the special effects editing area for the first graphical programming node. In other words, the special effects processing information already added to the special effects editing area can be configured in the first graphical programming node based on the special effects processing editing item, so that the first graphical programming node can perform special effects processing operations according to the configured special effects processing information.

[0048] For example, a first graphical programming node may include an execution start trigger port, a first resource input port, a first resource output port, an effects processing editing item port, a first delay setting item port, a start execution port, and a delay end output port. The execution start trigger port can be used to receive an execution start trigger signal that triggers the first graphical programming node to execute its corresponding effects rendering operation. The first resource input port can be used to acquire the effects rendering resources for the effects rendering operation. The first resource output port can be used to output the acquired effects rendering resources. The effects processing editing item port can be used to configure the effects processing information added to the effects editing area of ​​the first graphical programming node. The first delay setting item port can be used to set the delay time for acquiring the effects rendering result of the first graphical programming node. The start execution port is used to trigger the execution of the effects rendering operation corresponding to the first graphical programming node after the first graphical programming node receives the execution start trigger signal. The delay end execution port is used to output the rendering end signal of the first graphical programming node.

[0049] For example, Figure 2This is a schematic diagram illustrating the effect of a first graphical programming node provided in an embodiment of this disclosure. Figure 2 As shown, the first graphical programming node 21 includes an execution start trigger port 211, a first resource input port 212, a first resource output port 213, a special effects processing editing item port 214, a first delay setting item port 215, an execution port 216 at start, and an execution port 217 after the delay ends.

[0050] In this embodiment of the disclosure, when a node display operation is detected for the visual programming area, at least one candidate graphical programming node is displayed. Furthermore, when a node selection operation is detected for any graphical programming node, the selected graphical programming node can be designated as a first graphical programming node, and the first graphical programming node can be added and displayed in the visual programming area.

[0051] For example, Figure 3 This is a schematic diagram illustrating one effect of the special effects editing interface provided in an embodiment of this disclosure. Figure 3 As shown, the special effects editing interface 31 includes a special effects editing area 311 and a visual programming area 312. The special effects editing area 311 is the area in the special effects editing interface 31 excluding the visual programming area 312. The special effects editing area 311 may include an editing area 3111 for adding special effects processing information to be applied, wherein the added special effects processing information is special effects processing information A, special effects processing information B, special effects processing information C, and special effects processing information D. The special effects editing area 311 may also include a special effects processing information display area, which may include at least one candidate special effects processing information. Furthermore, the special effects editing area 311 may also include a parameter editing area for editing the special effects processing parameters of the added special effects processing information, a resource display area for the special effects resources to be applied, and / or a special effects preview area. The visual programming area 312 has a first graphical programming node 3121 added to it.

[0052] In this embodiment of the disclosure, there are various ways to display the first graphical programming node in the visual programming area. In order to facilitate operation and reduce the difficulty of operation, the first graphical programming element to be displayed in the visual programming area can be determined by the method of selecting an identifier.

[0053] Optionally, the effects editing interface includes an identifier display area; the identifier display area is used to display at least one programming node identifier. Further, after displaying the effects editing interface, the interface further includes: in response to an identifier selection operation for at least one programming node identifier, designating the graphical programming node corresponding to the selected programming node identifier as a first graphical programming node, and adding and displaying the first graphical programming node in the visual programming area.

[0054] The identifier display area can be an area within the special effects editing interface used to display pre-set identifiers. The identifier display area can be displayed in any form within the special effects editing interface, optionally as a menu list and / or a pop-up window. For example, upon detecting a special effects editing operation, in response to the operation, the special effects editing interface is displayed, and the identifier display area is displayed as a menu list at any location within the interface (e.g., on the left side of the interface). The identifier display area can be used to display at least one programming node identifier. The programming node identifier can be information used to identify graphical programming nodes. The programming node identifier can be at least one of text, numbers, English letters, and graphics.

[0055] As an optional implementation of this embodiment, at least one graphical programming node can be pre-set, and programming node identifiers corresponding to each graphical programming node can be determined. The graphical programming nodes and programming node identifiers are then associated and stored. Further, after displaying the special effects editing interface, at least one candidate programming node identifier can be displayed based on the identifier display area in the special effects editing interface. An identifier selection operation can be performed on any of the displayed programming node identifiers to select the corresponding programming node identifier. Further, upon detecting an identifier selection operation on at least one programming node identifier, the graphical programming node corresponding to the triggered programming node identifier can be obtained, and the obtained graphical programming node can be used as the first graphical programming node. Then, the first graphical programming node can be added to the visual programming area for programming based on the added first graphical programming node in the visual programming area.

[0056] In this embodiment of the disclosure, the special effects processing operation corresponding to the first graphical programming node may include an operation that generates special effects data through a data processing algorithm and / or an operation that directly applies special effects to an object without using a data processing algorithm. Generally, for the operation that generates special effects data through a data processing algorithm, the special effects rendering resource included in the data processing algorithm is a template rendering resource. In order to enable the special effects processing operation corresponding to the first graphical programming node to be applied to the special effects rendering resource configured by the user, the first graphical programming node includes a first resource input port; after the added first graphical programming node is displayed in the visual programming area, the method further includes: in response to a resource configuration operation for the first resource input port of the first graphical programming node, configuring a first special effects resource for the first graphical programming node.

[0057] The first resource input port can be understood as the port in the first graphical programming node used to configure special effects rendering resources. The resource configuration operation can be understood as the operation of configuring special effects rendering resources for the first graphical programming node. The resource configuration operation can be any operation input to the first resource input port. Optionally, it involves adding a resource programming node corresponding to the special effects rendering resource to be applied in the visual programming area, and then connecting the resource programming node to the first resource input port to execute the resource configuration operation. The first special effects resource can be a special effects resource to be rendered by the special effects processing information configured in the first graphical programming node. Optionally, the first special effects resource includes special effects rendering textures and / or special effects rendering materials. A special effects rendering texture can be understood as data characterizing the basic color, texture pattern, gloss, and / or bumpiness of the object to which the special effects are applied. The special effects rendering texture can be represented in image form. A special effects rendering material can be understood as data characterizing the surface attributes of the object to which the special effects are applied, that is, data characterizing the skin texture features and / or skin display color of the object to which the special effects are applied.

[0058] In this embodiment, to enable the special effects processing information configured in the first graphical programming node to apply to user-defined special effects rendering resources, a first resource input port can be set on the first graphical programming node. Furthermore, after the added first graphical programming node is displayed in the visual programming area, a resource configuration operation can be input to the first resource input port of the first graphical programming node. Then, upon detecting a resource configuration operation, a first special effects resource can be configured for the first graphical programming node based on the resource configuration operation. The advantage of this setup is that it achieves the effect of customizing the resources affected by the special effects processing information configured in the first graphical programming node, thereby enhancing the flexibility of special effects editing based on the first graphical programming node.

[0059] As an optional implementation of this disclosure, a resource programming node can be added to the visual programming area. This resource programming node may include a texture programming node and / or a material programming node. After the added first graphical programming node is displayed in the visual programming area, the resource programming node can be connected to the first resource input port of the first graphical programming node. Then, it can be determined that a resource configuration operation has been detected, and a first special effects resource can be configured for the first graphical programming node based on the resource configuration operation.

[0060] It should be noted that when rendering special effects based on the first graphical programming node, rendering is usually performed frame by frame, and the special effects rendering effect is obtained frame by frame. Rendering special effects for each frame based on the first graphical programming node takes a certain amount of time. To avoid the situation where the first graphical programming node has not completed the special effects rendering process when obtaining the special effects rendering effect corresponding to that frame, in this embodiment of the disclosure, the first graphical programming node includes a first delay setting item; after displaying the added first graphical programming node in the visual programming area, it further includes: in response to a delay setting operation on the first delay setting item of the first graphical programming node, displaying the set first delay time.

[0061] The first delay setting can be an operation entry point configured on the first graphical programming node to set the delay time for the output of special effects rendering. The delay setting operation can be understood as setting the delay time. Optionally, the delay setting operation includes delay selection and / or delay editing operations. The first delay time can be the delay time for acquiring the special effects rendering result. The first delay time is used to acquire the special effects rendering result of the first graphical programming node after a first delay time. In other words, the special effects rendering result of the first graphical programming node can be acquired after the first delay time. The first delay time can be set according to actual needs; for example, it can be the time required for the first graphical programming node to acquire 1 frame, 2 frames, or 3 frames of the image to be processed.

[0062] As an optional implementation of this disclosure, when a delay setting operation is detected for a first delay setting item of a first graphical programming node, at least one candidate delay time can be displayed. Furthermore, when a delay selection operation for any delay time is detected, the selected delay time can be used as the first delay time, and the first delay time can be displayed based on the first delay setting item.

[0063] As another optional implementation of this disclosure, upon detecting a delay setting operation for a first delay setting item of a first graphical programming node, the first delay setting item is updated to an editable input state in response to the delay setting operation. Further, a delay time can be input for the first delay setting item, and upon detecting an editing completion operation, the input delay time is used as the set first delay time, and the first delay time is displayed based on the first delay setting item.

[0064] S130, In response to the material configuration operation for the special effects processing editing item, configure special effects processing information for the first graphical programming node so that the first graphical programming node performs special effects rendering based on the configured special effects processing information.

[0065] The material configuration operation can be understood as configuring the special effects materials required to perform the corresponding special effects processing operation. Alternatively, the material configuration operation can also be understood as configuring special effects processing information for the first graphical programming node.

[0066] It should be noted that the special effects processing information configured for the first graphical programming node can be determined from the special effects processing information already added in the special effects editing area. In other words, the special effects processing information configured in the first graphical programming node can be selected from the special effects processing information already added in the special effects editing area. Furthermore, the special effects processing information can be pre-set information associated with the special effects processing process, including the virtual shooting device and the special effects processing objects associated with the virtual shooting device. That is, if a virtual shooting device is determined, the special effects processing objects associated with that virtual shooting device can be directly determined, and the special effects processing information can be determined based on the virtual shooting device and its associated special effects processing objects. Therefore, when configuring special effects processing information, it can be configured by configuring the virtual shooting device.

[0067] In this embodiment of the disclosure, the material configuration operation for special effects processing items can include a variety of implementation methods. In order to facilitate operation and reduce the difficulty of operation, special effects processing information can be configured by selecting a virtual shooting device.

[0068] As an optional implementation of this embodiment, when a device selection operation for a special effects editing item is detected, at least one candidate virtual shooting device can be displayed based on the special effects editing item. The displayed virtual shooting device may be a virtual shooting device already added to the special effects editing area. Furthermore, when a device selection operation for any virtual shooting device is detected, the selected virtual shooting device can be determined based on the device selection operation, and the selected virtual shooting device and the special effects processing object associated with that virtual shooting device can be configured as special effects processing information in the first graphical programming node. Subsequently, the first graphical programming node can perform special effects rendering based on the configured special effects processing information.

[0069] In practical applications, when editing complex special effects, including those generated through data processing models, developers typically edit the effect's processing logic by writing code. The effect can only be applied after the code is written. This method of editing special effects requires a high level of expertise from the user. For users without programming experience, it requires a significant amount of time and effort to learn and understand the process, presenting certain professional limitations.

[0070] To address the above situation, in this embodiment of the disclosure, the required graphical programming nodes are added to the visual programming area to perform special effects editing based on the added graphical programming nodes. Optionally, the visual programming area includes a third graphical programming node connected to the first graphical programming node.

[0071] The first graphical programming node can be a visual component used to perform special effects processing operations, whereby the special effects processing operations generate special effects data through a data processing model. The third graphical programming node is used to call a data processing model deployed on the server to generate special effects data. The data processing model can be a pre-trained deep learning model deployed on the server to process the data to be processed to generate special effects data. The data processing model can include various models capable of performing special effects processing on data to generate special effects outputs, optionally including at least one of image processing models, image generation models, and dialogue generation models.

[0072] In this embodiment, a first graphical programming node and a third graphical programming node can be added to the visual programming area, and the first graphical programming node and the third graphical programming node can be connected. Furthermore, special effects that meet the requirements of special effects editing can be generated based on the special effects processing information configured in the first graphical programming node and the data processing model corresponding to the third graphical programming node.

[0073] The technical solution of this disclosure, by responding to special effects editing operations, displays a special effects editing interface including a special effects editing area and a visual programming area, which can visualize the special effects editing process, facilitating subsequent special effects editing operations. Since the special effects editing area adds special effects processing information to be applied, it provides a data foundation for subsequent special effects editing, improving the efficiency of special effects editing. Furthermore, by responding to a node addition operation in the visual programming area, a first graphical programming node is displayed in the visual programming area. Graphical programming nodes can be added to the programming area through simple interactive operations. The first graphical programming node includes editable special effects processing editing items, which are used to configure the special effects processing information already added in the special effects editing area for the first graphical programming node, reducing the operational difficulty of the special effects editing process and supporting graphical editing in the visual programming area. The process node configures special effects processing information in the special effects editing area; furthermore, in response to the material configuration operation for the special effects processing editing item, it configures special effects processing information for the first graphical programming node, so that the first graphical programming node performs special effects rendering based on the configured special effects processing information. This solves the technical problems of high professional requirements, time-consuming and laborious, and inability to reuse special effects processing information in different areas in related technologies. It realizes the visualization of the special effects editing process, and the special effects processing information in the special effects editing area can be configured in the graphical programming node through simple interactive operations, so that the graphical programming node performs special effects rendering based on the special effects processing information. That is, it realizes the reuse of special effects processing information in the special effects editing area in the visual programming area, saves special effects production costs, reduces the performance consumption of special effects editing, improves special effects editing efficiency, and enhances the special effects editing experience.

[0074] Figure 4 This is a flowchart illustrating another special effects editing method provided in this embodiment. Based on the above embodiments, the special effects processing information in this embodiment includes a virtual shooting device and a special effects processing object associated with the virtual shooting device. In response to a material configuration operation for a special effects processing editing item, special effects processing information is configured for a first graphical programming node, including: in response to an editing trigger operation for a special effects processing editing item, displaying at least one candidate virtual shooting device; and in response to a device selection operation for a virtual shooting device, configuring a virtual shooting device and a special effects processing object for the first graphical programming node based on the device selection operation. Detailed implementation can be found in the description of this embodiment. Technical features that are the same as or similar to those in the foregoing embodiments will not be repeated here.

[0075] like Figure 4 As shown, the method in this embodiment may specifically include:

[0076] S210. In response to the special effects editing operation, a special effects editing interface is displayed; wherein, the special effects editing interface includes a special effects editing area and a visual programming area; the special effects editing area adds special effects processing information to be applied; the special effects processing information includes a virtual shooting device and special effects processing objects associated with the virtual shooting device.

[0077] The special effects processing objects include special effects elements and / or special effects processing logic. Special effects elements can be effects directly added to images or videos. For example, special effects elements can be special effects textures, etc. Special effects processing logic can be understood as the way to perform special effects processing operations to generate special effects data. Special effects processing logic can include one or more special effects processing operations.

[0078] In practical applications, when multiple special effects processing information is added to the special effects editing area, the virtual shooting devices in these multiple special effects processing information may correspond to the same layer during special effects rendering. Consequently, multiple special effects processing information may be rendered in the same layer, and / or, multiple special effects processing information may be rendered according to the order in which they were added to the special effects editing area, thus failing to obtain the special effects effect that meets the editing requirements.

[0079] In response to the above situation, in this embodiment of the disclosure, after displaying the special effects editing interface, the method further includes: in response to the layer setting operation for the virtual shooting device, determining the target layer corresponding to the virtual shooting device, so that the virtual shooting device can draw the special effects corresponding to the special effects processing object associated with the virtual shooting device based on the target layer.

[0080] Layer setting operations can be understood as setting the special effects rendering layer. Layer setting operations can include any operation input to the virtual shooting device, optionally including layer selection and / or layer editing operations. The target layer can be understood as the layer that the virtual shooting device can capture. Alternatively, the target layer can be the layer of the special effects processing object associated with the virtual shooting device that needs to be rendered. The target layer can be used to identify the rendering level corresponding to the virtual shooting device. The rendering level can be used to indicate the rendering order or priority of the special effects. Specifically, when the special effects editing area includes multiple special effects processing information, and each special effects processing information has a corresponding target layer, the rendering order of the multiple special effects processing information can be determined based on the determined target layers. Then, based on the rendering order, the special effects corresponding to the special effects processing object associated with the virtual shooting device can be drawn according to the corresponding target layers.

[0081] In this embodiment, a layer setting operation can be performed on the virtual shooting device to set the rendering layer corresponding to the virtual shooting device. Upon detecting a layer setting operation on the virtual shooting device, the system responds to the operation. Then, a target layer corresponding to the virtual shooting device is determined based on the layer setting operation. Furthermore, the virtual shooting device can then draw special effects corresponding to the special effects processing object associated with the virtual shooting device based on the target layer. The advantage of this setup is that it enables customized settings for the rendering layer corresponding to the virtual shooting device, thereby allowing for customized settings of the rendering level of the special effects processing information, enhancing the flexibility of the special effects editing process. Moreover, when multiple special effects processing information items are being rendered, setting the rendering level of the special effects processing information improves the overall effect.

[0082] As an optional implementation of this disclosure, a layer selection operation can be input to the virtual shooting device. Then, in response to the layer selection operation, at least one candidate layer is displayed. Furthermore, if a selection trigger operation for any layer is detected, the selected layer can be used as the target layer corresponding to the virtual shooting device.

[0083] As another optional implementation of this disclosure, a layer editing operation can be input to the virtual shooting device. Then, in response to the layer editing operation, the layer edited based on the layer editing operation is used as the target layer corresponding to the virtual shooting device.

[0084] S220, In response to a node addition operation for the visual programming area, the added first graphical programming node is displayed in the visual programming area, wherein the first graphical programming node includes editable special effects processing edit items.

[0085] S230, in response to an edit trigger operation for an effect processing edit item, displays at least one candidate virtual shooting device.

[0086] The editing trigger operation can be an operation that edits special effects information based on the special effects editing item after being triggered. The editing trigger operation can be any operation input to the special effects editing item, optionally including a click operation (including single click and / or multiple clicks) and / or the input operation device remaining on the special effects editing item for a preset duration, etc. The candidate virtual shooting device can be a virtual shooting device to be selected. The candidate virtual shooting device can be a virtual shooting device already added to the special effects editing area. In this embodiment, the display method of the candidate virtual shooting device can include various methods, optionally including a drop-down list, a menu list, and / or a pop-up window display, etc.

[0087] As an optional implementation of this embodiment, upon detecting a click operation on a special effects editing item, a virtual shooting device already added to the special effects editing area can be identified, and this virtual shooting device can be selected as a candidate virtual shooting device. Furthermore, at least one candidate virtual shooting device can be displayed in a drop-down list at a preset location on the special effects editing item.

[0088] S240, In response to a device selection operation for a virtual shooting device, configure a virtual shooting device and a special effects processing object for a first graphical programming node based on the device selection operation, so that the first graphical programming node performs special effects rendering based on the configured special effects processing information.

[0089] The device selection operation can be understood as selecting a virtual shooting device that meets the requirements. The device selection operation can be any operation input to the virtual shooting device, including click operations (including single clicks and / or multiple clicks) and / or the input operation device staying on the virtual shooting device for a preset time, etc.

[0090] In this embodiment of the disclosure, when at least one candidate virtual shooting device is displayed, the virtual shooting device configured for the first graphical programming node can be determined by inputting a device selection operation for the virtual shooting device. Furthermore, in response to the detected device selection operation for any virtual shooting device, the selected virtual shooting device is determined based on the device selection operation, and the selected virtual shooting device and the special effects processing object associated with the virtual shooting device are configured in the first graphical programming node. Consequently, the configured first graphical programming node can perform special effects rendering based on the configured special effects processing information.

[0091] As an optional implementation of this disclosure, when at least one candidate virtual shooting device is displayed, a click operation can be input for the virtual shooting device. Then, in response to the click operation, a selected virtual shooting device is determined based on the click operation. Furthermore, the selected virtual shooting device and an associated special effects processing object can be configured for the first graphical programming node. Furthermore, the configured first graphical programming node can perform special effects rendering based on the configured special effects processing information.

[0092] It should be noted that the pre-set special effects processing information can be edited based on template special effects resources. That is, when the special effects processing object included in the special effects processing information is a special effects element, the corresponding template special effects resource can be a static template image. Special effects elements are typically effects that do not move with the special effects object; when rendering special effects based on this special effects processing information, rendering this special effects element onto any image or video will not affect the special effects effect of that element. However, when the special effects processing object included in the special effects processing information is a special effects processing logic, the corresponding template special effects resource can be a rendering resource associated with the special effects processing operation. The special effects processing information can be generated after applying the included special effects processing operation to this rendering resource. In practical applications, if the special effects processing information configured in the first graphical programming node is the special effects processing logic, and special effects rendering is performed directly based on the special effects processing information, the special effects effect obtained after rendering may be poor if the template rendering resource corresponding to the special effects processing information and the rendering resource based on the special effects processing information are different.

[0093] In view of the above situation, in this embodiment of the disclosure, when the special effects processing information is special effects processing logic, the visual programming area includes a second graphical programming node connected to the first graphical programming node.

[0094] The second graphical programming node can be understood as a programming node used to replace and update the special effects resources for the special effects processing logic. The second graphical programming node is used to acquire the second special effects resources for the special effects processing logic and pass them to the first graphical programming node. The second special effects resources can be understood as the special effects resources configured by the first graphical programming node for the special effects processing logic. Optionally, the second special effects resources include special effects rendering textures and / or special effects rendering materials. In this embodiment, the second graphical programming node includes a second resource input port and an end signal output port. The second resource input port is used to input the second special effects resources for the special effects processing logic. The first graphical programming node includes an execution start trigger port. The end signal output port of the second graphical programming node is connected to the execution start trigger port of the first graphical programming node. It should be noted that the advantage of introducing a second graphical programming node is that it enables the replacement of special effects resources that function based on the special effects processing logic. During special effects editing, the first graphical programming node can perform special effects processing based on the replaced special effects resources, making the final special effects more in line with the special effects editing needs.

[0095] The second resource input port can be a port on the second graphical programming node used to input the second special effect resource to be applied. The end signal output port can be a port on the second graphical programming node used to output the execution end signal. The execution start trigger port can be a port on the first graphical programming node used to receive the execution start trigger signal.

[0096] As an optional implementation of this embodiment, a resource programming node corresponding to the second special effects resource can be added to the visual programming area. This resource programming node may include a resource output port. Further, the resource output port of the resource programming node can be connected to the second resource input port of the second graphical programming node. This allows the second graphical programming node to acquire the second special effects resource that performs the special effects processing logic. Further, the end signal output port of the second graphical programming node can be connected to the execution start trigger port of the first graphical programming node. This allows the first graphical programming node to start executing the configured special effects processing information based on the connected end signal output port and execution start trigger port when the second graphical programming node finishes execution.

[0097] For example, the second graphical programming node may include an execution start trigger port, a second resource input port, a second delay setting port, an execution start port, and an output port after the delay ends. The second resource input port can be used to acquire the special effects rendering resources for the special effects rendering operation. Depending on the special effects rendering resources, the second resource input port may include a special effects rendering texture input port and / or a special effects rendering material input port. The second delay setting port can be used to set the delay time for the second graphical programming node to output the execution end signal. The execution start port is used to trigger the special effects rendering resource replacement operation corresponding to the second graphical programming node after the second graphical programming node receives the execution start trigger signal. The execution end port is used to output the execution end signal of the second graphical programming node.

[0098] For example, Figure 5 This is a schematic diagram illustrating the effect of a second graphical programming node provided in an embodiment of this disclosure. Figure 5 As shown, the second graphical programming node 51 includes an execution start trigger port 511, a second resource input port 512, a second delay setting port 513, an execution port 514 at start, and an execution port 515 after the delay ends. The second resource input port 512 may include an effects rendering texture input port 5121 and an effects rendering material input port 5122.

[0099] It should be noted that when acquiring the second special effects resource based on the second graphical programming node, processing is typically performed frame by frame. That is, the second special effects resource corresponding to each frame in the special effects processing logic is acquired, and the template special effects resource corresponding to each frame in the special effects processing logic is replaced with the acquired second special effects resource. Furthermore, for each frame, after acquiring the second special effects resource corresponding to that frame, special effects rendering is performed on that frame based on the first graphical programming node. Acquiring the second special effects resource corresponding to each frame by the second graphical programming node takes a certain amount of time. To avoid the situation where the second graphical programming node has not fully acquired the second special effects resource corresponding to that frame when outputting the execution end signal, in this embodiment, after including the second graphical programming node in the visual programming area, the method further includes: displaying the set second delay time in response to a delay setting operation for the second delay setting item of the second graphical programming node.

[0100] The second delay setting can be an operation entry configured on the second graphical programming node to set the signal delay output time. The delay setting operation can be understood as setting the delay time. Optionally, the delay setting operation includes delay selection and / or delay editing operations. The second delay time can be the delay output time of the execution end signal. The second delay time is used to output the execution end signal of the second graphical programming node after a second delay. In other words, the execution end signal of the second graphical programming node can be output after the second delay time. Similarly, the second delay time can be set according to actual needs, for example, it can be the time required for the second graphical programming node to acquire 4 frames of images to be processed.

[0101] As an optional implementation of this disclosure, when a delay setting operation is detected for the second delay setting item of the second graphical programming node, at least one candidate delay time can be displayed. Furthermore, when a delay selection operation for any delay time is detected, the selected delay time can be used as the second delay time, and the second delay time can be displayed based on the second delay setting item.

[0102] As another optional implementation of this disclosure, upon detecting a delay setting operation for the second delay setting item of the second graphical programming node, the second delay setting item is updated to an editable input state in response to the delay setting operation. Furthermore, a delay time can be input for the second delay setting item, and upon detecting an editing completion operation, the input delay time is used as the set second delay time, and the second delay time is displayed based on the second delay setting item.

[0103] For example, Figure 6This is a schematic diagram of an operation interface for performing special effects editing in an embodiment of this disclosure. Figure 6 As shown, the visual programming area 312 includes a first graphical programming node 61, a second graphical programming node 62, an execution trigger programming node 63, a texture resource programming node 64, and a material resource programming node 65. Upon detecting an effect editing operation, in response to this operation, the execution trigger programming node 63 is connected to the execution start trigger port of the second graphical programming node 62, the texture resource programming node 64 is connected to the effect rendering texture port of the second graphical programming node, and the material resource programming node 65 is connected to the effect rendering material port of the second graphical programming node 62. Furthermore, based on the second graphical programming node 62, the resources used by the effect processing logic configured in the first graphical programming node 61 can be replaced with the effect rendering texture input through the texture resource programming node 64 and the effect rendering material input through the material resource programming node 65. Furthermore, the end signal output port of the second graphical programming node 62 after the delay ends can be connected to the execution start trigger interface of the first graphical programming node 61, and the texture resource programming node 64 can be connected to the first resource input port of the first graphical programming node 61. Then, after the second delay time set by the second graphical programming node 62 is reached, the execution end signal based on the second graphical programming node 62 can be input to the execution start trigger interface of the first graphical programming node 61. Upon receiving the execution end signal, the first graphical programming node 61 can be triggered to perform a special effects processing operation based on the special effects processing information configured in the special effects processing editing item and the first special effects resource received by the first resource input port. This can then generate special effects data.

[0104] The technical solution of this disclosure embodiment displays a special effects editing interface in response to a special effects editing operation. The special effects editing interface includes a special effects editing area and a visual programming area. The special effects editing area adds special effects processing information to be applied. The special effects processing information includes a virtual shooting device and special effects processing objects associated with the virtual shooting device. Further, in response to a node addition operation in the visual programming area, a first graphical programming node is displayed in the visual programming area. The first graphical programming node includes editable special effects processing editing items. In response to an editing trigger operation for the special effects processing editing items, at least one candidate virtual shooting device is displayed. Then, in response to a device selection operation for the virtual shooting device, a virtual shooting device and a special effects processing object are configured for the first graphical programming node based on the device selection operation. This allows the first graphical programming node to perform special effects rendering based on the configured special effects processing information. This achieves the effect of configuring special effects processing information for the first graphical programming node simply by setting the virtual shooting device through a simple interactive operation. It enables convenient and easy configuration of special effects processing information, reduces the operational difficulty of the special effects editing process, and improves the convenience and flexibility of the interaction.

[0105] Figure 7 This is a schematic diagram of the structure of a special effects editing device provided in an embodiment of the present disclosure, as shown below. Figure 7 As shown, the device includes: an editing interface display module 310, a programming node adding module 320, and a node effect configuration module 330. The editing interface display module 310 is used to display a special effects editing interface in response to an effect editing operation; the special effects editing interface includes a special effects editing area and a visual programming area; the special effects editing area adds special effects processing information to be applied; the programming node adding module 320 is used to display a first added graphical programming node in the visual programming area in response to a node adding operation for the visual programming area, wherein the first graphical programming node includes editable special effects processing editing items, which are used to configure the first graphical programming node with the special effects processing information already added in the special effects editing area; the node effect configuration module 330 is used to configure the special effects processing information for the first graphical programming node in response to a material configuration operation for the special effects processing editing items, so that the first graphical programming node performs special effects rendering based on the configured special effects processing information.

[0106] The technical solution of this embodiment, through the editing interface display module 310 responding to the special effects editing operation, displays a special effects editing interface including a special effects editing area and a visual programming area, which can visualize the special effects editing process, facilitating subsequent special effects editing operations. Since the special effects editing area adds special effects processing information to be applied, it provides a data foundation for subsequent special effects editing, improving the efficiency of special effects editing. Furthermore, through the programming node adding module 320 responding to the node adding operation for the visual programming area, it displays the added first graphical programming node in the visual programming area. Graphical programming nodes can be added to the programming area through simple interactive operations. The first graphical programming node includes editable special effects processing editing items, which are used to configure the special effects processing information already added in the special effects editing area for the first graphical programming node, reducing the operational difficulty of the special effects editing process and supporting the use of the visual programming area. The graphical programming node configures special effects processing information in the special effects editing area. Furthermore, the node special effects configuration module 330 responds to material configuration operations for special effects processing editing items, configuring special effects processing information for the first graphical programming node. This enables the first graphical programming node to perform special effects rendering based on the configured special effects processing information. This solves the technical problems of high professional requirements, time-consuming and labor-intensive processes, and the inability to reuse special effects processing information from different areas in related technologies. It achieves a visual presentation of the special effects editing process, and allows the configuration of special effects processing information in the special effects editing area into the graphical programming node through simple interactive operations, enabling the graphical programming node to perform special effects rendering based on the special effects processing information. In other words, it realizes the reuse of special effects processing information in the special effects editing area within the visual programming area, saving special effects production costs, reducing performance consumption in special effects editing, improving special effects editing efficiency, and enhancing the special effects editing experience.

[0107] Optionally, based on any of the above-mentioned optional technical solutions, the first graphical programming node includes a first resource input port; the device further includes a resource configuration module. The resource configuration module is configured, after the first added graphical programming node is displayed in the visual programming area, in response to a resource configuration operation on the first resource input port of the first graphical programming node, to configure a first special effects resource for the first graphical programming node, wherein the first special effects resource includes special effects rendering textures and / or special effects rendering materials.

[0108] Optionally, based on any of the above-mentioned optional technical solutions, the first graphical programming node includes a first delay setting item; the device further includes a time display module. The time display module is configured to, after displaying the added first graphical programming node in the visual programming area, in response to a delay setting operation for the first delay setting item of the first graphical programming node, display a set first delay time, wherein the first delay time is used to delay the acquisition of the special effects rendering result of the first graphical programming node by the first delay time.

[0109] Based on any of the above optional technical solutions, the special effects processing information may optionally include a virtual shooting device and a special effects processing object associated with the virtual shooting device; the special effects processing object includes special effects elements and / or special effects processing logic.

[0110] Based on any of the above-mentioned optional technical solutions, optionally, the node effect configuration module 330 includes: a candidate device display unit and a node effect configuration unit. The candidate device display unit is used to display at least one candidate virtual shooting device in response to an edit trigger operation for the effect processing editing item; the node effect configuration unit is used to configure the virtual shooting device and the effect processing object for the first graphical programming node based on the device selection operation for the virtual shooting device.

[0111] Optionally, based on any of the above-mentioned optional technical solutions, the device further includes a layer setting module. The layer setting module is used, after displaying the special effects editing interface, in response to a layer setting operation for the virtual shooting device, to determine a target layer corresponding to the virtual shooting device, so that the virtual shooting device draws special effects corresponding to the special effects processing object associated with the virtual shooting device based on the target layer.

[0112] Based on any of the above optional technical solutions, optionally, when the special effects processing information is the special effects processing logic, the visual programming area includes a second graphical programming node connected to the first graphical programming node; the second graphical programming node is used to obtain the second special effects resource acting on the special effects processing logic, and to pass the second special effects resource to the first graphical programming node.

[0113] Based on any of the above optional technical solutions, optionally, the second graphical programming node includes a second resource input port and an end signal output port; the second resource input port is used to input the second special effect resource for the special effect processing logic; the first graphical programming node includes an execution start trigger port; the end signal output port of the second graphical programming node and the execution start trigger port of the first graphical programming node are connected.

[0114] Based on any of the above-mentioned optional technical solutions, optionally, the second graphical programming node includes a second delay setting item; the device further includes a delay setting module. The delay setting module is configured to, after including the second graphical programming node in the visual programming area, in response to a delay setting operation for the second delay setting item of the second graphical programming node, display a set second delay time, wherein the second delay time is used to output an execution end signal of the second graphical programming node after a delay of the second delay time.

[0115] Based on any of the above optional technical solutions, optionally, the visual programming area includes a third graphical programming node connected to the first graphical programming node; the third graphical programming node is used to call the data processing model deployed on the server to generate special effects data.

[0116] The special effects editing apparatus provided in this disclosure can execute the special effects editing method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects of the method execution.

[0117] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.

[0118] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Reference is made below. Figure 8 It illustrates an electronic device suitable for implementing embodiments of the present disclosure (e.g., Figure 8 The diagram below shows the structure of the terminal device or server 500. The terminal device in this embodiment may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and vehicle terminals (e.g., vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 8 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0119] like Figure 8As shown, electronic device 500 may include a processing unit (e.g., central processing unit, graphics processor, etc.) 501, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 502 or a program loaded from storage device 508 into random access memory (RAM) 503. The RAM 503 also stores various programs and data required for the operation of electronic device 500. The processing unit 501, ROM 502, and RAM 503 are interconnected via bus 504. An edit / output (I / O) interface 505 is also connected to bus 504.

[0120] Typically, the following devices can be connected to I / O interface 505: input devices 506 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 507 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 508 including, for example, magnetic tapes, hard disks, etc.; and communication devices 509. Communication device 509 allows electronic device 500 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 8 An electronic device 500 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0121] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing device 501, it performs the functions defined in the methods of embodiments of this disclosure.

[0122] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0123] The electronic device provided in this embodiment and the special effects editing method provided in the above embodiments belong to the same inventive concept. Technical details not described in detail in this embodiment can be found in the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.

[0124] This disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the special effects editing method provided in the above embodiments.

[0125] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0126] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0127] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0128] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to: display a special effects editing interface in response to a special effects editing operation; wherein the special effects editing interface includes a special effects editing area and a visual programming area; add special effects processing information to be applied to the special effects editing area; display a first graphical programming node added to the visual programming area in response to a node adding operation for the visual programming area, wherein the first graphical programming node includes an editable special effects processing editing item, the special effects processing editing item being used to configure the special effects processing information already added to the special effects editing area for the first graphical programming node; and configure the special effects processing information for the first graphical programming node in response to a material configuration operation for the special effects processing editing item, so that the first graphical programming node performs special effects rendering based on the configured special effects processing information.

[0129] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0130] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0131] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The names of the units are not necessarily limiting in certain circumstances; for example, the editing interface display module can also be described as a "module for displaying the special effects editing interface".

[0132] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0133] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0134] According to one or more embodiments of this disclosure, [Example 1] provides a special effects editing method, including: displaying a special effects editing interface in response to a special effects editing operation; wherein the special effects editing interface includes a special effects editing area and a visual programming area; adding special effects processing information to be applied to the special effects editing area; displaying a first graphical programming node added in the visual programming area in response to a node adding operation for the visual programming area, wherein the first graphical programming node includes an editable special effects processing editing item, the special effects processing editing item being used to configure the special effects processing information added in the special effects editing area for the first graphical programming node; configuring the special effects processing information for the first graphical programming node in response to a material configuration operation for the special effects processing editing item, so that the first graphical programming node performs special effects rendering based on the configured special effects processing information.

[0135] According to one or more embodiments of this disclosure, [Example 2] provides the method of Example 1, further comprising: optionally, the first graphical programming node includes a first resource input port; after the first graphical programming node is displayed in the visual programming area, the method further comprises: in response to a resource configuration operation for the first resource input port of the first graphical programming node, configuring a first special effects resource for the first graphical programming node, wherein the first special effects resource includes special effects rendering textures and / or special effects rendering materials.

[0136] According to one or more embodiments of this disclosure, Example 3 provides the method of Example 1, which further includes: optionally, the first graphical programming node includes a first delay setting item; after displaying the added first graphical programming node in the visual programming area, it further includes: in response to a delay setting operation for the first delay setting item of the first graphical programming node, displaying a set first delay time, wherein the first delay time is used to obtain the special effects rendering result of the first graphical programming node after delaying the first delay time.

[0137] According to one or more embodiments of this disclosure, Example 4 provides the method of Example 1, which further includes: optionally, the special effects processing information includes a virtual shooting device and a special effects processing object associated with the virtual shooting device; the special effects processing object includes special effects elements and / or special effects processing logic.

[0138] According to one or more embodiments of this disclosure, Example 5 provides the method of Example 4, which further includes: optionally, configuring the special effects processing information for the first graphical programming node in response to a material configuration operation for the special effects processing editing item includes: displaying at least one candidate virtual shooting device in response to an edit trigger operation for the special effects processing editing item; and configuring the virtual shooting device and the special effects processing object for the first graphical programming node based on the device selection operation in response to a device selection operation for the virtual shooting device.

[0139] According to one or more embodiments of this disclosure, Example Six provides the method of Example Four, which further includes: optionally, after displaying the special effects editing interface, it further includes: in response to a layer setting operation for the virtual shooting device, determining a target layer corresponding to the virtual shooting device, so that the virtual shooting device draws a special effects effect corresponding to the special effects processing object associated with the virtual shooting device based on the target layer.

[0140] According to one or more embodiments of this disclosure, Example 7 provides the method of Example 4, which further includes: Optionally, when the special effects processing information is the special effects processing logic, the visual programming area includes a second graphical programming node connected to the first graphical programming node; the second graphical programming node is used to obtain a second special effects resource that the special effects processing logic acts on, and to pass the second special effects resource to the first graphical programming node.

[0141] According to one or more embodiments of this disclosure, Example 8 provides the method of Example 7, further comprising: optionally, the second graphical programming node includes a second resource input port and an end signal output port; the second resource input port is used to input a second special effects resource for the special effects processing logic; the first graphical programming node includes an execution start trigger port; the end signal output port of the second graphical programming node and the execution start trigger port of the first graphical programming node are connected.

[0142] According to one or more embodiments of this disclosure, Example 9 provides the method of Example 7, further comprising: optionally, the second graphical programming node includes a second delay setting; after the second graphical programming node is included in the visual programming area, the method further comprises: in response to a delay setting operation for the second delay setting of the second graphical programming node, displaying a set second delay time, wherein the second delay time is used to output an execution end signal of the second graphical programming node after delaying the second delay time.

[0143] According to one or more embodiments of this disclosure, Example 10 provides the method of Example 1, which further includes: optionally, the visual programming area includes a third graphical programming node connected to the first graphical programming node; the third graphical programming node is used to call a data processing model deployed on the server to generate special effects data.

[0144] According to one or more embodiments of this disclosure, [Example 11] provides a special effects editing device, including: an editing interface display module, configured to display a special effects editing interface in response to a special effects editing operation; wherein the special effects editing interface includes a special effects editing area and a visual programming area; the special effects editing area adds special effects processing information to be applied; a programming node adding module, configured to display a first graphical programming node added in the visual programming area in response to a node adding operation for the visual programming area, wherein the first graphical programming node includes an editable special effects processing editing item, the special effects processing editing item being configured to configure the special effects processing information added in the special effects editing area for the first graphical programming node; and a node special effects configuration module, configured to configure the special effects processing information for the first graphical programming node in response to a material configuration operation for the special effects processing editing item, so that the first graphical programming node performs special effects rendering based on the configured special effects processing information.

[0145] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0146] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0147] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A special effects editing method, characterized in that, include: In response to special effects editing operations, a special effects editing interface is displayed; wherein, the special effects editing interface includes a special effects editing area and a visual programming area; the special effects editing area adds special effects processing information to be applied; In response to a node addition operation for the visual programming area, the added first graphical programming node is displayed in the visual programming area, wherein the first graphical programming node includes an editable special effects processing editing item, the special effects processing editing item being used to configure the special effects processing information already added in the special effects editing area for the first graphical programming node; In response to the material configuration operation for the special effects processing editing item, the special effects processing information is configured for the first graphical programming node, so that the first graphical programming node performs special effects rendering based on the configured special effects processing information.

2. The special effects editing method according to claim 1, characterized in that, The first graphical programming node includes a first resource input port; After displaying the added first graphical programming node in the visual programming area, the method further includes: In response to a resource configuration operation for the first resource input port of the first graphical programming node, a first special effects resource is configured for the first graphical programming node, wherein the first special effects resource includes special effects rendering textures and / or special effects rendering materials.

3. The special effects editing method according to claim 1, characterized in that, The first graphical programming node includes a first delay setting; After displaying the added first graphical programming node in the visual programming area, it also includes: In response to a delay setting operation for a first delay setting item of the first graphical programming node, the set first delay time is displayed, wherein the first delay time is used to obtain the special effects rendering result of the first graphical programming node after delaying the first delay time.

4. The special effects editing method according to claim 1, characterized in that, The special effects processing information includes a virtual shooting device and special effects processing objects associated with the virtual shooting device; the special effects processing objects include special effects elements and / or special effects processing logic.

5. The special effects editing method according to claim 4, characterized in that, The step of configuring the special effects processing information for the first graphical programming node in response to the material configuration operation for the special effects processing editing item includes: In response to an edit trigger operation for the special effects processing edit item, at least one candidate virtual shooting device is displayed; In response to a device selection operation for the virtual shooting device, the virtual shooting device and the special effects processing object are configured for the first graphical programming node based on the device selection operation.

6. The special effects editing method according to claim 4, characterized in that, Following the display effects editing interface, the following is also included: In response to a layer setting operation for the virtual shooting device, a target layer corresponding to the virtual shooting device is determined, so that the virtual shooting device draws special effects corresponding to the special effects processing object associated with the virtual shooting device based on the target layer.

7. The special effects editing method according to claim 4, characterized in that, When the special effects processing information is the special effects processing logic, the visual programming area includes a second graphical programming node connected to the first graphical programming node; the second graphical programming node is used to obtain the second special effects resource that the special effects processing logic applies, and to pass the second special effects resource to the first graphical programming node.

8. The special effects editing method according to claim 7, characterized in that, The second graphical programming node includes a second resource input port and an end signal output port; the second resource input port is used to input the second special effect resource that performs the special effect processing logic; the first graphical programming node includes an execution start trigger port; the end signal output port of the second graphical programming node and the execution start trigger port of the first graphical programming node are connected.

9. The special effects editing method according to claim 7, characterized in that, The second graphical programming node includes a second delay setting; Following the inclusion of the second graphical programming node in the visual programming area, the following is also included: In response to a delay setting operation for a second delay setting item of the second graphical programming node, the set second delay time is displayed, wherein the second delay time is used to output the execution end signal of the second graphical programming node after delaying the second delay time.

10. The special effects editing method according to claim 1, characterized in that, The visual programming area includes a third graphical programming node connected to the first graphical programming node; the third graphical programming node is used to call the data processing model deployed on the server to generate special effects data.

11. A special effects editing device, characterized in that, include: The editing interface display module is used to display the special effects editing interface in response to special effects editing operations; wherein, the special effects editing interface includes a special effects editing area and a visual programming area; the special effects editing area adds special effects processing information to be applied; A programming node adding module is used to display the added first graphical programming node in the visual programming area in response to a node adding operation for the visual programming area. The first graphical programming node includes an editable special effects processing editing item, which is used to configure the special effects processing information already added in the special effects editing area for the first graphical programming node. The node effects configuration module is used to configure the effects processing information for the first graphical programming node in response to the material configuration operation for the effects processing editing item, so that the first graphical programming node performs effects rendering based on the configured effects processing information.

12. An electronic device, characterized in that, The electronic device includes: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the special effects editing method as described in any one of claims 1-10.

13. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the special effects editing method as described in any one of claims 1-10.

14. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the special effects editing method according to any one of claims 1-10.

Images