Special effect prop generation method, picture processing method, device and electronic equipment
Patent Information
- Application Number
- CN202210028388.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-11
- Publication Date
- 2026-10-16
- Estimated Expiration
- 2042-01-11
AI Technical Summary
[0003]然而,现有的道具创建过程较为繁琐,且无法立即发现道具中存在的问题,导致道具创建需要耗费较长的时间
[0027] The present disclosure provides a method for generating special effects props, a method for processing images, an apparatus, and an electronic device. These methods include displaying a special effects prop editing page and acquiring a first image. The special effects prop editing page includes a process information display area and an effect display area. The process information display area displays the process information of the prop to be edited, and the effect display area displays a second image obtained by processing the first image based on the process information of the prop to be edited. In response to an editing operation, the process information of the prop to be edited is edited, and the second image displayed in the effect display area is updated. In response to a special effects prop generation operation, a target special effects prop is generated based on the edited target prop process information. By employing the above technical solution, the present disclosure allows for the editing of special effects props by editing the prop process information, and displays a preview of the edited prop process information in real time during the editing process. This simplifies the creation and editing difficulty of special effects props, reduces the time spent by users in creating and editing special effects props, and improves the user experience.
Smart Images

Figure CN116459508B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of computer technology, and in particular to a method for generating special effects props, a method for processing images, an apparatus, and an electronic device. Background Technology
[0002] In existing technologies, developers need to create new props by editing code, and then test the props to see their effects after they are created.
[0003] However, the existing item creation process is rather cumbersome and cannot immediately detect problems with the items, resulting in a long creation time. Summary of the Invention
[0004] This disclosure provides a method for generating special effects props, a method for processing images, an apparatus, and an electronic device to simplify the prop creation process and shorten the time spent on prop creation.
[0005] In a first aspect, embodiments of this disclosure provide a method for generating special effects props, including:
[0006] Display the special effects prop editing page and obtain the first screen. The special effects prop editing page is provided with a process information display area and an effect display area. The process information display area is used to display the process information of the prop to be edited, and the effect display area is used to display the second screen. The second screen is a preview screen obtained by processing the first screen based on the process information of the prop to be edited.
[0007] In response to the editing operation, the process information of the prop to be edited is edited, and the second screen displayed in the effect display area is updated;
[0008] In response to the special effects item generation operation, the target special effects item is generated based on the target item flow information obtained through editing.
[0009] Secondly, embodiments of this disclosure provide another method for processing a screen, including:
[0010] The process involves acquiring the target prop flow information of the screen to be processed and the target special effects prop. The target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During the editing process, the special effects prop editing page displays a second screen obtained by processing the first screen based on the prop flow information to be edited.
[0011] The target special effects props are used to process the image to be processed;
[0012] When processing is complete, a rendering instruction packet is sent to the graphics processing unit (GPU) to instruct the GPU to render the output screen of each node according to the arrangement order of each node in the target prop process information, so as to obtain the processed target screen. The rendering instruction packet contains the rendering instructions of each node.
[0013] Thirdly, this disclosure also provides an apparatus for generating special effects props, including:
[0014] The page display module is used to display the special effects prop editing page and obtain a first screen. The special effects prop editing page is provided with a process information display area and an effect display area. The process information display area is used to display the process information of the prop to be edited, and the effect display area is used to display a second screen. The second screen is a preview screen obtained by processing the first screen based on the process information of the prop to be edited.
[0015] The editing module is used to respond to editing operations, edit the process information of the prop to be edited, and update the second screen displayed in the effect display area;
[0016] The prop generation module is used to respond to the special effects prop generation operation and generate the target special effects prop based on the target prop flow information obtained through editing.
[0017] Fourthly, embodiments of this disclosure also provide an image processing apparatus, including:
[0018] The image acquisition module is used to acquire the image to be processed and the target prop flow information of the target special effects prop. The target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During the editing process, the special effects prop editing page displays a second image obtained by processing the first image based on the prop flow information to be edited.
[0019] The image processing module is used to process the image to be processed using the target special effects props;
[0020] The instruction sending module is used to send a rendering instruction packet to the graphics processor (GPU) when processing is complete, instructing the GPU to render the output screen of each node according to the arrangement order of each node in the target prop process information, so as to obtain the processed target screen. The rendering instruction packet contains the rendering instructions of each node.
[0021] Fifthly, embodiments of this disclosure also provide an electronic device, including:
[0022] One or more processors;
[0023] Memory, used to store one or more programs.
[0024] When the one or more programs are executed by the one or more processors, the one or more processors implement the prop generation method or the screen processing method as described in the embodiments of this disclosure.
[0025] Sixthly, embodiments of this disclosure also provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the prop generation method or the image processing method as described in embodiments of this disclosure.
[0026] In a seventh aspect, this disclosure also provides a computer program product that, when executed by a computer, enables the computer to implement the prop generation method or the image processing method as described in this disclosure.
[0027] The present disclosure provides a method for generating special effects props, a method for processing images, an apparatus, and an electronic device. These methods include displaying a special effects prop editing page and acquiring a first image. The special effects prop editing page includes a process information display area and an effect display area. The process information display area displays the process information of the prop to be edited, and the effect display area displays a second image obtained by processing the first image based on the process information of the prop to be edited. In response to an editing operation, the process information of the prop to be edited is edited, and the second image displayed in the effect display area is updated. In response to a special effects prop generation operation, a target special effects prop is generated based on the edited target prop process information. By employing the above technical solution, the present disclosure allows for the editing of special effects props by editing the prop process information, and displays a preview of the edited prop process information in real time during the editing process. This simplifies the creation and editing difficulty of special effects props, reduces the time spent by users in creating and editing special effects props, and improves the user experience. Attached Figure Description
[0028] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.
[0029] Figure 1 A flowchart illustrating a method for generating special effects props according to an embodiment of this disclosure;
[0030] Figure 2 This is a schematic diagram of a special effects prop editing page provided in an embodiment of the present disclosure;
[0031] Figure 3A flowchart illustrating another method for generating special effects props provided in this embodiment of the disclosure;
[0032] Figure 4 A schematic flowchart illustrating a screen processing method provided in an embodiment of this disclosure;
[0033] Figure 5 A schematic flowchart illustrating another screen processing method provided in this embodiment of the present disclosure;
[0034] Figure 6 A structural block diagram of a special effects prop generation device provided in an embodiment of this disclosure;
[0035] Figure 7 A structural block diagram of a screen processing apparatus provided in an embodiment of this disclosure;
[0036] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation
[0037] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.
[0038] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.
[0039] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.
[0040] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.
[0041] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".
[0042] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
[0043] Figure 1 This is a flowchart illustrating a method for generating special effects props according to an embodiment of this disclosure. The method can be executed by a special effects prop generation device, which can be implemented in software and / or hardware and can be configured in an electronic device, typically a computer device. The special effects prop generation method provided in this disclosure is applicable to scenarios involving the creation of special effects props. Figure 1 As shown, the method for generating special effects props provided in this embodiment may include:
[0044] S101. Display the special effects prop editing page and obtain a first screen. The special effects prop editing page is provided with a process information display area and an effect display area. The process information display area is used to display the process information of the prop to be edited, and the effect display area is used to display a second screen. The second screen is a preview screen obtained by processing the first screen based on the process information of the prop to be edited.
[0045] The special effects item editing page can display the item's workflow information, allowing users to edit the items, such as creating new or modifying existing ones. Figure 2 As shown, the special effects prop editing page may contain a process information display area 20 and an effect display area 21. The process information display area 20 can be used to display the process information of the prop to be edited and the process information of the target prop obtained after editing. The effect display area 21 can be used to display the preview effect of the special effects prop corresponding to the process information of the prop to be edited in real time during the user's editing process.
[0046] The item process information to be edited can be understood as the item process information that the user is currently editing on the special effects item editing page. It can be information used to identify the execution process of the special effects item, such as text information, image information or flowcharts used to identify the execution process of the special effects item.
[0047] To further simplify the operations required by users during the editing process, preferably, such as Figure 2As shown, the process information for the prop to be edited can be presented in the form of a flowchart. The flowchart can have at least two nodes, each with at least one input connection point and / or at least one output connection point. Here, the flowchart can be a directed acyclic graph (DAG), with one input node and one output node. It can also further include filter nodes for applying filters to the received image, such as operation filter nodes for processing image textures, convolution filter nodes for convolution processing, and / or image cutout / repair filter nodes for repairing incomplete images. Input nodes may only have output connection points, and output nodes may only have input connection points. Each filter node can have both input and output connection points. An input connection point can be connected to an output connection point, used to input the image information output by the corresponding output connection point to the corresponding node for processing. An output connection point can be connected to one or more input connection points, used to send the processed image information from the corresponding node to the corresponding input connection point.
[0048] The first screen can be the initial screen that has not been processed using the item's workflow information to be edited. This initial screen can be a user-imported or client-preset video, animation, or image, used as the input screen for input nodes in the item's workflow diagram. Correspondingly, the second screen can be a preview screen obtained by processing the first screen based on the item's workflow information displayed on the item's editing page. For example, it can be a screen rendered based on the output information from the output nodes in the item's workflow diagram.
[0049] Specifically, the electronic device can respond to the user's (such as a researcher) editing page display operation, obtain the first screen, display the special effects prop editing page, display the prop process information to be edited in the process information display area of the special effects prop editing page, and display the second screen obtained by processing the first screen based on the prop process information to be edited at the current moment in the effect display area of the special effects prop editing page.
[0050] Taking the presentation of the process information for an item to be edited as a flowchart as an example, the electronic device can respond to the user's new creation operation by creating a flowchart for the item to be edited that contains only input nodes and output nodes, and these input nodes and output nodes are connected by connecting lines. This flowchart is then displayed in the process information display area of the special effects prop editing page, while the effect display area of the special effects prop editing page displays a second screen obtained by processing the first screen based on this flowchart. At this point, since the flowchart only contains input nodes and output nodes, and does not contain filter nodes, the second screen output by the output node is still the initial first screen.
[0051] In addition, electronic devices can also respond to the user's import operation, obtain the flowchart imported by the user as the flowchart of the prop to be edited, display the flowchart of the prop to be edited in the flowchart information display area of the special effects prop editing page, and display the second screen obtained by processing the first screen based on the flowchart of the prop to be edited in the effect display area of the special effects prop editing page.
[0052] S102. In response to the editing operation, the process information of the prop to be edited is edited, and the second screen displayed in the effect display area is updated.
[0053] Among them, the editing operation can be an operation to edit the process information of the item to be edited, such as an add operation to add process steps to the process information of the item to be edited, a delete operation to delete one or more process steps in the process information of the item to be edited, an order adjustment operation to adjust the execution order of each process step in the process information of the item to be edited, and / or a step editing operation to edit the content of the process steps in the process information of the item to be edited, etc.
[0054] Specifically, when a user wants to edit the process information of the prop to be edited displayed on the special effects prop editing page, they can perform corresponding editing operations, such as the aforementioned add operation, delete operation, order adjustment operation, or step editing operation. Correspondingly, when the electronic device receives the user's editing operation, it can edit the prop process information to be edited based on that operation. For example, in response to the user's add operation, it can add a new process step to the prop process information to be edited; in response to the user's delete operation, it can delete the corresponding process step in the prop process information to be edited; in response to the user's order adjustment operation, it can adjust the execution order of certain steps in the prop process information to be edited; or in response to the user's step editing operation, it can modify the content of the process steps in the prop process information to be edited, and so on. Furthermore, after each editing operation based on the user's editing operation, the first screen can be reprocessed based on the edited prop process information to obtain a new second screen, which is then displayed in the effect display area of the special effects prop editing page.
[0055] In addition, users can also view the first screen through the original screen viewing operation. For example, when a user wants to view the first screen, they can move the cursor to the effect display area, or trigger the original screen control. Correspondingly, when the electronic device receives the user's original screen viewing operation, it can display the first screen, such as switching the second screen displayed in the effect display area to the first screen, or displaying the original screen window and showing the first screen in the original screen window, so that the user can compare the first screen and the second screen.
[0056] In this embodiment, the editing of special effects props can be completed by editing the process information of the props to be edited, without writing code. Furthermore, the effect of the special effects props on the screen can be viewed in real time during the editing process. This simplifies the creation and editing of special effects props, improves the efficiency of creating and editing special effects props, reduces the time spent by users in creating and editing special effects props, and enhances the user experience.
[0057] S103. In response to the special effects prop generation operation, generate the target special effects prop based on the target prop flow information obtained from editing.
[0058] The special effects prop generation operation can be an operation that generates special effects props using the prop flow information obtained through editing, such as triggering the special effects prop generation control. Correspondingly, the target prop flow information can be the prop flow information obtained when the prop flow information to be edited is completed. The target special effects prop can be a special effects prop generated based on the target prop flow information to be edited.
[0059] Specifically, after a user finishes editing the process information for a desired item, they can perform an effect item generation operation when they wish to use the edited target item process information to generate a special effect item. Correspondingly, when the electronic device receives the user's effect item generation operation, it can obtain the user-edited target item process information and generate the target special effect item based on that information. For example, it can serialize the target item process information into a configurable item format (such as JSON format) to obtain the target special effect item.
[0060] In addition, users can also save the edited item flow information by performing a save operation. For example, when a user wants to save the currently obtained item flow information during or after editing, they can perform a save operation, such as triggering a save control; correspondingly, when the electronic device receives the user's save operation, it can save the item flow information currently displayed on the special effects item editing page, such as saving the item flow diagram currently displayed on the special effects item editing page in the form of a directed acyclic graph.
[0061] In one embodiment, the method for generating special effects props provided in this embodiment may further include: displaying the input screen of the corresponding input connection point when the cursor moves to the display area of any input connection point; and / or, displaying the output screen of the corresponding output connection point when the cursor moves to the display area of any output connection point.
[0062] In the above implementation, in addition to viewing the second screen obtained by processing the first screen based on the currently displayed prop process information in the effect display area, users can also view the intermediate effects of processing the first screen based on the currently displayed prop process information in real time, such as viewing the input and / or output screens of each node during the processing of the first screen. This allows them to clarify the processing effect of each node, quickly determine whether the corresponding node in the prop process diagram needs to be edited, further reduce the difficulty of editing special effects props, and improve the creation efficiency of special effects props.
[0063] For example, when a user wants to view the input screen of a node in the process information of an item to be edited, they can move the cursor to the display area of the input connection point of that node. Correspondingly, when the electronic device detects that the cursor has moved to the display area of an input connection point in the process information display area, it can display the input screen received by that input connection point, such as displaying an input screen rendered based on the input screen information received by that input connection point. Similarly, when a user wants to view the output screen of a node in the process information of an item to be edited, they can move the cursor to the display area of the output connection point of that node. Correspondingly, when the electronic device detects that the cursor has moved to the display area of an output connection point in the process information display area, it can display the output screen output by that output connection point, such as displaying an output screen rendered based on the output screen information of that output connection point.
[0064] In the above embodiments, the display methods of the output screen and the input screen of the input connection point can be flexibly set. For example, the input screen / output screen of the corresponding connection point can be displayed in the screen display area of the special effects prop editing page; or, a screen display area can be created on one side of the corresponding connection point, and the input screen / output screen can be displayed in the screen display area; or the input screen / output screen can be displayed in the form of a floating window, such as displaying a screen display window on one side of the corresponding connection point, and displaying the input screen / output screen of the connection point in the screen display window. This embodiment does not limit this.
[0065] The method for generating special effects props provided in this embodiment displays a special effects prop editing page and acquires a first screen. The special effects prop editing page includes a process information display area and an effect display area. The process information display area displays the process information of the prop to be edited, and the effect display area displays a second screen obtained by processing the first screen based on the process information of the prop to be edited. In response to an editing operation, the process information of the prop to be edited is edited, and the second screen displayed in the effect display area is updated. In response to a special effects prop generation operation, a target special effects prop is generated based on the edited target prop process information. This embodiment, by adopting the above technical solution, edits special effects props by editing prop process information and displays a preview of the edited prop process information in real time during the editing process. This simplifies the creation and editing difficulty of special effects props, reduces the time spent by users in creating and editing special effects props, and improves the user experience.
[0066] Figure 3 This is a flowchart illustrating another method for generating special effects props provided in this embodiment. The solution in this embodiment can be combined with one or more optional solutions in the above embodiments. Optionally, the step of editing the prop flow information to be edited in response to an editing operation includes: displaying a node list in response to a node addition operation acting on a first node in the prop flow information to be edited; and adding the second node between the first node and a third node in response to a triggering operation on a second node in the node list, wherein the third node is an adjacent node of the first node.
[0067] Optionally, the step of editing the prop process information in response to the editing operation includes: in response to a first sliding operation, controlling the endpoint of the connecting line located at the target input connection point to move with the first sliding operation until the first sliding operation ends, wherein the first sliding operation starts at the target input connection point; and / or, in response to a second sliding operation, drawing a new connecting line starting from the target output connection point, and controlling the endpoint of the new connecting line to move with the second sliding operation until the second sliding operation ends, wherein the second sliding operation starts at the target output connection point.
[0068] Optionally, the step of editing the process information of the item to be edited in response to the editing operation includes: displaying the configuration information of the fourth node in response to the configuration information display operation of the fourth node in the process information of the item to be edited; and displaying the modified configuration information in response to the configuration information modification operation.
[0069] Optionally, after generating the target special effect prop based on the target prop process information obtained from editing, the method further includes: in response to the publishing operation for the target special effect prop, uploading the target special effect prop to the server for publishing.
[0070] Correspondingly, such as Figure 3 As shown, the method for generating special effects props provided in this embodiment may include:
[0071] S201. Display the special effects prop editing page and obtain the first screen. Execute S202, S204, S205, or S206. The special effects prop editing page includes a process information display area and an effect display area. The process information display area displays the process information of the prop to be edited, presented in the form of a flowchart. The flowchart has at least two nodes, each with at least one input connection point and / or at least one output connection point. The effect display area displays a second screen, which is a preview screen obtained by processing the first screen based on the process information of the prop to be edited.
[0072] S202. In response to the node addition operation acting on the first node in the prop flow information to be edited, display the node list.
[0073] The node addition operation can be an operation that instructs an electronic device to display a node list to add filter nodes to the item flow information to be edited. Correspondingly, the first node can be the node to which the user wants to add a filter node; this first node can be any node in the item flow information to be edited. The node list can be used to display pre-set filter nodes, which can include basic filter nodes and / or composite filter nodes. Basic filter nodes can be the smallest granularity nodes, and composite filter nodes can be filter nodes obtained by combining multiple basic filter nodes in a certain flow sequence.
[0074] Specifically, when a user wants to add a filter node adjacent to a node in the item's workflow information to be edited, they can perform a node addition operation on that node. Correspondingly, upon receiving this node addition operation, the electronic device can display a node list, showing pre-set filter nodes, including their identifiers, for the user to select.
[0075] In one implementation, the node addition operation includes a right-click operation on the first node. That is, the user can instruct the electronic device to display a node list by clicking the right mouse button. For example, when a user wants to add a filter node between a given node and its adjacent nodes, they can move the cursor to the display position of that node and trigger the right mouse button. Correspondingly, when the electronic device detects that the user has triggered the right mouse button, it can designate the node at the current display position of the cursor as the first node, confirm receipt of the node addition operation for that first node, and display the node list in response to the node addition operation.
[0076] In another embodiment, the node addition operation includes a triggering operation on the list control of the first node. Before displaying the node list in response to the node addition operation on the first node in the process information of the item to be edited, the method further includes: displaying the list control of the first node when the cursor moves to the output connection point display area of the first node.
[0077] In the above implementation, the user can instruct the electronic device to display a list of nodes by triggering a list control.
[0078] The list control can be used to indicate the list of nodes displayed on an electronic device. The output connection point display area can be understood as the display area where the output connection points are located, that is, the display position of the output connection points.
[0079] For example, when a user wants to instruct an electronic device to display a list control, they can move the cursor to the output connection point display area of that node. When the electronic device detects that the cursor has moved to the output connection point display area of a node, it can designate that node as the first node and display the list control for that first node. Therefore, when the user wants to add a filter node between the first node and its adjacent nodes, they can trigger the list control. Correspondingly, when the electronic device detects that the user has triggered the list control for the first node, it can determine that a node addition operation has been received and, in response to the node addition operation, display the node list.
[0080] Furthermore, when the cursor moves to the input connection point display area of a node, the electronic device may or may not display the list control for that node; this embodiment does not impose any restrictions on this.
[0081] It should be noted that when a node add operation is received for different nodes, the filter nodes displayed in the node list may be the same or different. For example, when a node add operation is received for different nodes, all pre-set filter nodes may be displayed in the node list; or, only filter nodes that match the current node may be displayed, such as only filter nodes that can be connected to the current node.
[0082] S203. In response to the triggering operation on the second node in the node list, the second node is added between the first node and the third node, and S208 is executed, wherein the third node is an adjacent node of the first node.
[0083] The second node can be a filter node triggered by the user in the node list. The third node can be a node adjacent to the first node in the item flow information to be edited before the second node is added, such as a node whose input connection point is connected to the output connection point of the first node, and / or a node whose output connection point is connected to the input connection point of the first node, etc.
[0084] Specifically, when a user wants to add a node to the item's workflow information, they can trigger that node displayed in the node list, such as by triggering the node's identifier information. Correspondingly, when the electronic device detects that a user has triggered a node displayed in the node list, it can treat that node as a second node and add it between the first node and one of its adjacent nodes (i.e., a third node).
[0085] In this embodiment, the addition position of the second node can be set as needed. For example, the second node can be directly added between the first node and a node whose input connection point and output connection point are connected, or the second node can be added between the first node and a node whose output connection point and input connection point are connected. To make the addition position of the second node more in line with the user's actual addition intention and reduce the need for the user to adjust the position of the second node in the item flow information to be edited, this embodiment preferably adds the second node between the first node and a node whose input connection point and output connection point are connected when the node list is displayed in response to the user's right-click operation, or when the list control of the first node is displayed in response to the operation of moving the cursor to the display area of the first node's output connection point, and when the node list is displayed in response to the user's trigger operation on the list control; or when the list control of the first node is displayed in response to the operation of moving the cursor to the display area of the first node's input connection point, and when the node list is displayed in response to the user's trigger operation on the list control, the second node is added between the first node and a node whose output connection point and input connection point are connected.
[0086] In one implementation, when adding a second node between a first node and a node (i.e., a third node) that connects the first node to its input connection point and its output connection point, a connecting line between the second node and that node can be deleted, and the output connection point of the first node can be connected to the input connection point of the second node, and the output connection point of the second node can be connected to the input connection point of that node. Preferably, adding the second node between the first node and the third node includes: adding the second node to the process information display area, deleting the first connecting line displayed in the process information display area, and drawing a second and a third connecting line, wherein the first connecting line connects the output connection point of the first node to the input connection point of the third node, the second connecting line connects the output connection point of the first node to the input connection point of the second node, and the third connecting line connects the output connection point of the second node to the input connection point of the third node.
[0087] S204. In response to the first sliding operation, control the endpoint of the connecting line located at the target input connection point to move with the first sliding operation until the first sliding operation ends, and execute S208, wherein the first sliding operation starts at the target input connection point.
[0088] The first sliding operation can be a sliding operation that starts from an input connection point of a node displayed in the workflow information of the item to be edited, that is, a sliding operation whose starting point is located within the display area of the input connection point. Correspondingly, the target input connection point can be the input connection point from which the first sliding operation starts.
[0089] In this embodiment, the user can adjust the connection position of the connecting line connected to a certain input connection point by sliding the operation starting from that input connection point.
[0090] For example, when a user wants to adjust the connection position of a connecting line displayed in the item's flow information, they can slide from the input connection point where the end point of the connecting line is located, such as selecting the end point of the connecting line and dragging it. Correspondingly, when the electronic device detects a sliding operation starting from an input connection point in the item's flow information, it can use that input connection point as the target input connection point and control the end point of a connecting line connected to that target input connection point (such as the connecting line selected by the user) to move with the user's sliding operation until the user finishes sliding. If, when the user finishes sliding, the end point has moved to the display position of an input connection point in the item's flow diagram, the connecting line can be connected to that input connection point.
[0091] S205. In response to the second sliding operation, a new connection line is drawn starting from the target output connection point, and the endpoint of the new connection line is controlled to move with the second sliding operation until the second sliding operation ends. Then, S208 is executed, wherein the second sliding operation starts from the target output connection point.
[0092] The second sliding operation can be a sliding operation that starts from the output connection point of a node displayed in the workflow information of the item to be edited, that is, a sliding operation whose starting point is located within the display area of the output connection point. Correspondingly, the target output connection point can be the output connection point from which the second sliding operation starts.
[0093] In this embodiment, the user can draw a new connection line starting from an input connection point by sliding a motion that starts from an output connection point.
[0094] For example, when a user wants to draw a line connecting the output connection point of one node to the input connection point of another node—that is, when they want to input the screen information output by the output connection point to another node for processing—they can slide from that output connection point. Correspondingly, when the electronic device detects a sliding operation starting from an output connection point in the workflow information of the item to be edited, it can draw a new connection line starting from that output connection point and control the endpoint of this new connection line to move with the user's sliding operation until the user finishes sliding. If, when the user finishes sliding, the endpoint has moved to the display position of an input connection point in the workflow diagram of the item to be edited, the endpoint of the new connection line can be connected to that input connection point.
[0095] S206. In response to the configuration information display operation for the fourth node in the process information of the item to be edited, display the configuration information of the fourth node.
[0096] The configuration information display operation can be a trigger operation that instructs the electronic device to display the configuration information of a certain node in the process information of the prop to be edited, such as a left-click operation on the node or a trigger operation on the configuration control of the node. Correspondingly, the fourth node can be the node to which the configuration information display operation is performed. This node can be any node displayed in the process information display area, preferably a filter node displayed in the process information display area.
[0097] Specifically, when a user wants to view or modify the configuration information of a specific node in the item's process information to be edited, they can perform a configuration information display operation for that node. Correspondingly, when the electronic device receives this configuration information display operation for a specific node in the item's process information to be edited, it can display the configuration information for that node, such as displaying the configuration information for that node in the configuration information display area 22 of the special effects item editing page (e.g.,...). Figure 2 As shown), and / or, display a configuration information window above the process information display area 20, and display the configuration information of the node in the configuration information window.
[0098] In one embodiment, the configuration information display operation includes a left-click operation on the fourth node. That is, the user can instruct the electronic device to display the configuration information of a specific node by clicking the left mouse button. For example, when a user wants to view or modify the configuration information of a node, they can move the cursor to the display position of that node and trigger the left mouse button. Correspondingly, when the electronic device detects that the user has triggered the left mouse button, it can identify the node at the current display position of the cursor as the fourth node, confirm receipt of the configuration information display operation for the fourth node, and in response to the configuration information display operation, display the configuration information of the fourth node, such as displaying the configuration information of the node in the configuration information display area of the special effects prop editing page.
[0099] In another embodiment, the configuration information display operation includes a triggering operation on the configuration control of the fourth node. Before displaying the configuration information of the fourth node in response to the configuration information display operation for the fourth node in the process information of the item to be edited, the operation further includes: displaying the configuration control of the fourth node in response to a left mouse click operation on the fourth node.
[0100] In the above embodiments, the user can instruct the electronic device to display the configuration information of the corresponding node by triggering a configuration control. The configuration control can be a control used to instruct the electronic device to display the configuration information of the corresponding node.
[0101] For example, when a user wants to instruct an electronic device to display the configuration control for a specific node, they can move the cursor to the display location of that node and click the left mouse button. Upon detecting the user's left mouse button click, the electronic device can designate that node as a fourth node and display its configuration control. Thus, when the user views or modifies the configuration information of the fourth node, they can trigger the configuration control. Correspondingly, when the electronic device detects that the user has triggered the configuration control for the fourth node, it can determine that it has received a configuration information display operation for the fourth node and, in response to this operation, display the configuration information of the fourth node, such as displaying a configuration information window above the process information display area and displaying the node's configuration information within that window.
[0102] S207. In response to configuration information modification operations, display the modified configuration information.
[0103] Among them, the configuration information modification operation can be an operation to modify the configuration information of a certain node (i.e., the fourth node) in the process information of the item to be edited, such as modifying the node name, node type and / or node parameter values in the configuration information.
[0104] Specifically, the electronic device displays the configuration information of the fourth node. Thus, the user can modify the configuration information of the fourth node through corresponding configuration modification operations. Correspondingly, when the electronic device receives a user's configuration modification operation, it can modify the configuration information of the fourth node based on that operation and display the modified configuration information.
[0105] S208. Update the second screen displayed in the effect display area.
[0106] S209. In response to the special effects prop generation operation, generate the target special effects prop based on the target prop flow information obtained from editing.
[0107] S210. In response to the publishing operation for the target special effect item, the target special effect item is uploaded to the server for publishing.
[0108] In this embodiment, based on the user's publishing operation, the props created by the user can be published so that other users can use the props created by the user to process the screen.
[0109] Specifically, after the target special effects item is generated, the user can further perform a publishing operation, such as triggering the publishing control for the target special effects item. Correspondingly, when the electronic device detects the user's publishing operation for the target special effects item, it can upload the target special effects item to the server for publishing.
[0110] In addition, once the target effect prop is released, the user (i.e. the publisher of the target effect prop) or other users can use the target effect prop to process the screen and rate the target effect prop, so that other users can determine whether to use the target effect prop for screen processing based on the rating.
[0111] The method for generating special effects props provided in this embodiment can create new special effects props or modify existing ones without editing code, which simplifies the creation and modification process of special effects props and increases users' enthusiasm for publishing special effects props.
[0112] Figure 4This is a flowchart illustrating a screen processing method provided in an embodiment of this disclosure. The method can be executed by a screen processing device, which can be implemented in software and / or hardware and can be configured in an electronic device, typically a mobile phone or tablet. The screen processing method provided in this disclosure is applicable to scenarios where special effects props are used to process the screen to be processed. Figure 4 As shown, the image processing method provided in this embodiment may include:
[0113] S301. Obtain the target prop flow information of the screen to be processed and the target special effects prop, wherein the target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During the editing process, the special effects prop editing page displays a second screen obtained by processing the first screen based on the prop flow information to be edited.
[0114] The target special effects prop can be the special effects prop that the user wants to use for image processing. Correspondingly, the image to be processed can be the image that needs to be processed by the target special effects prop, such as video footage, animation footage, or image footage to be processed. The target prop flow information can be the prop flow information of the target special effects prop. This prop flow information can be set with multiple nodes, such as input nodes, output nodes, and at least one filter node, which can be used to identify the execution flow of the target special effects prop.
[0115] Specifically, it can acquire the screen that the user wants to process as the screen to be processed, take the special effect prop selected by the user as the target special effect prop, and acquire the prop flow information of the target special effect prop as the target prop flow information.
[0116] S302. The target special effects prop is used to process the image to be processed.
[0117] In this embodiment, after obtaining the target prop process information of the screen to be processed and the target special effect prop, the screen to be processed can be processed using the target special effect prop. For example, the screen information of the screen to be processed can be input to the input node of the target special effect prop. Based on the processing flow identified by the target prop process information, each node can be used to process the received screen information in sequence, and the target screen information output by the output node of the target special effect prop can be obtained.
[0118] S303. When processing is complete, a rendering instruction packet is sent to the graphics processor (GPU) to instruct the GPU to render the output screen of each node according to the arrangement order of each node in the target prop process information, so as to obtain the processed target screen. The rendering instruction packet contains the rendering instructions of each node.
[0119] In this embodiment, instead of submitting rendering instructions to the Graphics Processing Unit (GPU) immediately after each node has processed the received image information, the rendering instructions of each node are submitted to the GPU only after the target image information has been processed using the target effect props, such as after the output node outputs the processed target image information. This eliminates the need to submit rendering instructions multiple times to complete the rendering of the processed target image, simplifying the image processing process and reducing the runtime resources consumed by the image processing process.
[0120] The rendering instruction package may contain rendering instructions for each filter node in the target effect prop, and may further contain rendering instructions for the input nodes and output nodes of the target effect prop. The rendering instruction for a certain node can be used to instruct the GPU to render the output image of that node based on the output image information of that node.
[0121] For example, upon receiving the target image information output by the output node, the system can generate rendering instructions for each node in the target effect prop, control each node in the target effect prop to generate rendering instructions, or obtain the rendering instructions generated by each node when it finishes processing the received image information, or the rendering instructions generated by the corresponding node. Based on the rendering instructions of each node, a rendering instruction package is generated and submitted to the GPU. Thus, after receiving the rendering instruction package, the GPU can render the output images of each node according to the order of the nodes in the target prop flow information, based on the output image information of each node, to obtain the output images of each node, and thereby obtain the target image obtained from processing the image to be processed.
[0122] The image processing method provided in this embodiment obtains the image to be processed and the target prop flow information of the target special effects prop. This target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During the editing process, the special effects prop editing page displays a second image obtained by processing the first image based on the prop flow information to be edited. The target special effects prop is then used to process the image to be processed. When processing is complete, a rendering instruction packet is sent to the GPU to instruct the GPU to render the output images of each node according to the arrangement order of the nodes in the target prop flow information, thereby obtaining the processed target image. The rendering instruction packet contains the rendering instructions for each node. By adopting the above technical solution, this embodiment simplifies the image processing process and reduces the runtime resources occupied by the image processing process by uniformly sending rendering instructions to the GPU after each node has processed the received image information.
[0123] Figure 5This is a flowchart illustrating another screen processing method provided in this embodiment. The solution in this embodiment can be combined with one or more optional solutions in the above embodiments. Optionally, processing the screen to be processed using the target special effects prop includes: for each node in the target prop flow information, receiving input screen information through the current node; processing the input screen information through the current node using a target processing space to obtain at least one output screen information, wherein the target processing space is the memory space occupied by the current node when processing the input screen information; and outputting the output screen information through the current node.
[0124] Optionally, before processing the input screen information using the target processing space through the current node, the process includes: determining the target type and target quantity of the target processing space through the current node; determining, through the current node, any available processing space in the existing processing space whose space type matches the target type, wherein the existing processing space is the processing space already requested by each node in the target item flow information; obtaining the target quantity of available processing space as the target processing space when the current node responds to a situation where the quantity of available processing space is greater than or equal to the target quantity; obtaining the available processing space as the target processing space when the current node responds to a situation where the quantity of available processing space is less than the target quantity, and requesting target processing space from the GPU based on the difference between the target quantity and the quantity of space and the target type.
[0125] Correspondingly, such as Figure 5 As shown, the image processing method provided in this embodiment may include:
[0126] S401. Obtain the target prop flow information of the screen to be processed and the target special effects prop, wherein the target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During the editing process, the special effects prop editing page displays a second screen obtained by processing the first screen based on the prop flow information to be edited.
[0127] S402. For each node in the target prop process information, receive input screen information through the current node.
[0128] The current node can be any node in the target item's process information, such as an input node, filter node, or output node. The input screen information can be the screen information received by the current node, that is, the screen information input into the current node.
[0129] In this embodiment, each node can be sequentially designated as the current node according to its arrangement order in the target item flow information. Thus, when the current node is an input node, it can obtain information about the screen to be processed as its own input screen information; when the current node is a filter node or an output node, it can receive output screen information from each output connection point connected to its input connection point as its own input screen information.
[0130] S403. Determine the target type and target quantity of the target processing space through the current node, wherein the target processing space is the memory space occupied by the current node when processing the input screen information.
[0131] The target processing space refers to the GPU memory space used by the current node to process the input screen information. In other words, the current node can process the received input screen information and obtain the output screen information within its target processing space. Correspondingly, the target type can be defined by the size of the target processing space and its data processing format. The data processing format can be the format of data that the target processing space can process, such as which of the four categories of values—red color channel value R, green color channel value G, blue color channel value B, and opacity parameter A—the target processing space needs to process exclusively. The target quantity refers to the amount of target processing space required by the current node when processing the input screen information.
[0132] Specifically, when the current node needs to process the received input screen information, it can first determine the target type and target quantity of the target processing space required to process the received input screen information. For example, it can obtain the target type and target quantity of the target processing space recorded in its own code or configuration information, or obtain the type and quantity of the processing space required by itself during trial operation, as the target type and target quantity of the target processing space required by itself.
[0133] S404. Determine, through the current node, an idle processing space in the existing processing space whose space type matches the target type, and execute S405 or S406, wherein the existing processing space is the processing space that each node in the target item process information has applied for.
[0134] The existing processing space refers to the processing space already requested by the target special effect item before the target processing space is determined at the current node. That is, the processing space that each node between the current node and the current node in the target item process information has requested and obtained. The idle processing space is the processing space that is not occupied at the current moment.
[0135] Specifically, after determining the target type and number of targets in the target processing space, the current node can select an idle processing space whose type matches the target type of the target processing space from the existing memory spaces already allocated by the target effect prop.
[0136] S405. If the current node responds to the situation where the number of free processing spaces is greater than or equal to the target number, obtain the target number of free processing spaces as the target processing space, and execute S407.
[0137] S406. When the current node responds to the situation where the number of free processing spaces is less than the target number, it obtains the free processing space as the target processing space, and applies for the target processing space from the GPU based on the difference between the target number and the number of spaces and the target type.
[0138] For example, after the current node obtains free processing space with a space type that matches the target type, it can determine whether the number of free processing spaces obtained is greater than or equal to the target number of target processing spaces. If so, it directly obtains the target number of free processing spaces from the obtained processing space as its own target processing space. If not, it uses all the obtained free processing spaces as its own target processing space, calculates the difference between the target number of target processing spaces required by itself and the number of free processing spaces obtained, and uses this difference as the number of target processing spaces to be requested. It then requests this number of memory spaces from the GPU with a space type that matches the target type as its own target processing space.
[0139] In this embodiment, when each node needs to process the received input screen information, it does not directly request the target amount of processing space from the GPU as its own target processing space. Instead, it prioritizes using the free processing space that each node has already requested in the target special effects prop and whose space type matches the target type as the target processing space. Only when the number of free processing spaces that match the target type is less than the target number, it requests memory space from the GPU in a quantity equal to the difference between the two as the target processing space. This enables the reuse of existing processing space, reduces the occupation of GPU memory space, and lowers GPU and storage costs.
[0140] S407. The input screen information is processed by the current node using the target processing space to obtain at least one output screen information.
[0141] In this embodiment, after the current node obtains the target processing space, it can process the received input screen information within the target processing space to obtain at least one output screen information.
[0142] S408. Output the output screen information through the current node.
[0143] In this embodiment, after the current node processes and obtains the output screen information, it can output the output screen information. For example, when the current node is an input node or a filter node, it can output the corresponding output screen information to the node connected to the output connection point through its own output connection point; when the current node is an output node, it can use the output screen information as the target screen information of the target screen and output the target screen information.
[0144] S409. When processing is complete, a rendering instruction packet is sent to the graphics processor (GPU) to instruct the GPU to render the output screen of each node according to the arrangement order of each node in the target prop process information, so as to obtain the processed target screen. The rendering instruction packet contains the rendering instructions of each node.
[0145] The image processing method used in this embodiment can reduce the GPU memory space required for image processing by reusing existing processing space, thereby reducing GPU and storage costs and lowering the requirements for GPU configuration.
[0146] Figure 6 This is a structural block diagram of a special effects prop generation apparatus provided in an embodiment of this disclosure. The apparatus can be implemented by software and / or hardware, and can be configured in an electronic device, typically a computer device, and can generate special effects props by executing a special effects prop generation method. Figure 6 As shown, the special effects prop generation device provided in this embodiment may include: a page display module 601, an editing module 602, and a prop generation module 603, wherein,
[0147] The page display module 601 is used to display the special effects prop editing page and obtain a first screen. The special effects prop editing page is provided with a process information display area and an effect display area. The process information display area is used to display the process information of the prop to be edited, and the effect display area is used to display a second screen. The second screen is a preview screen obtained by processing the first screen based on the process information of the prop to be edited.
[0148] The editing module 602 is used to respond to the editing operation, edit the process information of the prop to be edited, and update the second screen displayed in the effect display area;
[0149] The prop generation module 603 is used to respond to the special effects prop generation operation and generate the target special effects prop based on the target prop flow information obtained through editing.
[0150] The special effects prop generation device provided in this embodiment displays a special effects prop editing page through a page display module and acquires a first screen. The special effects prop editing page includes a process information display area and an effect display area. The process information display area displays the process information of the prop to be edited, and the effect display area displays a second screen obtained by processing the first screen based on the process information of the prop to be edited. The editing module responds to the editing operation by editing the process information of the prop to be edited and updating the second screen displayed in the effect display area. The prop generation module responds to the special effects prop generation operation by generating a target special effects prop based on the edited target prop process information. This embodiment, by adopting the above technical solution, edits special effects props by editing prop process information and displays a preview of the edited prop process information in real time during the editing process. This simplifies the creation and editing difficulty of special effects props, reduces the time spent by users in creating and editing special effects props, and improves the user experience.
[0151] In the above scheme, the process information of the prop to be edited can be presented in the form of a flowchart. The flowchart can have at least two nodes, and each node can have at least one input connection point and / or at least one output connection point.
[0152] In the above scheme, the editing module 602 may include: a list display unit, used to display a node list in response to a node addition operation on a first node in the process information of the item to be edited; and a node addition unit, used to add the second node between the first node and the third node in response to a trigger operation on a second node in the node list, wherein the third node is an adjacent node of the first node.
[0153] In the above scheme, the node addition operation may include a right-click operation on the first node.
[0154] In the above scheme, the node addition operation may include a trigger operation of the list control acting on the first node, and the editing module 602 may further include: a list control display unit, used to display the list control of the first node when the cursor moves to the output connection point display area of the first node before displaying the node list in response to the node addition operation acting on the first node in the process information of the item to be edited.
[0155] In the above scheme, the node adding unit can be specifically used to: add the second node in the process information display area, delete the first connecting line displayed in the process information display area, and draw a second connecting line and a third connecting line, wherein the first connecting line is used to connect the output connecting point of the first node and the input connecting point of the third node, the second connecting line is used to connect the output connecting point of the first node and the input connecting point of the second node, and the third connecting line is used to connect the output connecting point of the second node and the input connecting point of the third node.
[0156] Furthermore, the special effects prop generation device provided in this embodiment may also include: a screen display module, used to display the input screen of the corresponding input connection point when the cursor moves to the display area of any input connection point; and / or, to display the output screen of the corresponding output connection point when the cursor moves to the display area of any output connection point.
[0157] In the above scheme, the editing module 602 may include: an endpoint movement unit, configured to, in response to a first sliding operation, control the endpoint of the connecting line located at the target input connection point to move with the first sliding operation until the first sliding operation ends, wherein the first sliding operation starts at the target input connection point; and / or, a connecting line drawing unit, configured to, in response to a second sliding operation, draw a new connecting line starting from the target output connection point, and control the endpoint of the new connecting line to move with the second sliding operation until the second sliding operation ends, wherein the second sliding operation starts at the target output connection point.
[0158] In the above scheme, the editing module 602 may include: a configuration information display unit, used to display the configuration information of the fourth node in response to the configuration information display operation for the fourth node in the process information of the item to be edited; and a configuration information modification unit, used to display the modified configuration information in response to the configuration information modification operation.
[0159] In the above scheme, the configuration information display operation may include a left mouse click operation on the fourth node.
[0160] In the above scheme, the configuration information display operation may include a trigger operation of the configuration control acting on the fourth node. The editing module 602 may also include: a configuration control display unit, used to display the configuration control of the fourth node in response to a left mouse click operation on the fourth node before displaying the configuration information of the fourth node in response to the configuration information display operation of the fourth node in the process information of the item to be edited.
[0161] Furthermore, the special effects prop generation device provided in this embodiment may also include: a prop publishing module, used to upload the target special effects prop to the server for publishing in response to a publishing operation for the target special effects prop after the target special effects prop is generated according to the edited target prop process information.
[0162] The prop generation apparatus provided in this disclosure can execute the prop generation method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the prop generation method. Technical details not described in detail in this embodiment can be found in the prop generation method provided in any embodiment of this disclosure.
[0163] Figure 7 This is a structural block diagram of a screen processing apparatus provided in an embodiment of the present disclosure. The apparatus can be implemented by software and / or hardware, and can be configured in an electronic device, typically a mobile phone or tablet computer, to process the screen by executing screen processing methods. Figure 7 As shown, the image processing device provided in this embodiment may include: an image acquisition module 701, an image processing module 702, and an instruction sending module 703, wherein,
[0164] The image acquisition module 701 is used to acquire the image to be processed and the target prop flow information of the target special effects prop. The target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During the editing process, the special effects prop editing page displays a second image obtained by processing the first image based on the prop flow information to be edited.
[0165] The image processing module 702 is used to process the image to be processed using the target special effects prop;
[0166] The instruction sending module 703 is used to send a rendering instruction packet to the graphics processor (GPU) when the processing is completed, so as to instruct the GPU to render the output screen of each node according to the arrangement order of each node in the target prop process information to obtain the processed target screen. The rendering instruction packet contains the rendering instructions of each node.
[0167] The image processing device provided in this embodiment acquires the image to be processed and the target prop flow information of the target special effects prop through an image acquisition module. This target prop flow information is obtained by editing the prop flow information to be edited in a special effects prop editing page. During the editing process, the special effects prop editing page displays a second image obtained by processing the first image based on the prop flow information to be edited. The image processing module processes the image to be processed using the target special effects prop. Upon completion of processing, the instruction sending module sends a rendering instruction packet to the GPU, instructing the GPU to render the output images of each node according to the arrangement order of the nodes in the target prop flow information, thereby obtaining the processed target image. The rendering instruction packet contains the rendering instructions for each node. By adopting the above technical solution, this embodiment simplifies the image processing process and reduces the runtime resources occupied by the image processing process by uniformly sending rendering instructions to the GPU after each node has processed the received image information.
[0168] In the above scheme, the screen processing module 702 may include: an information receiving unit, used to receive input screen information through the current node for each node in the target prop process information; an information processing unit, used to process the input screen information through the current node using a target processing space to obtain at least one output screen information, wherein the target processing space is the memory space occupied by the current node when processing the input screen information; and an information output unit, used to output the output screen information through the current node.
[0169] In the above scheme, the screen processing module 702 may further include: a quantity determination unit, used to determine the target type and target quantity of the target processing space through the current node before processing the input screen information through the target processing space by the current node; a space determination unit, used to determine the available processing space in the existing processing space whose space type matches the target type through the current node, wherein the existing processing space is the processing space that each node in the target prop process information has applied for; a space acquisition unit, used to acquire the target quantity of available processing space as the target processing space when the current node responds to the situation where the number of available processing space is greater than or equal to the target quantity; and a space application unit, used to acquire the available processing space as the target processing space when the current node responds to the situation where the number of available processing space is less than the target quantity, and apply for the target processing space from the GPU based on the difference between the target quantity and the number of space and the target type.
[0170] The image processing apparatus provided in this disclosure can execute the image processing method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the image processing method. Technical details not described in detail in this embodiment can be found in the image processing method provided in any embodiment of this disclosure.
[0171] The following is for reference. Figure 8 This document illustrates a structural schematic of an electronic device (e.g., a computer device or a terminal device) 800 suitable for implementing embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 8 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.
[0172] like Figure 8 As shown, the electronic device 800 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. The RAM 803 also stores various programs and data required for the operation of the electronic device 800. The processing device 801, ROM 802, and RAM 803 are interconnected via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.
[0173] Typically, the following devices can be connected to I / O interface 805: input devices 806 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 807 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 808 including, for example, magnetic tapes, hard disks, etc.; and communication devices 809. Communication device 809 allows electronic device 800 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 8 An electronic device 800 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.
[0174] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 809, or installed from a storage device 808, or installed from a ROM 802. When the computer program is executed by a processing device 801, it performs the functions defined in the methods of embodiments of this disclosure.
[0175] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0176] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol, such as HTTP (Hypertext Transfer Protocol), and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.
[0177] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.
[0178] The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to:
[0179] Display the special effects prop editing page and obtain a first screen. The special effects prop editing page includes a process information display area and an effect display area. The process information display area displays the process information of the prop to be edited, and the effect display area displays a second screen, which is a preview screen obtained by processing the first screen based on the process information of the prop to be edited. In response to the editing operation, the process information of the prop to be edited is edited, and the second screen displayed in the effect display area is updated. In response to the special effects prop generation operation, a target special effects prop is generated based on the edited target prop process information. Alternatively,
[0180] The process involves acquiring the target prop flow information of the image to be processed and the target special effects prop. This target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During editing, the special effects prop editing page displays a second image obtained by processing the first image based on the prop flow information to be edited. The target special effects prop is then used to process the image to be processed. When processing is complete, a rendering instruction packet is sent to the graphics processing unit (GPU) to instruct the GPU to render the output images of each node according to the arrangement order of the nodes in the target prop flow information, thereby obtaining the processed target image. The rendering instruction packet contains the rendering instructions for each node.
[0181] Computer program code for performing the operations of this disclosure can be written in one or more programming languages or a combination thereof, including but not limited to object-oriented programming languages such as Java, Smalltalk, and C++, as well as conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0182] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0183] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of modules do not, in some cases, constitute a limitation on the unit itself.
[0184] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.
[0185] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0186] According to one or more embodiments of this disclosure, Example 1 provides a method for generating special effects props, including:
[0187] Display the special effects prop editing page and obtain the first screen. The special effects prop editing page is provided with a process information display area and an effect display area. The process information display area is used to display the process information of the prop to be edited, and the effect display area is used to display the second screen. The second screen is a preview screen obtained by processing the first screen based on the process information of the prop to be edited.
[0188] In response to the editing operation, the process information of the prop to be edited is edited, and the second screen displayed in the effect display area is updated;
[0189] In response to the special effects item generation operation, the target special effects item is generated based on the target item flow information obtained through editing.
[0190] According to one or more embodiments of this disclosure, Example 2, based on the method described in Example 1, presents the process information of the item to be edited in the form of a flowchart, wherein the flowchart has at least two nodes, and each node has at least one input connection point and / or at least one output connection point.
[0191] According to one or more embodiments of this disclosure, Example 3 describes the method described in Example 2, wherein the editing of the prop process information to be edited in response to an editing operation includes:
[0192] In response to a node addition operation performed on the first node in the process information of the item to be edited, a node list is displayed;
[0193] In response to a trigger operation on a second node in the node list, the second node is added between the first node and the third node, wherein the third node is an adjacent node of the first node.
[0194] According to one or more embodiments of this disclosure, Example 4 describes the node addition operation according to Example 3, which includes a right-click operation on the first node.
[0195] According to one or more embodiments of this disclosure, Example 5 describes the method according to Example 3, wherein the node addition operation includes a triggering operation of a list control acting on the first node, and before displaying the node list in response to the node addition operation acting on the first node in the editable prop flow information, the method further includes:
[0196] When the cursor moves to the output connection point display area of the first node, the list control of the first node is displayed.
[0197] According to one or more embodiments of this disclosure, Example 6, based on the method described in Example 3, includes adding the second node between the first node and the third node, comprising:
[0198] Add the second node to the process information display area, delete the first connecting line displayed in the process information display area, and draw a second connecting line and a third connecting line. The first connecting line is used to connect the output connection point of the first node and the input connection point of the third node, the second connecting line is used to connect the output connection point of the first node and the input connection point of the second node, and the third connecting line is used to connect the output connection point of the second node and the input connection point of the third node.
[0199] According to one or more embodiments of this disclosure, Example 7, based on any one of Examples 2-6, further includes:
[0200] When the cursor moves to the display area of any input connection point, the input screen of the corresponding input connection point is displayed; and / or,
[0201] When the cursor moves to the display area of any output connection point, the output screen of the corresponding output connection point is displayed.
[0202] According to one or more embodiments of this disclosure, Example 8 describes the method according to any one of Examples 2-6, wherein the editing of the prop flow information to be edited in response to an editing operation includes:
[0203] In response to a first sliding operation, the endpoint of the connecting line located at the target input connection point is controlled to move with the first sliding operation until the first sliding operation ends, wherein the first sliding operation begins at the target input connection point; and / or,
[0204] In response to the second sliding operation, a new connection line is drawn starting from the target output connection point, and the endpoint of the new connection line is controlled to move with the second sliding operation until the second sliding operation ends, wherein the second sliding operation starts from the target output connection point.
[0205] According to one or more embodiments of this disclosure, Example 9 describes the method according to any one of Examples 2-6, wherein the editing of the prop flow information to be edited in response to an editing operation includes:
[0206] In response to the operation of displaying configuration information for the fourth node in the process information of the item to be edited, the configuration information of the fourth node is displayed;
[0207] In response to configuration information modification operations, display the modified configuration information.
[0208] According to one or more embodiments of this disclosure, Example 10 describes the configuration information display operation according to Example 9, which includes a left mouse click operation on the fourth node.
[0209] According to one or more embodiments of this disclosure, Example 11, based on the method described in Example 9, includes a triggering operation on a configuration control of the fourth node, and further includes, before displaying the configuration information of the fourth node in response to the configuration information display operation for the fourth node in the process information of the item to be edited:
[0210] In response to a left-click operation on the fourth node, the configuration controls for the fourth node are displayed.
[0211] According to one or more embodiments of this disclosure, Example 12, based on any one of Examples 1-6, further includes, after generating the target special effects prop based on the edited target prop flow information, the following:
[0212] In response to the publishing operation for the target special effects item, the target special effects item is uploaded to the server for publishing.
[0213] According to one or more embodiments of this disclosure, Example 13 provides a method for processing a screen, including:
[0214] The process involves acquiring the target prop flow information of the screen to be processed and the target special effects prop. The target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During the editing process, the special effects prop editing page displays a second screen obtained by processing the first screen based on the prop flow information to be edited.
[0215] The target special effects props are used to process the image to be processed;
[0216] When processing is complete, a rendering instruction packet is sent to the graphics processing unit (GPU) to instruct the GPU to render the output screen of each node according to the arrangement order of each node in the target prop process information, so as to obtain the processed target screen. The rendering instruction packet contains the rendering instructions of each node.
[0217] According to one or more embodiments of this disclosure, Example 14, based on the method described in Example 13, involves processing the image to be processed using the target special effects prop, including:
[0218] For each node in the target prop process information, input screen information is received through the current node;
[0219] The input screen information is processed by the current node using the target processing space to obtain at least one output screen information, wherein the target processing space is the memory space occupied by the current node when processing the input screen information;
[0220] The output screen information is output through the current node.
[0221] According to one or more embodiments of this disclosure, Example 15, based on the method of Example 14, includes, before processing the input screen information using a target processing space through the current node:
[0222] The target type and the number of targets in the target processing space are determined by the current node.
[0223] The current node determines the available processing space in the existing processing space whose space type matches the target type, wherein the existing processing space is the processing space that each node in the target item process information has applied for;
[0224] If the current node responds to a situation where the number of free processing spaces is greater than or equal to the target number, the target number of free processing spaces is obtained and used as the target processing space.
[0225] When the current node responds to the situation where the number of free processing spaces is less than the target number, it obtains the free processing space as the target processing space, and requests the target processing space from the GPU based on the difference between the target number and the number of spaces and the target type.
[0226] According to one or more embodiments of this disclosure, Example 16 provides an apparatus for generating props, comprising:
[0227] The page display module is used to display the special effects prop editing page and obtain a first screen. The special effects prop editing page is provided with a process information display area and an effect display area. The process information display area is used to display the process information of the prop to be edited, and the effect display area is used to display a second screen. The second screen is a preview screen obtained by processing the first screen based on the process information of the prop to be edited.
[0228] The editing module is used to respond to editing operations, edit the process information of the prop to be edited, and update the second screen displayed in the effect display area;
[0229] The prop generation module is used to respond to the special effects prop generation operation and generate the target special effects prop based on the target prop flow information obtained through editing.
[0230] According to one or more embodiments of this disclosure, Example 17 provides a screen processing apparatus, including:
[0231] The image acquisition module is used to acquire the image to be processed and the target prop flow information of the target special effects prop. The target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During the editing process, the special effects prop editing page displays a second image obtained by processing the first image based on the prop flow information to be edited.
[0232] The image processing module is used to process the image to be processed using the target special effects props;
[0233] The instruction sending module is used to send a rendering instruction packet to the graphics processor (GPU) when processing is complete, instructing the GPU to render the output screen of each node according to the arrangement order of each node in the target prop process information, so as to obtain the processed target screen. The rendering instruction packet contains the rendering instructions of each node.
[0234] According to one or more embodiments of this disclosure, Example 18 provides an electronic device, including:
[0235] One or more processors;
[0236] Memory, used to store one or more programs.
[0237] When the one or more programs are executed by the one or more processors, the one or more processors implement the prop generation method as described in any of Examples 1-12 or the screen processing method as described in any of Examples 13-15.
[0238] According to one or more embodiments of the present disclosure, Example 19 provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements a method for generating props as described in any of Examples 1-12 or a method for processing images as described in any of Examples 13-15.
[0239] According to one or more embodiments of this disclosure, Example 20 provides a computer program product that, when executed by a computer, causes the computer to implement a prop generation method as described in any of Examples 1-12 or a screen processing method as described in any of Examples 13-15.
[0240] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.
[0241] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.
[0242] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.
Claims
1. A method for generating special effects props, characterized in that, include: Display the special effects prop editing page and obtain the first screen. The special effects prop editing page is provided with a process information display area and an effect display area. The process information display area is used to display the process information of the prop to be edited, and the effect display area is used to display the second screen. The second screen is a preview screen obtained by processing the first screen based on the process information of the prop to be edited. The process information of the prop to be edited is presented in the form of a flowchart. The flowchart is provided with at least two nodes, and each node has at least one input connection point and / or at least one output connection point. In response to the editing operation, the process information of the prop to be edited is edited, and the second screen displayed in the effect display area is updated; In response to the special effects prop generation operation, the target special effects prop is generated based on the target prop flow information obtained through editing. The method further includes: when the cursor moves to the display area of any input connection point, displaying the input screen of the corresponding input connection point; when the cursor moves to the display area of any output connection point, displaying the output screen of the corresponding output connection point; wherein the input screen and the output screen are displayed in the form of floating windows; The process information of the item to be edited, in response to the editing operation, includes: In response to a node addition operation performed on the first node in the process information of the item to be edited, a node list is displayed; In response to a trigger operation on a second node in the node list, the second node is added between the first node and the third node, wherein the third node is an adjacent node of the first node; the third node includes nodes whose input connection points are connected to the output connection points of the first node, and / or nodes whose output connection points are connected to the input connection points of the first node.
2. The method according to claim 1, characterized in that, The node addition operation includes a right-click operation performed on the first node.
3. The method according to claim 1, characterized in that, The node addition operation includes a trigger operation on the list control acting on the first node. Before displaying the node list in response to the node addition operation acting on the first node in the item flow information to be edited, the operation further includes: When the cursor moves to the output connection point display area of the first node, the list control of the first node is displayed.
4. The method according to claim 1, characterized in that, Adding the second node between the first node and the third node includes: Add the second node to the process information display area, delete the first connecting line displayed in the process information display area, and draw a second connecting line and a third connecting line. The first connecting line is used to connect the output connection point of the first node and the input connection point of the third node, the second connecting line is used to connect the output connection point of the first node and the input connection point of the second node, and the third connecting line is used to connect the output connection point of the second node and the input connection point of the third node.
5. The method according to any one of claims 1-4, characterized in that, The step of responding to the edit operation by editing the process information of the item to be edited includes: In response to a first sliding operation, the endpoint of the connecting line located at the target input connection point is controlled to move with the first sliding operation until the first sliding operation ends, wherein the first sliding operation begins at the target input connection point; and / or, In response to the second sliding operation, a new connection line is drawn starting from the target output connection point, and the endpoint of the new connection line is controlled to move with the second sliding operation until the second sliding operation ends, wherein the second sliding operation starts from the target output connection point.
6. The method according to any one of claims 1-4, characterized in that, The step of responding to the edit operation by editing the process information of the item to be edited includes: In response to the operation of displaying configuration information for the fourth node in the process information of the item to be edited, the configuration information of the fourth node is displayed; In response to configuration information modification operations, display the modified configuration information.
7. The method according to claim 6, characterized in that, The configuration information display operation includes a left-click operation on the fourth node.
8. The method according to claim 6, characterized in that, The configuration information display operation includes a trigger operation on the configuration control of the fourth node. Before displaying the configuration information of the fourth node in response to the configuration information display operation for the fourth node in the process information of the item to be edited, the operation further includes: In response to a left-click operation on the fourth node, the configuration controls for the fourth node are displayed.
9. The method according to any one of claims 1-4, characterized in that, After generating the target special effects prop based on the edited target prop process information, the process further includes: In response to the publishing operation for the target special effects item, the target special effects item is uploaded to the server for publishing.
10. A method for processing an image, characterized in that, include: The process involves acquiring the target prop flow information of the screen to be processed and the target special effects prop. The target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During the editing process, the special effects prop editing page displays a second screen obtained by processing the first screen based on the prop flow information to be edited. The prop flow information to be edited is presented in the form of a flowchart, which has at least two nodes. For each node in the target item flow information, input screen information is received through the current node; the input screen information is processed by the current node using the target processing space to obtain at least one output screen information, wherein the target processing space is the memory space occupied by the current node when processing the input screen information; the output screen information is output through the current node; when processing is complete, a rendering instruction packet is sent to the graphics processing unit (GPU) to instruct the GPU to render the output screen of each node according to the arrangement order of the nodes in the target item flow information to obtain the processed target screen, wherein the rendering instruction packet contains the rendering instructions for each node; The step of receiving input screen information through the current node includes: when the current node is an input node, using the information of the screen to be processed obtained by the current node as its own input screen information; when the current node is a filter node or an output node, using the output screen information of each output connection point connected to its input connection point received by the current node through its input connection point as its own input screen information. Before processing the input screen information using the target processing space through the current node, the process includes: The target type and the number of targets in the target processing space are determined by the current node. The current node determines the available processing space in the existing processing space whose space type matches the target type, wherein the existing processing space is the processing space that each node in the target item process information has applied for; If the current node responds to a situation where the number of free processing spaces is greater than or equal to the target number, the target number of free processing spaces is obtained and used as the target processing space. When the current node responds to the situation where the number of free processing spaces is less than the target number, it obtains the free processing space as the target processing space, and requests the target processing space from the GPU based on the difference between the target number and the number of spaces and the target type.
11. A prop generation device, characterized in that, include: The page display module is used to display the special effects prop editing page and obtain a first screen. The special effects prop editing page is provided with a process information display area and an effect display area. The process information display area is used to display the process information of the prop to be edited, and the effect display area is used to display a second screen. The second screen is a preview screen obtained by processing the first screen based on the process information of the prop to be edited. The process information of the prop to be edited is presented in the form of a flowchart. The flowchart is provided with at least two nodes, and each node has at least one input connection point and / or at least one output connection point. The editing module is used to respond to editing operations, edit the process information of the prop to be edited, and update the second screen displayed in the effect display area; The prop generation module is used to respond to the special effects prop generation operation and generate the target special effects prop based on the target prop flow information obtained through editing; The device further includes: a screen display module, used to display the input screen of the corresponding input connection point when the cursor moves to the display area of any input connection point; and to display the output screen of the corresponding output connection point when the cursor moves to the display area of any output connection point; wherein the input screen and the output screen are displayed in the form of a floating window; The editing module includes: a list display unit, used to display a list of nodes in response to a node addition operation performed on a first node in the process information of the item to be edited; A node adding unit is configured to add the second node between the first node and the third node in response to a triggering operation on the second node in the node list, wherein the third node is an adjacent node of the first node; the third node includes a node whose input connection point is connected to the output connection point of the first node, and / or a node whose output connection point is connected to the input connection point of the first node.
12. A picture processing apparatus, characterized in that, include: The image acquisition module is used to acquire the image to be processed and the target prop flow information of the target special effects prop. The target prop flow information is obtained by editing the prop flow information to be edited in the special effects prop editing page. During the editing process, the special effects prop editing page displays a second image obtained by processing the first image based on the prop flow information to be edited. The prop flow information to be edited is presented in the form of a flowchart, and the flowchart has at least two nodes. The image processing module is used to receive input image information through the current node for each node in the target prop process information; process the input image information through the current node using the target processing space to obtain at least one output image information, wherein the target processing space is the memory space occupied by the current node when processing the input image information; and output the output image information through the current node. The instruction sending module is used to send a rendering instruction packet to the graphics processor (GPU) when the processing is completed, so as to instruct the GPU to render the output screen of each node according to the arrangement order of each node in the target prop process information to obtain the processed target screen. The rendering instruction packet contains the rendering instructions of each node. The image processing module is specifically used for: when the current node is an input node, using the information of the image to be processed obtained by the current node as its own input image information; when the current node is a filter node or an output node, using the output image information of each output connection point connected to its input connection point received by the current node through its input connection point as its own input image information. The image processing module is further configured to: before processing the input image information using the target processing space through the current node, determine the target type of the target processing space and the target quantity of the target processing space through the current node; The current node determines the available processing space in the existing processing space whose space type matches the target type, wherein the existing processing space is the processing space that each node in the target item process information has applied for; If the current node responds to a situation where the number of free processing spaces is greater than or equal to the target number, the target number of free processing spaces is obtained and used as the target processing space. When the current node responds to the situation where the number of free processing spaces is less than the target number, it obtains the free processing space as the target processing space, and requests the target processing space from the GPU based on the difference between the target number and the number of spaces and the target type.
13. An electronic device, characterized in that, include: One or more processors; Memory, used to store one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the prop generation method as described in any one of claims 1-9 or the screen processing method as described in claim 10.
14. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the prop generation method as described in any one of claims 1-9 or the screen processing method as described in claim 10.
15. A computer program product, characterized in that, When the computer program product is executed by a computer, the computer implements the prop generation method as described in any one of claims 1-9 or the screen processing method as described in claim 10.
Citation Information
Patent Citations
Combined special effect generation method and device and storage medium
CN110147231A
Special effect data packet generation method and device, image processing method and device, equipment and storage medium
CN113709549A
Material previewing method and device, equipment and storage medium
CN113721801A