Interaction method and device, electronic equipment and storage medium

Abstract

The invention relates to an interaction method and device, electronic equipment and a storage medium, and the method comprises the steps: displaying a media data processing stream configuration page, a canvas in the media data processing stream configuration page comprising a plurality of nodes; in response to a selection operation on the target node on the canvas, determining a second candidate node in the first candidate nodes; the first candidate nodes are remaining nodes except the target node in the canvas; the second candidate node is a node which can take the output information of the target node as the input information of the second candidate node; and displaying prompt information, wherein the prompt information is used for prompting which nodes in the canvas are the second candidate nodes. The essence of the method is that after a user specifies a target node, a system assists the user in automatically screening out potential nodes (namely second candidate nodes) capable of establishing connection with the target node, and prompts which nodes are the second candidate nodes to the user. The technical threshold of constructing the node type media data processing stream by a user can be reduced, and the user is helped to quickly construct the node type media data processing stream.

Description

Technical Field

[0001] The present disclosure relates to the field of interactive technology, and in particular to an interactive method, device, electronic device, and storage medium. Background Art

[0002] Today, media data processing tools that use node-based data processing flows are profoundly reshaping the field of creative design, enabling users to accurately customize and reliably reproduce media data designs with their sophisticated process control mechanisms.

[0003] However, in real-world situations, building a complete, operational, node-based data processing flow requires a high level of expertise from designers, making it difficult for some designers to accomplish this task on their own. Therefore, effectively lowering the technical barriers for designers to build node-based data processing flows is a pressing issue. Summary of the Invention

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an interaction method, device, electronic device and storage medium.

[0005] In a first aspect, the present disclosure provides an interaction method, the method comprising:

[0006] Displaying a media data processing flow configuration page, the media data processing flow configuration page includes a canvas display area; the canvas display area is used to display a canvas, and the canvas includes multiple nodes;

[0007] In response to a selection operation on a target node in the canvas, determining a second candidate node from the first candidate nodes; the first candidate nodes are nodes remaining in the canvas except the target node; the second candidate nodes are nodes that can use output information of the target node as input information;

[0008] Prompt information is displayed, where the prompt information is used to indicate which nodes in the canvas are second candidate nodes.

[0009] In a second aspect, the present disclosure further provides an interactive device, comprising:

[0010] A display module, configured to display a media data processing flow configuration page, wherein the media data processing flow configuration page includes a canvas display area; the canvas display area is used to display a canvas, and the canvas includes a plurality of nodes;

[0011] a determination module, configured to determine, in response to a selection operation on a target node in the canvas, a second candidate node from the first candidate nodes; the first candidate nodes being nodes remaining in the canvas except the target node; and the second candidate nodes being nodes that can use output information of the target node as input information;

[0012] The prompt module is used to display prompt information, where the prompt information is used to prompt which nodes in the canvas are second candidate nodes.

[0013] In a third aspect, the present disclosure further provides an electronic device, comprising:

[0014] one or more processors;

[0015] a storage device for storing one or more programs;

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the interaction method described above.

[0017] In a fourth aspect, the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, which implements the above-mentioned interaction method when executed by a processor.

[0018] The technical solution provided by the embodiments of the present disclosure has the following advantages over the prior art:

[0019] The technical solution provided by the embodiment of the present disclosure is provided by setting up a media data processing flow configuration page, the media data processing flow configuration page includes a canvas display area; the canvas display area is used to display the canvas, and the canvas includes multiple nodes; in response to the selection operation of the target node on the canvas, the second candidate node is determined in the first candidate node; the first candidate node is the node remaining in the canvas except the target node; the second candidate node is the node that can use the output information of the target node as its input information; and prompt information is displayed, and the prompt information is used to prompt which nodes in the canvas are the second candidate nodes. Its essence is to provide a method in which, after the user specifies the target node, the system can help the user automatically screen out nodes that can potentially establish a connection with the target node (i.e., the second candidate node), and prompt the user which nodes are the second candidate nodes. This setting can, on the one hand, reduce the technical threshold for users to build node-based media data processing flows, and on the other hand, can help users quickly build node-based media data processing flows. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0021] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] Figure 1 A flowchart of an interactive method provided in an embodiment of the present disclosure;

[0023] Figure 2-Figure 5 Schematic diagrams of several display interfaces provided in embodiments of the present disclosure;

[0024] Figure 6 is a structural diagram of an interactive device in an embodiment of the present disclosure;

[0025] Figure 7 Schematic diagram of the structure of an electronic device in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0026] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features therein can be combined with each other in the absence of conflict.

[0027] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0028] Figure 1 This is a flowchart of an interaction method provided in an embodiment of the present disclosure. This embodiment is applicable to interactions performed on a client. The method can be executed by an interaction device, which can be implemented using software and / or hardware. The device can be configured in an electronic device, such as a terminal, including but not limited to smartphones, PDAs, tablet computers, wearable devices with displays, desktop computers, laptop computers, all-in-one computers, smart home devices, etc. Alternatively, this embodiment can be applicable to interactions performed on a server. The method can be executed by an interaction device, which can be implemented using software and / or hardware. The device can be configured in an electronic device, such as a server.

[0029] like Figure 1 As shown, the method may specifically include:

[0030] S110 . Display a media data processing flow configuration page. The media data processing flow configuration page includes a canvas display area. The canvas display area is used to display a canvas. The canvas includes multiple nodes.

[0031] A data processing flow is a workflow that achieves the orderly execution of specific tasks and operations through node connections and process design. A node is an operational unit in a data processing flow, used to perform a specific operation step. A data processing flow is used to process media data. Media data can include, for example, at least one of the following: text, images, audio, and video.

[0032] A data processing flow is like a production line, connecting a series of interconnected nodes in an orderly manner to collaboratively complete the entire media data processing process. When raw material is input to a pre-configured data processing flow, it follows the process design and sequentially passes through the processing stages of each node to produce the final processed media data. The raw material and processed media data can be of the same or different types. For example, in a data processing flow for text-to-image generation, the raw material is text, and the processed media data is an image. In a data processing flow for image-to-image generation, the raw material is images and text, and the processed media data is an image.

[0033] For example, an image data processing flow may include the following nodes: a load model node, a text encoder, a load image node, an image encoding node, a sampler, an image decoding node, and a preview image node. The load model node is used to load a pre-trained drawing model, which includes a denoising algorithm, a text encoding model, and an image encoding and decoding component. The denoising algorithm is responsible for noise prediction and image generation. The image encoding and decoding component is used to convert between latent space and pixel space. The text encoder is used to encode text prompt words into semantic vectors. These vectors are then input as conditions into the sampler to guide the image generation process. The load image node is used to receive a user-provided guidance image. The image encoding node is used to convert the guidance image from pixel space to a latent space representation. The latent space representation of the guidance image is then input as a condition into the sampler to guide the image generation process. The sampler generates a latent space representation of the target image based on the denoising algorithm, the semantic vectors of the text prompt words, and the latent space representation of the guidance image. The image decoding node converts the latent space image output by the sampler into a pixel space image to obtain the final visual image. The preview image node is used to display the generated pixel space image.

[0034] The media data processing flow configuration page may be, for example, a page for configuring the media data processing flow. Configuring the media data processing flow may be, for example, constructing the media data processing flow by selecting appropriate nodes, configuring the parameters included in the nodes, and configuring the input and output relationships between different nodes.

[0035] The canvas can be, for example, a spatial range that assists the user in configuring a data processing flow. The canvas area can be, for example, the area on the media data processing flow configuration page that displays the currently configured data processing flow in real time. The canvas display area displays a partial area of ​​the canvas.

[0036] In some scenarios, the canvas can be viewed as a spatial area that supports unlimited expansion. The canvas area in the media data processing stream configuration page can be understood as a window for viewing the canvas. By operating the canvas (such as moving the canvas position, zooming in or out, etc.), different areas of the canvas are visible through the canvas display area.

[0037] A node can be, for example, a step in a media data processing flow or a complete algorithm. A node is usually associated with a set of parameters that are used to configure or limit the behavior of the node. For example, for a text encoding node, the parameters associated with it include the text content to be encoded. For an image resizing node, the parameters associated with it include the desired size of the image after resizing. For a K sampler node, the parameters associated with it include the step size of the model, the random seed, etc. The input-output relationship between different nodes can, for example, include using the output information of one node as the input data of another node.

[0038] In some scenarios, when configuring a media data processing flow, you need to first add the nodes required to build the media data processing flow to the canvas. When multiple nodes are added to the canvas, the canvas will contain the nodes.

[0039] In practice, panels, options or functional components representing nodes are optionally displayed in the canvas, so that the canvas includes multiple nodes.

[0040] S120 . In response to a selection operation on a target node on the canvas, determine a second candidate node from the first candidate nodes; the first candidate nodes are nodes remaining in the canvas except the target node; the second candidate nodes are nodes that can use output information of the target node as their input information.

[0041] The target node can be, for example, a node selected by the user from multiple nodes displayed on the current canvas. The user's selection of the target node indicates that the user wishes to configure the flow of the node's output information, that is, to determine which node will receive the target node's output information. In other words, the target node's output information is used as input information for which node. The selection operation of the target node on the canvas can be, for example, a click operation, a swipe operation, a mouse hover operation, etc. on the panel or icon representing the target node on the canvas.

[0042] The second candidate node can be, for example, a node that is selected from the first candidate node by the electronic device based on the characteristics of the output information of the target node and has the ability to receive the output information. In other words, the second candidate node is a candidate node that can potentially establish a connection with the target node. In some scenarios, the characteristics of the output information of the target node can be, for example, the type of the output information of the target node. Here, the type of the output information of the target node can be, for example, a numerical class, an image-related class, a code and a feature vector, etc. Furthermore, these types can be further subdivided, such as subdividing the code and the feature vector into text code, latent space tensor, noise tensor, etc.

[0043] It should be noted that, in practice, due to functional differences, the types of input information required by the input terminals of different nodes may not be exactly the same. For example, the input terminals of some nodes require input of text encoding results, the input terminals of some nodes require input of image encoding results, and the input terminals of some nodes require input of audio encoding results, etc. In addition, in some scenarios, a node may have multiple input terminals. In practice, among the multiple input terminals of the same node, some input terminals may require different types of input information, while some input terminals may require the same type of input information. Alternatively, among the multiple input terminals of the same node, the types of input information required by all nodes are the same. Or, among the multiple input terminals of the same node, the types of input information required by any two nodes are different. In addition, it is also possible that the same input terminal can accept different types of input information.

[0044] In some scenarios, when determining the second candidate node, if the type of input information required by an input terminal of a first candidate node is the same as the type of output information of an output terminal of the target node, the first candidate node is selected as the second candidate node.

[0045] S130 : Display prompt information, where the prompt information is used to indicate which nodes in the canvas are second candidate nodes.

[0046] The prompt information may be, for example, a specific display method that indicates to the user which nodes in the canvas are the second candidate nodes. This application does not limit the specific type of the prompt information or how it is expressed.

[0047] Exemplarily, the prompt information is displayed, including at least one of the following: adjusting the display status of the second candidate node in the canvas so that the display status of the adjusted second candidate node is different from the display status of the first node; the first node is the remaining nodes in the first candidate node except the second candidate node; displaying a first list, the first list including identification information of the second candidate node; in the canvas, using a guide line to connect the target node and the second candidate node.

[0048] “Adjust the display status of the second candidate node in the canvas so that the display status of the adjusted second candidate node is different from the display status of the first node” may mean, for example, that before the prompt information is displayed, the display status of all first candidate nodes in the canvas is the first state; after the second candidate node is determined, the display status of the second candidate node is switched from the first state to the second state, but the display status of the first candidate node (i.e., the first node) that has not been determined as the second candidate node remains in the first state.

[0049] Furthermore, adjusting the display status of the second candidate node in the canvas may include, for example, changing the visual attributes of the options, components or panels representing the second candidate node, such as text color, font style, border color, background color, color of the icon representing the input end, shape of the icon representing the input end, etc.

[0050] For example, see Figure 2 , the canvas includes nodes 1, 2, 3, and 4. If node 1 is taken as the target node, nodes 2, 3, and 4 are all first candidate nodes. Figure 2 The display states of the first candidate nodes are the same, showing the first state. After S120, it is determined that nodes 2 and 3 are the second candidate nodes, and node 4 is the first node. Figure 3 , switch the display status of node 2 and node 3 from the first state to the second state. Keep the display status of node 4 still in the first state. In this way, node 2 and node 3 can be highlighted, which is convenient for users to understand which nodes the target node can be connected to. Furthermore, it can be set that when the node is in the first state, the border of the panel representing the node is gray, and in the panel representing the node, the icon representing the input end is gray. When the node is in the second state, the border of the panel representing the node is a color other than gray (such as yellow), and in the panel representing the node, the icon representing the input end is a color other than gray (such as yellow).

[0051] The first list may be, for example, a list for summarizing and displaying identification information of the second candidate nodes. The identification information of the second candidate nodes may be, for example, the name or number of the second candidate nodes, which is used to distinguish different second candidate nodes.

[0052] For example, see Figure 2 , the canvas includes nodes 1, 2, 3, and 4. If node 1 is selected as the target node, and nodes 2 and 3 are determined as the second candidate nodes, see Figure 4 , displays a first list including identification information of node 2 and identification information of node 3. In this way, the user can understand which nodes the target node can connect to by browsing the first list.

[0053] In the canvas, using a guide line to connect the target node and the second candidate node means, in the form of a guide line, indicating which nodes the target node can be connected to. For example, see Figure 2 , the canvas includes nodes 1, 2, 3, and 4. If node 1 is selected as the target node, and nodes 2 and 3 are determined as the second candidate nodes, see Figure 3 In the canvas, guide line 1 connects node 1 to node 2, and guide line 2 connects node 1 to node 3. This way, users can understand which nodes the target node can be connected to through the guide lines.

[0054] In some embodiments, optionally, in response to a selection operation on a target node on the canvas, the display state of the target node is adjusted to a selected state. The selected state can, for example, be a state different from both the first state and the second state mentioned above. Optionally, the difference between the selected state and the first state and the second state mentioned above is mainly manifested in a difference in the visual attributes of the options, components, or panels representing the node, such as at least one of the following visual attributes: text color, font style, border color, and background color.

[0055] The above technical solution is provided by setting up a media data processing flow configuration page, the media data processing flow configuration page includes a canvas display area; the canvas display area is used to display the canvas, and the canvas includes multiple nodes; in response to the selection operation of the target node on the canvas, the second candidate node is determined in the first candidate node; the first candidate node is the node remaining in the canvas except the target node; the second candidate node is the node that can use the output information of the target node as its input information; prompt information is displayed, and the prompt information is used to prompt which nodes in the canvas are the second candidate nodes. Its essence is to provide a system that can automatically screen out nodes that can potentially establish connections with the target node (i.e., the second candidate nodes) after the user specifies the target node, and prompt the user which nodes are the second candidate nodes. This setting can, on the one hand, reduce the technical threshold for users to build node-based media data processing flows, and on the other hand, can help users quickly build node-based media data processing flows.

[0056] Based on the above technical solution, optionally, the method may further include: in response to a selection operation on a target second candidate node in the second candidate node, connecting an output end of the target node with an input end of the target second candidate node in the canvas using a data flow line.

[0057] The target second candidate node may be, for example, a node selected by the user from the second candidate nodes. Specifically, the user may select a second candidate node from the second candidate nodes, and the selected second candidate node is the target second candidate node.

[0058] The operation of selecting the target second candidate node from the second candidate nodes may, for example, include: selecting the target second candidate node in the canvas: selecting the identification information of the target second candidate node in the first list; and selecting the target guide line in the canvas, selecting the second candidate node connected by the target guide line as the target second candidate node. The operation of selecting the target second candidate node in the canvas may, for example, be a click, slide, or drag operation on an option, icon, panel, or component representing the target second candidate node in the canvas. The operation of selecting the identification information of the target second candidate node in the first list may, for example, be a click, slide, or drag operation on the identification information of the target second candidate node in the first list. The target guide line may, for example, be a guide line selected by the user from the guide lines displayed in the canvas. The operation of selecting the target guide line may, for example, be a click, slide, or drag operation on the target guide line, or an operation of dragging the target node onto the target guide line.

[0059] The data flow line may be used, for example, to indicate, under the current configuration of the output relationship of the target node, to which node's input terminal the output information of the target node will flow.

[0060] It should be noted that the function of a guide line is to indicate which first candidate nodes the target node can connect to. A guide line is a type of prompt information, a prompt before configuring the output information flow process of the target node. The appearance of a guide line does not mean that the output information of the target node will flow into the second candidate node it is connected to. When there are multiple second candidate nodes, multiple guide lines may appear on the canvas. One end of these guide lines is connected to the same node (i.e., the target node). The other ends of these guide lines are connected to different nodes (i.e., the second candidate nodes). The function of a data flow line is to indicate which second candidate node the output information of the target node will flow into. The appearance of a data flow line indicates that the output information flow process of the target node has been configured, and also means that the output information of the target node will flow into the target second candidate node it is connected to. In practice, multiple data flow lines will appear on the canvas for the same output terminal of the same target node. One end of these data flow lines is connected to the same node (i.e., the same output terminal of the target node). The other ends of these data flow lines are connected to the input terminals of different target second candidate nodes.

[0061] By setting a response to the selection operation of the target second candidate node in the second candidate node, in the canvas, the output end of the target node is connected to the input end of the target second candidate node using a data flow line. Its purpose is to allow the user to select the node the user needs (i.e., the target second candidate node) from the second candidate node, and then connect the output end of the target node with the target input end of the target second candidate node to complete the configuration of the output end of the target node.

[0062] Furthermore, the target second candidate node includes multiple input terminals. In response to the selection operation of the target second candidate node in the second candidate node, in the canvas, the output terminal of the target node is connected with the input terminal of the target second candidate node using a data flow line, which may include: in response to the selection operation of the target second candidate node in the second candidate node, displaying an input terminal list, the input terminal list including identification information of multiple input terminals of the target second candidate node; in response to the first selection operation of the target input terminal in the input terminal list, connecting the output terminal of the target node with the target input terminal of the target second candidate node using a data flow line.

[0063] The input terminal list may be, for example, a list of identification information of multiple input terminals for displaying the target second candidate node. The identification information of the input terminal may be, for example, information used to distinguish different input terminals. Exemplarily, the identification information of the input terminal includes the name and number of the input terminal.

[0064] In some scenarios, the input terminals displayed in the input terminal list are all input terminals of the target second candidate node. In other scenarios, the input terminals displayed in the input terminal list are input terminals of the target second candidate node that require the same type of input information as the type of output information of the target node output terminal.

[0065] The first selection operation on the target input terminal may be, for example, a click operation, a slide operation, or a drag operation on the identification information of the target input terminal.

[0066] For example, see Figure 3 , assuming that node 1 is the target node, and nodes 2 and 3 are the second candidate nodes. Node 3 includes two input terminals, input terminal 1 and input terminal 2. The user drags node 1 onto guide line 2. Since guide line 2 connects node 3, node 3 is selected as the second candidate node. Figure 5 , displaying a list of input terminals for node 3. This list includes the identification information for input terminal 1 and input terminal 2. If the user clicks the identification information for input terminal 1, a data flow line is used to connect the output terminal of the target node to input terminal 1 of the second candidate target node. In some scenarios, the data flow line may be a solid line and the guide line may be a dashed line.

[0067] By setting a setting to display an input terminal list in response to a selection operation of a target second candidate node in the second candidate node; the input terminal list includes identification information of multiple input terminals of the target second candidate node; and in response to a first selection operation of a target input terminal in the input terminal list, connecting the output terminal of the target node with the target input terminal of the target second candidate node using a data flow line. In essence, when the target second candidate node includes multiple input terminals, the user is allowed to select one or more of the input terminals as the target input terminal as needed, thereby achieving the goal of clearly specifying which input terminal of the target second candidate node the output terminal of the target node is connected to, thereby avoiding the problem of incorrect connection.

[0068] In some scenarios, there is a guiding line between the target node and the second candidate target node. In this case, the guiding line can be directly replaced with a data flow line. In other scenarios, there is no guiding line between the target node and the second candidate target node. In this case, the data flow line can be directly used to connect the output terminal of the target node to the target input terminal of the second candidate target node.

[0069] Furthermore, the method may further include: in response to a second selection operation on a target input terminal in the input terminal list, displaying attribute information of the target input terminal.

[0070] The second selection operation on the target input terminal can be the same operation as the first selection operation on the target input terminal, or can be a different operation. For example, the second selection operation on the target input terminal can be an operation of hovering a mouse over the identification information of the target input terminal. The second selection operation on the target input terminal can be an operation of clicking the identification information of the target input terminal.

[0071] The attribute information of the target input terminal may be, for example, description information of the function and purpose of the target input terminal.

[0072] For example, see Figure 5 If the user hovers the mouse over the identification information of input terminal 1, input terminal 1 is selected as the target input terminal. Hovering the mouse over the identification information of input terminal 1 is considered to have performed a second selection operation on the target input terminal in the input terminal list, and the attribute information of input terminal 1 is displayed. This attribute information reflects the purpose of input terminal 1.

[0073] In practice, since the input terminal identification information can convey relatively little information to the user, the target input terminal's attribute information is displayed in response to a second selection operation on the target input terminal in the input terminal list. This is intended to convey more information related to the target input terminal to the user, thereby helping the user to accurately select the appropriate input terminal.

[0074] Based on the above technical solutions, optionally, the method also includes: in the case where there is a guide line between the target node and the second candidate node, in response to the third selection operation of the target guide line, determining whether the second candidate node connected to the target guide line is outside the canvas display area; in response to the second candidate node connected to the target guide line being outside the canvas display area, shrinking the canvas so that both the target node and the second candidate node connected to the target guide line are within the canvas display area.

[0075] In some scenarios, the canvas can be viewed as a spatial area that can be expanded infinitely. The canvas area in the processing flow configuration page can be thought of as a window into the canvas, which only displays a portion of the canvas. By zooming in or out, or adjusting the canvas's position relative to the "window," different areas of the canvas can be revealed and observed.

[0076] If the user performs the third selection operation on the target guideline, it, to a certain extent, means that the user wishes to understand the specific details of the second candidate node connected to the target guideline. However, if the second candidate node connected to the target guideline is outside the canvas display area, the user cannot observe the second candidate node through the canvas area "window". By zooming out, the canvas area "window" can be used to present a larger area of ​​the canvas content, allowing the second candidate node to be observed. This helps the user determine whether to connect the output of the target node to the input of the second candidate node connected to the target guideline, thereby accurately configuring the target node output signal flow path.

[0077] Furthermore, the method may further include: in a case where there is a guide line between the target node and the second candidate node, in response to a fourth selection operation on the target guide line, adjusting the display state of the target guide line from the third state to the fourth state.

[0078] The third state and the fourth state are two different states, and the difference between the two states can be manifested in differences in visual attributes such as line color, line type, and line thickness.

[0079] The purpose of adjusting the display state of the target guide line from the third state to the fourth state in response to the fourth selection operation of the target guide line is to highlight the target guide line, which can help the user quickly find the second candidate node connected to the target guide line with the help of the target guide line.

[0080] It should also be noted that the fourth selection operation for the target guide line and the third selection operation for the target guide line can be the same operation or different operations, and this application does not limit this. For example, the fourth selection operation for the target guide line or the third selection operation for the target guide line can be a click operation, a drag operation, etc. on the target guide line.

[0081] It should be noted that for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

[0082] Figure 6 The diagram is a schematic diagram of the structure of an interactive device in an embodiment of the present disclosure. The interactive device provided in the embodiment of the present disclosure can be configured in the client or in the server. Figure 6 , the interactive device specifically includes:

[0083] A display module 310 is configured to display a media data processing flow configuration page, wherein the media data processing flow configuration page includes a canvas display area; the canvas display area is configured to display a canvas, and the canvas includes a plurality of nodes;

[0084] A determination module 320 is configured to determine, in response to a selection operation on a target node on the canvas, a second candidate node from the first candidate nodes; the first candidate nodes are nodes remaining in the canvas except the target node; the second candidate nodes are nodes that can use output information of the target node as input information;

[0085] The prompt module 330 is used to display prompt information, where the prompt information is used to prompt which nodes in the canvas are second candidate nodes.

[0086] Furthermore, the prompt module 330 is configured to perform at least one of the following steps:

[0087] Adjusting a display state of the second candidate node in the canvas so that the display state of the second candidate node after adjustment is different from the display state of the first node; the first node is the remaining node in the first candidate node excluding the second candidate node;

[0088] Displaying a first list, where the first list includes identification information of the second candidate node;

[0089] In the canvas, a guide line is used to connect the target node and the second candidate node.

[0090] Furthermore, the device also includes a configuration module, which is used to:

[0091] In response to a selection operation on a target second candidate node among the second candidate nodes, in the canvas, an output end of the target node is connected to an input end of the target second candidate node by using a data flow line.

[0092] Furthermore, the target second candidate node includes multiple input terminals and a configuration module, and is further configured to:

[0093] In response to a selection operation on a target second candidate node among the second candidate nodes, an input terminal list is displayed; the input terminal list includes identification information of the multiple input terminals of the target second candidate node;

[0094] In response to a first selection operation on a target input terminal in the input terminal list, a data flow line is used to connect the output terminal of the target node and the target input terminal of the target second candidate node.

[0095] Furthermore, the configuration module is also used to:

[0096] In response to a second selection operation on a target input terminal in the input terminal list, attribute information of the target input terminal is displayed.

[0097] Furthermore, the device also includes a preview module, which is used to:

[0098] In the case where there is a guide line between the target node and the second candidate node, in response to a third selection operation on the target guide line,

[0099] Determining whether a second candidate node connected to the target guide line is outside the canvas display area;

[0100] In response to the second candidate node connected to the target guide line being outside the canvas display area, the canvas is reduced so that the target node and the second candidate node connected to the target guide line are both within the canvas display area.

[0101] Furthermore, the device also includes a preview module, which is used to:

[0102] In a case where a guiding line exists between the target node and the second candidate node, in response to a fourth selection operation on the target guiding line, the display state of the target guiding line is adjusted from the third state to the fourth state.

[0103] The interactive device provided in the embodiment of the present disclosure can execute the steps executed by the client or server in the interactive method provided in the embodiment of the method of the present disclosure, and has the execution steps and beneficial effects, which will not be repeated here.

[0104] The following specific reference Figure 7 , which shows a schematic structural diagram of an electronic device 1000 suitable for implementing the embodiments of the present disclosure. The electronic device 1000 in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), wearable electronic devices, and fixed terminals such as digital TVs, desktop computers, smart home devices, and the like. Figure 7 The electronic device shown is only an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0105] like Figure 7 As shown, the electronic device 1000 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1001, which can perform various appropriate actions and processes to implement the interactive method of the embodiment described in the present disclosure according to the program stored in the read-only memory (ROM) 1002 or the program loaded from the storage device 1008 to the random access memory (RAM) 1003. Various programs and information required for the operation of the electronic device 1000 are also stored in the RAM 1003. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0106] Typically, the following devices may be connected to the I / O interface 1005: an input device 1006 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1007 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1008 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the electronic device 1000 to communicate with other devices wirelessly or by wire to exchange information. Although Figure 7 The electronic device 1000 is shown with various devices, but it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed instead.

[0107] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart, thereby implementing the interactive method as described above. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1009, or installed from the storage device 1008, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0108] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include an information signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated information signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0109] In some embodiments, the client and server can communicate using any known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital information communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any known or future developed network.

[0110] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0111] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:

[0112] Displaying a media data processing flow configuration page, the media data processing flow configuration page includes a canvas display area; the canvas display area is used to display a canvas, and the canvas includes multiple nodes;

[0113] In response to a selection operation on a target node in the canvas, determining a second candidate node from the first candidate nodes; the first candidate nodes are nodes remaining in the canvas except the target node; the second candidate nodes are nodes that can use output information of the target node as input information;

[0114] Prompt information is displayed, where the prompt information is used to indicate which nodes in the canvas are second candidate nodes.

[0115] Optionally, when the above one or more programs are executed by the electronic device, the electronic device may also execute other steps described in the above embodiments.

[0116] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0117] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0118] The units involved in the embodiments described in this disclosure may be implemented in software or hardware, wherein the name of a unit does not necessarily limit the unit itself.

[0119] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0120] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0121] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, including:

[0122] one or more processors;

[0123] a memory for storing one or more programs;

[0124] When the one or more programs are executed by the one or more processors, the one or more processors implement any of the interaction methods provided in the present disclosure.

[0125] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which implements any of the interaction methods provided by the present disclosure when the program is executed by a processor.

[0126] An embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the interaction method described above is implemented.

[0127] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0128] The foregoing description is intended only to provide specific embodiments of the present disclosure, intended to enable those skilled in the art to understand and implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments described herein, but rather to be construed in the broadest manner consistent with the principles and novel features disclosed herein.

Claims

1. An interactive method, characterized in that: The method comprises: Displaying a media data processing flow configuration page, the media data processing flow configuration page includes a canvas display area; the canvas display area is used to display a canvas, and the canvas includes multiple nodes; In response to a selection operation on a target node in the canvas, determining a second candidate node from the first candidate nodes; the first candidate nodes are nodes remaining in the canvas except the target node; the second candidate nodes are nodes that can use output information of the target node as input information; Prompt information is displayed, where the prompt information is used to indicate which nodes in the canvas are second candidate nodes.

2. The method according to claim 1, characterized in that The display prompt information includes at least one of the following: Adjusting a display state of the second candidate node in the canvas so that the display state of the second candidate node after adjustment is different from the display state of the first node; the first node is the remaining node in the first candidate node excluding the second candidate node; Displaying a first list, where the first list includes identification information of the second candidate node; In the canvas, a guide line is used to connect the target node and the second candidate node.

3. The method according to claim 1, characterized in that The method further comprises: In response to a selection operation on a target second candidate node among the second candidate nodes, in the canvas, an output end of the target node is connected to an input end of the target second candidate node by using a data flow line.

4. The method according to claim 3, characterized in that The target second candidate node includes a plurality of input terminals, and in response to the selection operation of the target second candidate node from the second candidate nodes, connecting the output terminals of the target node with the input terminals of the target second candidate node using data flow lines in the canvas, including: In response to a selection operation on a target second candidate node among the second candidate nodes, displaying an input terminal list, the input terminal list including identification information of the plurality of input terminals of the target second candidate node; In response to a first selection operation on a target input terminal in the input terminal list, a data flow line is used to connect the output terminal of the target node and the target input terminal of the target second candidate node.

5. The method according to claim 4, characterized in that The method further comprises: In response to a second selection operation on a target input terminal in the input terminal list, attribute information of the target input terminal is displayed.

6. The method according to claim 2, characterized in that The method further comprises: In the case where there is a guide line between the target node and the second candidate node, in response to a third selection operation on the target guide line, Determining whether a second candidate node connected to the target guide line is outside the canvas display area; In response to the second candidate node connected to the target guide line being outside the canvas display area, the canvas is reduced so that the target node and the second candidate node connected to the target guide line are both within the canvas display area.

7. The method according to claim 2, characterized in that The method further comprises: In a case where a guiding line exists between the target node and the second candidate node, in response to a fourth selection operation on the target guiding line, the display state of the target guiding line is adjusted from the third state to the fourth state.

8. An interactive device, characterized in that: include: A display module, configured to display a media data processing flow configuration page, wherein the media data processing flow configuration page includes a canvas display area; The canvas display area is used to display a canvas, and the canvas includes a plurality of nodes; a determination module, configured to determine, in response to a selection operation on a target node in the canvas, a second candidate node from the first candidate nodes; the first candidate nodes being nodes remaining in the canvas except the target node; and the second candidate nodes being nodes that can use output information of the target node as input information; The prompt module is used to display prompt information, where the prompt information is used to prompt which nodes in the canvas are second candidate nodes.

9. An electronic device, characterized in that: The electronic device comprises: one or more processors; a storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images