Flowchart interface data visualization display method and device, equipment and storage medium

Abstract

The application provides a flowchart interface data visualization display method, device and equipment and a storage medium. In an example of the application, the flowchart interface data visualization display method comprises: receiving a data flow direction viewing request for a target flowchart node; determining associated nodes and non-associated nodes in a flowchart, and displaying the associated nodes and the non-associated nodes with different display effects respectively; and outputting an information viewing interface element. The method can optimize the data viewing experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of machine vision, and in particular to a process diagram interface data visualization display method and device, equipment and a storage medium. BACKGROUND

[0002] Machine vision refers to the process of enabling machines to "see" and "understand" the environment through computers and related technologies. It involves using cameras, sensors, image processing algorithms and artificial intelligence technologies to enable machines to simulate human visual capabilities to acquire and process image or video data for recognition, analysis, judgment and decision-making.

[0003] In order to implement the execution of machine vision tasks, a complete and logical task flow can be composed of several different programs. In the flowchart, several programs are combined and packaged into several visualization modules according to their functions, so as to facilitate users to edit and view in the flowchart. A visualization module added in the flowchart can be regarded as a flow node. SUMMARY

[0004] Therefore, the present application provides a process diagram interface data visualization display method, device, equipment and storage medium.

[0005] According to a first aspect of an embodiment of the present application, a process diagram interface data visualization display method is provided, comprising:

[0006] receiving a data flow viewing request for a target flow node; wherein the target flow node is any flow node in a flowchart displayed in a visualization flowchart interface;

[0007] determining associated nodes and non-associated nodes in the flowchart, and displaying the associated nodes and the non-associated nodes with different display effects, respectively; wherein the associated nodes are flow nodes in the flowchart that have data flow interaction with the target flow node; the non-associated nodes are the remaining flow nodes in the flowchart except the target flow node and the associated nodes; and

[0008] outputting information viewing interface elements; wherein the information viewing interface elements are used to display identification information of the associated nodes, and interaction data information of each associated node and the target flow node.

[0009] According to a second aspect of an embodiment of the present application, a process diagram interface data visualization display device is provided, comprising:

[0010] The receiving unit is configured to receive a data flow direction viewing request for a target process node; wherein the target process node is any process node in a process diagram displayed in the visual process diagram interface;

[0011] The determining unit is configured to determine associated nodes and non-associated nodes in the process diagram; wherein the associated nodes are process nodes in the process diagram that have data flow interaction with the target process node; and the non-associated nodes are the remaining process nodes in the process diagram except the target process node and the associated nodes;

[0012] The display unit is configured to display the associated nodes and the non-associated nodes respectively with different display effects.

[0013] The output unit is configured to output information viewing interface elements; wherein the information viewing interface elements are used to display identification information of the associated nodes, and interaction data information of each associated node and the target process node.

[0014] According to a third aspect of the embodiments of the present application, an electronic device is provided, including a processor and a memory, the memory stores machine executable instructions capable of being executed by the processor, and the processor is configured to execute the machine executable instructions to implement the method provided in the first aspect.

[0015] According to a fourth aspect of the embodiments of the present application, a machine readable storage medium is provided, the machine readable storage medium stores machine executable instructions, and the machine executable instructions are executed by a processor to implement the method provided in the first aspect.

[0016] The process diagram interface data visualization display method provided in the embodiments of the present application, in the case of receiving a data flow direction viewing request for a target process node, on the one hand, the associated nodes and the non-associated nodes in the process diagram are displayed respectively with different display effects, so that relevant personnel can more intuitively distinguish the associated nodes and the non-associated nodes in the process diagram, and on the other hand, information viewing interface elements are output, the information viewing interface elements can be used to display identification information of the associated nodes, and interaction data information of each associated node and the target process node, so that in the case of being unable to display all display nodes in the process diagram, all associated nodes of the target process node and corresponding interaction data information can still be viewed through the information viewing interface elements, and the data viewing experience is optimized. BRIEF DESCRIPTION OF DRAWINGS

[0017] Figure 1 is a flowchart of a process diagram interface data visualization display method provided in the embodiments of the present application;

[0018] Figure 2is a schematic view of an information viewing floating window provided by an embodiment of the present application;

[0019] Figure 3 is a schematic view of a flowchart building and executing process provided by an embodiment of the present application;

[0020] Figure 4A is a schematic view of a normal state flowchart node provided by an embodiment of the present application;

[0021] Figure 4B is a schematic view of an abnormal state flowchart node provided by an embodiment of the present application;

[0022] Figure 5A is a schematic view of a hidden state abnormality statistics list provided by an embodiment of the present application;

[0023] Figure 5B is a schematic view of a complete display state abnormality statistics list provided by an embodiment of the present application;

[0024] Figure 6 is a schematic view of a flowchart running result provided by an embodiment of the present application;

[0025] Figure 7 is a schematic view of a flowchart data information viewing process provided by an embodiment of the present application;

[0026] Figure 8A is a schematic view of an error information viewing mode provided by an embodiment of the present application;

[0027] Figure 8B is a schematic view of a time-consuming information viewing mode provided by an embodiment of the present application;

[0028] Figure 9 is a schematic view of a data flow direction viewing process for a flowchart node provided by an embodiment of the present application;

[0029] Figure 10 is a data flow direction information display interface effect diagram provided by an embodiment of the present application;

[0030] Figure 11 is a schematic view of an information viewing floating window in a parameter error condition provided by an embodiment of the present application;

[0031] Figure 12 is a schematic view of a flowchart interface data visualization display device provided by an embodiment of the present application;

[0032] Figure 13 is a hardware structure schematic view of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0033] To make the skilled in the art better understand the technical solutions provided by the embodiments of the present application, the following first briefly describes some terms involved in the embodiments of the present application.

[0034] 1. Configuration integrity of a node: A process node can be an integrated whole encapsulated by a combination of multiple groups of programs, which contains multiple parameters. In order to enable it to be executed in a process, it is necessary to ensure that it has one or more data input sources. Whether there is an input source, whether the input source is fully configured, and whether the input source is valid are referred to as the configuration integrity of the node.

[0035] For example, a process node that has an input source, the input source is fully configured, and the input source is valid can be determined as a process node that is configured completely; a process node that meets any of the following conditions: there is no input source, the input source is not fully configured, and there is an invalid input source can be determined as a process node that is not configured completely.

[0036] 2. Data flow direction: The direction of the source of the data input into the selected process node and the direction of the data output from the selected process node are collectively referred to as the data flow direction.

[0037] 3. Subscribed data: In order for a subsequent process node to obtain specific data of a previous process node, in the case that the basic connection logic in the flowchart is created, the subsequent process node needs to be able to obtain the specific data output by the previous process node through subscription binding.

[0038] For example, for a process node for finding a circle in an input image, the specific data output by the process node can include the center coordinate position of the circle and the radius and the like.

[0039] In order to make the above-mentioned purposes, features and advantages of the embodiments of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be further described in detail below with reference to the drawings.

[0040] It should be noted that the sequence numbers of the steps in the embodiments of the present application do not mean the order of execution, and the execution order of the processes should be determined according to its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0041] Please refer to Figure 1 The flowchart interface data visualization display method provided by the embodiments of the present application can include the following steps, as shown in Figure 1

[0042] Step S100, receiving a data flow direction viewing request for a target process node; wherein the target process node is any process node in the flowchart displayed in the visual flowchart interface. ​

[0043] Exemplarily, in the embodiments of the present application, if not specially stated, the flowchart mentioned can refer to the flowchart corresponding to the machine vision task.

[0044] In the embodiments of the present application, for the flowchart displayed in the visual flowchart interface, the relevant personnel can view the data flow direction of any flow node (which can be referred to as a target flow node) in the flowchart according to the requirement.

[0045] Exemplarily, the relevant personnel can initiate a data flow direction viewing request for the target flow node in a manner of inputting a data flow direction viewing instruction for the target flow node displayed in the visual flowchart interface.

[0046] In step S110, the associated nodes and the non-associated nodes in the flowchart are determined, and the associated nodes and the non-associated nodes are displayed with different display effects respectively; wherein the associated nodes are the flow nodes in the flowchart which have data flow interaction with the target flow node; the non-associated nodes are the remaining flow nodes in the flowchart except the target flow node and the associated nodes.

[0047] In the embodiments of the present application, in the case of receiving the data flow direction viewing request for the target flow node, on the one hand, in order to distinguish and display the flow nodes (which can be referred to as associated nodes) in the flowchart which have data flow interaction with the target flow node, and the remaining flow nodes (which can be referred to as non-associated nodes) except the target flow node and the associated nodes, so that the relevant personnel can better distinguish the flow nodes which have data flow interaction with the target flow node and other flow nodes, the associated nodes and the non-associated nodes in the flowchart can be displayed with different display effects respectively.

[0048] In one example, displaying the associated nodes and the non-associated nodes with different display effects respectively can include:

[0049] highlighting the associated nodes, and / or weakening the display of the non-associated nodes.

[0050] Exemplarily, in order to enable the relevant personnel to view the associated nodes more intuitively, in the case of determining the associated nodes and the non-associated nodes in the flowchart, the associated nodes can be highlighted, and / or the non-associated nodes can be weakened.

[0051] Exemplarily, for the associated nodes displayed in the visual flowchart interface, the highlighting of the associated nodes can be implemented in one or more of the following manners: enhancing the display brightness, increasing the display size, changing the color, increasing the contrast, enhancing the color saturation, and increasing the border thickness.

[0052] For example, for the non-associated nodes displayed in the visualized flowchart interface, the weak display of the associated nodes can be realized by one or more of the following manners: reducing the display brightness, reducing the display size, changing the color, reducing the contrast, reducing the color saturation, and reducing the border thickness.

[0053] As an example, the associated nodes and the non-associated nodes can be displayed in different display effects by highlighting the associated nodes and normally displaying the non-associated nodes, or by normally displaying the associated nodes and weakly displaying the non-associated nodes, so as to realize the differentiated display of the associated nodes and the non-associated nodes with less information processing amount.

[0054] As another example, the associated nodes and the non-associated nodes can be displayed in different display effects by highlighting the associated nodes and weakly displaying the non-associated nodes, so as to enhance the display effect difference between the associated nodes and the non-associated nodes, and better distinguish the associated nodes and the non-associated nodes.

[0055] In step S120, an information viewing interface element is outputted, wherein the information viewing interface element is used to display the identification information of the associated nodes and the interaction data information between each associated node and the target flowchart node.

[0056] In the embodiment of the present application, considering that in the case that the number of flowchart nodes in the flowchart is relatively large, the visualized flowchart interface can not display all the flowchart nodes in the current visualized window, thereby, the current visualized window can not display all the associated nodes.

[0057] Therefore, in order to optimize the information viewing experience, in the case that the data flow viewing request for the target flowchart node is received, in addition to the above-mentioned manner of distinguishing the associated nodes and the non-associated nodes, the information viewing interface element can also be outputted, which is used to display the identification information of the associated nodes and the interaction data information between each associated node and the target flowchart node, so that the relevant personnel can view all the interaction node information and the specific interaction data through the information viewing interface element, thereby bringing a more perfect data viewing experience.

[0058] It can be seen that, in the case that the data flow viewing request for the target flowchart node is received, Figure 1In the method flow shown, in the case of receiving a data flow viewing request for a target flow node, on the one hand, the associated nodes and the non-associated nodes in the flowchart are displayed with different display effects respectively, so that relevant personnel can more intuitively distinguish the associated nodes and the non-associated nodes in the flowchart, and on the other hand, an information viewing interface element is output, which can be used to display the identification information of the associated nodes and the interaction data information of each associated node and the target flow node, so that the entire associated nodes of the target flow node and the corresponding interaction data information can be viewed through the information viewing interface element even in the case that all the display nodes in the flowchart cannot be displayed, and the data viewing experience is optimized.

[0059] In some embodiments, the information viewing interface element can include an information viewing floating window.

[0060] The associated nodes displayed in the information viewing floating window include input nodes and / or output nodes, for any input node, the interaction data information includes the input parameter name and the parameter name of the corresponding bound target flow node.

[0061] For any output node, the interaction data information includes the output parameter name and the parameter name of the corresponding output node.

[0062] For example, in order to optimize space utilization and realize real-time information display, the information viewing interface element can be in the form of a floating window, that is, the relevant information of the associated nodes can be displayed through an information viewing floating window.

[0063] For example, the associated nodes displayed in the information viewing floating window can include input nodes (if any) and / or output nodes (if any).

[0064] For any input node, the interaction data information can include the input parameter name and the parameter name of the corresponding bound target flow node.

[0065] For any output node, the interaction data information can include the output parameter name and the parameter name of the corresponding output node.

[0066] For example, the schematic diagram of the information viewing floating window can be seen in Figure 2 For example, as shown in Figure 2 In the information viewing floating window, the identification information (such as the node name) of the current flow node (such as the target flow node) and the associated nodes of all input data to the current flow node (which can be called input nodes) and the associated nodes of the output data of the current flow node (which can be called output nodes) can be displayed.

[0067] For example, as shown in Figure 2As shown, for the flow node 8, the input nodes can include the flow node 0 and the flow node 2, and the output node can include the flow node 9 (see Figure 10 As shown).

[0068] For the flow node 0, the input parameters include the parameter value 1, the parameter value 2, the parameter value 3, and the parameter value 4, which are respectively input to the parameters 1, 2, 3, and 4 of the flow node 8.

[0069] For the flow node 2, the input parameter includes the parameter value 5, which is input to the parameter 5 of the flow node 8.

[0070] For the flow node 9, the output parameter of the current flow node includes the parameter 6, which is output to the parameter 6 of the flow node 9.

[0071] It should be noted that in the embodiments of the present application, the information viewing interface element is not limited to a floating window, but can also be in other forms, such as a pop-up window, a sub-window (such as a small window displayed on one side of the main window), etc., and the specific implementation is not described here.

[0072] In one example, in the case where the target flow node is a flow node that outputs a failure result in the running process of the flowchart,

[0073] The information viewing floating window can also display the node error reason that causes the target flow node to output a failure result; and / or,

[0074] The information viewing floating window can also be marked with a data flow that causes the target flow node to output a failure result; and / or,

[0075] The information viewing floating window can also display specific error information that causes the target flow node to output a failure result.

[0076] As an example, the flowchart displayed in the visual flowchart interface can be in a running state according to a control instruction, and each flow node in the flowchart can output a success result or a failure result during the running process, and the specific implementation can be described below. In the case where the target flow node is a flow node that outputs a failure result in the running process of the flowchart, the information viewing floating window can also display information related to the reasons for the target flow node to output a result.

[0077] As an example, the information viewing floating window can display the node error reason that causes the target flow node to output a failure result, and a schematic diagram thereof can be as shown in Figure 2 As shown.

[0078] For example, in the case where the target flow node outputs a failure result due to a parameter error of a certain data flow, the node error reason can be a parameter error, and a schematic diagram thereof can be as shown in Figure 11 As shown.

[0079] As an example, the information viewing pop-up can indicate the data flow that caused the target process node to fail to output a result.

[0080] For example, the information viewing pop-up window can correspond to the data flow that caused the target process node to fail to output a result, and mark the specific error information that caused the target process node to fail to output a result.

[0081] by Figure 11 Taking the floating information window shown as an example, the data flow that causes the target process node to fail to output a result is as follows: Output 3 of node name 2 is output to Input 2 of node name 3. The reason why this data flow causes the target process node to fail to output a result is that the parameter value of Output 3 of node name 2 output to Input 2 of node name 3 is greater than 5.0 (the specific parameter value is 11.0).

[0082] As an example, the information viewer can display specific error messages that caused the target process node to fail to output a result.

[0083] by Figure 11 Taking the floating window for viewing information as an example, the specific error message that caused the target process node to fail to output the result is that the parameter value of the output 3 of node name 2 to the input 2 of node name 3 is greater than 5.0.

[0084] In one example, when the flowchart is in a running state, the information viewing pop-up can also display the running time of the target process node.

[0085] by Figure 11 Taking the floating window for viewing information as an example, the execution time of the target process node is 23ms.

[0086] In some embodiments, before receiving the data flow viewing request for the target process node, the following may also be included:

[0087] Upon detecting an instruction to enable the information viewing function, control the flowchart in the visual flowchart interface to enter the information viewing mode;

[0088] The aforementioned receiving of a data flow viewing request for a target process node may include:

[0089] When the flowchart is in information viewing mode, receive selection instructions for the target process node.

[0090] Exemplarily, since the data flow direction viewing function for the flow nodes is not supported in the conventional flowchart display interface, in order to improve the convenience and efficiency of the data flow direction viewing and improve the controllability and compatibility of the scheme, the information viewing function can be designed for the flowchart in the visual flowchart interface, under the condition that the information viewing function is turned on, the relevant personnel (such as a user) can view the data flow direction of the flow nodes; under the condition that the information viewing function is turned off, the relevant personnel cannot view the data flow direction of the flow nodes.

[0091] Exemplarily, under the condition that the information viewing function is turned on, the flowchart in the visual flowchart interface can enter the information viewing mode, under the mode, the relevant personnel can trigger the data flow direction viewing of the selected flow node by selecting the flow node in the flowchart.

[0092] Correspondingly, under the condition that the information viewing function turning-on instruction is detected, the flowchart in the visual flowchart interface can be controlled to enter the information viewing mode.

[0093] Under the condition that the flowchart is in the information viewing mode, the selection instruction for the flow nodes in the flowchart can be detected, and under the condition that the selection instruction for the target flow node is detected, it is determined that the data flow direction viewing request for the target flow node is received.

[0094] It should be noted that, in the embodiments of the present application, the way of initiating the data flow direction viewing request for the target flow node described in the above embodiments is only one specific example in the embodiments of the present application, and is not a limitation on the protection scope of the embodiments of the present application. In the technical solutions provided by the embodiments of the present application, the initiation of the data flow direction viewing request can also be realized by other ways, for example, the data flow direction viewing function can be added in the function menu of the flow node in the flowchart (for example, the display of the function menu can be triggered by right-clicking or long-pressing the mouse), and the relevant personnel can initiate the data flow direction viewing request for the selected flow node by selecting the data flow direction viewing function in the function menu of the flow node.

[0095] In some embodiments, the flowchart interface data visualization display method provided by the embodiments of the present application can further include:

[0096] For any flow node added in the visual flowchart interface, the configuration completeness state of the flow node is determined, and the node state of the flow node is displayed in the visual flowchart interface according to the configuration completeness state of the flow node; wherein the node state includes a normal state or an abnormal state, the node state of the flow node with complete and valid configuration parameters is the normal state, and the node state of the flow node with incomplete configuration parameters and / or invalid parameters is the abnormal state.

[0097] For example, in order to ensure that the flowchart can run normally, it is necessary to ensure that each flow node in the flowchart is configured completely.

[0098] Correspondingly, for any flow node added in the visual flowchart interface, the configuration completeness of the flow node can be detected, and the node state of the flow node can be determined and displayed according to the detection result.

[0099] In one example, for any flow node added in the visual flowchart interface, the configuration completeness of the flow node can be detected when the connection creation operation instruction for the flow node is detected.

[0100] For example, for any flow node added in the visual flowchart interface, the node state of the flow node can be displayed in the visual flowchart interface according to the configuration completeness of the flow node.

[0101] For example, for any flow node added in the visual flowchart interface, the data inherited by the flow node from the corresponding existing flow node can be determined according to the logical connection relationship between the flow node and the existing flow node in the flowchart interface, and the configuration completeness of the flow node can be determined according to the data inherited by the flow node.

[0102] For example, for a flow node with complete and valid configuration parameters (i.e., a flow node with complete configuration), the node state is a normal state.

[0103] For a flow node with incomplete configuration parameters and / or invalid parameters (i.e., a flow node with incomplete configuration), the corresponding node state is an abnormal state.

[0104] In one example, the flow nodes in the normal state and the flow nodes in the abnormal state can be displayed with different display effects.

[0105] For example, for a flow node in the normal state, no special display effect processing can be performed; for a flow node in the abnormal state, highlighting can be performed, such as displaying in red, so that relevant personnel can more intuitively view the flow node in the abnormal state.

[0106] In one example, in a case that it is determined that the current is in the error information viewing mode, and the flowchart in the visual flowchart interface is in the non-running state, for the flow node of the abnormal state, the abnormal state reason information can also be displayed; wherein, in a case that the flowchart in the visual flowchart interface enters the support information viewing mode, and the selection instruction for the error information viewing mode is detected, the flowchart in the visual flowchart interface enters the error information viewing mode; or, in a case that the flowchart in the visual flowchart interface enters the support information viewing mode, and the default mode in the support information viewing mode is the error information viewing mode, the flowchart in the visual flowchart interface enters the error information viewing mode.

[0107] In a case that it is determined that the current is in the time-consuming information viewing mode, and the flowchart in the visual flowchart interface is in the non-running state, for any flow node in the visual flowchart interface, the running time-consuming of the flow node is displayed in the specified area associated with the flow node, and the running time-consuming is a default value; wherein, in a case that the flowchart in the visual flowchart interface enters the support information viewing mode, and the selection instruction for the time-consuming information viewing mode is detected, the flowchart in the visual flowchart interface enters the time-consuming information viewing mode; or, in a case that the flowchart in the visual flowchart interface enters the support information viewing mode, and the default mode in the support information viewing mode is the time-consuming information viewing mode, the flowchart in the visual flowchart interface enters the time-consuming information viewing mode.

[0108] For example, the support information viewing mode can further include the error information viewing mode or the time-consuming information viewing mode.

[0109] In one example, in a case that the flowchart in the visual flowchart interface enters the support information viewing mode, the function buttons for selecting the "error information viewing" mode or the "time-consuming information viewing" mode can be displayed in the specified position (such as the specific area in the upper left corner) of the visual flowchart interface, and the relevant personnel can select to enter the "error information viewing" mode or the "time-consuming information viewing" mode according to the needs.

[0110] It should be noted that, in the embodiments of the present application, in a case that the flowchart in the visual flowchart interface enters the support information viewing mode, the "error information viewing" mode can be entered by default, and the relevant personnel can switch to the "time-consuming information viewing" mode according to the needs; or, in a case that the flowchart in the visual flowchart interface enters the support information viewing mode, the "time-consuming information viewing" mode can be entered by default, and the relevant personnel can switch to the "error information viewing" mode according to the needs.

[0111] Exemplarily, in the case that it is determined that the current is in the error information viewing mode and the flowchart in the visual flowchart interface is in the non-running state, the abnormal state reason information is displayed for the flowchart node in the abnormal state.

[0112] Exemplarily, the abnormal state reason information is used to locate the reason why the flowchart node is in the abnormal state.

[0113] As an example, displaying the abnormal state reason information can include:

[0114] For any flowchart node in the abnormal state, the first abnormal state reason information is displayed in the specified area associated with the flowchart node, and the first abnormal state reason information is used to indicate the main reason for the abnormality of the flowchart node.

[0115] Exemplarily, for any flowchart node in the abnormal state, the abnormal state reason information (which can be referred to as the first abnormal state reason information) can be displayed in the specified area associated with the flowchart node (such as below the display area of the flowchart node in the visual flowchart interface), so that the relevant personnel can intuitively determine the abnormal reason of the flowchart node in the abnormal state.

[0116] Exemplarily, the first abnormal state reason information can be used to indicate the main reason for the abnormality of the flowchart node.

[0117] In one example, in the case that the length of the first abnormal state reason information exceeds the display range of the specified area associated with the flowchart node, and the selection instruction for the specified area is detected (such as the current operation cursor mapping position is the specified area), the complete first abnormal state reason information is displayed.

[0118] As an example, displaying the abnormal state reason information can include:

[0119] The abnormal statistics list is displayed in the specified area of the visual flowchart interface; wherein, the abnormal statistics list is used to record the abnormal flowchart node information; the abnormal flowchart node information includes the identification information of the flowchart node in the abnormal state, and the second abnormal state reason information of the flowchart node in the abnormal state, and the second abnormal state reason information includes the abnormal value code and / or the abnormal reason information.

[0120] Exemplarily, the specified area of the visual flowchart interface can add the abnormal statistics list, so that the relevant personnel can more comprehensively view the related information of the flowchart node in the abnormal state existing in the flowchart.

[0121] Exemplarily, the abnormal statistics list is used to record the abnormal flowchart node information.

[0122] Exemplarily, the abnormal flow node information comprises identification information of the flow node in the abnormal state, and abnormal state cause information (may be referred to as second abnormal state cause information) of the flow node in the abnormal state.

[0123] Exemplarily, the second abnormal state cause information can comprise an abnormal value code, and / or abnormal cause information.

[0124] The abnormal value code can be used to identify a type of abnormal state, and relevant personnel can determine relevant cause information of the flow node abnormality according to the abnormal value code.

[0125] In an example, the abnormal statistics list is in a hidden state in a non-triggering case, and the abnormal statistics list in the hidden state displays at least part of the abnormal flow node information.

[0126] Exemplarily, in order to reduce the influence of the display of the abnormal statistics list on the display of other information, the abnormal statistics list can be in a hidden state in a non-triggering case.

[0127] Exemplarily, the relevant personnel can trigger the display of the abnormal statistics list by clicking the abnormal statistics list or placing an operation cursor in a region corresponding to the abnormal statistics list.

[0128] Exemplarily, the abnormal statistics list in the hidden state displays at least part of the abnormal flow node information.

[0129] For example, in a case where the number of abnormal flow node information in the abnormal statistics list is one, the abnormal statistics list in the hidden state can display all the abnormal flow node information; in a case where the number of abnormal flow node information in the abnormal statistics list exceeds one, the abnormal statistics list in the hidden state can display part of the abnormal flow node information.

[0130] For example, the abnormal statistics list in the hidden state can display the first abnormal flow node information in the list (which can be sorted according to the time sequence of determining the abnormality).

[0131] Exemplarily, in a case where it is determined that the current is in a time-consuming information viewing mode, and the flowchart in the visual flowchart interface is in a non-running state, for any flow node in the visual flowchart interface, the running time consumption of the flow node can be displayed in a specified region associated with the flow node.

[0132] Since the current flowchart is in a non-running state, the running time consumption of each flow node can be a default value.

[0133] Exemplarily, the above default value can be 0, or other values used to indicate that the current flowchart is in a non-running state, such as a preset invalid value.

[0134] In some embodiments, the flowchart interface data visualization display method provided by the embodiments of the present application can further include:

[0135] In the case of detecting a running operation instruction for the current flowchart and determining that the states of all flow nodes in the current flowchart are normal states, the current flowchart is controlled to enter a running state.

[0136] According to the success result or the failure result output by each flow node in the current flowchart, the flow nodes outputting the success result and the flow nodes outputting the failure result are displayed with different display effects.

[0137] For example, in the case that all flow nodes in the flowchart are in normal states, the relevant personnel can control the flowchart to run through the running operation instruction.

[0138] Correspondingly, in the case of detecting a running operation instruction for the current flowchart and determining that the states of all flow nodes in the current flowchart are normal states, the current flowchart is controlled to enter a running state.

[0139] For example, during the running of the current flowchart, for any flow node, the input data of the flow node can be processed by using the algorithm contained in the flow node according to the input data, and a success result (which can be referred to as an OK result) or a failure result (which can be referred to as an NG result) can be output according to the comparison result of the processing result and the configuration value of the flow node.

[0140] For example, for any flow node, the configuration value of the flow node can be a threshold range, and in the case that the processing result of the flow node on the input data is within the threshold range, an OK result can be output; otherwise, an NG result can be output.

[0141] For example, in the case that the flow node is not a tail node (i.e., there is another flow node whose input data is the output data of the flow node), the flow node can also output specified data to the next associated node.

[0142] For example, in order to enable the relevant personnel to better distinguish the flow nodes outputting the success result and the flow nodes outputting the failure result in the flowchart, the flow nodes outputting the success result and the flow nodes outputting the failure result can be displayed with different display effects according to the success result or the failure result output by each flow node in the current flowchart.

[0143] For example, the flow nodes outputting the success result and the flow nodes outputting the failure result can be distinguished by display color.

[0144] For example, a flow node outputting a success result can be displayed in green; and a flow node outputting a failure result can be displayed in red.

[0145] In one example, in a case where it is determined that the current is in the error information viewing mode, and the flowchart in the visual flowchart interface is in a running state, for a flow node outputting a failure result, error cause information causing the failure result is displayed in a specified area associated with the flow node; wherein, in a case where the flowchart in the visual flowchart interface enters the support information viewing mode, and a selection instruction for the error information viewing mode is detected, the flowchart in the visual flowchart interface enters the error information viewing mode; or, in a case where the flowchart in the visual flowchart interface enters the support information viewing mode, and a default mode in the support information viewing mode is the error information viewing mode, the flowchart in the visual flowchart interface enters the error information viewing mode.

[0146] In a case where it is determined that the current is in the time consuming information viewing mode, and the flowchart in the visual flowchart interface is in a running state, for any flow node in the visual flowchart interface, running time consuming of the flow node is displayed in a specified area associated with the flow node; wherein, in a case where the flowchart in the visual flowchart interface enters the support information viewing mode, and a selection instruction for the time consuming information viewing mode is detected, the flowchart in the visual flowchart interface enters the time consuming information viewing mode; or, in a case where the flowchart in the visual flowchart interface enters the support information viewing mode, and a default mode in the support information viewing mode is the time consuming information viewing mode, the flowchart in the visual flowchart interface enters the time consuming information viewing mode.

[0147] For example, the entering of the error information viewing mode or the time consuming information viewing mode can refer to the related description in the above examples.

[0148] In a case where it is determined that the current is in the error information viewing mode, and the flowchart in the visual flowchart interface is in a running state, for a flow node outputting a failure result, error cause information causing the failure result is displayed in a specified area associated with the flow node.

[0149] For example, for a flow node outputting a failure result, error cause information causing the failure result can be displayed in a lower area of a display area of the flow node.

[0150] In one example, in a case where the length of the error cause information exceeds the display range of a specified area associated with the flow node, and a selection instruction for the specified area is detected, the complete error cause information is displayed.

[0151] For example, in the case that it is determined that the current is in the time-consuming information viewing mode and the flowchart in the visual flowchart interface is in the running state, the running time of any flow node in the visual flowchart interface is displayed in the specified area associated with the flow node.

[0152] In one example, the display state of the running time of each flow node can be dynamically determined according to the sorting result of the real-time running time of each flow node in the visual flowchart interface.

[0153] In the visual flowchart interface, the correspondence between the running time in different display states and the sorting result of the running time can also be displayed.

[0154] For example, in order to better distinguish which flow nodes in the entire flow have longer running time and which flow nodes have shorter running time, the running time information can be specially processed and displayed.

[0155] For example, the running time of different flow nodes can be displayed differently according to the sorting result of the running time of different flow nodes.

[0156] In addition, considering that the running time of the flow nodes is dynamically changing during the running of the entire flow, in order to more accurately display the running time of each flow node, the real-time running time of each flow node can be dynamically determined.

[0157] Accordingly, the display state of the running time of each flow node can be dynamically determined according to the sorting result of the real-time running time of each flow node in the visual flowchart interface.

[0158] For example, in order to ensure that the user can effectively identify the correspondence between different display states and the sorting of the running time, the correspondence between the running time in different display states and the sorting result of the running time can also be displayed in the visual flowchart display interface.

[0159] For example, assuming that the running time of the flow nodes is distinguished by different colors, blue can represent the lowest running time, yellow can represent slightly low running time, orange can represent slightly high running time, and red can represent the highest running time.

[0160] Accordingly, the real-time running time of each flow node in the flowchart can be sorted, and the real-time running time of each flow node can be divided into four groups according to the sorting result, and displayed in the order of blue, yellow, orange and red from low to high.

[0161] In order for those skilled in the art to better understand the technical solutions provided by the embodiments of the present application, the technical solutions provided by the embodiments of the present application will be described below in conjunction with specific application scenarios.

[0162] Please refer to Figure 3 A flowchart is provided for the embodiment of the present application, and a flowchart is shown in the following figure. Figure 3 As shown in the figure, in the process of building a flowchart, for the added flow nodes, when detecting the connection operation for the flow node, the configuration integrity detection can be performed on the flow node, and the node state of each flow node is displayed.

[0163] In the case of a flow node with an abnormal state, the flow node can be displayed as an abnormal state, so that the relevant personnel can view the flow node with an abnormal state and adjust the configuration of the flow node with an abnormal state.

[0164] In the case of detecting the configuration adjustment operation instruction for the flow node with an abnormal state, the configuration integrity detection can be performed again on the flow node.

[0165] In the case where all flow nodes in the flowchart are in a normal state and the running operation instruction for the current flowchart is detected, the current flowchart is controlled to enter a running state.

[0166] Among them, each flow node in the flowchart can be executed according to the building logic sequence.

[0167] For any flow node, according to the input data of the flow node, the input data is processed by using the algorithm contained in the flow node, and according to the comparison result of the processing result and the configuration value of the flow node, the success result or the failure result is output.

[0168] For example, the flow nodes outputting success results and the flow nodes outputting failure results can be displayed with different display effects.

[0169] The related implementation details in the above process will be described below.

[0170] I. Configuration integrity detection

[0171] For example, the flow nodes can be divided into normal nodes (flow nodes in a normal state) and abnormal nodes (flow nodes in an abnormal state) according to the configuration integrity of the flow nodes.

[0172] Among them, the flow nodes with complete and valid configuration parameters (i.e. normal nodes) are displayed as normal state (without special processing effect); the flow nodes with incomplete configuration parameters and invalid parameters are displayed as abnormal state.

[0173] For example, for the abnormal nodes, the node can be highlighted as an abnormal state, and the text of the main reason causing the abnormality (for example, the first abnormal state reason information described above) can be displayed below the node.

[0174] For example, as shown in Figure 4A Three flow nodes are added and form logical connections, and the three flow nodes are configured complete, which are all displayed as normal state (no special processing effect).

[0175] As shown in Figure 4B Two new nodes (which can be called node name 3 and node name 4 respectively) are dragged into the flow, and the new flow nodes are connected with the existing flow nodes to create logical relationships. In the case of l connection for new nodes, new nodes can automatically inherit part of the serial data in the existing flow according to the connection logic.

[0176] For example, assuming that node name 2 is a node that outputs an image, and node name 3 and node name 4 are nodes that need to input images such as image search, when creating a connection relationship, the image output by node name 2 will be automatically associated with node name 3 and node name 4 (that is, node name 3 and node name 4 automatically subscribe to the output data of node name 2).

[0177] However, if the configuration of the new node after inheriting the data is still incomplete, the node will be displayed as an abnormal state.

[0178] For example, in the case of detecting an information viewing function opening instruction, the flowchart in the visual flowchart interface can be controlled to enter the information viewing mode.

[0179] In the case of entering the information viewing mode, the "error information viewing" mode or "time-consuming information viewing" mode selection function button can be displayed in a specific area in the upper left corner of the visual flowchart interface. Related personnel can select the "error information viewing" mode or "time-consuming information viewing" mode according to actual needs, and the schematic diagram can be as shown in Figure 5A .

[0180] For example, as shown in Figure 5A ( Figure 5A Taking the selection of the "error information viewing" mode as an example, for abnormal nodes, on the one hand, the node abnormal reason can be displayed below the abnormal node; on the other hand, a special area can be provided in the lower left corner of the interface to display an abnormal statistics list. In general cases (i.e. not triggered), the abnormal statistics list will be hidden (i.e. in a hidden state).

[0181] As shown in Figure 5A , the abnormal statistics list is in a hidden state, and only the information of the first abnormal node can be displayed.

[0182] For example, as shown in Figure 5BAs shown, the operation button can be displayed by triggering the interface, and the abnormal statistics list is triggered to be displayed completely. The complete display of the abnormal statistics list displays all abnormal nodes and their abnormal reasons and abnormal value codes.

[0183] II. Flowchart running.

[0184] In the case of normal state of each flow node in the flowchart, the "execution running" operation can be performed, that is, the relevant personnel can trigger the flowchart to run through the "execution running" function button.

[0185] During the running of the flowchart, the data received by each flow node is processed by the algorithm contained in the flow node, and the specified data is output and transmitted to the next associated node (if any).

[0186] For any flow node, the processing result of the input data by the flow node can also be compared with the configuration value of the flow node, and the OK result or NG result is determined according to the comparison result.

[0187] For example, the flow node whose processing result meets the configuration value (such as the threshold range, and the processing result is within the threshold range) outputs the OK result; the flow node whose processing result does not meet the configuration value outputs the NG result.

[0188] For example, the flow node whose processing result meets the configuration value (such as the threshold range, and the processing result is within the threshold range) outputs the OK result; the flow node whose processing result does not meet the configuration value outputs the NG result.

[0189] For example, in the case of "error information viewing" mode of the flowchart, the error reason information (also referred to as node NG result reason) causing the node NG can be displayed in the lower area of the display area of the flow node in the case of the flow node in the failure state. The schematic diagram can be as shown in Figure 6 .

[0190] For example, as shown in Figure 7 , in this embodiment, the flowchart of the flow data information viewing process can be as follows:

[0191] 1. In the visual flowchart interface, the flow nodes have been added, and these existing flow nodes will display their corresponding states.

[0192] For example, in the case of non-running state of the flowchart, the flow node can be determined to be in normal state or abnormal state according to the configuration integrity state of the flow node.

[0193] In the case of running state of the flowchart, the success result (OK result) or failure result (NG result) output by the flow node can be determined to be the flow node outputting the OK result or the NG result.

[0194] For different states of the node, a display can be distinguished.

[0195] 2、In the case of detecting information viewing function opening instruction, control the flowchart in the visual flowchart interface to enter the support information viewing mode.

[0196] 3、According to the detected selection instruction for the "error information viewing" mode or the "time-consuming information viewing" mode, enter the "error information viewing" mode or the "time-consuming information viewing" mode.

[0197] 4、In the "error information viewing" mode, the flowchart node in the abnormal state (or the flowchart node outputting NG result) is specially processed and displayed, and the node abnormal reason or error reason obtained is displayed near the corresponding abnormal node. Its schematic diagram can be as shown in Figure 8A .

[0198] 5、In the "time-consuming information viewing" mode, all flowchart nodes in the flowchart are specially processed and displayed, and their corresponding running time-consuming data is displayed near all flowchart nodes.

[0199] For example, when the flowchart is in a non-running state, the running time-consuming of each flowchart node can be a default value, such as 0.

[0200] When the flowchart is in a running state, the display state of the running time-consuming of each flowchart node is dynamically determined according to the real-time running time-consuming sorting result of each flowchart node in the visual flowchart interface.

[0201] For example, in order to ensure that the user can effectively identify the corresponding relationship between different display states and running time-consuming sorting, the visual flowchart display interface can also display the corresponding relationship between the running time-consuming with different display states and the running time-consuming sorting result. Its schematic diagram can be as shown in Figure 8B .

[0202] For example, assuming that the running time-consuming of the flowchart node is distinguished by different colors, blue can represent the lowest running time-consuming, yellow can represent slightly low running time-consuming, orange can represent slightly high running time-consuming, and red can represent the highest running time-consuming.

[0203] Correspondingly, the real-time running time-consuming of each flowchart node in the flowchart can be sorted, and the real-time running time-consuming of each flowchart node can be divided into four groups according to the sorting result, and displayed in blue, yellow, orange and red in turn according to the real-time running time-consuming from low to high.

[0204] Three, data flow viewing.

[0205] For example, Figure 9As shown, in this embodiment, the implementation process is viewed from the data flow direction of the flow node in the flowchart as follows:

[0206] 1. Display all nodes and their configuration states in the visual flowchart interface.

[0207] 2. In the case of detecting an information viewing function opening instruction, control the flowchart in the visual flowchart interface to enter the information viewing support mode.

[0208] 3. In the case where the flowchart is in the information viewing support mode, receive a selection instruction for a target flow node.

[0209] For example, in the case where the flowchart is in the information viewing support mode and a selection instruction for a target flow node is received, it is determined that a data flow direction viewing request for the target flow node is received.

[0210] 4. In response to the received data flow direction viewing request, distinguish and display associated nodes (also referred to as related nodes) and non-associated nodes (also referred to as non-related nodes) in the flowchart, highlight the associated nodes that have data flow interaction with the selected node, and weaken the display effect of other non-associated nodes. In addition, an information viewing floating window is displayed on one side of the selected flow node (such as the target flow node), and the floating window displays all associated nodes and specific interaction data parameters that have data flow interaction with the selected node. The schematic diagram can be as shown in Figure 10 .

[0211] As shown in Figure 10 , assuming that the target flow node is "node name 8", the three nodes (i.e. associated nodes) "node name 0", "node name 2", and "node name 9" that have data flow interaction with it can be highlighted, and the remaining nodes (i.e. non-associated nodes) are weakened in display effect, and the corresponding information viewing floating window is displayed on the right side of the display area of the target flow node.

[0212] The specific schematic diagram of the information viewing floating window can be as shown in Figure 2 .

[0213] In the information viewing floating window, the name of the current flow node, the time consumed by the current flow node for processing data, the error / exception reason of the current flow node (if the current flow node outputs a failure result), and all associated nodes (i.e. input nodes) that input data to the current flow node and associated nodes (i.e. output nodes) that output data from the current flow node are enumerated.

[0214] For example, for an input node, the name of the input node can be displayed and the specific parameter names of the input and the corresponding specific parameter names of the bound nodes in this process can be listed; for an output node, the name of the output node can be displayed and the specific parameter names of the output node in this process can be listed and the corresponding specific parameter names of the output nodes can be listed.

[0215] like Figure 2 As shown, for process node 8, the input nodes may include process node 0 and process node 2, and the output node may include process node 9.

[0216] For process node 0, the input parameters include parameter value 1, parameter value 2, parameter value 3 and parameter value 4, and each parameter is input to parameter 1, parameter 2, parameter 3 and parameter 4 of process node 8 respectively.

[0217] For process node 2, the input parameters include parameter value 5, which is input to parameter 5 in process node 8.

[0218] For process node 9, the parameters output by this process node include parameter 6, which is the parameter 6 output to process node 9.

[0219] The information viewing pop-up window allows for a more convenient view of the data flow at each process node without opening the configuration panel.

[0220] For example, a diagram illustrating the information pop-up window in case of parameter errors can be found here. Figure 11 .like Figure 11 As shown, for node name 3, its input nodes can include node name 1 and node name 2. The output node can include node name 4.

[0221] For node name 1, the parameter input to node name 3 is the output 1 of node name 1, and this parameter is output to the input 1 of node name 3. For example... Figure 11 As shown, in this example, the parameter value is 6.0.

[0222] For node name 2, the parameter input to node name 3 is the output 3 of node name 2, and this parameter is output to the input 2 of node name 3. For example... Figure 11 As shown, in this example, the parameter value is 11.0.

[0223] In this example, the normal parameter value range for input 2 of node name 3 is required to be no more than 5.0. Since the parameter value of output 3 of node name 3 is 11.0, and 11.0 > 5.0, an error occurs, and the error reason is "input parameter value is greater than 5.0".

[0224] For node name 4, the output of node name 3 is a parameter output 1, and the parameter is output to input 1 of node name 4. As shown in Figure 11 , in this example, the parameter value of the parameter is 1.0.

[0225] Based on Figure 11 the information floating window, the relevant personnel can clearly and intuitively view the input and output parameters of the node, and clearly know the parameter error reason in the case of parameter error.

[0226] For example, to more intuitively display the abnormal parameters, the normal parameters and the error parameters can be distinguished and displayed. For example, the normal parameters and the error parameters are distinguished and displayed by different colors and the like.

[0227] In an example, the abnormal parameters can be displayed in red, and the normal parameters can be displayed in green.

[0228] As can be seen, the technical scheme provided by the embodiments of the present application can provide comprehensive and intuitive data visualization information display. In the visualization flowchart interface, more comprehensive data information is displayed, including the configuration integrity state of the flowchart node, the state of the data anomaly, the reason of the anomaly, the running time consumption, the data flow direction and the like, which can effectively help the user to quickly locate and identify the key information when configuring and maintaining the complex flowchart, and facilitate the maintenance and adjustment.

[0229] In addition, through the information viewing floating window, even in the case that the flowchart cannot display all the nodes, all the interactive node information and the specific interactive data can still be viewed through the floating window, which facilitates the maintenance personnel to quickly switch the nodes to troubleshoot the flowchart configuration.

[0230] For example, taking a visual inspection process as an example. Usually, the number of flowchart nodes used in a project site visual inspection process is usually more than 100. After the flowchart is built, it needs to be regularly maintained and adjusted. Through the visualization flowchart interface, the abnormal nodes can be quickly located, and according to the problem reason exposed and displayed, even if all the flowchart nodes cannot be displayed under a single flowchart canvas, the associated nodes that are not displayed and the specific parameter flow direction that appears a problem can still be viewed through the floating window, and the configuration can be quickly adjusted.

[0231] The method provided by the present application is described above. The device provided by the present application is described below:

[0232] Please refer to Figure 12 , a structural schematic diagram of a flowchart interface data visualization display device provided by the embodiments of the present application, as shown in Figure 12 , the flowchart interface data visualization display device can include:

[0233] The receiving unit is configured to receive a data flow direction viewing request for a target process node; wherein the target process node is any process node in a process diagram displayed in a visual process diagram interface;

[0234] The determining unit is configured to determine associated nodes and non-associated nodes in the process diagram;

[0235] The display unit is configured to display the associated nodes and the non-associated nodes respectively in different display effects; wherein the associated nodes are process nodes in the process diagram that have data flow interaction with the target process node; and the non-associated nodes are the rest of the process nodes in the process diagram except the target process node and the associated nodes;

[0236] The output unit is configured to output an information viewing interface element; wherein the information viewing interface element is configured to display identification information of the associated nodes, and interaction data information of each of the associated nodes and the target process node.

[0237] In some embodiments, the information viewing interface element comprises an information viewing floating window;

[0238] The associated nodes displayed in the information viewing floating window comprise input nodes and / or output nodes; for any input node, the interaction data information comprises an input parameter name and a corresponding bound parameter name of the target process node;

[0239] For any output node, the interaction data information comprises an output parameter name and a parameter name of a corresponding output node.

[0240] In some embodiments, in a case where the target process node is a process node that outputs a failure result during running of the process diagram,

[0241] the information viewing floating window further displays a node error reason causing the target process node to output the failure result; and / or,

[0242] the information viewing floating window further labels a data flow direction causing the target process node to output the failure result; and / or,

[0243] the information viewing floating window further displays specific error information causing the target process node to output the failure result;

[0244] and / or,

[0245] in a case where the process diagram is in a running state, the information viewing floating window further displays a running time consumption of the target process node.

[0246] In some embodiments, the display unit displays the associated nodes and the non-associated nodes with different display effects respectively, including:

[0247] highlighting the associated nodes, and / or weakening the display of the non-associated nodes.

[0248] In some embodiments, before the receiving unit receives the data flow direction viewing request for the target process node, the method further includes:

[0249] In the case of detecting the information viewing function opening instruction, the control unit controls the process graph in the visual process graph interface to enter the information viewing mode;

[0250] The receiving unit receives the data flow direction viewing request for the target process node, including:

[0251] In the case of the process graph being in the information viewing mode, the receiving unit receives the selection instruction for the target process node.

[0252] In some embodiments, the determining unit is further configured to determine, for any process node added in the visual process graph interface, a configuration completeness state of the process node;

[0253] The display unit is further configured to display, in the visual process graph interface, a node state of the process node according to the configuration completeness state of the process node; wherein the node state includes a normal state or an abnormal state, and a process node with complete and valid configuration parameters corresponds to the normal state, and a process node with incomplete configuration parameters and / or invalid parameters corresponds to the abnormal state.

[0254] In some embodiments, for any process node added in the visual process graph interface, the determining unit determines a configuration completeness state of the process node, including:

[0255] For any process node added in the visual process graph interface, the determining unit determines data inherited by the process node from corresponding existing process nodes according to a logical connection relationship between the process node and the existing process nodes in the process graph interface, and determines a configuration completeness state of the process node according to the data inherited by the process node.

[0256] In some embodiments, the display unit is further configured to, when determining that it is currently in error information viewing mode and the flowchart in the visual flowchart interface is in a non-running state, display abnormal state reason information for the flowchart node in an abnormal state; wherein, the flowchart in the visual flowchart interface enters error information viewing mode when it is determined that it is currently in error information viewing mode and an instruction for selecting error information viewing mode is detected; or, the flowchart in the visual flowchart interface enters error information viewing mode when it is determined that it is in error information viewing mode and the default mode in the support information viewing mode is error information viewing mode.

[0257] When it is determined that the current state is in time consumption information viewing mode and the flowchart in the visual flowchart interface is in a non-running state, for any flowchart node in the visual flowchart interface, the running time of the flowchart node is displayed in the designated area associated with the flowchart node, and the running time is the default value; wherein, when the flowchart in the visual flowchart interface enters the supported information viewing mode and a selection instruction for the time consumption information viewing mode is detected, the flowchart in the visual flowchart interface enters the time consumption information viewing mode; or, when the flowchart in the visual flowchart interface enters the supported information viewing mode and the default mode in the supported information viewing mode is the time consumption information viewing mode, the flowchart in the visual flowchart interface enters the time consumption information viewing mode.

[0258] In some embodiments, the display unit displays abnormal status cause information, including:

[0259] For any process node in an abnormal state, first abnormal state cause information is displayed in a designated area associated with the process node. The first abnormal state cause information is used to indicate the main reason for the abnormality of the process node. If the length of the first abnormal state cause information exceeds the display range of the designated area associated with the process node, and a selection command for the designated area is detected, the complete first abnormal state cause information is displayed.

[0260] And / or,

[0261] An anomaly statistics list is displayed in a designated area of ​​the visualization flowchart interface; wherein, the anomaly statistics list is used to record anomaly process node information; the anomaly process node information includes the identifier information of the process node in an anomaly state, and the second anomaly state cause information of the process node in an anomaly state, the second anomaly state cause information including an anomaly value code, and / or, an anomaly cause information.

[0262] In some embodiments, the abnormality statistics list is in a hidden state in the absence of triggering, and the abnormality statistics list in the hidden state displays at least part of the abnormal flow node information.

[0263] In some embodiments, the receiving unit is further configured to, in a case where it is detected that an operation instruction for a current flowchart is received and it is determined that the node state of each flow node in the current flowchart is a normal state, control the current flowchart to enter a running state.

[0264] The display unit is further configured to display the flow nodes outputting the success result and the flow nodes outputting the failure result in different display effects according to the success result or the failure result output by each flow node in the current flowchart.

[0265] In some embodiments, during running of the current flowchart, for any flow node, the input data is processed by using the algorithm contained in the flow node according to the input data of the flow node, and a success result or a failure result is output according to a comparison result of the processing result and a configuration value of the flow node, and in a case where the flow node is not a tail node, specified data is output to a next associated node.

[0266] In some embodiments, the display unit is further configured to, in a case where it is determined that an error information viewing mode is currently entered and a flowchart in the visual flowchart interface is in a running state, for a flow node outputting a failure result, display error cause information causing the failure result in a specified area associated with the flow node; wherein the flowchart in the visual flowchart interface enters an error information viewing mode in a case where the flowchart in the visual flowchart interface enters a support information viewing mode and a selection instruction for the error information viewing mode is detected; or the flowchart in the visual flowchart interface enters the error information viewing mode in a case where the flowchart in the visual flowchart interface enters the support information viewing mode and a default mode in the support information viewing mode is the error information viewing mode.

[0267] In a case where it is determined that a time consumption information viewing mode is currently entered and a flowchart in the visual flowchart interface is in a running state, for any flow node in the visual flowchart interface, running time consumption of the flow node is displayed in a specified area associated with the flow node; wherein the flowchart in the visual flowchart interface enters a time consumption information viewing mode in a case where the flowchart in the visual flowchart interface enters a support information viewing mode and a selection instruction for the time consumption information viewing mode is detected; or the flowchart in the visual flowchart interface enters the time consumption information viewing mode in a case where the flowchart in the visual flowchart interface enters the support information viewing mode and a default mode in the support information viewing mode is the time consumption information viewing mode.

[0268] In some embodiments, the display unit is further configured to dynamically determine the display state of the running time of each process node according to the real-time running time sorting result of each process node in the visual process diagram interface.

[0269] The visual process diagram interface further displays a correspondence between the running time in different display states and the running time sorting result.

[0270] Embodiments of the present application provide an electronic device, including a processor and a memory, wherein the memory stores machine executable instructions capable of being executed by the processor, and the processor is configured to execute the machine executable instructions to implement the process diagram interface data visualization display method described above.

[0271] Please refer to Figure 13 , a hardware structure schematic diagram of an electronic device provided by embodiments of the present application. The electronic device can include a processor 1301 and a memory 1302 storing machine executable instructions. The processor 1301 and the memory 1302 can communicate via a system bus 1303. And by reading and executing the machine executable instructions corresponding to the process diagram interface data visualization display logic in the memory 1302, the processor 1301 can execute the process diagram interface data visualization display method described above.

[0272] The memory 1302 mentioned herein can be any electronic, magnetic, optical or other physical storage device, which can contain or store information such as executable instructions, data, etc. For example, the machine readable storage medium can be RAM (Radom Access Memory), volatile memory, non-volatile memory, flash memory, storage drive (such as hard drive), solid state disk, any type of storage disk (such as optical disk, dvd, etc.), or similar storage medium, or combination thereof.

[0273] In some embodiments, a machine readable storage medium, such as the memory 1302 in Figure 13 , is also provided, and the machine executable instructions are stored in the machine readable storage medium, which, when executed by the processor, implement the process diagram interface data visualization display method described above. For example, the storage medium can be ROM, RAM, CD-ROM, magnetic tape, floppy disk and optical data storage device, etc.

Claims

1. A method for visualizing flowchart interface data, the method comprising: The method comprises: receiving a data flow direction viewing request for a target process node; wherein the target process node is any process node in a process graph displayed in a visual process graph interface; the process graph comprises a process graph corresponding to a machine vision task; determining associated nodes and non-associated nodes in the process graph, and displaying the associated nodes and the non-associated nodes respectively with different display effects; wherein the associated nodes are process nodes in the process graph that have data flow interaction with the target process node; the non-associated nodes are the remaining process nodes in the process graph except the target process node and the associated nodes; and outputting information viewing interface elements; wherein the information viewing interface elements are used to display identification information of the associated nodes, and interaction data information of each associated node and the target process node; wherein the method further comprises: if it is determined that the current is in an error information viewing mode, if the process graph in the visual process graph interface is in a non-running state, for the process node in an abnormal state, displaying abnormal state reason information in the visual process graph interface; if the process graph in the visual process graph interface is in a running state, for the process node with a failed output result, displaying error reason information causing the failed result in a specified area associated with the process node; if it is determined that the current is in a time consumption information viewing mode, for any process node in the visual process graph interface, displaying running time consumption of the process node in a specified area associated with the process node; in response to detecting an operation instruction triggered in the visual process graph interface, switching the viewing mode corresponding to the operation instruction; the viewing mode is the error information viewing mode or the time consumption information viewing mode.

2. The method of claim 1, wherein, The information viewing interface elements comprise an information viewing floating window; the associated nodes displayed in the information viewing floating window comprise input nodes and / or output nodes, for any input node, the interaction data information comprises an input parameter name and a corresponding bound parameter name of the target process node; for any output node, the interaction data information comprises an output parameter name and a parameter name of a node to which the output is directed.

3. The method of claim 2, wherein, in the case where the target process node is a process node with a failed output result in the process graph running process, the information viewing floating window further displays node error reasons causing the target process node to output a failed result; and / or, the information viewing floating window further labels data flow directions causing the target process node to output a failed result; and / or, the information viewing floating window further displays specific error information causing the target process node to output a failed result; and / or, in the case where the process graph is in a running state, the information viewing floating window further displays running time consumption of the target process node. The displaying of the associated nodes and the non-associated nodes respectively with different display effects comprises:

4. The method of claim 1, wherein, highlighting the associated nodes, and / or weakening the display of the non-associated nodes. ​ 5. The method of claim 1, wherein, The method further comprises: In a case where the information viewing function opening instruction is detected, the control unit controls the process graph in the visual process graph interface to enter an information viewing mode; The receiving of the data flow direction viewing request for the target process node comprises: In a case where the process graph is in the information viewing mode, the control unit receives a selection instruction for the target process node.

6. The method of claim 1, wherein, The method further comprises: For any process node added in the visual process graph interface, the control unit determines a configuration integrity state of the process node, and displays a node state of the process node in the visual process graph interface according to the configuration integrity state of the process node; wherein the node state comprises a normal state or an abnormal state, and a process node with complete and valid configuration parameters corresponds to the normal state, and a process node with incomplete configuration parameters and / or invalid parameters corresponds to the abnormal state.

7. The method of claim 6, wherein, For any process node added in the visual process graph interface, the control unit determines a configuration integrity state of the process node, comprising: For any process node added in the visual process graph interface, the control unit determines data inherited by the process node from a corresponding existing process node according to a logical connection relationship between the process node and the existing process node in the process graph interface, and determines the configuration integrity state of the process node according to the data inherited by the process node.

8. The method of claim 1, wherein, The display of the abnormal state reason information comprises: For any process node in the abnormal state, the control unit displays first abnormal state reason information in a specified area associated with the process node, wherein the first abnormal state reason information is used to indicate a main reason causing the abnormality of the process node; wherein in a case where the length of the first abnormal state reason information exceeds the display range of the specified area associated with the process node, and a selection instruction for the specified area is detected, the complete first abnormal state reason information is displayed. And / or, The control unit displays an abnormality statistics list in a specified area of the visual process graph interface; wherein the abnormality statistics list is used to record abnormal process node information; the abnormal process node information comprises identification information of the process node in the abnormal state, and second abnormal state reason information of the process node in the abnormal state, wherein the second abnormal state reason information comprises an abnormal value code and / or an abnormal reason information.

9. The method of claim 8, wherein, The abnormality statistics list is in a hidden state in a case where no trigger is detected, and the abnormality statistics list in the hidden state displays at least part of the abnormal process node information.

10. The method of claim 1, wherein, The method further comprises: In a case where a running operation instruction for the current process graph is detected, and it is determined that the node state of each process node in the current process graph is in the normal state, the control unit controls the current process graph to enter a running state; According to the success result or the failure result output by each process node in the current process graph, the control unit displays the process node outputting the success result and the process node outputting the failure result with different display effects.

11. The method of claim 10, wherein, During the current flowchart running process, for any flowchart node, according to input data of the flowchart node, the input data is processed by using an algorithm contained in the flowchart node, and according to a comparison result of a processing result and a configuration value of the flowchart node, a success result or a failure result is output, and in a case where the flowchart node is not a tail node, specified data is output to a next associated node.

12. The method of claim 1, wherein, The method further comprises: According to the real-time running time consumption sorting result of each flowchart node in the visual flowchart interface, the display state of the running time consumption of each flowchart node is dynamically determined. In the visual flowchart interface, the correspondence between the running time consumption in different display states and the running time consumption sorting result is also displayed.

13. A flowchart interface data visualization apparatus, comprising: Comprise: The receiving unit is configured to receive a data flow viewing request for a target flowchart node; the target flowchart node is any flowchart node in a flowchart displayed in a visual flowchart interface; the flowchart comprises a flowchart corresponding to a machine vision task; The determining unit is configured to determine associated nodes and non-associated nodes in the flowchart; the associated nodes are flowchart nodes in the flowchart that have data flow interaction with the target flowchart node; the non-associated nodes are the remaining flowchart nodes in the flowchart except the target flowchart node and the associated nodes; The display unit is configured to display the associated nodes and the non-associated nodes with different display effects respectively; The output unit is configured to output an information viewing interface element; the information viewing interface element is configured to display identification information of the associated nodes and interaction data information of each associated node and the target flowchart node; In a case where it is determined that the current mode is an error information viewing mode, if the flowchart in the visual flowchart interface is in a non-running state, for flowchart nodes in an abnormal state, abnormal state reason information is displayed in the visual flowchart interface; if the flowchart in the visual flowchart interface is in a running state, for flowchart nodes with a failure result, error reason information causing the failure result is displayed in a specified area associated with the flowchart node. In a case where it is determined that the current mode is a time consumption information viewing mode, for any flowchart node in the visual flowchart interface, running time consumption of the flowchart node is displayed in a specified area associated with the flowchart node. In response to detecting an operation instruction triggered in the visual flowchart interface, the viewing mode corresponding to the operation instruction is switched; the viewing mode is the error information viewing mode or the time consumption information viewing mode.

14. The apparatus of claim 13, wherein, The information viewing interface element comprises an information viewing floating window; The associated nodes displayed in the information viewing floating window comprise input nodes and / or output nodes; for any input node, the interaction data information comprises an input parameter name and a corresponding bound parameter name of the target flowchart node; For any output node, the interaction data information comprises an output parameter name and a parameter name of a node to which the output is sent. In a case where the target process node is a process node outputting a failure result in a running process of the flowchart, the information viewing floating window further displays a node error reason causing the target process node to output a failure result; and / or, the information viewing floating window further labels a data flow causing the target process node to output a failure result; and / or, the information viewing floating window further displays specific error information causing the target process node to output a failure result; and / or, in a case where the flowchart is in a running state, the information viewing floating window further displays a running time consumption of the target process node; and / or, the display unit displays the associated node and the non-associated node respectively with different display effects, including: highlighting the associated node, and / or weakening the display of the non-associated node; and / or, before the receiving unit receives the data flow viewing request for the target process node, further including: in a case where an information viewing function opening instruction is detected, controlling the flowchart in the visual process chart interface to enter an information viewing supporting mode; the receiving unit receives the data flow viewing request for the target process node, including: in a case where the flowchart is in the information viewing supporting mode, receiving a selection instruction for the target process node; and / or, the determination unit is further configured to determine, for any process node added in the visual process chart interface, a configuration completeness state of the process node; the display unit is further configured to display, in the visual process chart interface, a node state of the process node according to the configuration completeness state of the process node; wherein the node state includes a normal state or an abnormal state, and a process node with complete and valid configuration parameters corresponds to the normal state, and a process node with incomplete configuration parameters and / or invalid parameters corresponds to the abnormal state; wherein, for any process node added in the visual process chart interface, the determination unit determines the configuration completeness state of the process node, including: for any process node added in the visual process chart interface, determining data inherited by the process node from corresponding existing process nodes according to a logical connection relationship between the process node and the existing process nodes in the flowchart interface, and determining the configuration completeness state of the process node according to the data inherited by the process node; wherein, the display unit displays abnormal state reason information, including: for any process node in an abnormal state, displaying first abnormal state reason information in a specified area associated with the process node, the first abnormal state reason information being used to indicate a main reason causing the abnormality of the process node; wherein, in a case where the length of the first abnormal state reason information exceeds the display range of the specified area associated with the process node, and a selection instruction for the specified area is detected, the complete first abnormal state reason information is displayed; and / or, display an exception statistics list in a specified area of the visual flowchart interface; wherein the exception statistics list is used to record exception flowchart node information; the exception flowchart node information comprises identification information of a flowchart node in an exception state, and second exception state cause information of the flowchart node in the exception state, the second exception state cause information comprising an exception value code and / or exception cause information; wherein the exception statistics list is in a hidden state under a non-triggering condition, and the exception statistics list in the hidden state displays at least part of the exception flowchart node information; and / or, the receiving unit is further configured to, in a case where a running operation instruction for a current flowchart is detected and it is determined that the node state of each flowchart node in the current flowchart is a normal state, control the current flowchart to enter a running state; the display unit is further configured to display flowchart nodes outputting a success result and flowchart nodes outputting a failure result in different display effects according to the success result or the failure result output by each flowchart node in the current flowchart; wherein, during running of the current flowchart, for any flowchart node, input data is processed by using an algorithm contained in the flowchart node according to the input data, and a success result or a failure result is output according to a comparison result of the processing result and a configuration value of the flowchart node, and in a case where the flowchart node is not a tail node, specified data is output to a next associated node; wherein the display unit is further configured to dynamically determine a display state of running time consumption of each flowchart node according to a real-time running time consumption sorting result of each flowchart node in the visual flowchart interface; wherein the visual flowchart interface further displays a corresponding relationship between running time consumption in different display states and the running time consumption sorting result.

15. An electronic device, comprising: The processor and the memory, the memory stores machine executable instructions that can be executed by the processor, the processor is used to execute machine executable instructions, to realize the method as claimed in any one of claims 1-12.

16. A machine-readable storage medium, characterized in that, The machine readable storage medium stores machine executable instructions, the machine executable instructions are executed by the processor to realize the method as claimed in any one of claims 1-12.

Images