Visual operation process design method, data management method and related devices thereof

Abstract

The invention provides a visual operation process design method, a data governance method and related devices thereof, the method is applied to a visual operation interface, and the method comprises the following steps: receiving a first input of a user on the visual operation interface; in response to the first input, displaying the first process instance on the canvas; receiving a second input of the user to a first node component in the first process instance; and in response to the second input, updating the processing logic parameters of the first node component, and displaying the second process instance through the canvas. According to the method, the detailed logic and attribute of each node are flexibly set by a user in a process construction process, so that a highly customized data processing strategy is realized, the response speed of a temporary demand is accelerated by promoting code reuse and modular design, the agility and high efficiency of data management work are ensured, and the data management efficiency is improved. And the software development efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of big data processing and computer technology, and in particular to a visual operation process design method, a data governance method and related devices. Background Art

[0002] In the rapidly changing era of Internet big data, the huge amount of information, demands and problems generated every day has significantly increased the workload of software developers, which has put higher technical requirements on software developers.

[0003] In the prior art, traditional software programming relies on defined data structures, which are relatively complex and difficult to maintain. In response to different types of design requirements, improper selection of data structures may lead to inefficient code, and unreasonable parameter passing methods will also affect program performance. In addition, structured programming has high technical requirements for developers, and the technical threshold for programming under complex requirements is even higher, resulting in low software development efficiency. Summary of the invention

[0004] The present invention provides a visual operation process design method, a data governance method and related devices, which are used to solve the defects of the prior art that software programs are designed based on defined data structures, the data structure maintenance cost is high, and when the design process is complicated and the data structure cannot meet the design requirements, the software development efficiency will be reduced. The software development efficiency is improved and the technical threshold is lowered.

[0005] The present invention provides a visual operation process design method, which is applied to a visual operation interface, wherein the visual operation interface includes multiple node components, multiple edge components and a canvas, each node component includes at least one connection pile, and different nodes have different processing logics; the method includes: Receive a first input from a user in the visual operation interface, where the first input is determined based on a process design requirement; In response to the first input, displaying a first process instance on the canvas, the first process instance comprising at least two node components and at least one edge component; receiving a second input from a user regarding a first node component in the first process instance; In response to the second input, the processing logic parameters of the first node component are updated, and a second process instance is displayed through the canvas.

[0006] According to a visual operation process design method provided by the present invention, the processing logic parameter of the first node component is updated by at least one of the following: Adjusting the running code of the first node component based on the target database form to obtain an updated first node component; The running code of the first node component is adjusted based on an online code editor to obtain the updated first node component.

[0007] According to a visual operation process design method provided by the present invention, after displaying the second process instance on the canvas, the method further includes: Receive a third input from a user, where the third input is used to perform a tracking operation on a running code corresponding to a second node component in the second process instance; In response to the third input, first instruction information is generated so that the server can output the execution status and execution result of the running code corresponding to the second node component.

[0008] According to a visual operation process design method provided by the present invention, after displaying the second process instance on the canvas, the method further includes: receiving a fourth input from a user, where the fourth input is used to monitor the running state of the third node component in the second process instance; In response to the fourth input, second instruction information is generated so that the server can output the operating status information of the third node component and issue an alarm for abnormal information in the operating status information.

[0009] According to a visual operation process design method provided by the present invention, after displaying the second process instance on the canvas, the method further includes: receiving a fifth input from the user; In response to the fifth input, the second process instance is sent to the target server so that the server can perform data governance services, where the data governance services include at least one of code running, step-by-step debugging, and data reading and writing.

[0010] The present invention also provides a data management method, which is applied to a server and includes: Receiving a sixth input from a user on a second process instance; the second process instance is determined based on the visual operation process design method; In response to the sixth input, a data governance service is executed, wherein the data governance service includes at least one of code running, distributed debugging, point monitoring, and exception information monitoring.

[0011] The present invention also provides a visual operation process design device, comprising: A first receiving module is used to receive a first input from a user in a visual operation interface, wherein the first input is determined based on a process design requirement; wherein the visual operation interface includes a plurality of node components, a plurality of edge components and the canvas, each node component includes at least one connection stub, and different nodes have different processing logics; A first response module, configured to respond to the first input and display a first process instance on a canvas; wherein the first process instance includes at least two node components and at least one edge component; A second receiving module, used to receive a second input from a user on a first node component in the first process instance; The second response module is used to respond to the second input, update the processing logic parameters of the first node component, and display the second process instance through the canvas.

[0012] The present invention also provides a data management device, comprising: A third receiving module is used to receive a sixth input of a user on a second process instance; the second process instance is determined based on the visual operation process design method; The third response module is used to respond to the sixth input and execute data governance business, and the data governance business includes at least one of code running, distributed debugging, point monitoring and exception information monitoring.

[0013] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements any one of the above-mentioned visual operation process design methods or data governance methods.

[0014] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the above-described visual operation process design methods or data governance methods.

[0015] The present invention also provides a computer program product, including a computer program, which, when executed by a processor, implements any of the above-mentioned visual operation process design methods or data governance methods.

[0016] The visual operation process design method, data governance method and related devices provided by the present invention construct a first process instance and perform a visual display through the first input of the user in the visual operation interface, update the processing logic parameters of the node component through the second input of the user to the first node component, and display the second process instance on the canvas, so that the user can flexibly set the detailed logic and attributes of each node in the process construction process, thereby realizing a highly customized data processing strategy, and accelerating the response speed to temporary needs by promoting code reuse and modular design, ensuring the agility and efficiency of data governance work, and thus improving software development efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 It is a flow chart of the visual operation process design method provided by the present invention.

[0019] Figure 2 It is a structural schematic diagram of the first process example provided by the present invention.

[0020] Figure 3 It is a flow chart of a method for monitoring the running status of a second process instance and issuing an alarm for abnormal information provided by the present invention.

[0021] Figure 4 This is one of the flow charts of the data governance method provided by the present invention.

[0022] Figure 5 This is the second flow chart of the data governance method provided by the present invention.

[0023] Figure 6 It is a structural schematic diagram of the visual operation process design device provided by the present invention.

[0024] Figure 7 It is a structural schematic diagram of the data management device provided by the present invention.

[0025] Figure 8 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] Combine the following Figure 1-Figure 7 Describe the visualized operation process design method, data management method and related devices of the present invention.

[0028] Figure 1 It is a flow chart of the visual operation process design method provided by the present invention, such as Figure 1As shown, the visual operation process design method is applied to a visual operation interface, which includes multiple node components, multiple edge components and a canvas, each node component includes at least one connection pile, and different nodes have different processing logics; the method includes the following steps: Step 110: Receive a first input from the user in the visual operation interface, where the first input is determined based on a process design requirement.

[0029] In this step, the canvas of the visual operation interface is used to display and edit the flowchart. The visual operation interface is provided with a toolbar, which is specifically used for adding new nodes, connecting lines, undoing, redoing, saving, loading and other operations; the visual operation interface also displays and edits the properties of the selected node, such as name, type, configuration parameters, etc.; the visual operation interface also includes a code editor for editing the specific logic of the node (such as JavaScript or Python, etc.); the visual operation interface also links to the node library to provide preview and drag functions for various nodes (such as start nodes, end nodes, calculation nodes, database nodes, etc.); the visual operation interface also includes a connection manager for displaying all connections and node relationships to facilitate management and optimization of processes.

[0030] In this step, the node component includes one or more node units, and the edge component node includes one or more edge units. The shape, color, and area size of the node unit or edge unit can be set according to user needs.

[0031] In this embodiment, the processing logic of a single step in data governance is determined within the node; a node unit includes 2 or 4 connection piles, which are interfaces of the edges and provide connection functions between nodes; the edges are used to determine the connection relationship between nodes; and the canvas is a container for storing nodes and edges.

[0032] In this embodiment, the node units on the visual operation interface can be edited by users, or can be imported from a node database.

[0033] In this embodiment, the first input may be a touch input, for example, the user clicks on the node component to be selected in the visual operation interface with a finger or a stylus; the first input may be a key input, for example, the node component is selected and confirmed in the visual operation interface through a physical key on the terminal; the first input may also be a voice input, for example, the user sends a voice command "select node A and node B" to the terminal, and node A and node B appear in the visual operation interface.

[0034] In this embodiment, different process design requirements determine different process instances, and the user calls multiple nodes and related edges from the toolbar or node library of the visual operation interface according to the first input to build a process instance with a combination of multiple logical functions.

[0035] Step 120: In response to the first input, display a first process instance on the canvas, where the first process instance includes at least two node components and at least one edge component.

[0036] In this step, the visual operation interface can be regarded as a terminal. The visual operation interface responds to the operation of building a process implementation example corresponding to the first input (moving, dragging, and connecting multiple node components) to display the complete first process instance in the canvas area of ​​the visual operation interface.

[0037] In this embodiment, through the first input, the "start node", "function node 1", "function node 2" and "output node" are dragged to the canvas area in sequence from the node library or the toolbar, and three edges are called from the toolbar to connect these four nodes in sequence to obtain a first process instance consisting of four nodes and three edges.

[0038] Step 130: Receive a second input from the user on the first node component in the first process instance.

[0039] In this step, the second input may be one of touch input, key input and voice input.

[0040] For example, the second input is touch input, and the user clicks one or more times on the canvas with a finger or a stylus; the second input is button input, for example, the first node component is selected and confirmed in the visual operation interface through a physical button on the terminal; the second input is voice input, for example, the user sends a voice command "edit the first node component" to the terminal, and the editing interface and related configuration parameters of the first node component will appear in the visual operation interface.

[0041] In this embodiment, the second input may be a combined input, for example, the second input includes a first sub-input and a second sub-input, the first sub-input is used to select a node to be configured, and the second sub-input is used to configure parameters.

[0042] Taking the example that the second input includes the first sub-input and the second sub-input are both touch inputs, the user double-clicks (first sub-input) the "function node 1" in the above first process instance with a stylus to enter the logic parameter configuration interface of the node, and performs code design and related parameter configuration in the logic parameter configuration interface through the second sub-input.

[0043] In this embodiment, the first node component may be one node or multiple nodes.

[0044] Step 140: In response to the second input, update the processing logic parameters of the first node component, and display the second process instance through the canvas.

[0045] In this step, the visual operation interface responds to the second input and displays the second process instance with completed node configuration on the canvas.

[0046] In this embodiment, the logic parameter configuration interface is provided with a code editor: for nodes that need to write code, an embedded code editor is provided. The editor should have basic code highlighting, automatic completion, syntax checking and other functions; when configuring parameters or codes, the logic parameter configuration interface provides instant verification and error prompts to help users find and correct problems in a timely manner.

[0047] In this embodiment, the user selects "Function Node 1" and "Function Node 2" through the second input and performs code design and configuration of related parameters. After the configuration is completed, the logical parameter configuration interface is displayed, and the visual operation interface is clicked to obtain a new process instance, namely the second process instance.

[0048] The visual operation process design method provided by the present invention constructs a first process instance and displays it visually through the first input of the user in the visual operation interface, updates the processing logic parameters of the node component through the second input of the user to the first node component, and displays the second process instance on the canvas, thereby enabling the user to flexibly set the detailed logic and properties of each node in the process construction process, thereby realizing a highly customized data processing strategy, accelerating the response speed to temporary needs by promoting code reuse and modular design, ensuring the agility and efficiency of data governance work, and thus improving software development efficiency.

[0049] In some embodiments, the processing logic parameters of the first node component are updated by at least one of the following: (1) Adjust the running code of the first node component based on the target database form to obtain an updated first node component.

[0050] In this embodiment, designing a database form includes determining a structure of the form, including fields and types, and determining that different form fields are associated with different process node configurations.

[0051] In this embodiment, the method of defining the process node configuration includes: creating a configuration table for storing the information of the process nodes; each node contains a unique identifier, a node name, a node type (such as start, end, approval, task, etc.), execution conditions, sequence, etc.

[0052] In this embodiment, writing code to read the form and configuration includes: reading form data and process node configuration from a database, mapping the read data to corresponding objects or data structures, and generating a process instance.

[0053] Specifically, the visual operation interface is provided with function nodes associated with the target database form, for example, the library table input node. This type of node can read data of types such as mysql, oracle, mongoDB, redis, kafka, elasticsearch, HBase, RabitMQ, rocketMQ, activeMQ, Hive and Greenplum from the following target databases.

[0054] In this embodiment, the visual operation interface is also provided with a library table operation node, which can execute, update, insert, delete and create operations on a certain data source; the node logic processing parameter update method based on the target database form can improve the configuration efficiency of simple data.

[0055] (2) Adjust the running code of the first node component based on the online code editor to obtain an updated first node component.

[0056] In this embodiment, the online code editor includes but is not limited to editors such as Monaco Editor (the basic editor of VS Code), CodeMirror, and Ace Editor.

[0057] Specifically, the editor can be integrated into the front-end application to ensure that it can correctly display and edit the code, load the code of the current node from the back-end or local storage into the online code editor, and ensure that the code in the editor is consistent with the code currently running on the node. Users can edit the code in the online code editor, such as modifying variables, functions, logic, etc.; before the user submits the edited code, code verification is performed, such as syntax checking, type checking, etc., and static analysis tools or integrated development environment (IDE) functions can also be used to assist in verification, and then the user-edited code is saved to the back-end or local storage for subsequent use; finally, in the back-end or process engine, the updated code is used to replace the original code of the node.

[0058] In some embodiments, the visual operation interface also includes a data computing node. This type of node can perform data volume comparison, data value comparison, incremental calculation, multi-stream merging, data sorting, data grouping, data deduplication, data splitting and data aggregation operations on data or multiple groups of data streams.

[0059] In this embodiment, the visual operation interface also includes a data conversion node. This type of node can perform single-column conversion into multiple columns, single-column split into multiple rows, single-column conversion into multiple rows, multiple rows conversion into multiple columns, multiple rows merged into one column, one row split into multiple rows, field mapping and data filtering conversion operations on the data flow.

[0060] In this embodiment, the visual operation interface also includes an interface calling node. This type of node can call http, websocket and file upload interfaces and return the result for the next node to use.

[0061] In this embodiment, the visual operation interface also includes a script execution node, which is a type of node that can execute SQL, Java, Javascript, python, and shell and return the result for use by the next node.

[0062] In this embodiment, the visual operation interface also includes a file processing component. This type of node can read or write Excel files, upload files to the server, read file information, move, create and delete files, and perform file decompression operations.

[0063] In this embodiment, the visual operation interface also includes general component nodes, which include start nodes, end nodes, sub-process nodes, timer nodes, gateway nodes and variable setting nodes; among them, the start and end nodes specify where the process starts and where it ends; the sub-process nodes reference other processes; the timer node, when the process runs to this node, it will sleep for the timer setting period; the gateway node is used to distribute subsequent nodes; the variable setting node sets local variables or global variables for use by subsequent nodes.

[0064] Figure 2 is a schematic diagram of the structure of the first process example provided by the present invention, Figure 2 In the illustrated embodiment, the first process instance includes sequentially connecting a "start node", a "data conversion node", a "gateway node", a "library table data output node" and an "end node", wherein the "library table data output node" includes "library table data output node 1" and "library table data output node 2".

[0065] The visual operation process design method provided by the present invention adjusts the running code of the first node component through the target database form, thereby improving the processing efficiency of simple design requirements. In combination with the online code editor, the running code of the first node component is adjusted, thereby improving the processing efficiency of more complex design requirements, thereby improving the processing efficiency of massive process design requirements.

[0066] In some embodiments, after displaying the second process instance on the canvas, the method also includes: receiving a third input from the user, the third input being used to perform a tracking operation on the running code corresponding to the second node component in the second process instance; in response to the third input, generating first instruction information for the server to output the execution status and execution results of the running code corresponding to the second node component.

[0067] In this embodiment, the third input may be a touch input, for example, the user uses a finger or a stylus to perform a point-embedding operation on the parameter configuration interface corresponding to the second node component; the third input may be a key input, for example, the user uses a physical key on the terminal to perform a point-embedding operation and confirm on the parameter configuration interface corresponding to the second node component; the third input may also be a voice input, for example, the user sends a voice command to the terminal "open the configuration interface of the second node component and execute the point-embedding operation at position C", etc.

[0068] In this embodiment, the terminal where the visual operation interface is located responds to the third input, and after performing tracking in the second process instance, generates a first instruction message. The instruction message may be information synchronization information, that is, the tracking information is synchronously sent to the server through the first instruction message. After receiving the instruction message, the server runs the running code corresponding to the second process instance, executes the corresponding tracking operation, and generates log information.

[0069] In this embodiment, the first instruction information can also be a control signal, provided that the visual operation interface and the server have established a data collaborative connection. Under the collaborative connection, after the visual operation interface or either end of the server updates the node or code of the second process instance, the other end will synchronize the information, that is, the tracking operation is completed after the visual operation interface responds to the third input, and the server has obtained the tracking information. The visual operation interface then generates the first instruction information to instruct the server to run the second process instance according to the tracking information, and print the status and results of each process node after the tracking is executed during process running and debugging, that is, log data.

[0070] The visual operation process design method provided by the present invention generates the first instruction information in response to the user's third input, so that the server can synchronously update the tracking point operation of the second process instance, and output the log information of the corresponding running code of the second node component, thereby realizing the coordinated update of the log information between the visual operation interface and the server.

[0071] In some embodiments, after displaying the second process instance on the canvas, the method also includes: receiving a fourth input from the user, the fourth input being used to monitor the operating status of the third node component in the second process instance; in response to the fourth input, generating second instruction information for the server to output the operating status information of the third node component and to issue an alarm for abnormal information in the operating status information.

[0072] In this embodiment, the fourth input may be a touch input, for example, the user configures the operation monitoring parameters in the parameter configuration interface corresponding to the third node component through a finger or a stylus; the fourth input may be a key input, for example, the user configures the operation monitoring parameters and confirms in the parameter configuration interface corresponding to the third node component through a physical key on the terminal; the fourth input may also be a voice input, for example, the user sends a voice command to the terminal "open the configuration interface of the third node component and start the operation monitoring function", etc.

[0073] In this embodiment, the terminal where the visual operation interface is located responds to the fourth input, and after setting the operation monitoring parameter process in the second process instance, generates a second instruction message. The instruction message can be information synchronization information, that is, the operation monitoring parameters are synchronously sent to the server through the second instruction message. After the server receives the second instruction message, it starts the code operation monitoring function during the operation and debugging of the second process instance, and automatically reports errors and alarms for the monitored abnormal information.

[0074] Similarly, the second instruction information can also be a control signal. When the visual operation interface and the server have established a data collaborative connection, when the visual operation interface responds to the fourth input and completes the operation status monitoring configuration, the server synchronously obtains the operation status monitoring configuration information, and the visual operation interface regenerates the second instruction information to instruct the server to start operation status monitoring when running the second process instance, and automatically report errors and alarms for the monitored abnormal information.

[0075] Specifically, when the server runs the program, it reads the node data from MongoDB, searches for the root node through a fixed algorithm, and then searches for the child nodes in turn to run until there are no child nodes or an exception occurs and stops running; when running the child nodes, the reflection mechanism of Java is used to find and execute the code snippet required for the child node to run; and regarding exception handling, this embodiment can use the reflection mechanism to execute the node method, and only needs to wrap a layer of try catch outside the method.invoke.

[0076] Figure 3 is a flow chart of a method for monitoring the running status of a second process instance and providing an alarm for abnormal information provided by the present invention. Figure 3 In the illustrated embodiment, the user clicks a run button on the visual operation interface or the server, and the server reads the process information of the second process instance, reads the information of each node in turn, and runs the node; when an exception occurs in the node running status and the user defines an exception handling method, the exception information is processed, and it is continued to be determined whether there is a subsequent node. If so, the node continues to be run; if not, the process is terminated.

[0077] The visual operation process design method provided by the present invention generates second instruction information in response to the user's fourth input, so that the server can synchronously update the code operation status monitoring and abnormal alarm functions of the second process instance, thereby realizing the coordinated update of the operation status information and safety prompts between the visual operation interface and the server, and improving the code maintenance efficiency.

[0078] In some embodiments, the visual operation interface is also generally used to receive user input to implement data filtering and rule conversion operations; for example, the user can bind rules to a single data field or a certain data field in a list, and the bound rules total 6 built-in rules (date formatting, random number generation, data desensitization, data encryption, data interception). If the existing general rules cannot meet the needs, the user can also write the code to define the rules, further improving the user's flexibility and efficiency in software code development.

[0079] In some embodiments, the visual operation interface also generally receives user input to implement a timed execution function, which is used to timed execute a process designed by the user.

[0080] In some embodiments, the visual operation interface can also receive user input to link to almost all mainstream databases on the market.

[0081] In some embodiments, the visual operation interface also generally receives the user's input of customized data processing rules, and the data flow can be converted according to the corresponding rules in the process design.

[0082] In some embodiments, the visual operation interface also generally receives user input to provide a function of exposing an http interface to the outside, and the designed process can be called as an application program interface.

[0083] In some embodiments, the visual operation interface also generally receives user input, instructs the server to generate logs and record other operation logs of the user.

[0084] In some embodiments, after displaying the second process instance on the canvas, the method also includes: receiving a fifth input from the user; in response to the fifth input, sending the second process instance to the target server so that the server can execute data governance services, the data governance services including at least one of code running, step-by-step debugging, and data reading and writing.

[0085] In this embodiment, the fifth input can be a touch input, for example, the user clicks the send control on the visual operation interface with a finger or a stylus to send the saved second process instance to the server; the fifth input can be a key input, for example, the user sends the saved second process instance to the server through a physical key on the terminal; the fifth input can also be a voice input, for example, the user sends a voice command to the terminal "send the second process instance to the server".

[0086] In this embodiment, after the user clicks Save, all nodes and process information of the second process instance are collected and sent to the server, and the server performs the storage operation. In this embodiment, the server process running and step-by-step debugging functions, when the user clicks the run or debug button, the server will read all the nodes of the process designed by the user in turn and execute them in sequence. Each time a node is executed, all the properties of the node will be read, and data processing will be performed based on this information; the collected node information is disordered and the running order needs to be determined according to the link properties of the node at runtime.

[0087] It should be noted that the process will automatically execute from the first node to the last node in sequence or terminate when an error occurs, while step-by-step debugging is to wait for the user to issue an instruction to run the node and then run it one node at a time; during step-by-step debugging, the user can also observe the information generated during the runtime in the console of the interface, including the variables of the current node and process, the node execution results, and the running time.

[0088] The visual operation process design method provided by the present invention sends the second process instance to the target server through the user's fifth input so that the server can execute data governance services, thereby realizing online updating, debugging and compiling of the process instance, and further improving software development efficiency.

[0089] The data governance method provided by the present invention is described below. The data governance method described below and the visual operation process design method described above can be referenced to each other.

[0090] Figure 4 This is one of the flow charts of the data governance method provided by the present invention, such as Figure 4 As shown, the data governance method, applied to the server, includes the following steps: Step 410: Receive the sixth input of the user for the second process instance; the second process instance is determined based on the visual operation process design method.

[0091] In this embodiment, the acquisition method of the second process embodiment is the same as the above steps 110 to 140, and will not be repeated in this embodiment.

[0092] In this embodiment, the processing logic parameters of the first node component are updated by at least one of the following: adjusting the running code of the first node component based on the target database form to obtain an updated first node component; adjusting the running code of the first node component based on the online code editor to obtain an updated first node component.

[0093] In this embodiment, after the second process instance is displayed on the canvas, a third input from the user is received, and the third input is used to perform a tracking operation on the running code corresponding to the second node component in the second process instance; in response to the third input, first instruction information is generated for the server to output the execution status and execution results of the running code corresponding to the second node component.

[0094] In this embodiment, after the second process instance is displayed on the canvas, a fourth input from the user is received, and the fourth input is used to monitor the running status of the third node component in the second process instance; in response to the fourth input, second instruction information is generated so that the server can output the running status information of the third node component and issue an alarm for abnormal information in the running status information.

[0095] In this embodiment, after the second process instance is displayed on the canvas, a fifth input from the user is received; in response to the fifth input, the second process instance is sent to the target server so that the server can execute data governance services, and the data governance services include at least one of code running, step-by-step debugging, and data reading and writing; the specific implementation method of the above embodiment has been described in the embodiment at the corresponding position above, and will not be repeated in this embodiment.

[0096] Step 420: In response to the sixth input, execute data governance services, where the data governance services include at least one of code execution, distributed debugging, point monitoring, and exception information monitoring.

[0097] In this step, the sixth input can be a touch input, for example, the user selects "Run" in the data governance service on the server operation interface with a finger or a stylus, instructing the server to run the corresponding code of the second process instance; the sixth input can be a key input, for example, the user selects "Run" in the data governance service on the server operation interface through a physical key on the terminal; the sixth input can also be a voice input, for example, the user sends a voice command "Run the second process instance" to the server.

[0098] In this embodiment, the server process running and step-by-step debugging functions, when the user clicks the run or debug button, the server will read all the nodes of the process designed by the user in turn and execute them in sequence. Each time a node is executed, all the properties of the node will be read, and data processing will be performed based on this information; the collected node information is disordered and the running order needs to be determined according to the link properties of the node at runtime.

[0099] It should be noted that the process will automatically execute from the first node to the last node in sequence or terminate when an error occurs, while step-by-step debugging is to wait for the user to issue an instruction to run the node and then run it one node at a time; during step-by-step debugging, the user can also observe the information generated during the runtime in the console of the interface, including the variables of the current node and process, the node execution results, and the running time.

[0100] The data governance method provided by the present invention, through the server responding to the user's sixth input to the second process instance, executes at least one of the second process instance code running, distributed debugging, tracking point monitoring and exception information monitoring, to implement a highly customized data processing strategy, reduce the workload of development and operation and maintenance personnel, reduce the cost and time loss caused by duplication of work and human errors, and improve software development efficiency.

[0101] Figure 5 This is the second flow chart of the data governance method provided by the present invention. Figure 5 In the illustrated embodiment, a feasible data governance method includes: 501. The user manually plans the data governance process (corresponding to step 110-step 120); 502. Setting the process node attributes (corresponding to step 130-step 140); 502. Running or debugging; 503. Completing data governance (corresponding to step 410-step 420).

[0102] The visualized operation process design device provided by the present invention is described below. The visualized operation process design device described below and the visualized operation process design method described above can be referred to each other.

[0103] Figure 6 is a schematic diagram of the structure of the visual operation process design device provided by the present invention, such as Figure 6 As shown, the visual operation process design device includes: a first response module 620, a first response module 620, a second receiving module 630 and a second response module 640.

[0104] A first receiving module 610 is used to receive a first input from a user in a visual operation interface, where the first input is determined based on a process design requirement; wherein the visual operation interface includes a plurality of node components, a plurality of edge components and a canvas, each node component includes at least one connection stub, and different nodes have different processing logics; A first response module 620 is used to respond to the first input and display a first process instance on the canvas; wherein the first process instance includes at least two node components and at least one edge component; The second receiving module 630 is used to receive a second input of the user on the first node component in the first process instance; The second response module 640 is used to respond to the second input, update the processing logic parameters of the first node component, and display the second process instance through the canvas.

[0105] The visual operation process design device provided by the present invention constructs a first process instance and displays it visually through the first input of the user in the visual operation interface, updates the processing logic parameters of the node component through the second input of the user to the first node component, and displays the second process instance on the canvas, thereby enabling the user to flexibly set the detailed logic and properties of each node in the process construction process, thereby realizing a highly customized data processing strategy, accelerating the response speed to temporary needs by promoting code reuse and modular design, ensuring the agility and efficiency of data governance work, and thus improving software development efficiency.

[0106] The data governance device provided by the present invention is described below. The data governance device described below and the data governance method described above can be referenced to each other.

[0107] Figure 7 is a schematic diagram of the structure of the data management device provided by the present invention, such as Figure 7 As shown, the data governance device includes: a third receiving module 710 and a third responding module 720.

[0108] The third receiving module 710 is used to receive a sixth input of the user on the second process instance; the second process instance is determined based on the visual operation process design method; The third response module 720 is used to respond to the sixth input and execute data governance business, which includes at least one of code running, distributed debugging, point monitoring and abnormal information monitoring.

[0109] The data governance device provided by the present invention responds to the user's sixth input to the second process instance through the server, and executes at least one of the second process instance code running, distributed debugging, tracking point monitoring and exception information monitoring, to implement a highly customized data processing strategy, reduce the workload of development and operation and maintenance personnel, reduce the cost and time loss caused by duplication of work and human errors, and improve software development efficiency.

[0110] Figure 8 is a schematic diagram of the structure of the electronic device provided by the present invention, such as Figure 8As shown, the electronic device may include: a processor 810, a communication interface 820, a memory 830 and a communication bus 840, wherein the processor 810, the communication interface 820 and the memory 830 communicate with each other through the communication bus 840. The processor 810 may call the logic instructions in the memory 830 to execute the visual operation process design method, which is applied to the visual operation interface and includes: receiving a first input from a user in the visual operation interface, the first input being determined based on the process design requirements; in response to the first input, displaying a first process instance on a canvas, the first process instance including at least two node components and at least one edge component; receiving a second input from the user to a first node component in the first process instance; in response to the second input, updating the processing logic parameters of the first node component and displaying the second process instance through the canvas.

[0111] Or execute a data governance method, which is applied to a server, including: receiving a sixth input from a user to a second process instance; determining the second process instance based on a visual operation process design method; and executing data governance services in response to the sixth input, the data governance services including at least one of code running, distributed debugging, point monitoring, and exception information monitoring.

[0112] In addition, the logic instructions in the above-mentioned memory 830 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0113] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the visual operation process design method provided by the above methods. The method is applied to a visual operation interface, including: receiving a first input from a user in the visual operation interface, the first input is determined based on the process design requirements; in response to the first input, displaying a first process instance on a canvas, the first process instance including at least two node components and at least one edge component; receiving a second input from the user to a first node component in the first process instance; in response to the second input, updating the processing logic parameters of the first node component, and displaying the second process instance through the canvas.

[0114] Or execute a data governance method, which is applied to a server, including: receiving a sixth input from a user to a second process instance; determining the second process instance based on a visual operation process design method; and executing data governance services in response to the sixth input, the data governance services including at least one of code running, distributed debugging, point monitoring, and exception information monitoring.

[0115] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, it is implemented to execute the visual operation process design method provided by the above-mentioned methods. The method is applied to a visual operation interface, including: receiving a first input from a user in the visual operation interface, the first input being determined based on the process design requirements; in response to the first input, displaying a first process instance on a canvas, the first process instance including at least two node components and at least one edge component; receiving a second input from the user to a first node component in the first process instance; in response to the second input, updating the processing logic parameters of the first node component, and displaying the second process instance through the canvas.

[0116] Or execute a data governance method, which is applied to a server, including: receiving a sixth input from a user to a second process instance; determining the second process instance based on a visual operation process design method; and executing data governance services in response to the sixth input, the data governance services including at least one of code running, distributed debugging, point monitoring, and exception information monitoring.

[0117] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0118] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0119] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A visual operation process design method, applied to a visual operation interface, characterized in that: The visual operation interface includes multiple node components, multiple edge components and a canvas, each node component includes at least one connection pile, and different nodes have different processing logics; the method includes: Receive a first input from a user in the visual operation interface, where the first input is determined based on a process design requirement; In response to the first input, displaying a first process instance on the canvas, the first process instance comprising at least two node components and at least one edge component; receiving a second input from a user on a first node component in the first process instance; In response to the second input, the processing logic parameters of the first node component are updated, and a second process instance is displayed through the canvas.

2. The visual operation process design method according to claim 1, characterized in that: The processing logic parameters of the first node component are updated by at least one of the following: Adjusting the running code of the first node component based on the target database form to obtain an updated first node component; The running code of the first node component is adjusted based on an online code editor to obtain the updated first node component.

3. The visual operation process design method according to claim 1, characterized in that: After displaying the second process instance on the canvas, the method further includes: Receive a third input from a user, where the third input is used to perform a tracking operation on a running code corresponding to a second node component in the second process instance; In response to the third input, first instruction information is generated so that the server can output the execution status and execution result of the running code corresponding to the second node component.

4. The visual operation process design method according to claim 1, characterized in that: After displaying the second process instance on the canvas, the method further includes: receiving a fourth input from a user, where the fourth input is used to monitor the running state of a third node component in the second process instance; In response to the fourth input, second instruction information is generated so that the server can output the operating status information of the third node component and issue an alarm for abnormal information in the operating status information.

5. The visual operation process design method according to claim 1, characterized in that: After displaying the second process instance on the canvas, the method further includes: receiving a fifth input from the user; In response to the fifth input, the second process instance is sent to the target server so that the server can perform data governance services, where the data governance services include at least one of code running, step-by-step debugging, and data reading and writing.

6. A data management method, applied to a server, characterized in that: include: receiving a sixth input from the user for the second process instance; The second process instance is determined based on the visual operation process design method according to any one of claims 1 to 5; In response to the sixth input, a data governance service is executed, wherein the data governance service includes at least one of code running, distributed debugging, point monitoring, and exception information monitoring.

7. A visual operation process design device, characterized in that: include: A first receiving module is used to receive a first input from a user in a visual operation interface, wherein the first input is determined based on a process design requirement; wherein the visual operation interface includes a plurality of node components, a plurality of edge components and a canvas, each node component includes at least one connection stub, and different nodes have different processing logics; A first response module, configured to respond to the first input and display a first process instance on the canvas; wherein the first process instance includes at least two node components and at least one edge component; A second receiving module, used to receive a second input from a user on a first node component in the first process instance; The second response module is used to respond to the second input, update the processing logic parameters of the first node component, and display the second process instance through the canvas.

8. A data management device, characterized in that: include: A third receiving module, used to receive a sixth input of the user on the second process instance; The second process instance is determined based on the visual operation process design method according to any one of claims 1 to 5; The third response module is used to respond to the sixth input and execute data governance business, and the data governance business includes at least one of code running, distributed debugging, point monitoring and exception information monitoring.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 6 is implemented.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images