A visualization method, system, medium and terminal for data lineage analysis

Abstract

The present invention belongs to the technical field of data visualization processing, and discloses a visualization method, system, medium, and terminal for data lineage analysis, which utilize visual elements of an operation interface to display the lineage relationship of data; switch at the same level according to the lineage relationship for the upward tracing and downward detection of the impact surface operation instructions of the data elements; and switch at different levels according to the lineage relationship for the drill-up and drill-down operation instructions of the data elements. The drill-down operation includes refining from the level of any current data element to the next level, including: drilling down from the database level to the table level, and drilling down from the table level to the field level. The present invention can display the lineage view of any data element. The present invention supports drill-up and drill-down operations on the current data element; supports tracing back and detecting operations on the current data element; and supports the switching function of data elements at the same level.

Description

Technical Field

[0001] The present invention belongs to the technical field of data visualization processing, and in particular, relates to a visualization method, system, medium and terminal for data lineage analysis. Background Art

[0002] At present, in the process of data governance, lineage analysis is a means to ensure the correct fusion (aggregation) of data, and the traceability of data fusion processing can be achieved through lineage analysis.

[0003] Data fusion is a data extraction process that spans data sources and data tables.

[0004] Usually, end users and operation and maintenance users need to pay most attention to what the data sources of each field in the target table are. That is, to establish a mapping relationship between a source table, source field and a target table, target field. Most existing technologies display this correspondence at both the table and field levels.

[0005] A target table can correspond to fields from multiple source tables. For example, in the target table named TABLE_NAME_5, field COLUMN_NAME_21 comes from some operation of COLUMNE_13 and COLUMN_NAME_15 of TABLE_NAME_3, and COLUMN_NAME_15 of TABLE_NAME_3 comes from COLUMN_NAME_10 of TABLE_NAME_2. This field can be traced back to field COLUMN_NAME_4 of source table TABLE_NAME_1.

[0006] Through the target table, you can clearly see the target fields of the target table, know the rules of data processing in the database, and clearly understand the source of data in each field.

[0007] In order to solve the above problems, the prior art CN113220944A - A method for visual display of blood relationship analysis based on power dispatching data discloses a method for visual display of blood relationship analysis based on power dispatching data, which is characterized by comprising the following procedural steps:

[0008] Step 1: Collect power dispatch data and organize it into a table and store it in the database;

[0009] Step 2: Establish a global hierarchical relationship mapping and a flow relationship mapping of the attribute description data based on the principle of blood relationship analysis for the collected power dispatching data to obtain the mapping relationship;

[0010] Step 3: Establish a visualization interface to display the distribution diagram of the hierarchical relationship and data forwarding relationship between power dispatching data based on the global hierarchical relationship mapping and the flow relationship mapping of attribute description data.

[0011] The collected power dispatching data is organized into a table form, each power dispatching data table is a data node, and the column information of each table is used as the attribute of the node, storing the field name, type, and attribute description;

[0012] In the table: field name stores the variable parameter with attribute description, type stores the format of field name, and attribute description stores the relevant information of the current data node;

[0013] The relevant information of the attribute description includes: inherent information that does not change during operation and operation monitoring data.

[0014] The inherent information that does not change during operation includes: device ID, device name, manufacturer, model, asset unit, contact number, email, rated capacity, and rated voltage;

[0015] The operation monitoring data include: operation data to be detected during the operation of the equipment: voltage level, operation status, administrative area code, boiler parameters, and nuclear power unit parameters.

[0016] The step of obtaining the global hierarchical relationship mapping includes:

[0017] The basic data in the collected power dispatching data is used as nodes and divided into levels; the levels between the node tables are used as the hierarchical relationship mapping between nodes to display the global hierarchical relationship of the power dispatching data displayed at the node level.

[0018] The basic data is a first-level node, including: organizational structure, power equipment container, primary energy object, power generation equipment, AC transmission equipment, substation equipment, DC transmission equipment, etc. The organizational structure includes the following second-level nodes: basic information of power grid companies, basic information of power generation companies, basic information of power grids, basic information of equipment suppliers, information of control centers, etc.; the power equipment container includes the following second-level nodes: basic information of power plants, wiring methods of power plants, basic information of hydropower plants, basic information of thermal power plants, basic information of nuclear power plants, basic information of new energy power stations, etc.; the primary energy object includes the following second-level nodes: basic information of rivers, basic information of run-of-river reservoirs, basic information of pumped-storage reservoirs, etc.; the power generation equipment includes the following second-level nodes: basic information of generators, static parameters of generators, parameters of wind turbines, parameters of nuclear power units, parameters of boilers, etc.; the AC transmission equipment includes the following second-level nodes: basic information of AC lines; the substation equipment includes the following second-level nodes: basic information of busbars, basic information of transformers, parameters of transformers, basic information of current transformers, basic information of voltage transformers, etc.; the DC transmission equipment includes the following second-level nodes: basic information of DC lines.

[0019] The acquisition of the flow direction relationship mapping of the attribute description data is divided into the following steps according to the data forwarding flow direction:

[0020] Define the sending node of the current attribute description data as the parent node and the receiving node as the child node, and query the forwarding relationship of all other node attribute description data related to any attribute description data of the current node;

[0021] The forwarding relationship of the node attribute description data is screened, deduplicated, summarized and aggregated to obtain the flow relationship mapping of any attribute description data used for query.

[0022] The visualization interface is used to display a global hierarchical relationship mapping distribution diagram of the power dispatching data table obtained according to the node hierarchy, and a flow relationship mapping distribution diagram of the attribute description data obtained according to the forwarding relationship of the attribute description data.

[0023] The global hierarchical relationship mapping distribution diagram is a tree-shaped hierarchical display diagram of the power dispatching data table displayed according to the level to which the nodes belong;

[0024] When you click on any attribute description in the power dispatch data table, a distribution diagram of the data forwarding flow relationship between nodes related to it is displayed;

[0025] When the table header name of the power dispatching data table is clicked, a distribution diagram of the data forwarding flow relationship mapping between all nodes related to the attribute description of the selected power dispatching data table is displayed.

[0026] Prior art 2 CN112632141A - Visualization method, device, computer equipment and medium for blood relationship analysis data, discloses a visualization method for blood relationship analysis data, including:

[0027] receiving a data visualization request from a user terminal; and

[0028] In response to the data visualization request, determine the data source node that needs to be visualized from the data visualization request, and determine the corresponding lineage data object from the data object table according to the data source node as the current lineage data object;

[0029] Determine whether the current bloodline data object has a dependent node;

[0030] If it exists, obtain the recursive layer number of each dependent node, and generate a bloodline relationship graph based on the current bloodline data object based on the bloodline coordinate algorithm and the recursive layer number, wherein the recursive layer number refers to the number of recursions that the current bloodline data object goes up layer by layer through the dependent nodes to find the data source node.

[0031] The obtaining of the number of recursive layers of each dependent node and generating a blood relationship graph based on the current blood relationship data object based on a blood relationship coordinate algorithm and the number of recursive layers includes:

[0032] Selecting one node from at least one of the dependent nodes as the basic coordinate node of the current bloodline data object;

[0033] Obtaining a bloodline coordinate algorithm corresponding to the basic coordinate node;

[0034] A blood relationship graph based on the current blood relationship data object is generated by using the acquired blood relationship coordinate algorithm and the number of nodes.

[0035] The algorithm for obtaining the bloodline coordinates corresponding to the basic coordinate node includes:

[0036] If the basic coordinate node is a dependent node corresponding to a first recursive layer number, the first lineage coordinate algorithm is used as the lineage coordinate algorithm, wherein the first recursive layer number is the maximum recursive layer number;

[0037] If the basic coordinate node is a dependent node corresponding to a second recursive layer, a second lineage coordinate algorithm is used as the lineage coordinate algorithm, wherein the second recursive layer is the recursive layer except the maximum recursive layer.

[0038] The method of generating a blood relationship diagram based on the current blood relationship data object by using the blood relationship coordinate algorithm obtained includes:

[0039] Calculate the number of child nodes on each dependent layer of the current lineage data object, wherein the dependent layer refers to the node layer where the child nodes with the same first node distance are located;

[0040] Calculating the expansion angle between two adjacent child nodes on the same dependency layer;

[0041] Calculate the node radius between each of the child nodes and the current blood relationship data object; and

[0042] Based on the number of nodes, the expansion angle and the node radius, the blood relationship graph is obtained through the blood relationship coordinate algorithm.

[0043] The obtaining of the blood relationship graph by using a blood relationship coordinate algorithm based on the number of nodes, the expansion angle, and the node radius includes:

[0044] pass

[0045] (X n+r*cos((mp)*θ1), Y n+r*sin((mp)*θ1))

[0046] Calculate the coordinates of each child node to obtain a blood relationship diagram based on the current blood relationship data object, where Xn refers to the X-axis coordinate of the current blood relationship data object, Yn refers to the Y-axis coordinate of the current blood relationship data object, θ1 refers to the expansion angle, r refers to the node coordinate, p refers to the pth child node on the same dependency layer, m refers to (k-1) / 2, and k refers to the number of child nodes on the same dependency layer.

[0047] The obtaining of the blood relationship graph by using a blood relationship coordinate algorithm based on the number of nodes, the expansion angle, and the node radius includes:

[0048] (X n+(h max-h min+1)*r*cos((mp)*θ1), Y n+(h max-h min+1)*r*sin((mp)*θ1))

[0049] Calculate the coordinates of each child node to obtain a blood relationship diagram based on the current blood relationship data object, where Xn refers to the X-axis coordinate of the current blood relationship data object, Yn refers to the Y-axis coordinate of the current blood relationship data object, θ1 refers to the expansion angle, r refers to the node coordinate, p refers to the pth child node on the same dependency layer, m refers to (k-1) / 2, k refers to the number of child nodes on the same dependency layer, hmax refers to the maximum number of recursive layers, and hmin is the number of recursive layers of the selected basic coordinate node.

[0050] The calculating the number of child nodes on each dependent layer of the current lineage data object includes:

[0051] Acquire a data object table, wherein the data object table includes mapping relationships between various lineage data objects;

[0052] Determine the dependency relationship between the bloodline data objects according to the mapping relationship;

[0053] Based on the dependency relationship, the number of child nodes on each dependency layer of the current lineage data object is determined to obtain the number of nodes.

[0054] Prior art 3 CN111694858A - Data lineage analysis method, device, equipment and computer-readable storage medium, discloses a data lineage analysis method, including the following steps:

[0055] Obtaining an input table, an output table, and a blood relationship between the input table and the output table of a structured query language SQL statement currently executed on the big data platform;

[0056] Converting the input table and the output table into entity objects under a preset type system respectively, and storing the entity objects in a preset graphic database;

[0057] According to the blood relationship, construct a blood relationship map between the entity objects in the graphic database;

[0058] Receiving a mapping relationship between a business source table and a big data table sent by a data access platform, wherein the data access platform is used to extract business data from the business source table of a relational business database and transfer it to the big data table of the big data platform, and in the process of extracting business data, record the mapping relationship between the business source table and the big data table;

[0059] According to the mapping relationship, determining the target entity object node to which the ancestor node is to be added in the blood relationship map;

[0060] A corresponding ancestor node is added to the target entity object node to obtain a target blood relationship graph, wherein the ancestor node is used to represent an entity object converted from the business source table of the target entity object.

[0061] The step of obtaining the input table, the output table, and the blood relationship between the input table and the output table of the structured query language SQL statement currently executed on the big data platform includes:

[0062] Through the preset hook program, monitor the structured query language SQL statements currently executed on the big data platform;

[0063] The monitored SQL statement is parsed by a preset syntax parser and lexical parser to obtain an input table, an output table, and a blood relationship between the input table and the output table of the SQL statement.

[0064] The step of constructing a blood relationship map between the entity objects in the graphic database according to the blood relationship comprises:

[0065] Calling a preset graph processing engine, and creating entity object nodes corresponding to the input table and the output table in the graph database through the graph processing engine;

[0066] According to the blood relationship, directed edges are added between the created entity object nodes to generate a blood relationship graph between the entity objects.

[0067] The step of determining the target entity object node to which the ancestor node is to be added in the blood relationship graph according to the mapping relationship comprises:

[0068] Obtaining the table name of the big data table in the mapping relationship;

[0069] Determine whether there is an entity object node corresponding to the table name in the blood relationship map;

[0070] If there is an entity object node corresponding to the table name in the blood relationship map, the entity object node corresponding to the table name is determined as the target entity object node to which the ancestor node is to be added.

[0071] After the step of adding a corresponding ancestor node to the target entity object node to obtain a target blood relationship graph, wherein the ancestor node is used to represent an entity object converted from a business source table of the target entity object, the step further includes:

[0072] Determining the entity object node to be analyzed in the target blood relationship map;

[0073] Acquire the business associated with the entity object node to be analyzed, and count the number of chains of the blood relationship chain containing the entity object node to be analyzed;

[0074] Comparing the number of chains with a first preset threshold and a second preset threshold respectively, the first preset threshold being greater than the second preset threshold;

[0075] When the number of chains is greater than or equal to the first preset threshold, marking the business associated with the entity object node to be analyzed as a hot business;

[0076] When the number of chains is less than or equal to the second preset threshold, the business associated with the entity object node to be analyzed is marked as a cold business.

[0077] After the step of adding a corresponding ancestor node to the target entity object node to obtain a target blood relationship graph, wherein the ancestor node is used to represent an entity object converted from a business source table of the target entity object, the step further includes:

[0078] Receiving a query instruction based on the target blood relationship map through a preset user interaction page;

[0079] According to the query instruction, the target data blood relationship analysis map is sent to the user interaction page for visual display.

[0080] After the step of sending the target data blood relationship analysis map to the user interaction page for visual display according to the query instruction, the method further includes:

[0081] According to a preset receiving frequency, receiving a mapping relationship between a business source table and a large data table sent by the data access platform;

[0082] Determine whether the mapping relationship has been updated, and detect whether a new SQL statement has been executed on the big data platform;

[0083] If the mapping relationship is updated, or a new SQL statement is executed on the big data platform, the target blood relationship map is updated accordingly.

[0084] Through the above analysis, the problems and defects of the prior art are as follows:

[0085] (1) In more complex scenarios, the field connection lines will appear complicated and difficult to understand. This is not very practical.

[0086] (2) It is impossible to describe the blood relationship of data at a higher level than the data table, so as to understand the data relationship in complex scenarios from a high-level perspective. At the database level, current technology cannot understand which upstream databases a database extracts data from and which databases it provides data for; at the subsystem level higher than the database, existing technology cannot understand the data source (ODS subsystem, master data subsystem, etc.) of a subsystem (data warehouse system) and the data flow (various data marts, data service subsystems, etc.).

[0087] (3) It is impossible to switch perspectives at the system, database, table, field, and other levels. For example, the operator may first observe the data relationship between subsystems from a global perspective, and then drill down layer by layer to the field level to explore the data source of a specific report, resulting in low work efficiency.

[0088] The difficulty in solving the above problems and defects lies in the innovation in operation. It is necessary to use the interactive operation described in the present invention on the blood relationship analysis interface to solve the above problems.

[0089] The significance of solving the above problems and defects is:

[0090] (1) Expand the traditional lineage analysis from table structure tracing to the database and system level.

[0091] (2) The visualization interface provided by the present invention allows users to perform operations such as tracing back, ascending, exploring, drilling up, and drilling down on data in one operation interface, and quickly query the source and flow of data at the same level and across levels, thereby improving work efficiency. Summary of the invention

[0092] In view of the problems existing in the prior art, the present invention provides a visualization method, system, medium and terminal for data lineage analysis.

[0093] The present invention is implemented as follows: a visualization method for data lineage analysis, comprising:

[0094] Use the operation interface to display the blood relationship of data elements;

[0095] Switch the input upward tracing and downward detection impact surface operation instructions at the same level according to the blood relationship;

[0096] The input drill-up and drill-down operation instructions are switched at different levels according to the blood relationship.

[0097] Furthermore, the visual elements include:

[0098] Wireframe diagram, used to display the data element of current focus. The wireframe title bar displays the name of the element at the previous level, and the content bar displays the name of the current element;

[0099] Start node: used to indicate the upstream starting point;

[0100] Termination node: used to indicate the downstream end point;

[0101] Data connection line: used to indicate the upstream and downstream relationship of data;

[0102] Wireframe content area operation drop-down list: appears after clicking the wireframe content area, and is used to list the subset elements of the current data element, as well as two operation bars. The first operation bar is used for subset element search and upward tracing and downward detection of impact surface operations, and the second operation bar is used for drill-up operations.

[0103] Wireframe title area operation drop-down list: appears after clicking the wireframe title area, used to list the same-level elements of the current data element.

[0104] Furthermore, the upward tracing operation instruction includes:

[0105] Click the wireframe content bar in the operation interface to display the wireframe content area drop-down list;

[0106] Receive the upstream instruction of the first operation bar in the operation drop-down list, and the operation interface will increase the display of the upstream elements of the wireframe diagram and connect the current wireframe diagram through the data connection line; if there is no upstream element, the starting node will be displayed.

[0107] Further, the downward detection influence surface operation instruction includes:

[0108] Click the wireframe content bar in the operation interface to display a drop-down list for wireframe content area operations;

[0109] Receive the downward instruction of the first operation bar in the operation drop-down list, and the operation interface will add the downstream element display of the wireframe diagram and connect the current wireframe diagram through the data connection line; if there is no downstream element, the termination node will be displayed.

[0110] Further, the drill-down operation instruction includes:

[0111] Click the wireframe content bar in the operation interface to display the wireframe content area drop-down list;

[0112] Click the second operation item in the operation drop-down list to perform a drill-down operation on any subset element. Drill down from the current level of any subset element to the next level, including: from the database level, drill down to the table level, and from the table level, drill down to the field level.

[0113] Further, the drill-up operation instruction includes:

[0114] Click the wireframe content bar in the operation interface to display the wireframe content area drop-down list;

[0115] Click the Drill Up button in the first operation bar of the Operation drop-down list to perform the Drill Up operation. Drill up from the level of any current subset element to the previous level, including drilling up from the field level to the table level, from the table level to the database level, and from the database level to the subsystem level.

[0116] Furthermore, in the drop-down list in the wireframe content area, you can also perform element query operations:

[0117] Click the wireframe content bar or title bar, and the interface will display the "Wireframe content area operation drop-down list". Enter keywords in the text box of the first operation bar in the list, and the interface will perform fuzzy matching based on the keywords. The drop-down box will only display the matched subset elements.

[0118] Another object of the present invention is to provide a visualization system for data lineage analysis, including an operation interface;

[0119] The operation interface includes: a visual element display module for displaying the blood relationship of visual elements;

[0120] The same-level switching module is used to switch the input upward tracing and downward detection of the impact surface operation instructions at the same level according to the blood relationship;

[0121] The different level switching modules are used to switch the input drill-up and drill-down operation instructions at different levels according to the blood relationship.

[0122] Another object of the present invention is to provide an information data processing terminal, which includes a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the visualization method of data lineage analysis.

[0123] Another object of the present invention is to provide a computer-readable storage medium storing a computer program, which, when executed by a processor, enables the processor to perform the visualization method of data lineage analysis.

[0124] Combining all the above technical solutions, the advantages and positive effects of the present invention are as follows:

[0125] The present invention proposes a lineage visualization method that supports drill-up and drill-down operations. The method provides an operation interface that allows the user to focus on an element (e.g., a field, a table) and perform up and down tracing. Elements at the same level can be switched at any time, such as switching different fields of the same table, switching different tables in the same database. At the same time, drill-up and drill-down operations are provided, and switching between different levels is possible.

[0126] Compared with the prior art, the present invention will bring the following positive effects as follows:

[0127]

[0128] The visualization method for data lineage analysis provided by the present invention can display the lineage relationship view of any data element.

[0129] Supports drill-up operations from the current data element level to the upper level, such as: from the field level, drill-up to the table level, from the table level to the database level, from the database level, drill-up to the subsystem level, etc.

[0130] Supports drill-down operations, from the current data element level to the next level, such as: from the database level, drill down to the table level, from the table level, drill down to the field level, etc.

[0131] The function of switching data elements at the same level, such as: currently displaying the blood relationship of field one of a table, you can switch to other fields of the table at any time to display the blood relationship of other fields. BRIEF DESCRIPTION OF THE DRAWINGS

[0132] Figure 1 It is a flow chart of a visualization method for data lineage analysis provided by an embodiment of the present invention.

[0133] Figure 2 It is a block diagram of a visual element provided by an embodiment of the present invention.

[0134] Figure 3 It is a schematic diagram of a wireframe content area drop-down list provided by an embodiment of the present invention.

[0135] Figure 4 It is a schematic diagram of a drop-down list in a wireframe title area provided by an embodiment of the present invention.

[0136] Figure 5 This is a diagram of an interface of a deposit asset table of a user asset library provided by an embodiment of the present invention.

[0137] Figure 6This is a diagram of a content area drop-down list interface provided by an embodiment of the present invention.

[0138] Figure 7 This is a page refresh switching to the upward tracing result interface diagram provided by an embodiment of the present invention.

[0139] Figure 8 This is a diagram of a page refresh switching to a drop-down result interface provided by an embodiment of the present invention.

[0140] Fig. 9 This is a search element interface diagram provided by an embodiment of the present invention

[0141] Fig.10 This is a drill-down operation provided by an embodiment of the present invention. Click on any subset element interface.

[0142] Fig.11 This is a drill-down result interface diagram provided by an embodiment of the present invention

[0143] Fig.12 The embodiment of the present invention provides a content area drop-down list, and the interface diagram before the drill-up operation is executed

[0144] Fig.13 This is a diagram of the drill-down result interface provided by an embodiment of the present invention.

[0145] Fig.14 The present invention provides a wireframe title area drop-down list interface diagram

[0146] Fig.15 The present invention provides a same-layer element switching result interface diagram DETAILED DESCRIPTION

[0147] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0148] In view of the problems existing in the prior art, the present invention provides a visualization method, system, medium and terminal for data lineage analysis. The present invention is described in detail below with reference to the accompanying drawings.

[0149] like Figure 1 As shown, the visualization method of data lineage analysis provided by the embodiment of the present invention includes the following steps:

[0150] S101, using the operation interface to display the blood relationship of visual elements.

[0151] S102, search element operation, the operation interface receives the input wireframe content bar or title bar instruction, displays the operation drop-down list, obtains the input keyword in the text box of the first operation bar in the operation drop-down list, performs fuzzy matching based on the keyword, and the operation drop-down list drop-down box only displays the matched subset elements.

[0152] S103, switching the input upward tracing and downward detecting influence surface operation instructions at the same level according to the blood relationship; switching the input up-drilling and down-drilling operation instructions at different levels according to the blood relationship.

[0153] In step S101, the visual elements include:

[0154] Wireframe diagram, used to display the data element of current focus. The wireframe title bar displays the name of the element at the previous level, and the content bar displays the name of the current element;

[0155] Start node: used to indicate the upstream starting point;

[0156] Termination node: used to indicate the downstream end point;

[0157] Data connection line: used to indicate the upstream and downstream relationship of data;

[0158] Wireframe content area drop-down list: used to list subset elements of the current data element, and two operation bars. The first operation bar is used for subset element search and upward tracing, downward detection of impact surface operations and upward drilling operations. The second operation bar is used to display the subordinate elements of the current element and perform downward drilling operations.

[0159] Wireframe title area drop-down list: appears after clicking the wireframe title area, and is used to list the sibling elements of the current data element. Clicking a sibling element will display the blood relationship of the element.

[0160] In step S103, the upward tracing operation instruction includes:

[0161] Click the wireframe content bar in the operation interface to display the "wireframe content area drop-down list";

[0162] Receive the upstream instruction of the first operation bar in the operation drop-down list, and the operation interface will increase the display of the upstream elements of the wireframe diagram and connect the current wireframe diagram through the data connection line; if there is no upstream element, the starting node will be displayed.

[0163] The downward detection influence surface operation instruction includes:

[0164] Click the wireframe content bar in the operation interface to display the "wireframe content area drop-down list";

[0165] Receive the downward instruction of the first operation bar in the operation drop-down list, and the operation interface will add the downstream element display of the wireframe diagram and connect the current wireframe diagram through the data connection line; if there is no downstream element, the termination node will be displayed.

[0166] In step S103, the drill-down operation instruction includes:

[0167] Click the wireframe title bar in the operation interface to display the "wireframe content area drop-down list";

[0168] Receive any current subset element, click the element in the second operation bar of the operation drop-down list to perform a drill-down operation, and drill down from the level of any current subset element to the next level, including: from the database level, drill down to the table level, and from the table level, drill down to the field level.

[0169] In step S103, the drill-up operation instruction includes:

[0170] Click the wireframe content area in the operation interface to display the wireframe content area operation drop-down list;

[0171] Click the drill-up button in the first operation bar of the drop-down list to perform the drill-up operation.

[0172] From the level of any current subset element, move up to the previous level, including drilling up from the field level to the table level, drilling up from the table level to the database level, and drilling up from the database level to the subsystem level.

[0173] Another object of the present invention is to provide a visualization system for data lineage analysis, including an operation interface;

[0174] The operation interface includes: a visual element display module for displaying the blood relationship of visual elements;

[0175] The same-level switching module is used to switch the input upward tracing and downward detection of the impact surface operation instructions at the same level according to the blood relationship;

[0176] The different level switching modules are used to switch the input drill-up and drill-down operation instructions at different levels according to the blood relationship.

[0177] The visualization method of data lineage analysis provided by the present invention displays the lineage relationship view of any data element.

[0178] Supports drill-up operations from the current data element level to the upper level, such as: from the field level, drill-up to the table level, from the table level to the database level, from the database level, drill-up to the subsystem level, etc.

[0179] Supports drill-down operations, from the current data element level to the next level, such as: from the database level, drill down to the table level, from the table level, drill down to the field level, etc.

[0180] The function of switching data elements at the same level, such as: currently displaying the blood relationship of field one of a table, you can switch to other fields of the table at any time to display the blood relationship of other fields.

[0181] The visualization method of data lineage analysis provided by the present invention can also be implemented by ordinary technicians in the industry using other steps. Figure 1 The visualization method for data lineage analysis provided by the present invention is only a specific embodiment.

[0182] The technical solution of the present invention is further described below in conjunction with specific embodiments.

[0183] Embodiment 1:

[0184] In the present invention, the visual elements involved are as follows Figure 2 shown.

[0185] Among them, the wireframe diagram: displays the data element currently in focus, the wireframe title bar displays the name of the element at the previous level, and the content bar displays the name of the current element.

[0186] Starting node: A circle diagram, indicating the upstream starting point.

[0187] End Node: A square diagram representing the downstream endpoint.

[0188] Data connection line: indicates the upstream and downstream relationship of data.

[0189] The wireframe content area drop-down list is as follows Figure 3 As shown: Clicking the wireframe content area displays a drop-down list of the wireframe content area, which includes subset elements of the current data element and two operation bars, one of which is used for "subset element search" and "upward tracing", "downward detection of impact surface operation", and "up drilling", and the other displays the subset elements of the current element and is used for "down drilling" operations.

[0190] The wireframe title area drop-down list is as follows Figure 4 As shown: Clicking the wireframe title area will display a drop-down list of the wireframe title area, which contains the same set elements of the current data element. Clicking a same-level element will display the blood relationship of the element.

[0191] Embodiment 2:

[0192] Based on the above visual elements, the present invention further provides the following basic operations:

[0193] (1) "Upward tracing" operation: Click the content bar of the wireframe diagram, and the interface will display the "Wireframe diagram content area drop-down list". Click the "upward tracing" icon button in the first operation bar of the list. The interface will add the upstream element of the wireframe diagram and connect the current wireframe diagram through the data connection line. If there is no upstream element, the "starting node" will be displayed. For example:

[0194] 1) Click on the "Deposit Assets Table" area of ​​the User Asset Library, such as Figure 5 Shown

[0195] 2) Display the "Wireframe Content Area Drop-down List" and click the "Up" button. Figure 6 shown.

[0196] 3) After clicking the "Up" button, the page refreshes and switches to the up-tracking results, such as Figure 7 shown.

[0197] (2) "Downward detection of the impact surface" operation: Click the wireframe content bar, the interface will display the "operation drop-down list", click the "downward detection" icon button in the first operation bar of the list, the interface will add the downstream element of the wireframe and connect the current wireframe through the data connection line. If there is no downstream element, the "end node" will be displayed. For example:

[0198] 1) Click on the deposit asset table in the user asset library, such as Figure 5 shown.

[0199] 2) The "Wireframe Content Area Drop-down List" pops up, and then click the "Drop Down" button, such as Figure 6 shown.

[0200] 3) After clicking "Drill Down", the page refreshes and switches to the drilling results, such as Figure 8 shown.

[0201] (3) "Find Element" operation: Click the wireframe content bar or title bar, and the interface will display the "Wireframe Content Operation Drop-down List" or "Wireframe Title Bar Drop-down List". Enter a keyword in the text box of the first operation bar in the list, and the interface will perform fuzzy matching based on the keyword. The drop-down box will only display the matched subset elements. For example:

[0202] 1) In the "Wireframe Content Area Drop-down List", click "Search Box", such as Figure 6 shown.

[0203] 2) Enter keywords in the "Search Box" and the interface will perform fuzzy matching based on the keywords. The drop-down box will display the matched subset elements, such as Fig. 9 shown.

[0204] (4) "Drill down" operation: Click the wireframe content bar, the interface will display the "wireframe content area drop-down list", click any subset element of the data, the current page will refresh, the wireframe content bar will display the element, and the title bar will display its parent element. Its upstream and downstream elements will change synchronously. For example:

[0205] 1) In the "Wireframe Content Area Drop-down List", click "Any Subset Element", such as Fig.10 shown.

[0206] 2) After clicking "Any Subset Element", the current page is refreshed and the drill-down results are displayed, such as Fig.11 shown.

[0207] (5) “Drill up” operation: Click the wireframe content bar, and the interface will display the “Wireframe content area drop-down list”. Click the “Drill up to previous level” icon button in the second operation bar of the list. The content bar of the title bar will display the parent element of the current element, and the title bar will display the parent element of the parent element. The upstream and downstream elements will change synchronously.

[0208] 1) In the "Wireframe Content Area Drop-down List", click the "Drill Up" button, such as Fig.12 shown.

[0209] 2) After clicking the "Drill Up" button, the drill up results are displayed, such as Fig.13 shown.

[0210] (6) "Same-layer switching operation": Click the wireframe title bar, and the interface will display the "wireframe title area drop-down list", which will list all data elements on the same layer. Click the element to be switched, and the content bar of the wireframe will display the selected element. At the same time, its upstream and downstream elements will change synchronously. For example:

[0211] 1) Click the title bar of the User Asset Library, "User Asset Library" area, such as Fig.14 Shown

[0212] 2) Display the "Wireframe Title Area Drop-down List", click "Any Same Layer Element", and the same layer element will be switched, such as Fig.15 shown.

[0213] Embodiment 3:

[0214] In one embodiment of the present invention, it can be developed through a variety of general software technologies, such as: browser-based JS+HTML, desktop application-based C# / WINFORM, JAVA / SWT / javaFx, QT5 / C++, QT5 / phython, etc.

[0215] The bloodline analysis method of the present invention achieved the first place in the POC of the data asset management project of Nanjing Bank and was highly praised by the bank.

[0216] It should be noted that the embodiments of the present invention can be implemented by hardware, software, or a combination of software and hardware. The hardware part can be implemented using dedicated logic; the software part can be stored in a memory and executed by an appropriate instruction execution system, such as a microprocessor or dedicated design hardware. It can be understood by a person of ordinary skill in the art that the above-mentioned devices and methods can be implemented using computer executable instructions and / or contained in a processor control code, such as a carrier medium such as a disk, CD or DVD-ROM, a programmable memory such as a read-only memory (firmware), or a data carrier such as an optical or electronic signal carrier. Such code is provided on the carrier medium. The device and its modules of the present invention can be implemented by hardware circuits such as very large-scale integrated circuits or gate arrays, semiconductors such as logic chips, transistors, etc., or programmable hardware devices such as field programmable gate arrays, programmable logic devices, etc., can also be implemented by software executed by various types of processors, and can also be implemented by a combination of the above-mentioned hardware circuits and software, such as firmware.

[0217] The above description is only a specific implementation mode of the present invention, but the protection scope of the present invention is not limited thereto. Any modifications, equivalent substitutions and improvements made by any technician familiar with the technical field within the technical scope disclosed by the present invention and within the spirit and principle of the present invention should be covered by the protection scope of the present invention.

Claims

1. A visualization method for data lineage analysis, characterized in that: The visualization method of data lineage analysis includes: Use the operation interface to show the blood relationship of visual elements; According to the blood relationship, the upward tracing instructions and downward detection influence surface operation instructions of the data elements are switched and displayed at the same level; according to the blood relationship, the upward and downward drilling operation instructions of the data elements are switched and displayed at different levels; The visual elements include: Wireframe diagram, used to display the data element of current focus. The wireframe title bar displays the name of the element at the previous level, and the content bar displays the name of the current element; Start node: used to indicate the upstream starting point; Termination node: used to indicate the downstream end point; Data connection line: used to indicate the upstream and downstream relationship of data; Wireframe content area drop-down list: used to list subset elements of the current data element, and two operation bars. The first operation bar is used for subset element search and upward tracing, downward detection of impact surface operations and upward drilling operations. The second operation bar is used to display the subordinate elements of the current element and perform downward drilling operations. Wireframe title area drop-down list: appears after clicking the wireframe title area, used to list the same-level elements of the current data element; click a same-level element to display the blood relationship of the element; The drill-down operation instruction includes: Click the wireframe content bar in the operation interface to display the wireframe content area drop-down list; Receive any current subset element, click the element in the second operation bar of the operation drop-down list to perform a drill-down operation, and drill down from the level of any current subset element to the next level, including: from the database level, drill down to the table level, and from the table level, drill down to the field level.

2. The visualization method for data lineage analysis according to claim 1, characterized in that: The upward tracing operation instruction includes: Click the wireframe content bar in the operation interface to display the wireframe content area drop-down list; Receive the upstream instruction of the first operation bar in the operation drop-down list, and the operation interface will increase the display of the upstream elements of the wireframe diagram and connect the current wireframe diagram through the data connection line; if there is no upstream element, the starting node will be displayed.

3. The visualization method for data lineage analysis according to claim 1, characterized in that: The downward detection influence surface operation instruction includes: Click the wireframe content bar in the operation interface to display the wireframe content area drop-down list; Receive the downward instruction of the first operation bar in the operation drop-down list, and the operation interface will add the downstream element display of the wireframe diagram and connect the current wireframe diagram through the data connection line; if there is no downstream element, the termination node will be displayed.

4. The visualization method for data lineage analysis according to claim 1, characterized in that: The drilling operation instruction includes: Click the wireframe content bar in the operation interface to display the wireframe content area drop-down list; Click the drill-up button in the first operation bar of the drop-down list to perform the drill-up operation; From the level of any current subset element, move up to the previous level, including drilling up from the field level to the table level, drilling up from the table level to the database level, and drilling up from the database level to the subsystem level.

5. The visualization method for data lineage analysis according to claim 1, characterized in that: Before executing the drill-up and drill-down operation instructions, you must also: Find element operation, the operation interface receives the input wireframe content bar or title bar command, displays the operation drop-down list, obtains the input keyword in the text box of the first operation bar in the operation drop-down list, and performs fuzzy matching based on the keyword. The operation drop-down list drop-down box only displays the matched subset elements.

6. A data lineage analysis visualization system implementing the data lineage analysis visualization method according to any one of claims 1 to 5, characterized in that: The visualization system for data lineage analysis includes an operation interface; The operation interface includes: Visual element display module, used to display the blood relationship of visual elements; The same-level switching module is used to switch the input upward tracing and downward detection of the impact surface operation instructions at the same level according to the blood relationship; The different level switching modules are used to execute the operation instructions of the input drill-up and drill-down according to the blood relationship and switch at different levels.

7. An information data processing terminal, characterized in that: The information data processing terminal includes a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the visualization method for data lineage analysis as described in any one of claims 1 to 5.

8. A computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, the processor executes the visualization method for data lineage analysis according to any one of claims 1 to 5.

Images