Index blood relationship construction method and device, electronic equipment and computer program product

Abstract

The invention discloses an index blood relationship construction method and device, electronic equipment and a computer program product. The index blood relationship construction method comprises the steps that index configuration information configured by a user is acquired, and the index configuration information comprises an index calculation formula; analyzing the index blood relationship according to the index configuration information to obtain an analysis result of the index blood relationship; processing the index calculation formula by using a tree topology structure to generate a calculation formula of the tree topology structure; according to the analysis result of the index blood relationship and the calculation formula of the tree topology structure, index calculation is carried out in parallel, and an index calculation result is obtained; and generating an index blood relationship graph according to the index calculation result. According to the method, the index blood relationship of the data calculation link is realized, the method has a visual data link tracking capability, and the problems of long time consumption and complex path in data problem checking are solved; the method is not limited by blood relationship levels, index calculation can be completed in parallel, the data processing speed and efficiency are improved, and the calculation cost is saved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a method, device, electronic equipment, and computer program product for constructing an indicator blood relationship. Background Art

[0002] In the field of financial business, commonly used indicators can be divided into basic indicators and composite indicators. Basic indicators are the most basic data summarized by dimensions such as tellers and institutions, such as the number of transactions, transaction amount, number of transaction users, etc. Composite indicators are data calculated based on basic indicators or other composite indicators, such as revenue rate, debt ratio, comprehensive revenue growth, etc. The calculation of composite indicators can be very complex, involving indicators at multiple levels. Usually users can only see the calculation results of the final indicator, and the calculation process of the final indicator is a black box for users. If data problems occur, the tracing process is also very long, and developers are required to help locate and analyze. There is currently no relevant technical solution to solve this problem.

[0003] Indicator lineage refers to the various relationships formed between indicators during their entire life cycle. These relationships are like human lineage, so they are called indicator lineage. Indicator lineage is an important part of the indicator system. It can not only help us analyze the lineage paths between indicators, but also trace the lineage paths of indicator data under the same dimension.

[0004] In the field of data governance, there is a similar concept called data lineage. There are two common types of data lineage: table-level and field-level. They can help us analyze the lineage path of tables and fields from the data source to the current location. There are some open source data lineage components in the industry, such as Apache Atlas. However, the implementation principles of data lineage and indicator lineage are completely different. Data lineage, such as Atlas, is usually based on the parsing of AST syntax trees.

[0005] Therefore, how to make the calculation links of all indicators transparent and build the blood relationship of indicators has become a technical problem that urgently needs to be solved. Summary of the invention

[0006] The embodiments of the present application provide a method, device, electronic device, and computer program product for constructing an indicator blood relationship to realize the indicator blood relationship of a data computing link and intuitive data link tracking capabilities.

[0007] The present application embodiment adopts the following technical solutions:

[0008] In a first aspect, an embodiment of the present application provides a method for constructing an indicator blood relationship, the method comprising:

[0009] Obtaining indicator configuration information configured by a user, wherein the indicator configuration information includes an indicator calculation formula;

[0010] Analyzing the indicator blood relationship according to the indicator configuration information to obtain the analysis result of the indicator blood relationship;

[0011] Processing the indicator calculation formula using a tree topology structure to generate a calculation formula of a tree topology structure;

[0012] The indicator calculation is performed in parallel according to the analytical result of the indicator blood relationship and the calculation formula of the tree topological structure to obtain the indicator calculation result;

[0013] An indicator blood relationship diagram is generated according to the indicator calculation results.

[0014] Optionally, the obtaining of the indicator configuration information configured by the user includes:

[0015] Get the user-configured indicators and indicator calculation formulas;

[0016] The indicators include basic indicators and composite indicators, and the indicator calculation formula includes at least one of a basic operator and a custom operator.

[0017] Optionally, parsing the indicator blood relationship according to the indicator configuration information to obtain the parsing result of the indicator blood relationship includes:

[0018] A graph model element defining an indicator blood relationship based on a graph model, wherein the graph model element of the indicator blood relationship includes nodes, edges, and node attributes;

[0019] Analyze the indicator blood relationship according to the graph model elements of the indicator blood relationship and the indicator configuration information, and generate a graph model of the indicator blood relationship;

[0020] The graph model of the indicator blood relationship is stored in a graph database.

[0021] Optionally, the indicator calculation formula is processed by using a tree topology structure to generate a calculation formula of a tree topology structure, including:

[0022] Recursively expand the indicator calculation formula using a tree topological structure to obtain a recursively expanded indicator calculation formula;

[0023] The UDF function is used to process the special values ​​in the recursive expansion process to obtain the special value processing results;

[0024] The calculation formula of the tree topology structure is constructed according to the index calculation formula after the recursive expansion and the special value processing result.

[0025] Optionally, the tree topology structure includes a plurality of computing nodes, and the indicator calculation is performed in parallel according to the analysis result of the indicator blood relationship and the calculation formula of the tree topology structure, and the indicator calculation result obtained includes:

[0026] Read the detailed indicator data associated with each computing node;

[0027] According to the calculation formula and UDF function of the tree topology structure, the indicator detailed data associated with each calculation node are respectively calculated in parallel to obtain the indicator calculation results of each calculation node.

[0028] Optionally, the calculation formula and UDF function of the tree topology structure are used to perform parallel calculations on the indicator detail data associated with each computing node to obtain the indicator calculation results of each computing node, including:

[0029] Dividing the indicator detail data associated with each computing node into multiple batches using a computing model, wherein the computing model includes at least one of an offline computing model and a real-time computing model;

[0030] According to the calculation formula and UDF function of the tree topology structure, multiple batches of indicator detail data associated with each computing node are respectively calculated in parallel to obtain the indicator calculation results of each computing node.

[0031] Optionally, generating an indicator blood relationship diagram according to the indicator calculation result includes:

[0032] Based on the blood dependency relationship between the indicators, an indicator blood relationship diagram is generated and displayed according to the indicator calculation results;

[0033] The blood relationship between the indicators includes upstream blood dependency relationship and downstream blood dependency relationship.

[0034] In a second aspect, the embodiment of the present application further provides an indicator blood relationship construction device, the indicator blood relationship construction device comprising:

[0035] An acquisition unit, used to acquire indicator configuration information configured by a user, wherein the indicator configuration information includes an indicator calculation formula;

[0036] A parsing unit, used for parsing the indicator blood relationship according to the indicator configuration information to obtain a parsing result of the indicator blood relationship;

[0037] A processing unit, used to process the indicator calculation formula using a tree topology structure to generate a calculation formula of the tree topology structure;

[0038] A calculation unit, used to perform indicator calculation in parallel according to the analysis result of the indicator blood relationship and the calculation formula of the tree topological structure to obtain the indicator calculation result;

[0039] A generating unit is used to generate an indicator blood relationship diagram according to the indicator calculation result.

[0040] In a third aspect, an embodiment of the present application further provides an electronic device, including:

[0041] Processor; and

[0042] A memory arranged to store computer executable instructions, which, when executed, cause the processor to perform any of the aforementioned indicator blood relationship construction methods.

[0043] In a fourth aspect, an embodiment of the present application further provides a computer program product, including a computer program or instructions, which, when executed by a processor, implements any of the aforementioned methods for establishing indicator blood relationships.

[0044] At least one of the above technical solutions adopted in the embodiments of the present application can achieve the following beneficial effects: the indicator blood relationship construction method of the embodiment of the present application first obtains the indicator configuration information configured by the user, and the indicator configuration information includes the indicator calculation formula; then the indicator blood relationship is analyzed according to the indicator configuration information to obtain the analysis result of the indicator blood relationship; then the indicator calculation formula is processed using the tree topology structure to generate the calculation formula of the tree topology structure; then the indicator calculation is performed in parallel according to the analysis result of the indicator blood relationship and the calculation formula of the tree topology structure to obtain the indicator calculation result; finally, the indicator blood relationship diagram is generated according to the indicator calculation result. The indicator blood relationship construction method of the embodiment of the present application realizes the indicator blood relationship of the data calculation link, has an intuitive data link tracking capability, solves the problem of time-consuming and complex paths in troubleshooting data problems; is not restricted by the blood relationship level, can complete the indicator calculation in parallel, improves the speed and efficiency of data processing, and saves computing costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0046] Figure 1 This is a flow chart of a method for constructing a blood relationship of an indicator in an embodiment of the present application;

[0047] Figure 2 A schematic diagram of a calculation formula and a calculation process based on a tree topology structure in an embodiment of the present application;

[0048] Figure 3 This is a schematic diagram of the construction effect of an indicator blood relationship diagram in an embodiment of the present application;

[0049] Figure 4 This is a schematic diagram of detailed indicator data under a specified dimension in an embodiment of the present application;

[0050] Figure 5 This is a schematic diagram of the overall process of constructing a blood relationship of an indicator in an embodiment of the present application;

[0051] Figure 6 This is a schematic diagram of the structure of an indicator blood relationship construction device in an embodiment of the present application;

[0052] Figure 7 It is a schematic diagram of the structure of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0054] The technical solutions provided by various embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0055] The solutions for constructing the indicator blood relationship in the prior art have at least the following problems:

[0056] 1) To check the indicator relationship and indicator calculation caliber, developers need to check the code, which consumes a lot of manpower;

[0057] 2.) The calculation of indicators for multi-level blood relationships needs to be calculated in a fixed order. The downstream indicators can only be calculated after the upstream indicators are calculated. The deeper the blood relationship level, the longer it takes and consumes a lot of computing resources.

[0058] Based on this, the present application embodiment provides a method for constructing an indicator blood relationship, such as Figure 1 As shown, a flow chart of a method for constructing a blood relationship of an indicator in an embodiment of the present application is provided, and the method for constructing a blood relationship of an indicator at least includes the following steps S110 to S150:

[0059] Step S110, obtaining indicator configuration information configured by the user, wherein the indicator configuration information includes an indicator calculation formula.

[0060] When constructing indicator blood relationships, it is necessary to first obtain the indicator configuration information configured by the user. The embodiment of the present application can provide a visualization interface for users to configure indicators. Users can define indicator aggregation methods and calculation rules on the visualization interface. For example, configure the indicator dimension, calculation formula, time granularity and unit and other information on the visualization interface as the basis for the subsequent construction of indicator blood relationships.

[0061] Step S120, analyzing the indicator blood relationship according to the indicator configuration information to obtain the analysis result of the indicator blood relationship.

[0062] According to the indicator configuration information obtained in the above steps, it is necessary to parse the indicator blood relationship from the indicator configuration information configured by the user, including parsing the specific configured indicators, the hierarchical relationship between indicators, and the relationship between indicators and detailed data tables.

[0063] Step S130, processing the indicator calculation formula using a tree topology structure to generate a calculation formula of a tree topology structure.

[0064] A tree topology is a network structure that connects multiple nodes in a hierarchical relationship, similar to an inverted tree, with a root node at the top and multiple branch nodes below, each branch node can also have sub-branch nodes, and the bottom layer is a leaf node. The embodiment of the present application uses a tree topology structure to process the indicator calculation formula and generate a calculation formula for the tree topology structure, in order to break through the indicator hierarchy limitation and improve calculation efficiency.

[0065] Step S140, performing indicator calculation in parallel according to the analysis result of the indicator blood relationship and the calculation formula of the tree topological structure to obtain the indicator calculation result.

[0066] The existing multi-level blood relationship indicator calculation needs to be calculated in a fixed order. The downstream indicators can only be calculated after the upstream indicators are calculated. The deeper the blood relationship level, the longer it takes, and a lot of computing resources are consumed.

[0067] The calculation formula of the tree topology structure generated by the embodiment of the present application after processing the indicator calculation formula configured by the user based on the above-mentioned tree topology structure can break through the limitation of the indicator hierarchy. The nodes of each level in the tree topology structure are independent of each other. Therefore, the indicator data can be calculated in parallel according to the parsed indicator blood relationship and the calculation formula of the tree topology structure. It is not restricted by the hierarchy and does not need to summarize the calculation results layer by layer. It greatly improves the efficiency of indicator calculation and saves computing resources.

[0068] Step S150, generating an indicator blood relationship diagram according to the indicator calculation results.

[0069] After obtaining the indicator calculation results, the indicator blood relationship can be displayed through a hierarchical graph based on the indicator calculation results, including displaying the entire processing process of the indicator data, to achieve intuitive and clear data calculation link tracking capabilities.

[0070] The indicator blood relationship construction method of the embodiment of the present application realizes the indicator blood relationship of the data calculation link, has an intuitive data link tracking capability, and solves the time-consuming and complex path problems of troubleshooting data problems; it is not restricted by the blood relationship hierarchy, and can complete indicator calculations in parallel, thereby improving the speed and efficiency of data processing and saving computing costs.

[0071] In some embodiments of the present application, obtaining the indicator configuration information configured by the user includes: obtaining the indicators and indicator calculation formulas configured by the user; wherein the indicators include basic indicators and composite indicators, and the indicator calculation formula includes at least one of a basic operator and a custom operator.

[0072] The embodiment of the present application supports the definition and management of basic indicators and composite indicators by users. Users only need to configure the indicator dimensions, calculation formulas, time granularity, units and other information on the visual interface. In addition, it not only supports common operators, such as addition, subtraction, multiplication and division, but also supports various complex and custom operators, such as power operations, piecewise functions, date variables, etc. At the same time, it also supports multi-dimensional and multi-granular indicator configuration. Dimensions are attributes for classifying or grouping indicators, such as tellers, institutions, etc.; granularity is the time unit for aggregating or subdividing indicators, such as days, months, quarters, etc.

[0073] The indicator lineage construction process of the embodiment of the present application is performed on indicators of the same dimension, such as teller dimension, institution dimension, etc. The indicator data of the same dimension can be stored in the same data table.

[0074] In some embodiments of the present application, parsing the indicator blood relationship according to the indicator configuration information to obtain the parsing result of the indicator blood relationship includes: defining the graph model elements of the indicator blood relationship based on the graph model, the graph model elements of the indicator blood relationship include nodes, edges and node attributes; parsing the indicator blood relationship according to the graph model elements of the indicator blood relationship and the indicator configuration information to generate a graph model of the indicator blood relationship; storing the graph model of the indicator blood relationship in a graph database.

[0075] The embodiment of the present application can use a graph database such as JanusGraph to store and query indicator lineage relationships, and define graph model elements of indicator lineage relationships based on a graph model, as shown in Tables 1 and 2 below.

[0076] The embodiment of the present application defines two nodes (Vertex), namely idx_code (indicator ID) and hive_table (hive table name). The indicator ID includes the ID of the basic indicator and the composite indicator. The hive table name is the name of the detailed data table. The relationship between the detailed data table and the indicator is associated by the primary key. Among them, the node idx_code contains attributes of multiple dimensions, namely idx_name (indicator name), defination (indicator definition), indicator description information, indicator dimension, etc.; the node hive_table contains 1 attribute, namely key_col (primary key list), such as [col1, col2].

[0077] In addition, three edges are defined, namely idx_code_rel_up (indicator upstream dependency), idx_code_rel_down (indicator downstream dependency), and idx_code_place (indicator storage relationship). Indicator upstream dependency refers to which data or indicators an indicator is obtained from, indicator downstream dependency refers to which data or indicators an indicator is used or referenced by, and indicator storage relationship refers to which data table the data used for indicator calculation comes from.

[0078] Table 1

[0079]

[0080] Table 2

[0081]

[0082] Based on the graph model elements defined above, the steps for constructing the indicator blood relationship in the embodiment of the present application are as follows:

[0083] 1) Based on the above graph model schema information, create nodes, edges, attributes, etc. through the Janusgraph API;

[0084] 2) Parse the indicator calculation rules through regular expressions, obtain node and edge information, and add node and edge relationships through API, such as (idx_code1, idx_code_rel_up, idx_code2), etc.

[0085] 3) Create indexes on nodes and edges to improve query efficiency.

[0086] Of course, in addition to storing indicator blood relationships in the form of a graph database as described above, data structures such as triples may also be used for storage. The specific storage method can be flexibly configured by technicians in this field according to actual needs and is not specifically limited here.

[0087] In some embodiments of the present application, the indicator calculation formula is processed using a tree topology structure to generate a calculation formula of a tree topology structure, including: recursively expanding the indicator calculation formula using a tree topology structure to obtain the indicator calculation formula after recursive expansion; using a UDF function to process special values ​​in the recursive expansion process to obtain special value processing results; and constructing the calculation formula of the tree topology structure based on the indicator calculation formula after recursive expansion and the special value processing results.

[0088] like Figure 2 As shown, a schematic diagram of a calculation formula and calculation process based on a tree topology structure in an embodiment of the present application is provided. The tree topology structure generation module is designed to break through the index level restrictions and improve the calculation efficiency. The key to this construction process is to recursively expand the user-configured index calculation formula, and use user-defined UDF (User-Defined Function) functions such as NVL functions to process special Null values ​​during the expansion process, so as to solve the problem that the calculation of a certain node in the recursive process affects the calculation of subsequent nodes. At the same time, the index calculation formula supports users to perform combined calculations of the same indicator and different time dimensions. The calculation formula constructed according to the tree topology structure is the one that actually participates in the calculation.

[0089] In some embodiments of the present application, the tree topology structure includes multiple computing nodes, and the indicator calculation is performed in parallel according to the analysis results of the indicator blood relationship and the calculation formula of the tree topology structure, and the indicator calculation results are obtained, including: reading the indicator detailed data associated with each computing node; according to the calculation formula and UDF function of the tree topology structure, the indicator detailed data associated with each computing node is calculated in parallel to obtain the indicator calculation results of each computing node.

[0090] The tree topology structure of the embodiment of the present application includes multiple indicator calculation nodes. When performing indicator calculation, the indicator detailed data used for the specific calculation of each indicator calculation node can be determined based on the analyzed indicator blood relationship, and then the indicator detailed data can be read from the corresponding data table, and the user-defined UDF function can be loaded again. The calculation formula recursively expanded by the tree topology structure and the user-defined UDF function are combined to perform parallel calculation of the indicators to obtain the indicator calculation results of each calculation node.

[0091] In some embodiments of the present application, the indicator detail data associated with each computing node is calculated in parallel according to the calculation formula and UDF function of the tree topology structure to obtain the indicator calculation result of each computing node, including: using the calculation model to divide the indicator detail data associated with each computing node into multiple batches, the calculation model includes at least one of an offline calculation model and a real-time calculation model; according to the calculation formula and UDF function of the tree topology structure, the indicator detail data of multiple batches associated with each computing node is calculated in parallel to obtain the indicator calculation result of each computing node.

[0092] The embodiments of the present application can use different computing models, such as MapReduce, Spark, SparkStreaming, etc. These computing models can divide the data into multiple small batches and then process them in parallel on different computing nodes. At the same time, there is no relationship between the calculation order of each root node and branch node, and there is no need to summarize the calculation results level by level, thereby improving the speed and efficiency of data processing and saving computing costs.

[0093] Indicator calculation can be divided into offline calculation and real-time calculation. For example, SparkSQL calculation engine can be used for offline calculation, and SparkStreaming calculation engine can be used for real-time calculation. The two differ only in timeliness, and the calculation logic is the same, that is, both obtain the calculation formula of the tree topology structure of each root node and branch node, and perform batch calculation, and store the calculation results in Hive and Hbase. The specific calculation model to be adopted can be flexibly selected by technicians in this field according to actual needs, and no specific limitation is made here.

[0094] In some embodiments of the present application, generating an indicator blood relationship diagram according to the indicator calculation results includes: based on the blood dependency between indicators, generating and displaying an indicator blood relationship diagram according to the indicator calculation results; wherein the blood relationship between the indicators includes upstream indicator blood dependency and downstream indicator blood dependency.

[0095] The embodiment of the present application can display the indicator lineage relationship through a hierarchical graphic, specifically display the process of indicator data processing, and support the display of upstream lineage and downstream lineage. Upstream lineage refers to displaying which data or indicators an indicator is obtained through which rules or methods, and downstream lineage refers to displaying which data or indicators an indicator is used or referenced by.

[0096] In addition, it can also provide indicator lineage of specified dimensions, such as teller dimension or institution dimension. First, query the upstream and downstream lineage of the indicator through JanusGraph, and then obtain the indicator value based on the indicator code + dimension information as the RowKey primary key, so as to realize the lineage relationship of the indicator details of the specified dimension.

[0097] In order to facilitate the understanding of the embodiments of the present application, Figure 3 As shown, a schematic diagram of the construction effect of an indicator blood relationship diagram in an embodiment of the present application is provided, such as Figure 4 As shown, a schematic diagram of indicator detail data under a specified dimension in an embodiment of the present application is provided.

[0098] like Figure 5 As shown, a schematic diagram of the overall process of constructing an indicator blood relationship in an embodiment of the present application is provided. First, the indicator configuration information configured by the user is obtained, including configuration information such as the indicator dimension, calculation formula, time granularity and unit. Then, based on the indicator configuration information configured by the user, the blood relationship between the indicators is obtained by parsing the indicator calculation formula, and efficient blood relationship services are provided by using graph storage and graph computing technology. At the same time, the indicator calculation formula is recursively expanded using a tree topological structure, and a custom UDF function is used to perform special Null value processing during the expansion process, and finally a calculation formula of a tree topological structure is generated. Afterwards, the indicator calculation is performed in parallel according to the constructed indicator blood relationship and the calculation formula of the tree topological structure to obtain the indicator calculation result. Finally, an indicator blood relationship diagram is generated based on the indicator calculation result.

[0099] In summary, the key points of the indicator blood relationship construction method of this application mainly include:

[0100] 1) A method for constructing indicator lineage for data computing links is proposed. By parsing indicator expressions, the lineage relationship between indicators is obtained, and graph storage and graph computing technologies are used to provide efficient lineage services.

[0101] 2) The tree topology structure is adopted, which breaks through the limitation of blood relationship level and realizes the functions of free combination and batch calculation of indicators of any node.

[0102] The indicator blood relationship construction method of the present application has achieved at least the following technical effects:

[0103] 1) It can realize the indicator blood relationship of the data calculation link and has the intuitive data link tracking capability, which solves the problem of time-consuming and complex path for troubleshooting data problems;

[0104] 2) It uses a simple and efficient graph computing engine that can store and manage the three elements of the graph model. It can also optimize the traversal and query efficiency of the graph through bidirectional linked lists and index-free adjacency, thus providing efficient blood relationship analysis capabilities;

[0105] 3) A tree topology structure is used to break through the indicator hierarchy limitations, improve the speed and efficiency of indicator data calculation, and save computing costs.

[0106] The present application embodiment also provides an indicator blood relationship construction device 600, such as Figure 6 As shown, a schematic diagram of the structure of an indicator blood relationship construction device in an embodiment of the present application is provided, wherein the indicator blood relationship construction device 600 includes: an acquisition unit 610, a parsing unit 620, a processing unit 630, a calculation unit 640 and a generation unit 650, wherein:

[0107] An acquisition unit 610 is used to acquire the indicator configuration information configured by the user, wherein the indicator configuration information includes an indicator calculation formula;

[0108] The parsing unit 620 is used to parse the indicator blood relationship according to the indicator configuration information to obtain the parsing result of the indicator blood relationship;

[0109] A processing unit 630 is used to process the indicator calculation formula using a tree topology structure to generate a calculation formula of a tree topology structure;

[0110] A calculation unit 640 is used to perform index calculation in parallel according to the analysis result of the index blood relationship and the calculation formula of the tree topological structure to obtain an index calculation result;

[0111] The generating unit 650 is used to generate an indicator blood relationship diagram according to the indicator calculation result.

[0112] In some embodiments of the present application, the acquisition unit 610 is specifically used to: obtain user-configured indicators and indicator calculation formulas; wherein the indicators include basic indicators and composite indicators, and the indicator calculation formula includes at least one of a basic operator and a custom operator.

[0113] In some embodiments of the present application, the parsing unit 620 is specifically used to: define graph model elements of indicator blood relationship based on the graph model, wherein the graph model elements of indicator blood relationship include nodes, edges and node attributes; parse the indicator blood relationship according to the graph model elements of the indicator blood relationship and the indicator configuration information to generate a graph model of the indicator blood relationship; and store the graph model of the indicator blood relationship in a graph database.

[0114] In some embodiments of the present application, the processing unit 630 is specifically used to: recursively expand the indicator calculation formula using a tree topology structure to obtain the recursively expanded indicator calculation formula; use a UDF function to process special values ​​in the recursive expansion process to obtain special value processing results; and construct the calculation formula of the tree topology structure based on the recursively expanded indicator calculation formula and the special value processing results.

[0115] In some embodiments of the present application, the tree topology structure includes multiple computing nodes, and the computing unit 640 is specifically used to: read the indicator detail data associated with each computing node; according to the calculation formula and UDF function of the tree topology structure, perform parallel calculations on the indicator detail data associated with each computing node to obtain the indicator calculation results of each computing node.

[0116] In some embodiments of the present application, the calculation unit 640 is specifically used to: use a calculation model to divide the indicator detail data associated with each computing node into multiple batches, and the calculation model includes at least one of an offline calculation model and a real-time calculation model; according to the calculation formula and UDF function of the tree topology structure, the indicator detail data of multiple batches associated with each computing node are calculated in parallel to obtain the indicator calculation results of each computing node.

[0117] In some embodiments of the present application, the generation unit 650 is specifically used to: based on the bloodline dependency between indicators, generate and display an indicator bloodline relationship diagram according to the indicator calculation results; wherein the bloodline relationship between the indicators includes the upstream bloodline dependency of the indicators and the downstream bloodline dependency of the indicators.

[0118] It can be understood that the above-mentioned indicator blood relationship construction device can implement each step of the indicator blood relationship construction method provided in the aforementioned embodiment, and the relevant explanations about the indicator blood relationship construction method are applicable to the indicator blood relationship construction device, which will not be repeated here.

[0119] Figure 7 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. Figure 7 At the hardware level, the electronic device includes a processor, and optionally also includes an internal bus, a network interface, and a memory. The memory may include a memory, such as a high-speed random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage. Of course, the electronic device may also include hardware required for other services.

[0120] The processor, network interface and memory can be interconnected through an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0121] The memory is used to store the program. Specifically, the program may include a program code, and the program code includes a computer operation instruction. The memory may include a memory and a non-volatile memory, and provides instructions and data to the processor.

[0122] The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it, forming an indicator blood relationship construction device at the logical level. The processor executes the program stored in the memory and is specifically used to perform the following operations:

[0123] Obtaining indicator configuration information configured by a user, wherein the indicator configuration information includes an indicator calculation formula;

[0124] Analyzing the indicator blood relationship according to the indicator configuration information to obtain the analysis result of the indicator blood relationship;

[0125] Processing the indicator calculation formula using a tree topology structure to generate a calculation formula of a tree topology structure;

[0126] The indicator calculation is performed in parallel according to the analytical result of the indicator blood relationship and the calculation formula of the tree topological structure to obtain the indicator calculation result;

[0127] An indicator blood relationship diagram is generated according to the indicator calculation results.

[0128] The above application Figure 1The method performed by the indicator blood relationship construction device disclosed in the illustrated embodiment can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0129] The present application also provides a computer program product, including a computer program or an instruction, which is implemented when the computer program or the instruction is executed by a processor. Figure 1 The indicator blood relationship construction method in the embodiment shown is specifically used to perform:

[0130] Obtaining indicator configuration information configured by a user, wherein the indicator configuration information includes an indicator calculation formula;

[0131] Analyzing the indicator blood relationship according to the indicator configuration information to obtain the analysis result of the indicator blood relationship;

[0132] Processing the indicator calculation formula using a tree topology structure to generate a calculation formula of a tree topology structure;

[0133] The indicator calculation is performed in parallel according to the analytical result of the indicator blood relationship and the calculation formula of the tree topological structure to obtain the indicator calculation result;

[0134] An indicator blood relationship diagram is generated according to the indicator calculation results.

[0135] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0136] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0137] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0138] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0139] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0140] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0141] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0142] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0143] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0144] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A method for constructing an indicator blood relationship, characterized in that: The indicator blood relationship construction method comprises: Obtaining indicator configuration information configured by a user, wherein the indicator configuration information includes an indicator calculation formula; Analyzing the indicator blood relationship according to the indicator configuration information to obtain the analysis result of the indicator blood relationship; Processing the indicator calculation formula using a tree topology structure to generate a calculation formula of a tree topology structure; The indicator calculation is performed in parallel according to the analytical result of the indicator blood relationship and the calculation formula of the tree topological structure to obtain the indicator calculation result; An indicator blood relationship diagram is generated according to the indicator calculation results.

2. The method for constructing the indicator blood relationship according to claim 1, characterized in that: The step of obtaining the indicator configuration information configured by the user includes: Get the user-configured indicators and indicator calculation formulas; The indicators include basic indicators and composite indicators, and the indicator calculation formula includes at least one of a basic operator and a custom operator.

3. The method for constructing the indicator blood relationship according to claim 1, characterized in that: The step of parsing the indicator blood relationship according to the indicator configuration information to obtain the parsing result of the indicator blood relationship includes: A graph model element defining an indicator blood relationship based on a graph model, wherein the graph model element of the indicator blood relationship includes nodes, edges, and node attributes; Analyze the indicator blood relationship according to the graph model elements of the indicator blood relationship and the indicator configuration information, and generate a graph model of the indicator blood relationship; The graph model of the indicator blood relationship is stored in a graph database.

4. The method for constructing an indicator blood relationship according to claim 1, characterized in that: The indicator calculation formula is processed by using a tree topology structure to generate a calculation formula of a tree topology structure, which includes: Recursively expand the indicator calculation formula using a tree topological structure to obtain a recursively expanded indicator calculation formula; The UDF function is used to process the special values ​​in the recursive expansion process to obtain the special value processing results; The calculation formula of the tree topology structure is constructed according to the index calculation formula after the recursive expansion and the special value processing result.

5. The method for constructing an indicator blood relationship according to claim 1, characterized in that: The tree topology structure includes a plurality of computing nodes. The indicator calculation is performed in parallel based on the analysis result of the indicator blood relationship and the calculation formula of the tree topology structure, and the indicator calculation results obtained include: Read the detailed indicator data associated with each computing node; According to the calculation formula and UDF function of the tree topology structure, the indicator detailed data associated with each calculation node are respectively calculated in parallel to obtain the indicator calculation results of each calculation node.

6. The method for constructing the indicator blood relationship according to claim 5, characterized in that: The calculation formula and UDF function of the tree topology structure are used to perform parallel calculations on the index detail data associated with each computing node to obtain the index calculation results of each computing node, including: Dividing the indicator detail data associated with each computing node into multiple batches using a computing model, wherein the computing model includes at least one of an offline computing model and a real-time computing model; According to the calculation formula and UDF function of the tree topology structure, multiple batches of indicator detail data associated with each computing node are respectively calculated in parallel to obtain the indicator calculation results of each computing node.

7. The method for constructing an indicator blood relationship according to claim 1, characterized in that: Generating the indicator blood relationship diagram according to the indicator calculation result comprises: Based on the blood dependency relationship between the indicators, an indicator blood relationship diagram is generated and displayed according to the indicator calculation results; The blood relationship between the indicators includes upstream blood dependency relationship and downstream blood dependency relationship.

8. An indicator blood relationship construction device, characterized in that: The indicator blood relationship construction device comprises: An acquisition unit, used to acquire indicator configuration information configured by a user, wherein the indicator configuration information includes an indicator calculation formula; A parsing unit, used for parsing the indicator blood relationship according to the indicator configuration information to obtain a parsing result of the indicator blood relationship; A processing unit, used to process the indicator calculation formula using a tree topology structure to generate a calculation formula of the tree topology structure; A calculation unit, used to perform indicator calculation in parallel according to the analysis result of the indicator blood relationship and the calculation formula of the tree topological structure to obtain the indicator calculation result; A generating unit is used to generate an indicator blood relationship diagram according to the indicator calculation result.

9. An electronic device, comprising: processor; as well as A memory arranged to store computer executable instructions, wherein when the executable instructions are executed, the processor executes the indicator blood relationship construction method according to any one of claims 1 to 7.

10. A computer program product, comprising a computer program or instructions, wherein when the computer program or instructions are executed by a processor, the method for constructing an indicator blood relationship according to any one of claims 1 to 7 is implemented.

Images