Derivative index generation method and device, electronic equipment, storage medium and product
By selecting and connecting atomic indicators on the configuration interface, generating and aggregating data tables, the problems of low efficiency and complex adjustment in the existing technology are solved, and fast and efficient indicator generation and adjustment are achieved.
Patent Information
- Application Number
- CN202411006503.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-25
- Publication Date
- 2024-11-19
AI Technical Summary
The generation efficiency of indicators in the existing technology is low, and technical personnel need to communicate in depth with business personnel, which increases the communication cost and development cycle, and reloads the data table when adjusting the indicator caliber, resulting in reduced efficiency.
Select target atomic indicators and connection operation logic through the configuration interface to generate derivative indicators, and aggregate data tables according to the aggregate dimensions to reduce the amount of data and achieve rapid generation and adjustment of indicators.
It reduces the communication costs between technicians and business personnel, shortens the development cycle, improves the efficiency of indicator generation and adjustment, and reduces the complexity and risks of data processing.
Smart Images

Figure CN118982277A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of data analysis technology, and in particular relates to a method, device, electronic device, storage medium and product for generating a derivative indicator. Background Art
[0002] The indicator analysis engine can be used to build and maintain indicators to help enterprises and organizations quickly acquire, integrate and analyze data, thereby providing effective support for enterprise decision-making.
[0003] In related technologies, the generation of indicators usually requires in-depth communication between technical personnel and business personnel. This method can ensure the accuracy of the logical operations corresponding to the indicators, but it increases the communication costs and the indicator development cycle, and reduces the efficiency of indicator generation.
[0004] In addition, in related technologies, all data in a data table is usually loaded into a local disk. When the indicator scope needs to be adjusted, the data table on the local disk needs to be reloaded and corrected, or even reloaded. This method also reduces the efficiency of indicator generation.
[0005] It can be seen that in the related art, the generation of indicators has the problem of low generation efficiency. Summary of the invention
[0006] The embodiments of the present application provide a method, device, electronic device, storage medium and product for generating a derivative indicator, which can realize the generation of a derivative indicator and improve the generation efficiency of the derivative indicator.
[0007] In a first aspect, an embodiment of the present application provides a method for generating a derived indicator, the method comprising: in response to a user's selection operation of selecting a target atomic indicator from candidate atomic indicators in a configuration interface, determining at least one customer atomic indicator constituting a target derived indicator; in response to a user's connection operation of at least one customer atomic indicator, generating a target operation logic corresponding to the target derived indicator; aggregating a customer data table to which at least one customer atomic indicator belongs according to an aggregation dimension matching a target business scenario to obtain an aggregated customer data table, wherein the customer data table includes business data of a customer handling business, and the business data has at least one customer atomic indicator; and constructing an association relationship between at least one customer atomic indicator and the aggregated customer data table according to the target operation logic to obtain a target derived indicator.
[0008] In a second aspect, an embodiment of the present application provides a device for generating a derived indicator, the device comprising: an indicator selection module, for determining at least one customer atomic indicator constituting a target derived indicator in response to a user's selection operation of selecting a target atomic indicator from candidate atomic indicators in a configuration interface; a logic generation module, for generating a target operation logic corresponding to the target derived indicator in response to a user's connection operation of at least one customer atomic indicator; an aggregation module, for aggregating a customer data table to which at least one customer atomic indicator belongs according to an aggregation dimension matching a target business scenario to obtain an aggregated customer data table, wherein the customer data table includes business data of a customer handling business, and the business data has at least one customer atomic indicator; an indicator generation module, for constructing an association relationship between at least one customer atomic indicator and the aggregated customer data table according to the target operation logic to obtain a target derived indicator.
[0009] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, the method for generating a derivative indicator as described in the first aspect is implemented.
[0010] In a fourth aspect, an embodiment of the present application provides a computer storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method for generating a derivative indicator as described in the first aspect is implemented.
[0011] In a fifth aspect, an embodiment of the present application provides a computer program product. When the instructions in the computer program product are executed by a processor of an electronic device, the electronic device can execute the method for generating a derivative indicator as described in the first aspect.
[0012] As can be seen from the above content, in the embodiment of the present application, the user can configure the operation logic of the target derivative indicator through the configuration interface without the participation of technical personnel, thereby reducing the communication cost between technical personnel and business personnel, reducing the development cycle of derivative indicators, and improving the generation efficiency of derivative indicators. In addition, in the embodiment of the present application, before associating indicators and data tables, the data table is aggregated according to the aggregation dimension, and the amount of data in the aggregated data table is much smaller than the amount of data in the data table before aggregation, so that when adjusting the indicator caliber, it is not necessary to load all the data in the data table, and only part of the data in the data table needs to be loaded, which improves the adjustment efficiency of the indicator caliber and further improves the generation efficiency of derivative indicators.
[0013] It can be seen that the method provided in the embodiment of the present application can realize the generation of derivative indicators and improve the generation efficiency of derivative indicators. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0015] Figure 1 It is a flowchart of a method for generating a derivative index provided by an embodiment of the present application;
[0016] Figure 2 This is a schematic diagram of generating a derivative indicator provided by an embodiment of the present application;
[0017] Figure 3 This is a schematic diagram of generating a target derivative indicator under the first derivative type provided by an embodiment of the present application;
[0018] Figure 4 This is a schematic diagram of generating a target derivative indicator under the second derivative type provided by an embodiment of the present application;
[0019] Figure 5 is a structural schematic diagram of a device for generating a derivative index provided by another embodiment of the present application;
[0020] Figure 6 It is a structural diagram of an electronic device provided by yet another embodiment of the present application. DETAILED DESCRIPTION
[0021] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.
[0022] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.
[0023] It should be noted that the acquisition, storage, use and processing of data in the embodiments of the present application are in compliance with the relevant provisions of national laws and regulations.
[0024] In addition, it should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.
[0025] For ease of understanding, before explaining the solution provided in this application, the background involved in the solution provided in this application is first explained.
[0026] The indicator analysis engine can be used to build and maintain indicators to help enterprises and organizations quickly acquire, integrate and analyze data, thereby providing effective support for enterprise decision-making. Generally, the indicator analysis engine has basic functions such as processing massive detailed data, providing data analysis, and report generation, and supports extended functions such as data detail screening and multi-dimensional aggregation of indicators.
[0027] At present, enterprises mainly use the following indicator analysis tools and means to achieve indicator analysis:
[0028] (1) BI (Business Intelligence) tool, which has strong visualization capabilities and can build charts by dragging and dropping.
[0029] (2) Excel, mainly used for small-scale data calculations.
[0030] (3) Fixed report development, which is suitable for fixed data presentation and business scenarios that do not change frequently.
[0031] (4) Customized indicator analysis tools are developed based on the specific needs of the enterprise and are more flexible and powerful to use.
[0032] Since BI tools lack efficient query syntax optimization, Excel is only suitable for processing small-scale data sets, and fixed reports cannot cope with changing business needs. Customized indicator analysis tools can meet the needs of enterprises to process massive data quickly and flexibly. Therefore, customized indicator analysis tools are increasingly used in the field of data analysis.
[0033] However, existing customized indicator analysis engines have the following disadvantages:
[0034] (1) It is difficult to expand indicators. In the process of business development, it is often necessary to expand or add new indicators to meet business needs. However, even if the new indicators are composed of existing indicators and do not require new source data from the upstream system, the implementation process of these new indicators still needs to go through a series of complete development cycles, which increases the cycle of the implementation process. Even if the new indicators are only based on the logical combination of existing indicators, in-depth communication with the business department is required to ensure an accurate understanding of the indicator requirements, including clarifying the definition of the indicator, calculation logic, business significance, and application scenarios.
[0035] (2) Difficulty in adjusting the scope. In the process of data analysis and business decision-making, adjusting the scope of indicators is a routine task. When the scope of indicators needs to be adjusted, since the indicator data has already been stored on the disk, the historical data stored on the disk needs to be reloaded and corrected. This process involves multiple levels, including data reading, scope conversion, recalculation, and storage of results. When the amount of data is huge, this reloading and correction process will become extremely time-consuming and resource-consuming. It is also necessary to ensure that the ongoing data analysis work will not be affected during the processing, which poses great challenges to the performance and stability of the system. It can be seen that in the relevant technologies, the adjustment of the scope of indicators has the problem of complex adjustment and difficulty in adjustment.
[0036] (3) Difficulty in managing indicators. In the current business environment, indicator management faces serious challenges. One of the most prominent issues is the maintenance and updating of indicator metadata. The current practice of indicator maintenance is usually for technical personnel to directly operate the database through the background. This method is not only inefficient, but also has serious maintainability issues. Specifically, whenever a new indicator needs to be added or an existing indicator needs to be modified, it is necessary to manually write and update the JSON text, and each indicator corresponds to an independent JSON. This method is opaque to business personnel and extremely cumbersome and time-consuming for technical personnel, greatly increasing the cost of technical maintenance. Due to the lack of a simple and easy-to-use indicator management solution and system, the management of indicators has become extremely difficult. The lack of an effective communication and collaboration mechanism between business personnel and technical personnel leads to frequent misunderstandings and conflicts in the definition, update and use of indicators. This not only affects the accuracy of business decisions, but also seriously restricts the operational efficiency of the enterprise.
[0037] (4) There are few types of indicators. The types of indicators currently covered are relatively limited, and only simple aggregation operations are supported, such as sum, average, maximum, and other operations. As business complexity and data analysis needs increase, the indicator analysis engine's support for higher-level and more dynamic indicators is particularly insufficient. The existing indicator analysis engine does not support growth change indicators, such as the increase in asset management scale. Such indicators usually reflect the net growth of a certain business or resource over a period of time, and are particularly important for evaluating the growth rate and trend of the business. In addition, the existing indicator analysis engine is also unable to support state transition indicators, which usually involve changes in the status of customers, orders, or other entities over a specific time period. Such indicators are of great significance for understanding user behavior and evaluating service quality.
[0038] (5) Lack of evaluation system. When building a data-driven decision support system, a key link is to establish an accurate and fair indicator scoring system. However, due to the significant differences in the dimensions and value ranges of different indicators, which may range from tens to tens of thousands, or even larger, it is particularly difficult to build a unified, standardized, and flexible indicator scoring system. The dimensions of different indicators may include monetary amounts, quantities, percentages, ratios, and other types, which have great differences in numerical size and expression. More importantly, an ideal indicator scoring system should also be flexible enough to adapt to changes in different business scenarios and needs.
[0039] In order to solve the problems of the prior art, the embodiments of the present application provide a method, device, electronic device, storage medium and product for generating a derivative indicator.
[0040] The following first introduces the method for generating the derived index provided in the embodiment of the present application. The method provided in the embodiment of the present application can be applied to an index analysis engine, in which a human-computer interaction unit is deployed to receive instructions from business personnel.
[0041] Figure 1 FIG. 1 is a flow chart of a method for generating a derivative index provided by an embodiment of the present application. Figure 1 As shown, the method may include the following steps:
[0042] Step S101 : in response to a user's selection operation of selecting a target atomic indicator from candidate atomic indicators in a configuration interface, at least one customer atomic indicator constituting a target derived indicator is determined.
[0043] In step S101, an atomic indicator is an indicator that can directly measure a specific phenomenon or object, which is usually calculated based on clearly defined variables or measurement standards. In the embodiment of the present application, an atomic indicator is an inseparable indicator in the business, such as sales amount, inventory quantity, etc. In the embodiment of the present application, a customer atomic indicator refers to an atomic indicator that directly measures customer data.
[0044] In step S101, the derived indicators are indicators that are further developed and evolved on the basis of the atomic indicators, and are usually obtained by calculating, modeling or in-depth analysis of the atomic indicators.
[0045] In one example, a user (i.e., a business person) can select atomic indicators that constitute a derived indicator through the configuration interface of the indicator analysis engine. For example, in the configuration interface, each atomic indicator corresponds to a control, and the user selects the control in the configuration interface, which is actually selecting the atomic indicator. In addition, in an embodiment of the present application, before the user selects the target atomic indicator, the user can input a business scenario into the indicator analysis engine, so that the indicator analysis engine can select candidate atomic indicators that match the business scenario from multiple atomic indicators and display them to the user, so that the user can select the customer atomic indicators that constitute the target derived indicator from the candidate atomic indicators according to actual needs.
[0046] Step S102 , in response to a user's connection operation on at least one customer atomic indicator, generating a target operation logic corresponding to a target derived indicator.
[0047] In step S102, the user can connect the controls corresponding to the customer atomic indicators through the configuration interface of the indicator analysis engine. The control connection between the customer atomic indicators represents the operation logic of the logical operation of the customer atomic indicators that constitute the target derived indicators. That is, in the embodiment of the present application, the user can determine the operation logic of the target derived indicators through human-computer interaction with the indicator analysis engine, which reduces the communication between technical personnel and business personnel and improves the efficiency of generating derived indicators.
[0048] Step S103 , aggregating the customer data table to which at least one customer atomic indicator belongs according to an aggregation dimension matching the target business scenario, to obtain an aggregated customer data table.
[0049] In step S103, the aggregation dimensions corresponding to different business scenarios may be different. For example, in a business scenario of evaluating employee performance, the aggregation dimension may be account manager; for another example, in a scenario of evaluating the business income of each financial institution, the aggregation dimension may be financial institution.
[0050] In step S103, the customer data table includes business data of the customer's business, such as the business type, processing time, customer number, etc. In the embodiment of the present application, the business data has at least one customer atomic indicator. For example, the customer atomic indicator corresponding to the business data for handling Class A business includes a business type indicator, a customer number indicator, a processing time indicator, etc.
[0051] In an embodiment of the present application, the indicator analysis engine can aggregate the data in the customer data table through the aggregation dimension, thereby reducing the amount of data in the billions to a smaller amount, thereby reducing the amount of data processed by the indicator analysis engine.
[0052] Step S104, according to the target operation logic, construct an association relationship between at least one customer atomic indicator and the aggregated customer data table to obtain a target derived indicator.
[0053] After obtaining the target operation logic of the target derived indicator, the customer atomic indicators that constitute the target derived indicator, and the indicator data source (i.e., the aggregated customer data table) by executing steps S101 to S103, the indicator analysis engine can obtain the target derived indicator by associating the customer atomic indicators with the aggregated customer data table and performing relevant operations according to the target operation logic.
[0054] It is worth noting that in step S104, the target derived indicator is constructed using the aggregated customer data table, that is, what is loaded locally in the indicator analysis engine is the aggregated customer data table rather than the complete customer data table. This method reduces the amount of data transmitted between the data source and the indicator analysis engine, and when the indicator caliber changes, there is no need to reload and correct the historical data on the local disk, which reduces the complexity and risk of data processing and ensures the stability and continuity of the indicator analysis engine.
[0055] Based on the scheme defined by the above steps S101 to S104, it can be known that in the embodiment of the present application, the user can configure the operation logic of the target derivative indicator through the configuration interface without the participation of technical personnel, thereby reducing the communication cost between technical personnel and business personnel, reducing the development cycle of derivative indicators, and improving the generation efficiency of derivative indicators. In addition, in the embodiment of the present application, before associating indicators and data tables, the data table is aggregated according to the aggregation dimension, and the amount of data in the aggregated data table is much smaller than the amount of data in the data table before aggregation, so that when adjusting the indicator caliber, it is not necessary to load all the data in the data table, and only part of the data in the data table needs to be loaded, which improves the adjustment efficiency of the indicator caliber and further improves the generation efficiency of derivative indicators.
[0056] It can be seen that the method provided in the embodiment of the present application can realize the generation of derivative indicators and improve the generation efficiency of derivative indicators.
[0057] The following is an introduction to the implementation process of the method provided in the embodiment of the present application.
[0058] It can be seen from the above steps S101 to S104 that after the user selects a customer atomic indicator and determines the target operation logic of the target derived indicator, the customer data table to which at least one customer atomic indicator belongs is aggregated according to the aggregation dimension matching the target business scenario.
[0059] Specifically, the indicator analysis engine first obtains the customer data table to which at least one customer atomic indicator belongs; then, it performs staggered aggregation on the customer data table to obtain a first aggregated data table; then, it obtains the aggregation time period corresponding to the target derived indicator; it filters out the data within the aggregation time period from the first aggregated data table to obtain a second aggregated data table; finally, under the aggregation dimension, it aggregates the data in the second aggregated data table to obtain an aggregated customer data table.
[0060] In one example, Figure 2 shows a schematic diagram of the generation of derived indicators, Figure 2 It can be seen that, first, the data source stores multiple customer data tables, which are physical tables, for example, Figure 2 The data granularity of customer small width table 1, customer small width table 2, and customer small width table 3 is customer number + date. The indicator analysis engine associates multiple customer data tables through the "dislocated UNION" method to obtain the first aggregate data table. By dislocated association of multiple customer data tables, the performance consumption caused by ClickHouse JOIN operations can be avoided and data processing efficiency can be improved.
[0061] Next, we build a customer index aggregation table, which is a memory table. This table can convert the time dimension into an extension of the column, and transform it into the customer's initial index value and final index value, which is convenient for the rapid acquisition of subsequent index values. At this time, we get a table without the time dimension, which is the second aggregation data table. For example, in Figure 2 In the data table containing indicators such as custody relationship, AUM (Asset Under Management), and wealth management sales, the dimensions are expanded to obtain the customer indicator aggregation table corresponding to the aggregation period. The customer indicator aggregation table does not contain the time dimension, but contains the institution number dimension, that is, the customer indicator aggregation table counts the data of the institution granularity within the aggregation period.
[0062] It should be noted that in the above example, the initial index value is the value corresponding to the index in the first time period, and the final index value is the value corresponding to the index in the second time period. The first time period is earlier than the second time period, and the first time period and the second time period are the above-mentioned aggregation periods.
[0063] Further, such as Figure 2 As shown, the indicator analysis engine can also obtain an extended indicator detail table, aggregate the extended indicator detail table, and obtain an extended indicator aggregation table; then determine the aggregation dimension from the extended indicator aggregation table, for example, Figure 2 In the example, the aggregation dimension is the account manager, specifically the account manager's on-the-job time. Then, the customer indicator aggregation table is distributedly aggregated under the aggregation dimension to obtain a distributed aggregation table.
[0064] It should be noted that by aggregating the customer data table, the data of billions (customer + date granularity) is reduced to a smaller amount of data (account manager, organization granularity), and the association of the customer data table is easier and more efficient for ClickHouse. Then, the local memory table uses ClickHouse's clustering method to complete the distributed aggregation and quickly calculate the values of all atomic indicators.
[0065] Furthermore, if Figure 2 As shown, after the distributed aggregation table is generated, logical operations are performed on the customer atomic indicators through the distributed aggregation table. For example, the addition, subtraction, multiplication and division operations of the customer atomic indicators are configured based on JSON rules, and the JSON rules are automatically converted into SQL (Structured Query Language). The customer atomic indicators are operated through SQL statements to obtain the values of the target derived indicators, so as to improve the diversity of the indicator system.
[0066] After generating the target derived indicators, the indicator analysis engine sets weights for the generated indicators, adjusts the weight distribution of different indicators according to business needs, and uses the median algorithm to remove the indicator weights that are outside the preset weight range in the indicator weight values to avoid the influence of extreme values on the indicator evaluation results. Then, the indicator analysis system can use the window sorting technology to sort the indicators and obtain the indicator score ranking table. Among them, the indicator score ranking table is also a memory table.
[0067] After completing the aggregation of the customer data table, the indicator analysis engine can construct an association relationship between at least one customer atomic indicator and the aggregated customer data table according to the target operation logic to obtain a target derived indicator.
[0068] Specifically, the indicator analysis engine constructs an association relationship between at least one customer atomic indicator and the aggregated customer data table to obtain a dimension atomic indicator; and then, according to the target operation logic, constructs an association relationship between the dimension atomic indicator and the first indicator to obtain a target derived indicator.
[0069] In the above embodiment, the first indicator includes at least one of the following: at least one customer atomic indicator, a first atomic indicator, and a first derived indicator, wherein the first atomic indicator is an atomic indicator other than the customer atomic indicator (for example, a customer atomic indicator, a dimension atomic indicator), and the first derived indicator is a derived indicator other than the target derived indicator. The indicator analysis engine may determine the specific type of the first indicator according to business requirements.
[0070] In one embodiment, the indicator analysis engine can determine the derivative type corresponding to the target operation logic based on the association between the operation logic and the derivative type, and then derive the dimensional atomic indicator and the first indicator in real time through the derivative rules corresponding to the derivative type to obtain the target derivative indicator.
[0071] In the above embodiment, the derivative type includes: a first derivative type and a second derivative type, wherein the first derivative type is used to characterize the business growth status, for example, AUM increase, which can reflect the net growth of a certain business or resource over a period of time, and is particularly important for evaluating the business growth rate and trend. The second derivative type is used to characterize the business status transition, which usually involves the change of the status of customers, orders or other entities in a specific time period. Such indicators are of great significance for understanding user behavior and evaluating service quality.
[0072] When the derivative type is the first derivative type, the indicator analysis engine determines the dimension atomic indicator as the beginning atomic indicator and the first indicator as the ending atomic indicator; then, it constructs the incremental change relationship between the ending atomic indicator and the beginning atomic indicator to obtain the target derivative indicator.
[0073] In the above embodiment, the initial atomic index is used to associate the data of the aggregated customer data table in the first time period, and the final atomic index is used to associate the data of the aggregated customer data table in the second time period.
[0074] In one example, Figure 3 The generation process of the target derived indicator under the first derivative type is shown. First, the process atomic indicator is constructed, and the customer data table of customer + time is converted into a wide table of customer granularity indicators, and the compression method is conditional aggregation. In the ClickHouse database, the xxxIf() conditional aggregation function is used. For example, for the customer's beginning AUM time point balance indicator, its SQL expression is: sumIf (aum time point value, data_dt = 'beginning') group by customer number.
[0075] After obtaining the process atomic indicators, the indicator analysis engine aggregates the process atomic indicators according to the aggregation dimension to obtain the dimension atomic indicator A. The aggregation dimension can be selected by the user through the configuration interface of the indicator analysis engine. For example, if the user wants to obtain the total balance of the beginning AUM of the customers under the account manager, the aggregation dimension is the account manager, and its SQL expression is: sum (the balance of the beginning AUM of the customers) group by account manager.
[0076] For dimension atomic indicator B, its configuration process is similar to that of dimension atomic indicator A, the only difference is that the aggregation period is the end period.
[0077] Finally, through the configured rules, that is, logical operations are performed on the dimension atomic indicators A and B according to the target operation logic, the target derived indicators can be obtained. Figure 3 The growth rate of AUM of customers under the account manager is expressed in SQL as follows: (target atomic indicator B-target atomic indicator A) / target atomic indicator A, that is, (the sum of the AUM balances of customers at the end of the period-the sum of the AUM balances of customers at the beginning of the period) / the sum of the AUM balances of customers at the beginning of the period, that is, the logical operation rule of the target derivative indicator is (BA) / A.
[0078] When the derivative type is the second derivative type, the indicator analysis engine determines the dimension atomic indicator as the beginning-of-period atomic indicator, and determines the first indicator as the ending-of-period atomic indicator; then, according to the derivative rules, logical operations are performed on at least one customer atomic indicator and the ending-of-period atomic indicator to obtain the customer derived indicator; then, the customer derived indicator is aggregated according to the aggregation dimension to obtain the ending-of-period dimension indicator; finally, the state change relationship of the ending-of-period dimension indicator relative to the beginning-of-period atomic indicator is constructed to obtain the target derived indicator.
[0079] In the above embodiment, the initial atomic index is used to associate the data of the aggregated customer data table in the first time period, and the final atomic index is used to associate the data of the aggregated customer data table in the second time period.
[0080] In one example, Figure 4 The generation process of target derivative indicators under the second derivative type is shown. Figure 4 Take the gold-level customer retention indicator as an example. The gold-level customer retention indicator is defined as customers whose rating is gold at the beginning of the period and whose rating is gold or above at the end of the period. Figure 4 It can be seen that the generation of the second derivative type of indicators requires first completing a rule operation at the original data granularity (for example, customer granularity) and then performing aggregation.
[0081] like Figure 4As shown, the process atomic indicator is constructed, and the customer data table of customer + time is converted into a wide table of customer granularity indicators, and the compression method is conditional aggregation. In the ClickHouse database, the xxxIf() conditional aggregation function is used. For example, for process atomic indicator A, its SQL expression is: countIf(customer number, data_dt = 'beginning of period' and customer level in ('gold level') group by customer number); for process atomic indicator B, its SQL expression is: countIf(customer number, data_dt = 'end of period' and customer level in ('gold level', 'platinum level', 'diamond level', ...) group by customer number).
[0082] After obtaining the process atomic indicator, process atomic indicator A is dimensionally aggregated according to the dimension to obtain dimension atomic indicator C, which represents the number of gold-level customers at the beginning of the period; according to the operation logic if (Aand B, yes, no), process atomic indicator A and process atomic indicator B are logically operated to obtain customer derived indicators, which represent whether the customer is gold-level, that is, a gold-level customer at the beginning of the period and a gold-level customer or above at the end of the period. Then, the customer derived indicators are dimensionally aggregated, for example, Figure 4 In the example, according to the dimension of the account manager, the SQL statement: sum(customer gold level retention mark) group by account manager is used to perform dimension aggregation on the customer derived indicators to obtain the dimension atomic indicator D.
[0083] Next, logical operations are performed on dimension atomic indicators C and D according to the target operation logic D / C to obtain the target derived indicator, which is used to characterize the gold-level customer retention rate under the account manager, that is, the number of gold-level customers at the beginning of the period and gold-level and above at the end of the period / the number of gold-level customers at the beginning of the period.
[0084] Furthermore, after obtaining the target derived indicator, the derived indicator calculation logic can be configured based on JSON rules to facilitate the expansion of subsequent indicator management functions, thereby further enabling users to customize indicator calculation methods based on business needs.
[0085] In one embodiment, the indicator analysis engine generates a JSON statement corresponding to the target operation logic; and converts the JSON statement into a database query statement to obtain data associated with at least one customer atomic indicator from the aggregated customer data table; then, logical operations are performed on the data associated with at least one customer atomic indicator according to the target operation logic to obtain data corresponding to the target derived indicator.
[0086] As an example, after the user enters the indicator information through the visual interface, the indicator management tool in the indicator analysis engine converts the entered indicator information into a table configuration, and automatically converts it into the JSON calculation rules of the indicator, and stores the rules in the database. Figure 4 ,The configuration of dimension atomic indicators is shown in Table 1, and the configuration of target derived indicators is shown in Table 2.
[0087] Table 1
[0088]
[0089] Table 2
[0090]
[0091] By adopting visual logic configuration, the logical relationship between source tables, atomic indicators, and derived indicators is configured through an intuitive graphical interface, and JSON expressions are automatically generated. This method makes indicator management more intuitive and convenient, and reduces the complexity of configuration. At the same time, by outputting indicator configuration information in JSON format, the decoupling between indicator management and indicator use is achieved, and the flexibility and scalability of the indicator analysis engine are improved.
[0092] In another embodiment, after obtaining the target derived indicator, the indicator analysis engine may also determine the indicator weight corresponding to the target derived indicator according to the importance of the target derived indicator in the target business scenario; update the target derived indicator to the multiple indicators corresponding to the target business scenario to obtain the updated multiple indicators; then, sort the updated multiple indicators according to the indicator weight to obtain the sorting result; then, determine the evaluation indicator for performance evaluation of the target object according to the sorting result; finally, perform performance evaluation on the target object through the evaluation indicator.
[0093] In the above embodiment, the target object can be a customer manager, and the user can set the weights of different indicators according to business needs to ensure the comprehensiveness and fairness of the evaluation results. Before sorting the indicators, the median algorithm can be used to remove extreme weight values to avoid the impact of extreme values on the evaluation results and improve the robustness of the evaluation. In addition, the indicator analysis engine can automatically score and sort the performance of employees according to the preset evaluation rules and algorithms, providing managers with intuitive and clear employee performance rankings and comparison information.
[0094] This concludes the introduction to the method provided in the embodiments of the present application.
[0095] From the above introduction, it can be seen that the method provided by this application can quickly expand indicators and achieve rapid expansion of indicators without going through a complete development cycle, which greatly shortens the time for indicators to go online. By standardizing the indicator combination logic, the communication cost of the business department is reduced, ensuring an accurate understanding of indicator requirements, improving the efficiency and flexibility of indicator development, and supporting the business to quickly respond to market changes.
[0096] The method provided by this application can also adjust the caliber efficiently, simplify the indicator adjustment process, and do not need to reload and correct the historical data on the disk, which reduces the complexity and risk of data processing, and provides the ability to adjust the caliber without affecting the existing data analysis work, ensuring the stability and continuity of the system. In addition, the method provided by this application also improves the efficiency and accuracy of data processing, and supports the flexible adjustment of the indicator caliber by the business.
[0097] The method provided by this application can also realize the intelligent management of indicators. Through the visual indicator management system, the automatic maintenance and update of indicator metadata are realized, the efficiency and accuracy of indicator management are improved, the technical maintenance cost is reduced, and business personnel can view and manage indicators intuitively. The method also establishes an effective communication and collaboration mechanism between business personnel and technical personnel, and improves the accuracy of business decisions.
[0098] The method provided in this application also enriches the indicator types, supports higher-level and more dynamic indicators, and meets the increasing business complexity and data analysis needs. The method provides support for growth change indicators and state transition indicators, helping businesses to more accurately evaluate business growth rates and trends, understand user behavior and service quality, and support business customization and dynamic expansion of indicators.
[0099] The method provided in this application makes the evaluation system more complete. It establishes an accurate and fair indicator scoring system and solves the problem of large differences in the dimensions and value ranges of different indicators. This method uses a standardized scoring algorithm and a flexible configuration method to enable the indicator scoring system to adapt to changes in different business scenarios and needs. This method improves the accuracy and fairness of business decisions and supports enterprises in building a data-driven decision support system.
[0100] Based on the method for generating a derived index provided in the above embodiment, the present application also provides a specific implementation of a device for generating a derived index. Figure 5 The derived indicator generation device 500 provided in the embodiment of the present application includes: an indicator selection module 501, a logic generation module 502, an aggregation module 503 and an indicator generation module 504.
[0101] The indicator selection module 501 is used to determine at least one customer atomic indicator constituting a target derived indicator in response to a user's selection operation of selecting a target atomic indicator from candidate atomic indicators in a configuration interface;
[0102] The logic generation module 502 is used to generate a target operation logic corresponding to a target derived indicator in response to a user's connection operation on at least one customer atomic indicator;
[0103] Aggregation module 503, used to aggregate the customer data table to which at least one customer atomic indicator belongs according to the aggregation dimension matching the target business scenario, to obtain an aggregated customer data table, wherein the customer data table includes business data of the customer handling business, and the business data has at least one customer atomic indicator;
[0104] The indicator generation module 504 is used to construct the association relationship between at least one customer atomic indicator and the aggregated customer data table according to the target operation logic to obtain the target derived indicator.
[0105] In one example, the aggregation module is specifically used to obtain a customer data table to which at least one customer atomic indicator belongs; perform staggered aggregation on the customer data table to obtain a first aggregate data table; obtain an aggregation time period corresponding to a target derivative indicator; filter out data within the aggregation time period from the first aggregate data table to obtain a second aggregate data table; and perform aggregation processing on the data in the second aggregate data table under the aggregation dimension to obtain an aggregated customer data table.
[0106] In one example, the indicator generation module includes: an association construction module and a derivative module. The association construction module is used to construct an association relationship between at least one customer atomic indicator and the aggregated customer data table to obtain a dimension atomic indicator; the derivative module is used to construct an association relationship between the dimension atomic indicator and the first indicator according to the target operation logic to obtain a target derivative indicator, wherein the first indicator includes at least one of the following: at least one customer atomic indicator, a first atomic indicator, and a first derivative indicator, wherein the first atomic indicator is an atomic indicator other than the customer atomic indicator, and the first derivative indicator is a derivative indicator other than the target derivative indicator.
[0107] In one example, the derivation module includes: a type determination module and a target derivation module. The type determination module is used to determine the derivative type corresponding to the target operation logic according to the association between the operation logic and the derivative type, wherein the derivative type includes: a first derivative type for characterizing the business growth state and a second derivative type for characterizing the business state transition; the target derivation module is used to derive the dimension atomic indicator and the first indicator in real time through the derivation rules corresponding to the derivative type to obtain the target derivative indicator.
[0108] In one example, the target derivation module is specifically used to determine the dimension atomic indicator as the beginning atomic indicator and the first indicator as the ending atomic indicator when the derivative type is the first derivative type, wherein the beginning atomic indicator is used to associate the data of the aggregated customer data table in the first time period, and the ending atomic indicator is used to associate the data of the aggregated customer data table in the second time period; construct the incremental change relationship of the ending atomic indicator relative to the beginning atomic indicator to obtain the target derived indicator.
[0109] In one example, the target derivation module is specifically used to determine the dimension atomic indicator as the beginning-of-period atomic indicator and the first indicator as the ending-of-period atomic indicator when the derivative type is the second derivative type, wherein the beginning-of-period atomic indicator is used to associate the data of the aggregated customer data table within the first time period, and the ending-of-period atomic indicator is used to associate the data of the aggregated customer data table within the second time period; perform logical operations on at least one customer atomic indicator and the ending-of-period atomic indicator according to the derivation rules to obtain a customer derived indicator; aggregate the customer derived indicators according to the aggregation dimension to obtain an ending-of-period dimensional indicator; and construct a state change relationship between the ending-of-period dimensional indicator and the beginning-of-period atomic indicator to obtain a target derived indicator.
[0110] In one example, the device for generating a derived indicator also includes: a logical operation module, which is used to construct an association relationship between at least one customer atomic indicator and an aggregated customer data table according to a target operation logic, and after obtaining a target derived indicator, generate a JSON statement corresponding to the target operation logic; convert the JSON statement into a database query statement to obtain data associated with at least one customer atomic indicator from the aggregated customer data table; perform logical operations on the data associated with at least one customer atomic indicator according to the target operation logic to obtain data corresponding to the target derived indicator.
[0111] In one example, the device for generating a derived indicator also includes: an evaluation module, which is used to construct an association relationship between at least one customer atomic indicator and an aggregated customer data table according to the target operation logic, and after obtaining the target derived indicator, determine the indicator weight corresponding to the target derived indicator according to the importance of the target derived indicator in the target business scenario; update the target derived indicator to multiple indicators corresponding to the target business scenario to obtain multiple updated indicators; sort the updated multiple indicators according to the indicator weight to obtain a sorting result; determine the evaluation indicator for performance evaluation of the target object according to the sorting result; and perform performance evaluation on the target object through the evaluation indicator.
[0112] Each module of the device for generating a derivative index provided in the embodiment of the present application can realize Figure 1The functions of each step of the method for generating a derivative indicator are provided, and the corresponding technical effects can be achieved. For the sake of brevity, they will not be repeated here.
[0113] Figure 6 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application is shown.
[0114] The electronic device may include a processor 601 and a memory 602 storing computer program instructions.
[0115] Specifically, the processor 601 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.
[0116] The memory 602 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 602 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 602 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 602 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 602 is a non-volatile solid-state memory.
[0117] The memory may include read-only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical / tangible memory storage devices. Thus, typically, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to one aspect of the present application.
[0118] The processor 601 implements any one of the methods for generating a derivative indicator in the above embodiments by reading and executing computer program instructions stored in the memory 602 .
[0119] In one example, the electronic device may further include a communication interface 603 and a bus 610. Figure 6 As shown, the processor 601, the memory 602, and the communication interface 603 are connected via a bus 610 and communicate with each other.
[0120] The communication interface 603 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.
[0121] Bus 610 includes hardware, software or both, and the parts of electronic equipment are coupled to each other. For example, but not limitation, bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 610 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the application considers any suitable bus or interconnection.
[0122] In combination with the method for generating a derivative indicator in the above embodiment, the embodiment of the present application can provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when the computer program instructions are executed by a processor, any method for generating a derivative indicator in the above embodiment is implemented.
[0123] An embodiment of the present application also provides a computer program product, including a computer program, which, when executed, implements any one of the methods for generating a derivative indicator in the above embodiments.
[0124] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.
[0125] Aspects of the present disclosure are described above with reference to the flow chart and / or block diagram of the generation method, device, electronic device, storage medium and product of the derivative index according to the embodiment of the present disclosure. It should be understood that each box in the flow chart and / or block diagram and the combination of each box in the flow chart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the function / action specified in one or more boxes of the flow chart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor or a field programmable logic circuit. It can also be understood that each box in the block diagram and / or flow chart and the combination of boxes in the block diagram and / or flow chart can also be implemented by dedicated hardware that performs a specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.
[0126] The above are only specific implementation methods of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.
Claims
1. A method for generating a derivative index, characterized in that: include: In response to a user's selection operation of selecting a target atomic indicator from candidate atomic indicators in a configuration interface, determining at least one client atomic indicator constituting a target derived indicator; In response to a user's connection operation on at least one of the customer atomic indicators, generating a target operation logic corresponding to the target derived indicator; Aggregate the customer data table to which at least one customer atomic indicator belongs according to an aggregation dimension matching the target business scenario to obtain an aggregated customer data table, wherein the customer data table includes business data of a user handling business, and the business data has at least one customer atomic indicator; According to the target operation logic, an association relationship between at least one of the customer atomic indicators and the aggregated customer data table is constructed to obtain the target derived indicator.
2. The method according to claim 1, characterized in that According to the aggregation dimension matching the target business scenario, the customer data table to which at least one customer atomic indicator belongs is aggregated to obtain an aggregated customer data table, including: Obtaining a customer data table to which at least one customer atomic indicator belongs; Performing dislocation aggregation on the customer data table to obtain a first aggregated data table; Obtaining the aggregation period corresponding to the target derived indicator; Filtering the data in the aggregation period from the first aggregation data table to obtain a second aggregation data table; Under the aggregation dimension, the data in the second aggregation data table is aggregated to obtain the aggregated customer data table.
3. The method according to claim 1, characterized in that: According to the target operation logic, an association relationship between at least one of the customer atomic indicators and the aggregated customer data table is constructed to obtain the target derived indicator, including: Constructing an association relationship between at least one of the customer atomic indicators and the aggregated customer data table to obtain a dimension atomic indicator; According to the target operation logic, the association relationship between the dimensional atomic indicator and the first indicator is constructed to obtain the target derived indicator, wherein the first indicator includes at least one of the following: at least one of the customer atomic indicator, a first atomic indicator, and a first derived indicator, wherein the first atomic indicator is an atomic indicator other than the customer atomic indicator, and the first derived indicator is a derived indicator other than the target derived indicator.
4. The method according to claim 3, characterized in that According to the target operation logic, the association relationship between the dimension atomic indicator and the first indicator is constructed to obtain the target derived indicator, including: Determine the derivative type corresponding to the target operation logic according to the association relationship between the operation logic and the derivative type, wherein the derivative type includes: a first derivative type for characterizing a business growth state and a second derivative type for characterizing a business state transition; The dimensional atomic indicator and the first indicator are derived in real time through a derivation rule corresponding to the derivation type to obtain a target derived indicator.
5. The method according to claim 4, characterized in that The dimensional atomic indicator and the first indicator are derived in real time by using a derivation rule corresponding to the derivation type to obtain a target derived indicator, including: In the case where the derivative type is the first derivative type, the dimension atomic indicator is determined as a beginning-of-period atomic indicator, and the first indicator is determined as a ending-of-period atomic indicator, wherein the beginning-of-period atomic indicator is used to associate data of the aggregated customer data table within a first time period, and the ending-of-period atomic indicator is used to associate data of the aggregated customer data table within a second time period; An incremental change relationship between the final atomic index and the initial atomic index is constructed to obtain the target derived index.
6. The method according to claim 4, characterized in that The dimensional atomic indicator and the first indicator are derived in real time by using a derivation rule corresponding to the derivation type to obtain a target derived indicator, including: In the case where the derivative type is the second derivative type, the dimension atomic index is determined as a beginning-of-period atomic index, and the first index is determined as a ending-of-period atomic index, wherein the beginning-of-period atomic index is used to associate data of the aggregated customer data table within a first time period, and the ending-of-period atomic index is used to associate data of the aggregated customer data table within a second time period; Performing a logical operation on at least one of the customer atomic indicators and the period-end atomic indicator according to the derivation rule to obtain a customer derived indicator; Aggregate the customer-derived indicators according to the aggregation dimension to obtain the end-of-period dimension indicators; A state change relationship between the end-of-period dimensional indicator and the beginning-of-period atomic indicator is constructed to obtain the target derived indicator.
7. The method according to claim 1, characterized in that After constructing an association relationship between at least one of the customer atomic indicators and the aggregated customer data table according to the target operation logic to obtain the target derived indicator, the method further includes: Generate a JSON statement corresponding to the target operation logic; Convert the JSON statement into a database query statement to obtain data associated with at least one of the customer atomic indicators from the aggregated customer data table; A logical operation is performed on the data associated with at least one of the customer atomic indicators according to the target operation logic to obtain data corresponding to the target derived indicator.
8. The method according to claim 1, characterized in that After constructing an association relationship between at least one of the customer atomic indicators and the aggregated customer data table according to the target operation logic to obtain the target derived indicator, the method further includes: Determining the indicator weight corresponding to the target derived indicator according to the importance of the target derived indicator in the target business scenario; Updating the target derived indicator to multiple indicators corresponding to the target business scenario to obtain multiple updated indicators; Sorting the updated multiple indicators according to the indicator weights to obtain a sorting result; Determine the evaluation index for the performance evaluation of the target object according to the ranking result; The performance of the target object is evaluated using the evaluation indicators.
9. A device for generating a derivative index, characterized in that: include: An indicator selection module, configured to determine at least one customer atomic indicator constituting a target derived indicator in response to a user's selection operation of selecting a target atomic indicator from candidate atomic indicators in a configuration interface; A logic generation module, configured to generate a target operation logic corresponding to the target derived indicator in response to a user's connection operation on at least one of the customer atomic indicators; an aggregation module, configured to aggregate the customer data table to which at least one customer atomic indicator belongs according to an aggregation dimension matching a target business scenario, to obtain an aggregated customer data table, wherein the customer data table includes business data of a customer handling a business, and the business data has at least one customer atomic indicator; The indicator generation module is used to construct an association relationship between at least one of the customer atomic indicators and the aggregated customer data table according to the target operation logic to obtain the target derived indicator.
10. An electronic device, characterized in that: The electronic device comprises: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, the method for generating a derivative indicator according to any one of claims 1 to 8 is implemented.
11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the method for generating a derivative indicator according to any one of claims 1 to 8 is implemented.
12. A computer program product, characterized in that When the instructions in the computer program product are executed by a processor of an electronic device, the electronic device executes the method for generating a derivative indicator as described in any one of claims 1 to 8.
