Industry data processing method, device, electronic equipment and storage medium
By generating indicator metadata and indicator clusters, establishing data tables and association relationships, the problem of unclear industry data expression in the existing technology is solved, and clear management of industry data and multi-dimensional analysis are achieved.
Patent Information
- Application Number
- CN202210707817.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-21
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2042-06-21
AI Technical Summary
The existing technology is difficult to clearly express and analyze complex industry data, which makes it impossible to meet the multi-index and multi-dimensional data analysis needs, especially in time-series data display and online data analysis.
By obtaining pending industry data, generating indicator metadata and indicator clusters, and establishing corresponding data tables, establishing the association relationship between indicator metadata and dimension values, and forming a clear data structure to support data analysis.
It realizes clear expression and associated storage management of industry data, making data analysis more basic and feasible, and supports multi-index and multi-dimensional complex analysis.
Smart Images

Figure CN114970485B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data processing technology, and in particular to an industry data processing method, device, electronic equipment and storage medium. Background Art
[0002] At present, in the daily business processes of various service industries, more and more industry data are generated. These industry data have certain reliability and extensiveness, and can reflect the characteristics, laws and operating conditions of business acquisition. By processing and analyzing these industry data, users can understand the development and changes of business in a timely manner and formulate strategies in a timely manner.
[0003] Due to the large amount of industry data and more frequent data maintenance, a colon is usually used to concatenate the name of the business indicator and the values of different dimensions to form an indicator expression, for example: "Brand A car company: XX model: passenger car sales: automotive industry: month-on-month growth". However, this expression cannot help users clearly understand which are the business indicators and the measurement information of the business indicators. Such a data structure can only be used for time series data display in a single scenario. Whether it is analysts conducting complex analysis of multiple indicators and dimensions, or computers conducting online data analysis or artificial intelligence calculations, it is far from enough.
[0004] Therefore, how to provide an industry data indicator processing method so that the data structure can clearly express the meaning of each data and thus provide a basis for data analysis is a technical problem that needs to be solved. Summary of the invention
[0005] One of the purposes of the present invention is to provide an industry data processing method, device, electronic device and storage medium, so that the data structure can clearly express the meaning of each data, thereby providing a basis for data analysis.
[0006] In a first aspect, the present invention provides an industry data processing method, comprising: obtaining a plurality of industry data to be processed; each of the industry data to be processed comprises an indicator template, a dimension value of a metric dimension of the indicator template, and an update period of the industry data to be processed; for each of the indicator templates, generating indicator metadata corresponding to the indicator template and an identifier of the indicator metadata according to the dimension value and the update period corresponding to the indicator template, and generating an indicator metadata table according to all the indicator metadata; if there is target indicator metadata having the same indicator template, the metric dimension and the same update period in all the indicator metadata, then generating an indicator cluster corresponding to the target indicator metadata and an identifier of the indicator cluster based on the indicator template, the metric dimension and the update period, and generating an indicator cluster data table according to all the indicator clusters; generating a first corresponding relationship according to the identifier of the indicator metadata and the identifier of the dimension value in the indicator metadata, and generating an indicator metadata and dimension value association data table based on all the first corresponding relationships, and generating a second corresponding relationship according to the identifier of the target indicator metadata and the identifier of the indicator cluster, and generating an indicator metadata and indicator cluster association data table based on all the second corresponding relationships.
[0007] In a second aspect, the present invention provides an industry data processing device, comprising:
[0008] An acquisition module, used for acquiring a plurality of pieces of industry data to be processed; each piece of the industry data to be processed comprises an indicator template, a dimension value of a measurement dimension of the indicator template, and an update cycle of the industry data to be processed;
[0009] A generation module, used for generating, for each of the indicator templates, indicator metadata corresponding to the indicator template and an identifier of the indicator metadata according to the dimension value and the update period corresponding to the indicator template, and generating an indicator metadata table according to all the indicator metadata;
[0010] The generating module is further configured to generate an indicator cluster corresponding to the target indicator metadata and an identifier of the indicator cluster based on the indicator template, the measurement dimension and the update cycle, and generate an indicator cluster data table based on all the indicator clusters if there is target indicator metadata having the same indicator template, the same measurement dimension and the same update cycle among all the indicator metadata;
[0011] The generation module is also used to generate a first corresponding relationship according to the identifier of the indicator metadata and the identifier of the dimension value in the indicator metadata, and generate a data table associating the indicator metadata and the dimension value based on all the first corresponding relationships, and to generate a second corresponding relationship according to the identifier of the target indicator metadata and the identifier of the indicator cluster, and generate a data table associating the indicator metadata and the indicator cluster based on all the second corresponding relationships.
[0012] In a third aspect, the present invention provides a device, comprising a processor and a memory, wherein the memory stores a computer program executable by the processor, and the processor can execute the computer program to implement the method described in the first aspect.
[0013] In a fourth aspect, the present invention provides a storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method described in the first aspect.
[0014] The industry data processing method, device, electronic device and storage medium provided by the present invention include: for each indicator template of the industry data to be processed, according to the dimension value and update cycle corresponding to the indicator template, generate indicator metadata and the identifier of the indicator metadata, and generate an indicator metadata table according to all indicator metadata; based on the indicator template, the measurement dimension and the update cycle, generate an indicator cluster and an indicator cluster data table; according to the first correspondence between the identifier of the indicator metadata and the identifier of the dimension value in the indicator metadata, generate an indicator metadata and a dimension value associated data table, and according to the second correspondence between the identifier of the target indicator metadata and the identifier of the indicator cluster, generate an indicator metadata and an indicator cluster associated data table. The present invention can perform associated storage management on industry data, and makes the expression of industry data clear and concise through the indicator metadata and indicator cluster, providing a data basis for subsequent data analysis. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.
[0016] Figure 1 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention;
[0017] Figure 2 A schematic flow chart of an industry data processing method provided by an embodiment of the present invention;
[0018] Figure 3An example diagram of an industry data statistics table provided in an embodiment of the present invention;
[0019] Figure 4 One of the schematic flow charts of another industry data processing method provided by an embodiment of the present invention;
[0020] Figure 5 A second schematic flow chart of another industry data processing method provided by an embodiment of the present invention;
[0021] Figure 6 A third schematic flow chart of another industry data processing method provided by an embodiment of the present invention;
[0022] Figure 7 A fourth schematic flow chart of another industry data processing method provided by an embodiment of the present invention;
[0023] Figure 8 A functional module diagram of an industry data processing device provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0024] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.
[0025] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0026] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.
[0027] In the description of the present invention, it should be noted that if the terms "upper", "lower", "inside", "outside", etc. appear to indicate an orientation or position relationship, they are based on the orientation or position relationship shown in the accompanying drawings, or are the orientation or position relationship in which the product of the invention is usually placed when used. They are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention.
[0028] In addition, the terms “first”, “second”, etc., if used, are merely used to distinguish between the descriptions and should not be understood as indicating or implying relative importance.
[0029] It should be noted that, in the absence of conflict, the features in the embodiments of the present invention may be combined with each other.
[0030] At present, more and more industry data are generated in the daily business processes of various service industries, such as the financial industry and the media industry. These industry data have a certain degree of reliability and extensiveness, and can reflect the characteristics, laws and operating conditions of the business.
[0031] In order to promote mutual development among industries, different service industries will circulate data through data lists, so that different service industries can conduct analysis based on the obtained industry data, which can help users to understand business development changes and formulate strategies in a timely manner.
[0032] For example, in the field of investment research, the degree of dataization of investment research is relatively low and the forms are diverse. Data exchange within and between financial institutions is frequent and business is developing rapidly.
[0033] However, due to the large amount of industry data and more frequent data maintenance, colons are usually used to concatenate the name of the business indicator and the values of different dimensions to form an indicator expression, such as "Brand A car: Model X: Passenger car sales: Automobile industry: Month-on-month growth". This data expression is usually a derivative indicator of a time series, but the indicator template from which the derivative indicator is derived and the meaning of each word between colons are not included in the list of data circulation. For example, "Brand A car: Model X: Passenger car sales: Automobile industry: Month-on-month growth". In this data structure, users have no way of knowing whether "Brand A car" represents stocks or companies, so it cannot help users clearly know which are business indicators and the measurement information of business indicators. Such a data structure can only be used for time series data display in a single scenario. Whether it is analysts conducting complex analysis of multiple indicators and dimensions, or computers conducting online data analysis or artificial intelligence calculations, it is far from enough.
[0034] In order to solve the above problems, an embodiment of the present invention provides an industry data processing method. Before introducing the industry data processing method provided by the embodiment of the present invention, relevant terms involved in the embodiment of the present invention are first introduced.
[0035] (1) Indicator template: It is a unified standard used to measure a certain business and has a unique and clear name, such as product sales volume, purchase price, sales price, etc.
[0036] (2) Entity (that is, the target industry object in the embodiment of the present invention): an object that participates in business generation activities. Common entity types include companies, regions, products, securities, etc.
[0037] (3) Measurement dimension: It is the observation angle of business indicators. For example, cars can be divided into different car types, different car models, etc. Common dimensions include region, company, product, model, etc., and can also be divided into atomic dimension and non-atomic dimension. Atomic dimension refers to mutually exclusive and complete division and annotation under the same logic, while non-atomic dimension is a combination of atomic dimension to meet statistical needs. It can be understood that there is a parent-child relationship or combination relationship between non-atomic dimension and atomic dimension. For example, there is a parent-child relationship between car companies and car models. Car companies are a non-atomic dimension and car models are an atomic dimension. For another example, take the regional dimension as an example. Province A and City A are both regional dimensions. City A is located in Province A, so Province A is a non-atomic dimension and City A is an atomic dimension. For another example, Organization A is composed of multiple countries. Organization A and these countries are in a combination relationship. Then Organization A is a non-atomic dimension and each country is an atomic dimension.
[0038] (4) Indicator metadata: data represented by indicator templates, entities, and measurement dimensions, such as: I = f(I T ,E,X I ), where I represents the indicator metadata; I T Characterization indicator template; X I The dimension vector representing the indicator I; E represents the entity value, and common entities include regions, companies, securities, etc.; f represents the combination function, which means that the indicator template is I T , dimension value is X I , the entity is an indicator of E.
[0039] (5) Indicator value: The value of the indicator template under different measurement dimensions, in the form of: V = g(I, t), where I represents the indicator metadata; t represents a specific time point; and g represents the value function, which means taking the indicator metadata as I and the indicator value at time node t.
[0040] (6) Indicator cluster: indicator data composed of indicator metadata with the same indicator template and the same measurement dimension.
[0041] The following describes an electronic device provided by an embodiment of the present invention. The electronic device can be used to execute the industry data processing method provided by an embodiment of the present invention. Figure 1 , Figure 1 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention.
[0042] like Figure 1As shown, the electronic device 100 includes a memory 101, a processor 102 and a communication interface 103, and the memory 101, the processor 102 and the communication interface 103 are directly or indirectly electrically connected to each other to achieve data transmission or interaction. For example, these elements can be electrically connected to each other through one or more communication buses or signal lines.
[0043] The memory 101 can be used to store software programs and modules, such as the instructions / modules of the industry data processing device 300 provided in the embodiment of the present invention, which can be stored in the memory 101 in the form of software or firmware or fixed in the operating system (OS) of the electronic device 100. The processor 102 executes various functional applications and data processing by executing the software programs and modules stored in the memory 101. The communication interface 103 can be used to communicate signaling or data with other node devices.
[0044] Among them, the memory 101 can be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable read-only memory (EEPROM), etc.
[0045] The processor 102 may be an integrated circuit chip with signal processing capability. The processor 102 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.
[0046] Understandably, Figure 1 The structure shown is for illustration only. The electronic device 100 may also include Figure 1More or fewer components as shown, or with Figure 1 Different configurations shown. Figure 1 The components shown may be implemented in hardware, software or a combination thereof.
[0047] The following describes an industry data processing method provided by an embodiment of the present invention. Figure 2 , Figure 2 A schematic flow chart of an industry data processing method provided by an embodiment of the present invention, which can be used to Figure 1 The electronic device in the embodiment is an execution subject, and the method may include:
[0048] S201, obtaining multiple pieces of industry data to be processed.
[0049] Each piece of industry data to be processed includes an indicator template, a dimension value of a measurement dimension of the indicator template, and an update cycle of the industry data to be processed.
[0050] For example, the monthly sales data of all passenger cars of all automobile companies are obtained from a certain automobile association. The indicator template is sales volume, the measurement dimensions are automobile companies and passenger cars, and the update cycle is monthly.
[0051] In a possible implementation, the above-mentioned industry data to be processed can be obtained through various channels. For example, in the automotive industry, the industry data updated monthly in each city can be crawled from the corresponding data maintenance platform through crawler technology; for another example, in the non-banking industry, various indicators of various securities companies will be published in the annual report data, so the annual report data can be automatically parsed through the NLP method, and the indicators and corresponding indicator values can be exported.
[0052] In order to facilitate the execution of subsequent processing procedures, after obtaining the industry data to be processed, the embodiment of the present invention can also perform layered and unified processing on the above-mentioned businesses to be processed, so that indicator metadata and indicator clusters can be generated in the processed industry data to be processed, thereby improving data processing efficiency.
[0053] Therefore, the embodiment of the present invention also provides a possible implementation method, namely:
[0054] Obtain industry statistics;
[0055] Among them, the industry data statistics table is as follows Figure 3 As shown, Figure 3 This is an example diagram of an industry data statistics table provided in an embodiment of the present invention. The table can maintain the indicator values of each indicator template under different measurement dimensions. It can be seen that the industry data statistics table has a first information example corresponding to the indicator template, a second information column corresponding to the measurement dimension, and a third information column corresponding to the entity;
[0056] In response to user operations, the indicator template of each industry data to be processed is matched with the first information column, the indicator value of the indicator template under the measurement dimension is matched with the second information column, and the entity is matched with the third information column.
[0057] S202, for each indicator template, generate indicator metadata corresponding to the indicator template and an identifier of the indicator metadata according to the dimension value and update cycle corresponding to the indicator template, and generate an indicator metadata table according to all the indicator metadata.
[0058] In an embodiment of the present invention, the indicator template, dimension value, and update cycle can be spliced in a specific manner to generate indicator metadata. For example, each indicator metadata uses an English colon to separate the indicator template, dimension value, and update cycle, and then multiple dimension values are separated by underscores.
[0059] For example, see Figure 3 , the indicator templates include "sales volume" and "sales price", and the measurement dimensions include "car company" and "car model". For the indicator template "sales volume", taking the third row of data as an example, the indicator metadata that can be generated is "sales volume: brand 1_aa model: month". For another example, for the indicator template "sales price", taking the third row of data as an example, the indicator metadata generated is "sales price: brand 1_aa model: month", where "brand 1" is also the entity of the indicator template.
[0060] The embodiment of the present invention can also assign an identifier to each indicator metadata, and the identifier provides a basis for subsequent data extraction, thereby preventing data extraction errors and improving data processing accuracy.
[0061] After obtaining all indicator metadata and the identifier corresponding to each indicator metadata, an indicator metadata table can be generated. The indicator metadata table in the embodiment of the present invention can be as shown in Table 1. The indicator metadata table is used to maintain indicator template data, dimension value data, and entity data that are combined to specify a specific indicator. It is directly associated with the indicator value.
[0062] Table 1
[0063]
[0064] S203, if there is target indicator metadata with the same indicator template, measurement dimension and update cycle among all indicator metadata, then based on the indicator template, measurement dimension and update cycle, generate an indicator cluster and an indicator cluster identifier corresponding to the target indicator metadata, and generate an indicator cluster data table based on all indicator clusters.
[0065] For example, see Figure 3For the indicator template "sales volume", the generated indicator metadata can include "sales volume: brand 1_aa model: month", "sales volume: brand 1_bb model: month", etc. For the indicator template "sales price", the generated indicator metadata includes "sales price: brand 1_aa model: month". It can be seen that the "indicator templates" in "sales volume: brand 1_aa model: month" and "sales volume: brand 1_bb model: month" are all sales volume, the measurement dimensions are "car company" and "car model", and the update cycle is month. Therefore, these two indicator metadata can be combined into an indicator cluster of "sales volume: car company_car model: month"; for the two indicator metadata of "sales volume: brand 1_aa model: month" and "sales price: brand 1_aa model: month", the indicator metadata of the two are different, so the same indicator cluster cannot be generated.
[0066] The embodiment of the present invention further allocates an identifier to each index cluster, and the identifier is used to provide a guarantee for subsequently establishing a data table associating the index cluster with the index metadata.
[0067] The indicator cluster data table generated by the embodiment of the present invention may be as shown in Table 2, which is used to store indicator cluster data.
[0068] Table 2
[0069]
[0070] Through the above implementation, industry data with the same measurement dimension, the same indicator template and the same data update cycle can be uniformly associated together to provide guidance for subsequent data analysis.
[0071] S204, generating a first correspondence according to the identifier of the indicator metadata and the identifier of the dimension value in the indicator metadata, and generating a data table associating the indicator metadata and the dimension value based on all the first correspondences, and generating a second correspondence according to the identifier of the target indicator metadata and the identifier of the indicator cluster, and generating a data table associating the indicator metadata and the indicator cluster based on all the second correspondences.
[0072] In order to associate multiple indicator metadata that generate the same indicator cluster, the embodiment of the present invention can also assign an identifier to the indicator cluster, establish a correspondence between the identifier of the indicator cluster and the identifier of the indicator metadata, and generate an indicator cluster and indicator metadata association data table based on this correspondence.
[0073] The indicator cluster and indicator metadata association data table provided by the implementation of the present invention is shown in Table 3. The table is used to store the indicator metadata and indicator cluster association. Since the indicator metadata and indicator value are a many-to-many mapping, that is, one indicator may be included in multiple indicator clusters, these indicator clusters may be parent-child relationships, and one indicator cluster may also contain multiple indicators, so this table is needed to store the association relationship.
[0074] Table 3
[0075]
[0076] In order to facilitate determination of the dimension value corresponding to the measurement dimension in each indicator metadata, an embodiment of the present invention establishes a correspondence between each indicator metadata and the dimension value, and generates an indicator metadata and dimension value association data table based on the correspondence.
[0077] The indicator metadata and dimension value association data table generated by the implementation of the present invention is shown in Table 4. The table is used to store the association between indicator metadata and dimension values. Since the indicator metadata and indicator values are many-to-many mappings, that is, one indicator may correspond to multiple dimension values, and one dimension value may be used by multiple indicators, the table is needed to store the association relationship.
[0078] Table 4
[0079]
[0080] For example, see Figure 3 , assuming that the generated indicator metadata is "sales price: brand 1_aa type: month", where "brand 1" and "aa type" are the two dimension values corresponding to the indicator metadata. Therefore, identifiers can be assigned to these two dimension values, and the corresponding relationships between "brand 1" and "aa type" and "sales price" can be established respectively. Based on all the corresponding relationships, a data table associating indicator metadata and dimension values can be generated.
[0081] As can be seen from Table 4 above, the indicator metadata and dimension value association data table also maintains the order of each dimension value. This order information can provide a data basis for subsequently specifying the display strategy of each dimension value.
[0082] In an optional implementation manner, the embodiment of the present invention can also generate an indicator template data table, see Figure 4 , Figure 4 One of the schematic flow charts of another industry data processing method provided by an embodiment of the present invention:
[0083] S205, for each indicator metadata, generate an indicator template data table according to the identifier, type information and level information corresponding to the indicator template in the indicator metadata.
[0084] In the embodiment of the present invention, the hierarchical information indicates whether the indicator template is a derived indicator template. The derived indicator template can be obtained by calculation in the indicator template. For example, the indicator template "GDP year-on-year" can be obtained by calculating "GDP" using specific rules for a specific time. It is worth noting that not all derived indicator templates are obtained by calculation. When the atomic indicator template does not exist, the derived indicator template can also be imported.
[0085] The indicator template data table provided in the embodiment of the present invention can be referred to Table 5, which is used to define the indicator template.
[0086] Table 5
[0087]
[0088] It can be seen that the parent in the above table indicates the hierarchical information of the indicator template. If an indicator template is a derived template, the hierarchical information and derived type are maintained in the table. If not, the row information can be empty.
[0089] It should be noted that in the process of generating the indicator template data table, the indicator template may have multiple names with the same business meaning. For example, "PE" and "price-earnings ratio" refer to the same thing. At this time, the data management personnel can determine which one to use as the standard and store it in the data table.
[0090] In an optional implementation manner, the embodiment of the present invention can also generate an indicator value data table, see Figure 5 , Figure 5 A second schematic flow chart of another industry data processing method provided by an embodiment of the present invention:
[0091] S206 , for each indicator metadata, generate an indicator value data table according to the identifier of the indicator metadata, the indicator value of the indicator template under the measurement dimension, and the time information corresponding to the indicator value.
[0092] The indicator value data table generated by the embodiment of the present invention may be as shown in Table 6, which is used to store the indicator value table, and the indicator value is the value of the indicator metadata at a specific time.
[0093] Table 6
[0094]
[0095] In an optional implementation, the embodiment of the present invention can also generate an indicator template data table, see Figure 6 , Figure 6 A third schematic flow chart of another industry data processing method provided by an embodiment of the present invention:
[0096] S207, for each piece of industry data to be processed, generate a target industry object information table according to the target industry object of the business to be processed and the identifier of the target industry object.
[0097] The target industry object information table generated by the embodiment of the present invention can be as shown in Table 7. The table is used to store entity data. The target industry objects can be but are not limited to securities, companies, industries, regions, etc. It is possible that different types of target industry objects can have the same name, such as the company name is the same as the issued stocks, so it is necessary to introduce entity type distinction.
[0098] Table 7
[0099]
[0100]
[0101] In an optional implementation manner, the embodiment of the present invention can also generate an indicator template data table, see Figure 7 , Figure 7 A fourth schematic flow chart of another industry data processing method provided by an embodiment of the present invention:
[0102] S208, for all metric dimensions, generate a dimension value data table according to all metric values corresponding to the metric dimensions and an identifier of each metric value.
[0103] The dimension value data table generated by the embodiment of the present invention may be as shown in Table 8, which is used to store dimension value data.
[0104] Table 8
[0105]
[0106] For example, continue with Figure 3 As shown, the names of the dimension values are "car company" and "car model". For "car company", the dimension values are "brand 1", "brand 2" and "brand 3". For "car model", the dimension values are "aa type", "bb type", "A type" and "II type".
[0107] It should be noted that the above steps S205, S206, S207 and S208 can be executed simultaneously or separately, and are not limited here. Therefore, the embodiment of the present invention can generate the above-mentioned various data tables at the same time, and can also generate the above-mentioned various data tables at different times according to different requirements.
[0108] In an optional implementation manner, after obtaining the industry data to be processed, the embodiment of the present invention can count all the industry data to be processed into the industry data statistics table. In order to avoid data redundancy, the embodiment of the present invention also provides a possible implementation manner:
[0109] a1. For each target measurement dimension in the industry data to be processed, determine whether the target measurement dimension is in the pre-generated industry data statistical table; wherein the industry data statistical table is used to maintain the indicator value of each indicator template under different dimensions; wherein the target measurement dimension is any one of all measurement dimensions;
[0110] a2, if it exists, respond to the user operation and make the indicator value of the indicator template in the industry data to be processed under the target measurement dimension correspond to the information column corresponding to the target measurement dimension;
[0111] a3, if it does not exist, then generate the information column corresponding to the target measurement dimension according to the target measurement dimension, and execute the step of responding to the user operation, matching the indicator value of the indicator template in the industry data to be processed under the target measurement dimension with the information column corresponding to the target measurement dimension.
[0112] For example, after obtaining the monthly sales data of passenger cars, the measurement dimensions of the indicator template here are "car company" and "car model". First, determine whether the two dimensions of "car company" and "car model" exist in the industry data statistics table. If not, add new information columns corresponding to "car company" and "car model" in the industry data statistics table. If they already exist, there is no need to add them.
[0113] Among them, for the indicator template and entity, the above steps a1 to a3 can also be implemented to ensure that each industry data to be processed can be completely saved in the industry data statistics table.
[0114] In an optional implementation, the embodiment of the present invention can also provide an implementation of industry data display based on the various tables generated above, namely:
[0115] b1, when the display operation instruction is obtained, the target indicator metadata is determined from the indicator metadata and indicator cluster association data table according to the obtained indicator cluster identifier;
[0116] b2, from the indicator metadata and dimension value association data table, determine the identifiers of all dimension values corresponding to the target indicator metadata, and based on the identifiers of all dimension values, extract all dimensions from the pre-generated dimension value information table;
[0117] b3 extracts all indicator values from the pre-generated indicator value data table according to the identifier of the target indicator metadata;
[0118] b4, display all dimensions and the indicator values under each dimension.
[0119] After standardizing the business indicators in the above way, these indicators can be observed in a structured manner on the front end.
[0120] See also Figure 8 , Figure 8 This is a functional module diagram of an industry data processing device provided by an embodiment of the present invention. The industry data processing device 300 may include:
[0121] The acquisition module 310 is used to acquire multiple pieces of industry data to be processed; each piece of industry data to be processed includes an indicator template, a dimension value of a measurement dimension of the indicator template, and an update cycle of the industry data to be processed;
[0122] The generating module 320 is used to generate the indicator metadata corresponding to the indicator template and the indicator metadata identifier for each indicator template according to the dimension value and update cycle corresponding to the indicator template, and generate the indicator metadata table according to all the indicator metadata;
[0123] The generating module 320 is further used to generate an indicator cluster and an indicator cluster identifier corresponding to the target indicator metadata based on the indicator template, the measurement dimension and the update cycle, and generate an indicator cluster data table based on all indicator clusters if there is target indicator metadata with the same indicator template, measurement dimension and update cycle in all indicator metadata;
[0124] The generation module 320 is also used to generate a first corresponding relationship according to the identifier of the indicator metadata and the identifier of the dimension value in the indicator metadata, and generate a data table associating the indicator metadata and the dimension value based on all the first corresponding relationships, and to generate a second corresponding relationship according to the identifier of the target indicator metadata and the identifier of the indicator cluster, and generate a data table associating the indicator metadata and the indicator cluster based on all the second corresponding relationships.
[0125] In an optional implementation, the generation module 320 is further used to generate an indicator template data table for each indicator metadata according to the identifier, type information and level information corresponding to the indicator template in the indicator metadata.
[0126] In an optional implementation, the generation module 320 is further used to generate an indicator value data table for each indicator metadata according to the identifier of the indicator metadata, the indicator value of the indicator template under the measurement dimension, and the time information corresponding to the indicator metadata.
[0127] In an optional implementation, the generation module 320 is further used to generate a target industry object information table for each piece of industry data to be processed according to the target industry object of the business to be processed and the identifier of the target industry object.
[0128] In an optional implementation, the generation module is further used to generate a dimension value data table for all measurement dimensions according to all measurement values corresponding to the measurement dimensions and an identifier of each measurement value.
[0129] In an optional implementation, a determination module is also included, which is used to determine whether the target measurement dimension in each piece of industry data to be processed is in a pre-generated industry data statistical table; wherein the industry data statistical table is used to maintain the indicator value of each indicator template in different dimensions; wherein the target measurement dimension is any one of all measurement dimensions; if it exists, in response to user operations, the indicator value of the indicator template in the industry data to be processed under the target measurement dimension is matched with the information column corresponding to the target measurement dimension; if it does not exist, based on the target measurement dimension, an information column corresponding to the target measurement dimension is generated, and the step of responding to user operations and matching the indicator value of the indicator template in the industry data to be processed under the target measurement dimension with the information column corresponding to the target measurement dimension is executed.
[0130] In an optional implementation, a display module is further included, which is used to determine the target indicator metadata from the indicator metadata and indicator cluster association data table according to the obtained indicator cluster identifier when a display operation instruction is obtained; determine the identifiers of all dimension values corresponding to the target indicator metadata from the indicator metadata and dimension value association data table, and based on the identifiers of all dimension values, extract all dimensions from the pre-generated dimension value information table; extract all indicator values from the pre-generated indicator value data table according to the identifier of the target indicator metadata; and display all dimensions and the indicator values under each dimension.
[0131] The embodiment of the present invention further provides a storage medium on which a computer program is stored, and when the computer program is executed by a processor, an industry data processing method as described in any of the above embodiments is implemented. The computer storage medium can be, but is not limited to, a U disk, a mobile hard disk, a ROM, a RAM, a PROM, an EPROM, an EEPROM, a magnetic disk, or an optical disk, and other media that can store program codes.
[0132] The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims
1. A method for processing industry data, characterized in that: The method comprises: Acquire multiple pieces of industry data to be processed; each piece of the industry data to be processed includes an indicator template, a dimension value of a measurement dimension of the indicator template, and an update cycle of the industry data to be processed; For each of the indicator templates, according to the dimension value and the update period corresponding to the indicator template, generate the indicator metadata corresponding to the indicator template and the identifier of the indicator metadata, and generate an indicator metadata table according to all the indicator metadata; If there is target indicator metadata with the same indicator template, measurement dimension and update period in all the indicator metadata, then based on the indicator template, measurement dimension and update period, generate an indicator cluster corresponding to the target indicator metadata and an identifier of the indicator cluster, and generate an indicator cluster data table according to all the indicator clusters; Generate a first correspondence according to the identifier of the indicator metadata and the identifier of the dimension value in the indicator metadata, and generate an indicator metadata and dimension value association data table based on all the first correspondences, and generate a second correspondence according to the identifier of the target indicator metadata and the identifier of the indicator cluster, and generate an indicator metadata and indicator cluster association data table based on all the second correspondences; When the display operation instruction is obtained, the target indicator metadata is determined from the indicator metadata and indicator cluster association data table according to the obtained indicator cluster identifier; Determine the identifiers of all dimension values corresponding to the target indicator metadata from the indicator metadata and dimension value association data table, and extract all dimensions from the pre-generated dimension value information table based on the identifiers of all dimension values; Extracting all indicator values from a pre-generated indicator value data table according to the identifier of the target indicator metadata; All the dimensions and the indicator values under each dimension are displayed.
2. The industry data processing method according to claim 1, characterized in that: The method further comprises: For each of the indicator metadata, an indicator template data table is generated according to the identifier, type information and level information corresponding to the indicator template in the indicator metadata.
3. The industry data processing method according to claim 1, characterized in that: The method further comprises: For each of the indicator metadata, an indicator value data table is generated according to the identifier of the indicator metadata, the indicator value of the indicator template under the measurement dimension, and the time information corresponding to the indicator metadata.
4. The industry data processing method according to claim 1, characterized in that: The method further comprises: For each piece of the to-be-processed industry data, a target industry object information table is generated according to the target industry object for generating the to-be-processed industry data and the identifier of the target industry object.
5. The industry data processing method according to claim 1, characterized in that: The method further comprises: For all the metric dimensions, a dimension value data table is generated according to all metric values corresponding to the metric dimensions and an identifier of each metric value.
6. The industry data processing method according to claim 1, characterized in that: The method further comprises: For each target measurement dimension in the industry data to be processed, determine whether the target measurement dimension is in a pre-generated industry data statistical table; wherein the industry data statistical table is used to maintain the indicator value of each indicator template under different dimensions; wherein the target measurement dimension is any one of all the measurement dimensions; If it exists, in response to the user operation, the indicator value of the indicator template in the to-be-processed industry data under the target measurement dimension is matched with the information column corresponding to the target measurement dimension; If it does not exist, then based on the target measurement dimension, generate an information column corresponding to the target measurement dimension, and execute a step in response to user operations to correspond the indicator value of the indicator template in the industry data to be processed under the target measurement dimension with the information column corresponding to the target measurement dimension.
7. An industry data processing device, characterized in that: include: An acquisition module, used for acquiring a plurality of pieces of industry data to be processed; each piece of the industry data to be processed comprises an indicator template, a dimension value of a measurement dimension of the indicator template, and an update cycle of the industry data to be processed; A generation module, used for generating, for each of the indicator templates, indicator metadata corresponding to the indicator template and an identifier of the indicator metadata according to the dimension value and the update period corresponding to the indicator template, and generating an indicator metadata table according to all the indicator metadata; The generating module is further configured to generate an indicator cluster corresponding to the target indicator metadata and an identifier of the indicator cluster based on the indicator template, the measurement dimension and the update cycle, and generate an indicator cluster data table based on all the indicator clusters if there is target indicator metadata having the same indicator template, the same measurement dimension and the same update cycle among all the indicator metadata; The generating module is further configured to generate a first corresponding relationship according to the identifier of the indicator metadata and the identifier of the dimension value in the indicator metadata, and generate an indicator metadata and dimension value association data table based on all the first corresponding relationships, and to generate a second corresponding relationship according to the identifier of the target indicator metadata and the identifier of the indicator cluster, and generate an indicator metadata and indicator cluster association data table based on all the second corresponding relationships; A display module is used to, when a display operation instruction is obtained, determine the target indicator metadata from the indicator metadata and indicator cluster association data table according to the obtained indicator cluster identifier; determine the identifiers of all dimension values corresponding to the target indicator metadata from the indicator metadata and dimension value association data table, and based on the identifiers of all dimension values, extract all dimensions from a pre-generated dimension value information table; extract all indicator values from a pre-generated indicator value data table according to the identifier of the target indicator metadata; and display all dimensions and the indicator values under each dimension.
8. An electronic device, comprising a processor and a memory, characterized in that: The memory stores a computer program that can be executed by the processor, and the processor can execute the computer program to implement the method according to any one of claims 1 to 6.
9. A storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.
