Data analysis method, system, computer device and readable storage medium

Through the configured data analysis method, the existing variable analysis method is solved, and variable logic adjustment and optimization without release is realized, development efficiency and learning cost are improved, and multimodal analysis is supported.

CN119088445BActive Publication Date: 2025-02-14KINCHENG BANK OF TIANJIN CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411571092.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-11-06
Publication Date
2025-02-14
Estimated Expiration
2044-11-06

AI Technical Summary

Technical Problem

The existing variable analysis methods are hard-coded to parse, resulting in the time-consuming construction and maintenance of variables, depend on version quality, low logic adjustment and up-and-down efficiency, and high cost of understanding and learning variables.

Method used

A data analysis method is proposed, by obtaining variable parameters and modal analysis configuration tables, querying variable configuration information, finding modal analysis configuration items, obtaining variable source data and calculating the parsed value. This method configures variable parameter-related information and supports multimodal analysis.

Benefits of technology

Logical adjustment and optimization of variables can be performed without publishing, shortening variable delivery time, improving development efficiency, reducing the time and learning cost of understanding variables, and supporting multimodal analysis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088445B_ABST
    Figure CN119088445B_ABST
Patent Text Reader

Abstract

The present application relates to the field of data processing technology, and in particular to a data analysis method, system, computer device and readable storage medium. The method obtains variable parameters and a modal analysis configuration table; then queries the corresponding variable configuration information according to the variable parameters, wherein the variable configuration information includes a prophetic variable configuration item and a variable calculation configuration item; based on the variable calculation configuration item, finds the modal analysis configuration item corresponding to the variable parameter from the modal analysis configuration table; based on the modal analysis configuration item and the variable calculation configuration item, obtains the variable source data of the variable parameter; finally, calculates the analysis value corresponding to the variable source data based on the variable calculation configuration item. The variable parameters of the present application do not need to be released after addition / modification, which can shorten the variable delivery time and improve development efficiency; it can also be clearly displayed through visualization to reduce learning costs; it also supports multi-modal analysis, covering most parameter analysis needs.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data parsing method, system, computer device and readable storage medium. Background Art

[0002] Most existing variable parsing is done through hard-coding, which can cause the following problems:

[0003] First, building a simple variable also requires going through the entire process of demand development. This method is time-consuming and overly dependent on the quality of the version. If problems occur in the same version, it will also affect the launch of the variable.

[0004] Second, the logical adjustment, optimization, and online and offline operation of variables all require the release process, which is inefficient and difficult to maintain.

[0005] Third, in the variable parsing method, if you need to understand the definition, life cycle or dependency of a variable, you can only look for the relevant requirements of the variable or infer the business logic of the variable from the development logic, which requires a high cost for understanding and learning the variable. Summary of the invention

[0006] In view of the above problems, the present application proposes a data parsing method, system, computer device and readable storage medium.

[0007] In a first aspect, an embodiment of the present application provides a data parsing method, comprising:

[0008] Get variable parameters and modal analysis configuration table;

[0009] Querying corresponding variable configuration information according to the variable parameters, wherein the variable configuration information includes variable calculation configuration items;

[0010] Based on the variable calculation configuration item, searching the modal analysis configuration item corresponding to the variable parameter from the modal analysis configuration table;

[0011] Based on the modal analysis configuration item and the variable calculation configuration item, obtaining variable source data of the variable parameter;

[0012] The parsed value corresponding to the variable source data is calculated based on the variable calculation configuration item.

[0013] In some embodiments, searching the modal analysis configuration item corresponding to the variable parameter from the modal analysis configuration table based on the variable calculation configuration item includes:

[0014] Extracting a modal analysis category corresponding to the variable parameter from the variable calculation configuration item;

[0015] According to the modal analysis category, the modal analysis configuration item corresponding to the variable parameter is searched from the modal analysis configuration table.

[0016] In some embodiments, the acquiring the variable source data of the variable parameter based on the modal analysis configuration item and the variable calculation configuration item includes:

[0017] Extracting configuration codes and non-prophetic variables from the variable calculation configuration items;

[0018] Extracting input parameter related information from the modal analysis configuration item, and acquiring a modal operation mode from the modal analysis configuration item according to the configuration code; wherein the input parameter related information includes an input parameter class path and an input parameter dependency;

[0019] Determine whether to obtain the prophet variable based on the input parameter related information;

[0020] If so, obtain the prophetic variable according to the non-prophetic variable and the input parameter dependency, and then obtain the variable source data based on the modal operation mode, the prophetic variable and the input parameter class path;

[0021] If not, the variable source data is obtained according to the modal operation mode.

[0022] In some embodiments, the variable configuration information includes a prophet variable configuration item; and obtaining the prophet variable according to the non-prophet variable and the input parameter dependency relationship includes:

[0023] According to the input parameter dependency relationship, search for the dependent variables of the non-prophetic variable;

[0024] Determine whether the dependent variable is the prophetic variable;

[0025] If it is not the prophet variable, a new dependent variable is obtained according to the dependent variable and the input parameter dependency relationship of the dependent variable, and then it is determined whether the new dependent variable is the prophet variable, until the prophet variable is obtained;

[0026] The method of determining whether the dependent variable is the prophetic variable includes any one of the following methods:

[0027] Method 1: judging whether the dependent variable is a prophet variable according to the prophet variable configuration item;

[0028] Method 2: judging whether the dependent variable is a prophetic variable according to the variable calculation configuration item.

[0029] In some embodiments, the obtaining of variable source data based on the modal operation mode, the prophetic variable and the input parameter class path includes:

[0030] Parsing the input parameter class path to obtain input parameter information, wherein the input parameter information includes an attribute type and a non-null value;

[0031] Verify whether the prophet variable is qualified according to the input parameter information;

[0032] When the prophet variable is qualified, the prophet variable is converted into a modal operation input parameter according to the input parameter information;

[0033] The variable source data is obtained according to the modal operation input parameters and the modal operation mode.

[0034] In some embodiments, the variable source data is associated with an active data verification rule; after obtaining the variable source data of the variable parameter, the method further includes:

[0035] Verifying the variable source data according to the source data verification rule;

[0036] If the variable source data passes the verification, the parsed value corresponding to the variable source data is calculated based on the variable calculation configuration item.

[0037] In some embodiments, the calculating the parsed value corresponding to the variable source data based on the variable calculation configuration item includes:

[0038] Obtaining the calculation expression in the variable calculation configuration item;

[0039] According to the calculation expression and the variable source data, the parsed value corresponding to the variable source data is calculated.

[0040] In a second aspect, an embodiment of the present application provides a data analysis system, including:

[0041] A first acquisition unit is used to acquire variable parameters and a modal analysis configuration table;

[0042] A first query unit, configured to query corresponding variable configuration information according to the variable parameter, wherein the variable configuration information includes a prophet variable configuration item and a variable calculation configuration item;

[0043] A second query unit, configured to search the modal analysis configuration item corresponding to the variable parameter from the modal analysis configuration table based on the variable calculation configuration item;

[0044] A second acquisition unit, configured to acquire variable source data of the variable parameter based on the modal analysis configuration item and the variable calculation configuration item;

[0045] A calculation unit is used to calculate the parsed value corresponding to the variable source data based on the variable calculation configuration item.

[0046] In a third aspect, an embodiment of the present application proposes a computer device, comprising a storage unit and a processing unit, wherein the storage unit stores a computer program, and the processing unit executes the steps of the above-mentioned data analysis method by calling the computer program stored in the storage unit.

[0047] In a fourth aspect, an embodiment of the present application proposes a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program is suitable for loading by a processor to execute the steps of the above-mentioned data parsing method.

[0048] The embodiments of the present application have the following beneficial effects:

[0049] The embodiment of the present application proposes a data parsing method, which obtains variable parameters and a modal parsing configuration table; then queries the corresponding variable configuration information according to the variable parameters, wherein the variable configuration information includes a prophetic variable configuration item and a variable calculation configuration item; based on the variable calculation configuration item, finds the modal parsing configuration item corresponding to the variable parameter from the modal parsing configuration table; based on the modal parsing configuration item and the variable calculation configuration item, obtains the variable source data of the variable parameter; finally, calculates the parsing value corresponding to the variable source data based on the variable calculation configuration item. The present application proposes a new parsing method, which configures the information related to the variable parameters, adjusts the logic of the variables, optimizes them, and goes online and offline without publishing, shortens the variable delivery time, and improves development efficiency. The dependency relationship of the configured variable parameters, especially the more complex variable dependency, can be clearly displayed through visualization, reducing the time to understand the variables and reducing the learning cost. Not only that, the present application also supports multi-modal parsing, covering most parameter parsing needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the technical solution of the present application, the following is a brief introduction to the drawings required for use in the embodiments. It should be understood that the following drawings only illustrate certain embodiments of the present application and should not be regarded as limiting the scope of protection of the present application. In each of the drawings, similar components are numbered similarly.

[0051] Figure 1 A first flow chart of the data analysis method proposed in the embodiment of the present application is shown;

[0052] Figure 2 A schematic diagram of prophet variable configuration items of the data parsing method proposed in an embodiment of the present application is shown;

[0053] Figure 3 A second flow chart of the data analysis method proposed in the embodiment of the present application is shown;

[0054] Figure 4A third flow chart of the data analysis method proposed in the embodiment of the present application is shown;

[0055] Figure 5 A fourth flow chart of the data analysis method proposed in the embodiment of the present application is shown;

[0056] Figure 6 A fifth flow chart of the data analysis method proposed in the embodiment of the present application is shown;

[0057] Figure 7 A sixth flow chart of the data analysis method proposed in the embodiment of the present application is shown;

[0058] Figure 8 A seventh flow chart of the data analysis method proposed in the embodiment of the present application is shown;

[0059] Fig. 9 A schematic diagram of the structure of a data analysis system proposed in another embodiment of the present application is shown. DETAILED DESCRIPTION

[0060] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments.

[0061] The components of the embodiments of the present application generally described and shown in the drawings herein may be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0062] Hereinafter, the terms "including", "having" and their cognates, which may be used in various embodiments of the present application, are intended only to indicate specific features, numbers, steps, operations, elements, components, or combinations of the foregoing items, and should not be understood as first excluding the existence of one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing items or adding the possibility of one or more features, numbers, steps, operations, elements, components, or combinations of the foregoing items.

[0063] Furthermore, the terms “first”, “second”, “third”, etc. are merely used for distinguishing descriptions and are not to be understood as indicating or implying relative importance.

[0064] Unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meanings as those generally understood by those skilled in the art to which the various embodiments of the present application belong. The terms (such as those defined in generally used dictionaries) will be interpreted as having the same meanings as the contextual meanings in the relevant technical field and will not be interpreted as having idealized meanings or overly formal meanings unless clearly defined in the various embodiments of the present application.

[0065] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0066] Hard coding means writing certain values ​​or parameters directly into the code. Once it is online, it cannot be modified at any time. If new values ​​or parameters are added, a new version needs to be released, which cannot be flexibly configured by users. For variable parsing, in order to simplify the code, it is usually parsed through hard coding, which leads to the above-mentioned problems.

[0067] Therefore, in order to solve the above problems, the present application proposes a data analysis method.

[0068] Please refer to Figure 1 , is a flow chart of a data analysis method proposed in an embodiment of the present application. Exemplarily, the data analysis method is applied to scenarios such as variable analysis.

[0069] In some embodiments, Figure 1 As shown, the data parsing method includes:

[0070] S110, obtaining variable parameters and modal analysis configuration table.

[0071] Since the existing variable parameters (hereinafter referred to as variables) correspond to different types of parsing types, namely modal parsing categories, such as Bean parsing mode, RPC parsing mode, SQL parsing mode or format conversion mode, etc. Different parsing modes mean that the variable source data of the corresponding variable parameters need to be obtained through different acquisition methods. Among them, the Bean parsing mode is the acquisition method provided by the data source in this system; the RPC parsing mode is the parsing method of the data source in another system; the SQL parsing mode is the method of processing big data for the provided data source. Among them, the conversion of fixed formats only needs to configure the corresponding conversion rules, and the variable calculation configuration table includes the modal parsing category corresponding to the variable parameter.

[0072] S210. Query corresponding variable configuration information according to variable parameters.

[0073] Each variable parameter corresponds to variable configuration information. Variable configuration information includes prophet variable configuration items and variable calculation configuration items. The pre-configured prophet variable configuration table includes prophet variable configuration items corresponding to each variable parameter. Each prophet variable configuration item includes a unique prophet variable and configuration information related to the prophet variable. Among them, the prophet variable refers to the data associated with the current variable parameter. The source data required for the variable parameter can be obtained through the prophet variable and the corresponding modal operation mode. For example, if you need to find a person’s ID number, you need to get the person’s name first. The person’s name is used as the prophet variable and the ID number is used as the source data. Figure 2 As shown in the figure, the figure shows a prophet variable configuration item, and the prophet variable in the figure is "KEY".

[0074] S310 . Based on the variable calculation configuration item, search the modal analysis configuration item corresponding to the variable parameter from the modal analysis configuration table.

[0075] In some embodiments, Figure 3 As shown, based on the variable calculation configuration item, the modal analysis configuration item corresponding to the variable parameter is searched from the modal analysis configuration table, including:

[0076] S311. Extracting a modal analysis category corresponding to a variable parameter from a variable calculation configuration item.

[0077] S312. Searching for a modal analysis configuration item corresponding to the variable parameter from a modal analysis configuration table according to the modal analysis category.

[0078] The pre-configured variable calculation configuration table includes the variable calculation configuration items corresponding to each variable parameter. Each variable calculation configuration item includes the corresponding unique non-prophetic variable, the configuration code of the non-prophetic variable, the modal analysis category, the configuration calculation name, the method name, the service required variable list, the service calculation result variable list, etc. The pre-configured modal analysis configuration table includes the modal analysis configuration items corresponding to each variable parameter. Therefore, each variable parameter corresponds to a modal analysis configuration item and a modal analysis category, so the modal analysis configuration item of the required parameter variable can be found through the modal analysis category.

[0079] S410. Obtain variable source data of variable parameters based on the modal analysis configuration item and the variable calculation configuration item.

[0080] In some embodiments, Figure 4 As shown, based on the modal analysis configuration items and the variable calculation configuration items, the variable source data of the variable parameters are obtained, including:

[0081] S411. Extract configuration codes and non-prophetic variables from variable calculation configuration items.

[0082] According to the configuration code, the unique modal analysis configuration item corresponding to the variable parameter can be found. The modal analysis configuration item includes the configuration code, configuration name (such as customer information query), etc. Among them, the non-prophetic variable is associated with the variable parameter.

[0083] Exemplarily, the configuration code may be: "rpcGoodsld1" and the like, and may be set arbitrarily according to actual conditions, and is not limited here.

[0084] S412: extracting input parameter related information from the modal analysis configuration item, and obtaining the modal operation mode from the modal analysis configuration item according to the configuration code.

[0085] Among them, the input parameter related information includes the input parameter class path and input parameter dependencies. The input parameter class path defines multiple fields of modal operation input parameters, such as the attribute name, attribute type, whether it is non-empty, and the source variable of the assignment. The modal operation mode includes several operation parameters, such as the operation mode name, etc. It should be noted that the modal operation mode is not limited to the Bean modal operation mode, RPC modal operation mode, and SQL modal operation mode, and there is no restriction here.

[0086] S413. Determine whether it is necessary to obtain the prophet variable according to the input parameter related information.

[0087] When the input parameter related information is not obtained, it is determined that there is no need to obtain the prophet variable. When the input parameter related information is obtained, it is determined that the prophet variable needs to be obtained.

[0088] S414. If yes, obtain the prophet variable according to the non-prophet variable and the input parameter dependency, and then obtain the variable source data based on the modal operation mode, the prophet variable and the input parameter class path.

[0089] When it is determined that a prophet variable needs to be obtained, the prophet variable needs to be converted into a modal operation input parameter that conforms to certain rules, and then the variable source data is obtained according to the modal operation input parameter and the modal operation mode.

[0090] Get prophetic variables based on non-prophetic variables and input parameter dependencies, such as Figure 5 As shown, including:

[0091] S4141. Search for dependent variables of non-prophetic variables according to the input parameter dependency.

[0092] Input the non-prophetic variables and modal parsing configuration items into the preset input parameter construction model. The input parameter construction model will find the corresponding prophetic variables based on the non-prophetic variables, and then convert the prophetic variables into modal operation input parameters that conform to the format defined in the input parameter path. Finally, the variable source data is obtained based on the modal operation input parameters and modal operation mode.

[0093] It should be noted that since each variable parameter (including dependent variables) has a corresponding modal parsing configuration item, which contains the input parameter class path and input parameter dependency, the dependent variables of non-prophetic variables can be found based on the input parameter dependency of each variable.

[0094] S4142. Determine whether the dependent variable is a prophetic variable.

[0095] The method of determining whether the dependent variable is a prophetic variable includes any of the following methods:

[0096] Method 1: Determine whether the dependent variable is a prophet variable based on the prophet variable configuration item;

[0097] Since each variable parameter corresponds to variable configuration information, and the variable configuration information includes prophet variable configuration items. The prophet variable configuration table includes all prophet variable configuration items and each prophet variable directory. If the current dependent variable is not in the prophet variable directory, it means that the dependent variable is a non-prophet variable, otherwise, it is a prophet variable.

[0098] Method 2: Determine whether the dependent variable is a prophetic variable based on the variable calculation configuration item.

[0099] Of course, each variable parameter corresponds to variable configuration information, and the variable configuration information includes variable calculation configuration items. Therefore, a variable calculation configuration table can be set in advance, which includes all variable calculation configuration items and each non-prophetic variable directory. If the current dependent variable is not in the prophetic variable directory, it means that the dependent variable is a prophetic variable, otherwise, it is a non-prophetic variable.

[0100] S4143. If it is not a prophet variable, a new dependent variable is obtained according to the dependent variable and the input parameter dependency relationship of the dependent variable, and then it is determined whether the new dependent variable is a prophet variable, until the prophet variable is obtained.

[0101] Exemplarily, if the dependent variable of the non-prophet variable KEY1 is KEY2, and it is judged that KEY2 is still not a prophet variable, it is necessary to continue to find the dependent variable of KEY2 as KEY3 based on the input parameter dependency relationship of KEY2. If KEY3 is judged to be a prophet variable, stop searching. If it is judged that KEY3 is not a prophet variable, continue to recursively search for the dependent variables of KEY3 until the prophet variable is obtained. At this point, all the intermediate variables that a variable depends on in the solution process can be obtained (if KEY3 is a prophet variable, the intermediate variable is KEY2), as well as the prophet variable values ​​that the intermediate variables depend on. At the same time, the required analytical modes and the order of analytical mode execution in the variable solution process can also be obtained. According to the relationship between the above variables, a variable dependency diagram and a solution process diagram can be drawn, so that people who use or maintain the variables can easily understand and master the variables.

[0102] S415: If not, obtain variable source data according to the modal operation mode.

[0103] Among them, when it is determined that the prophet variable needs to be obtained, the prophet variable is converted into a modal operation input parameter that conforms to the format defined in the input parameter path, and finally a source data acquisition request is generated according to the modal operation input parameter and the modal operation mode to obtain the variable source data. When the prophet variable does not need to be obtained, a source data acquisition request is generated according to the non-prophet variable and the corresponding modal analysis category to directly obtain the variable source data.

[0104] In some embodiments, Figure 6 As shown, the variable source data is obtained based on the modal operation mode, the prophet variable and the input parameter class path, including:

[0105] S4144. Parse the input parameter class path to obtain input parameter information.

[0106] S4145. Check whether the prophet variable is qualified according to the input parameter information.

[0107] S4146. When the prophet variable is qualified, the prophet variable is converted into a modal operation input parameter according to the input parameter information.

[0108] S4147. Obtain variable source data according to modal operation input parameters and modal operation mode.

[0109] The input parameter construction model will parse the input parameter class path to obtain the input parameter information. Then, the prophet variable is checked to see if it is qualified based on the input parameter information. The input parameter information includes information such as attribute type and non-empty value. There are many ways to check whether the prophet variable is qualified. For example, if any of the attribute type and non-empty value is unqualified, it means that the prophet variable is unqualified. Only when the attribute type and non-empty value are both qualified, can the prophet variable be qualified. Of course, other judgment conditions can be added as the content of the prophet variable verification, which is not limited here.

[0110] Exemplarily, if the required attribute type is a number, but the obtained attribute type is text, it means that the obtained prophet variable is unqualified; or, if the required non-null value is 0, which means that the value of the prophet variable is a null value, it means that the obtained prophet variable is unqualified.

[0111] In some embodiments, Figure 7 As shown, the variable source data is associated with the active data verification rule; after obtaining the variable source data according to the prophet variable, it also includes:

[0112] S416. Verify the variable source data according to the source data verification rules.

[0113] S417: If the variable source data verification passes, the parsed value corresponding to the variable source data is calculated based on the variable calculation configuration item.

[0114] In order to improve efficiency, the obtained variable source data needs to be verified. The variable source data verification rules are not limited here. For example, the variable source data can be verified by the request result identifier and the variable source data value.

[0115] When obtaining source data, in addition to returning the variable source data value, such as the value of b and c, the request result identifier (an identifier of whether the request is successful) is also returned, such as flag. If flag=1, it means the request is successful; if flag=0, it means the request failed. If the request fails, it means that the variable source data verification failed, and there is no need to perform the following steps.

[0116] For example, if you need to calculate the variable parameter a, you need to get the source data through the RPC parsing mode, but the RPC mode source data acquisition can only get b and c. However, the final result, that is, the parsed value, can be calculated based on b and c based on the variable configuration information.

[0117] Optionally, the verification rule may also include "obtaining a result verification expression from a modal analysis configuration item. Verifying the variable source data through the result verification expression, etc." For example, judging the values ​​of variables b and c, if one of them is empty, it means that the verification fails, etc., and there is no limitation here.

[0118] S510: Calculate the parsed value corresponding to the variable source data based on the variable calculation configuration item.

[0119] In most cases, the source data obtained is not the parsed value, and the source data needs to be calculated again to obtain the parsed value.

[0120] In some embodiments, Figure 8 As shown, the parsed value corresponding to the variable source data is calculated based on the variable calculation configuration item, including:

[0121] S511. Obtain a calculation expression in a variable calculation configuration item.

[0122] S512. Calculate the analytical value corresponding to the variable source data according to the calculation expression and the variable source data.

[0123] Exemplarily, if the source data are b and c, and the calculation expression is b+c, the resolved value is the value of "b+c".

[0124] In some implementations, the parsed value corresponds to a parsing rule, further comprising: verifying the parsed value according to the parsing rule.

[0125] The parsing rules include whether all parsing values ​​are empty, whether the parsing value configuration is qualified, etc.

[0126] The embodiment of the present application proposes a data parsing method, which obtains variable parameters and a modal parsing configuration table; then queries the corresponding variable configuration information according to the variable parameters, wherein the variable configuration information includes a prophetic variable configuration item and a variable calculation configuration item; based on the variable calculation configuration item, finds the modal parsing configuration item corresponding to the variable parameter from the modal parsing configuration table; based on the modal parsing configuration item and the variable calculation configuration item, obtains the variable source data of the variable parameter; finally, calculates the parsing value corresponding to the variable source data based on the variable calculation configuration item. The present application proposes a new parsing method, which configures the information related to the variable parameters, adjusts the logic of the variables, optimizes them, and goes online and offline without publishing, shortens the variable delivery time, and improves development efficiency. The dependency relationship of the configured variable parameters, especially the more complex variable dependency, can be clearly displayed through visualization, reducing the time to understand the variables and reducing the learning cost. Not only that, the present application also supports multi-modal parsing, covering most parameter parsing needs.

[0127] Another embodiment of the present application further provides a data analysis system 600, such as Fig. 9 As shown, the data analysis system 600 includes:

[0128] The first acquisition unit 610 is used to acquire variable parameters and a modal analysis configuration table.

[0129] The first query unit 620 is used to query the corresponding variable configuration information according to the variable parameters, wherein the variable configuration information includes a prophet variable configuration item and a variable calculation configuration item.

[0130] The second query unit 630 is used to search the modal analysis configuration item corresponding to the variable parameter from the modal analysis configuration table based on the variable calculation configuration item.

[0131] The second acquisition unit 640 is used to acquire variable source data of variable parameters based on the modal analysis configuration item and the variable calculation configuration item.

[0132] The calculation unit 650 is used to calculate the parsed value corresponding to the variable source data based on the variable calculation configuration item.

[0133] Another embodiment of the present application further proposes a computer device, including a storage unit and a processing unit, wherein a computer program is stored in the storage unit, and the processing unit executes the steps of the above-mentioned data analysis method by calling the computer program stored in the storage unit.

[0134] Another embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. The computer program is suitable for being loaded by a processor to execute the steps of the data parsing method as described above.

[0135] It can be understood that the method steps of this embodiment correspond to the data analysis method in the above-mentioned embodiment, wherein the optional items of the above-mentioned data analysis method are also applicable to this embodiment and will not be described repeatedly here.

[0136] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and structure diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and a part of the module, program segment or code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in an alternative implementation, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the structure diagram and / or the flow diagram, and the combination of boxes in the structure diagram and / or the flow diagram, can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0137] In addition, the functional modules or units in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0138] If the function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a smart phone, a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program code.

[0139] The above description is only a specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. A data analysis method, characterized in that: include: Get variable parameters and modal analysis configuration table; Querying corresponding variable configuration information according to the variable parameters, wherein the variable configuration information includes variable calculation configuration items; Based on the variable calculation configuration item, searching the modal analysis configuration item corresponding to the variable parameter from the modal analysis configuration table; Based on the modal analysis configuration item and the variable calculation configuration item, obtaining variable source data of the variable parameter; Calculate the parsed value corresponding to the variable source data based on the variable calculation configuration item; The acquiring the variable source data of the variable parameter based on the modal analysis configuration item and the variable calculation configuration item includes: Extracting configuration codes and non-prophetic variables from the variable calculation configuration items; Extracting input parameter related information from the modal analysis configuration item, and acquiring a modal operation mode from the modal analysis configuration item according to the configuration code; wherein the input parameter related information includes an input parameter class path and an input parameter dependency; Determine whether it is necessary to obtain a prophet variable according to the input parameter related information; wherein the prophet variable refers to data associated with the current variable parameter, and the source data required for the variable parameter can be obtained through the prophet variable and the corresponding modal operation mode; If so, obtain the prophetic variable according to the non-prophetic variable and the input parameter dependency, and then obtain the variable source data based on the modal operation mode, the prophetic variable and the input parameter class path; If not, the variable source data is obtained according to the modal operation mode.

2. The data analysis method according to claim 1, characterized in that: The step of searching the modal analysis configuration table for the modal analysis configuration item corresponding to the variable parameter based on the variable calculation configuration item includes: Extracting a modal analysis category corresponding to the variable parameter from the variable calculation configuration item; According to the modal analysis category, the modal analysis configuration item corresponding to the variable parameter is searched from the modal analysis configuration table.

3. The data analysis method according to claim 1, characterized in that: The variable configuration information includes a prophet variable configuration item; the acquiring the prophet variable according to the non-prophet variable and the input parameter dependency relationship includes: According to the input parameter dependency relationship, search for the dependent variables of the non-prophetic variable; Determine whether the dependent variable is the prophetic variable; If it is not the prophet variable, a new dependent variable is obtained according to the dependent variable and the input parameter dependency relationship of the dependent variable, and then it is determined whether the new dependent variable is the prophet variable, until the prophet variable is obtained; The method of determining whether the dependent variable is the prophetic variable includes any one of the following methods: Method 1: judging whether the dependent variable is a prophet variable according to the prophet variable configuration item; Method 2: judging whether the dependent variable is a prophetic variable according to the variable calculation configuration item.

4. The data analysis method according to claim 1, characterized in that: The acquiring variable source data based on the modal operation mode, the prophet variable and the input parameter class path includes: Parsing the input parameter class path to obtain input parameter information, wherein the input parameter information includes an attribute type and a non-null value; Verify whether the prophet variable is qualified according to the input parameter information; When the prophet variable is qualified, the prophet variable is converted into a modal operation input parameter according to the input parameter information; The variable source data is obtained according to the modal operation input parameters and the modal operation mode.

5. The data analysis method according to claim 1, characterized in that: The variable source data is associated with an active data verification rule; after obtaining the variable source data of the variable parameter, it also includes: Verifying the variable source data according to the source data verification rule; If the variable source data passes the verification, the parsed value corresponding to the variable source data is calculated based on the variable calculation configuration item.

6. The data analysis method according to claim 1, characterized in that: The calculating the parsed value corresponding to the variable source data based on the variable calculation configuration item includes: Obtaining the calculation expression in the variable calculation configuration item; According to the calculation expression and the variable source data, the parsed value corresponding to the variable source data is calculated.

7. A data analysis system, characterized in that: include: A first acquisition unit is used to acquire variable parameters and a modal analysis configuration table; A first query unit, configured to query corresponding variable configuration information according to the variable parameter, wherein the variable configuration information includes a prophet variable configuration item and a variable calculation configuration item; A second query unit, configured to search the modal analysis configuration item corresponding to the variable parameter from the modal analysis configuration table based on the variable calculation configuration item; A second acquisition unit, configured to acquire variable source data of the variable parameter based on the modal analysis configuration item and the variable calculation configuration item; A calculation unit, used for calculating the parsed value corresponding to the variable source data based on the variable calculation configuration item; The acquiring the variable source data of the variable parameter based on the modal analysis configuration item and the variable calculation configuration item includes: Extracting configuration codes and non-prophetic variables from the variable calculation configuration items; Extracting input parameter related information from the modal analysis configuration item, and acquiring a modal operation mode from the modal analysis configuration item according to the configuration code; wherein the input parameter related information includes an input parameter class path and an input parameter dependency; Determine whether it is necessary to obtain a prophet variable according to the input parameter related information; wherein the prophet variable refers to data associated with the current variable parameter, and the source data required for the variable parameter can be obtained through the prophet variable and the corresponding modal operation mode; If so, obtain the prophetic variable according to the non-prophetic variable and the input parameter dependency, and then obtain the variable source data based on the modal operation mode, the prophetic variable and the input parameter class path; If not, the variable source data is obtained according to the modal operation mode.

8. A computer device, characterized in that: It comprises a storage unit and a processing unit, wherein the storage unit stores a computer program, and the processing unit executes the steps of the data analysis method according to any one of claims 1 to 6 by calling the computer program stored in the storage unit.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor to execute the steps of the data analysis method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Power grid equipment state automatic evaluation method

    CN105117980A

  • Variable processing method and device, computer equipment and storage medium

    CN114116761A