Wide-meter stability detection method, detection device, storage medium and processor

Abstract

This application provides a method, device, storage medium, and processor for detecting wide-scale stability. The method includes: obtaining multiple pieces of first target data; determining multiple pieces of second target data based on the multiple pieces of first target data; calculating the average of all information entropies of all pieces of second target data to obtain a target information entropy; and calculating the difference between 1 and the target information entropy to obtain a stability value. This method addresses the issues of existing wide-scale stability analysis methods, which suffer from delayed analysis and high subjectivity.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a method for detecting wide table stability, a device for detecting wide table stability, a computer-readable storage medium, and a processor. Background Art

[0002] With the banking industry's increasing emphasis on digital transformation, big data applications are becoming increasingly integrated with banking scenarios. Wide tables offer efficient model design based on business logic and data usage, providing strong support for downstream data applications. Wide tables integrate data from diverse business themes, resulting in complex structures and numerous indicators. The underlying data originates from various business systems, tables, and fields, creating numerous dependencies. This consumes significant performance resources and results in slow operation. During the operation of wide tables, any failure at any stage will be transmitted to the wide table, resulting in poor stability. However, there is a lack of scientific and effective methods to measure this instability.

[0003] Existing wide table stability analysis methods generally analyze wide table stability only when large fluctuations in wide table operating information cause adverse effects. Timeliness cannot be guaranteed. In addition, they generally rely on personal experience to perform simple analysis and deduction of log files to judge the wide table stability. This is highly subjective and cannot guarantee objectivity. Summary of the Invention

[0004] The main purpose of this application is to provide a method for detecting wide-meter stability, a device for detecting wide-meter stability, a computer-readable storage medium and a processor, so as to at least solve the problems of the existing wide-meter stability analysis method that the analysis is not timely and is highly subjective.

[0005] In order to achieve the above-mentioned purpose, according to one aspect of the present application, a method for detecting the stability of a wide table is provided, wherein the wide table to be detected includes multiple indicator fields, and the wide table to be detected is run multiple times, and the method includes: obtaining multiple first target data, wherein one first target data includes a processing speed type of multiple indicator fields during a running process, and one processing speed type represents the size of the processing speed of one indicator field, and the wide table to be detected is a wide table for detecting stability; based on the multiple first target data, determining multiple second target data, wherein one second target data corresponds to one first target data, and one second target data includes the information entropy of all the processing speed types of the corresponding first target data; calculating the average value of all the information entropies of all the second target data to obtain the target information entropy; calculating the difference between 1 and the target information entropy to obtain a stability value, wherein the stability value reflects the stability of the wide table to be detected, and the larger the stability value, the stronger the stability of the wide table to be detected.

[0006] Optionally, in determining a plurality of second target data according to a plurality of first target data, the method further comprises: determining a plurality of second target data according to the i-th first target data and E ij =-P ij log2 P ij , determine the information entropy of the processing speed type j in the i-th operation process, where E ij is the information entropy of the processing speed type j during the i-th operation, P ij It is the ratio of the number of the processing speed type j contained in the i-th first target data to the total number of the processing speed types contained in the first target data.

[0007] Optionally, obtaining multiple first target data includes: obtaining multiple third target data, one third target data includes the processing time of multiple indicator fields in one said running process; determining multiple first target data according to each of the third target data and multiple preset mapping relationships, one indicator field corresponds to one preset mapping relationship, and the preset mapping relationship corresponding to the indicator field is the mapping relationship between the processing time of the indicator field and the processing speed type of the indicator field.

[0008] Optionally, one of the running processes includes multiple processing processes, and multiple indicator fields are processed in the processing process to obtain multiple third target data, including: obtaining the names of multiple indicator fields from the wide table to be detected; obtaining multiple fourth target data from the log file based on the names of all the indicator fields, and one of the fourth target data includes at least one processing time information of each indicator field in the running process, and the processing time information of the indicator field includes the duration of the processing process where the indicator field is located and the processing time of the dependency table of the indicator field, and the dependency table is a wide table used to process the indicator field; based on all the fourth target data, multiple third target data are determined, and the processing time of one indicator field is the sum of the duration of the processing process where the indicator field is located and the processing time of the dependency table of the indicator field.

[0009] Optionally, one of the fourth target data further includes name information of each of the indicator fields in one of the running processes, the name information including the name of the indicator field, the name of the processing process where the indicator field is located, and the name of the dependency table of the indicator field. After obtaining multiple fourth target data from the log file based on the names of all the indicator fields, and before determining multiple third target data based on all the fourth target data, the method further includes: a determination step for determining whether the fifth target data has the name information of the second target indicator field based on the name information of the first target indicator field, the first target indicator field being the name of any one of the indicator fields contained in the fifth target data, the fifth target data being any one of the fourth target data, and the second target indicator field being the name of the fifth target data that is identical to the second target indicator field. , and the name of the processing procedure where the second target indicator field is located is the same as the name of the processing procedure where the first target indicator field is located, and the name of the dependent table of the second target indicator field is the same as the name of the dependent table of the first target indicator field; a deleting step, when the name information of the second target indicator field exists in the fifth target data, the name information of the second target indicator field in the fifth target data and the processing time information of the second target indicator field in the fifth target data are deleted; a first repeating step, repeating the determining step and the deleting step at least once, until the name information of the second target indicator field does not exist in the fifth target data; a second repeating step, repeating the first repeating step at least once, until all the processing of the fourth target data is completed.

[0010] Optionally, the names of multiple indicator fields are obtained from the wide table to be detected, including: obtaining the names of multiple fields and the types of each field from the log file; when the type of the field is number type, int type or decimal type, determining the name of the field as the name of the indicator field.

[0011] Optionally, the method includes: obtaining the stable values of multiple wide tables to be detected; sorting the stable values in ascending order to obtain a stable value sequence; generating an alarm message based on the name of the wide table to be detected corresponding to the top M stable values in the stable value sequence, wherein the alarm message indicates that the wide table to be detected is unstable.

[0012] According to another aspect of the present application, a device for detecting the stability of a wide table is provided, wherein the wide table to be detected includes multiple indicator fields, and the wide table to be detected is run multiple times. The device includes: a first acquisition unit, used to acquire multiple first target data, each of the first target data includes a processing speed type of multiple indicator fields during a run, and each processing speed type represents the size of the processing speed of one indicator field, and the wide table to be detected is a wide table for detecting stability; a first determination unit, used to determine multiple second target data based on the multiple first target data, each of the second target data corresponds to a first target data, and each of the second target data includes information entropy of all the processing speed types of the corresponding first target data; a first calculation unit, used to calculate the average value of all the information entropies of all the second target data to obtain a target information entropy; a second calculation unit, used to calculate the difference between 1 and the target information entropy to obtain a stability value, wherein the stability value reflects the stability of the wide table to be detected, and a larger stability value indicates a stronger stability of the wide table to be detected.

[0013] According to another aspect of the present application, a computer-readable storage medium is provided, which includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any one of the wide table stability detection methods.

[0014] According to another aspect of the present application, a processor is provided, which is used to run a program, wherein the program executes any one of the wide table stability detection methods when running.

[0015] By applying the technical solution of the present application, the processing speed types of multiple indicator fields are obtained during multiple running processes of the wide table to be detected, and a stable value reflecting the stability of the wide table to be detected is calculated based on the processing speed types of multiple indicator fields during multiple running processes of the wide table to be detected. Compared with the existing analysis method for the stability of the wide table, the stability of the wide table is generally analyzed only when the wide table operation information has large fluctuations and causes adverse effects, and timeliness cannot be guaranteed. The present application can detect the stability of the wide table to be detected in real time during the running process of the wide table to be detected, thereby ensuring the timeliness of the wide table stability detection. The existing analysis method for the stability of the wide table generally relies on personal experience to perform a simple analysis and deduction of the log file, and then judge the stability of the wide table, which is highly subjective and objectivity cannot be guaranteed. The present application automatically determines the stable value reflecting the stability of the wide table to be detected based on the processing speed types of multiple indicator fields during multiple running processes of the wide table to be detected, without the need for manual analysis, thereby ensuring the objectivity of the wide table stability detection. This method solves the problems of the existing analysis method for the stability of the wide table, which is untimely and highly subjective. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The drawings that constitute part of this application are used to provide a further understanding of this application. The illustrative embodiments of this application and their descriptions are used to explain this application and do not constitute an improper limitation on this application. In the drawings:

[0017] Figure 1 A hardware structure block diagram of a mobile terminal for performing a wide table stability detection method provided in an embodiment of the present application is shown;

[0018] Figure 2 A schematic flow chart of a method for detecting wide-surface stability according to an embodiment of the present application is shown;

[0019] Figure 3 The figure shows a structural block diagram of a wide-range stability detection device provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0020] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in this application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0021] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0022] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0023] For ease of description, some nouns or terms involved in the embodiments of the present application are explained below:

[0024] Wide table: refers to a database table that associates dimensions, attributes, and indicators related to business entities, enabling unified storage of different information between business entities.

[0025] Indicator fields: These are quantifiable metrics obtained by segmenting business units in a wide table. These metrics are typically calculated through aggregation methods such as summation and averaging, and serve as an important basis for quantification.

[0026] As introduced in the background technology, the existing wide-meter stability analysis method has the problems of untimely analysis and strong subjectivity. In order to solve the problems of untimely analysis and strong subjectivity in the existing wide-meter stability analysis method, the embodiments of the present application provide a wide-meter stability detection method, a wide-meter stability detection device, a computer-readable storage medium and a processor.

[0027] The technical solutions in the embodiments of the present invention will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present invention.

[0028] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, Figure 1 FIG. 1 is a hardware structure block diagram of a mobile terminal for detecting a wide range stability according to an embodiment of the present invention. Figure 1 As shown, the mobile terminal may include one or more ( Figure 1 Only one is shown) a processor 102 (the processor 102 may include but is not limited to a microprocessor MCU or a programmable logic device FPGA and other processing devices) and a memory 104 for storing data, wherein the mobile terminal may also include a transmission device 106 and an input and output device 108 for communication functions. It will be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the mobile terminal. Figure 1 More or fewer components than shown, or with Figure 1 Different configurations shown.

[0029] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the device information display method in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, implementing the above-mentioned method. The memory 104 may include a high-speed random access memory and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely located relative to the processor 102, and these remote memories can be connected to the mobile terminal via a network. Examples of the above-mentioned networks include but are not limited to the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. The transmission device 106 is used to receive or send data via a network. Specific examples of the above-mentioned network may include a wireless network provided by the mobile terminal's communication provider. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, abbreviated as NIC), which can be connected to other network devices via a base station to communicate with the Internet. In one example, the transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0030] In this embodiment, a method for detecting the stability of a wide table running on a mobile terminal, a computer terminal or a similar computing device is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0031] The wide table to be tested includes multiple indicator fields. The wide table to be tested is run multiple times. Figure 2 FIG. 1 is a flow chart of a method for detecting the stability of a wide table according to an embodiment of the present application. Figure 2 As shown, the method includes the following steps:

[0032] Step S201, obtaining multiple pieces of first target data;

[0033] Wherein, one of the first target data includes a processing speed type of a plurality of the indicator fields during a running process, one processing speed type indicates the magnitude of the processing speed of one of the indicator fields, and the wide table to be tested is a wide table of stability to be tested;

[0034] Specifically, the wide table to be detected runs 5 to 10 times. In an optional implementation, as shown in Table 1, the wide table to be detected runs 8 times. Each serial number in the serial number column represents an indicator field. During multiple runs of the wide table to be detected, processing speed types of multiple indicator fields are obtained. The processing speed types include: fast (indicated by 1), medium fast (indicated by 2), normal speed (indicated by 3), medium slow (indicated by 4), and slow (indicated by 5).

[0035] Table 1

[0036]

[0037]

[0038] In an optional implementation, the above step S201 may be implemented as follows:

[0039] Step S2011, obtaining a plurality of third target data, wherein one piece of the third target data includes processing time of a plurality of the indicator fields in one of the running processes;

[0040] One of the above-mentioned operation processes includes multiple processing processes, and multiple of the above-mentioned indicator fields are processed in the above-mentioned processing processes. In an optional implementation manner, the above-mentioned step S2011 can be implemented as follows:

[0041] Step S20111: Obtain the names of the plurality of indicator fields from the wide table to be detected;

[0042] In an optional implementation, the above step S20111 may be implemented as follows:

[0043] From the above log file, obtain the names of multiple fields and the types of each of the above fields;

[0044] When the type of the above field is number type, int type or decimal type, the name of the above field is determined to be the name of the above indicator field.

[0045] Specifically, in some optional implementations, as shown in Table 2, the log file includes: the name of the wide table to be detected, the names of multiple fields and the types of each field, and the number type field, the int type field and the decimal type field are all indicator fields.

[0046] Table 2

[0047] The name of the wide table to be tested The name of the field Field type table_a field_1 varchar table_a field_2 date table_a field_3 number table_a field_4 varchar table_a field_5 int table_a field_6 decimal table_a field_7 int

[0048] Step S20112: Based on the names of all the indicator fields, a plurality of fourth target data items are obtained from the log file. Each piece of the fourth target data item includes at least one processing duration information of each indicator field during the operation. The processing duration information of each indicator field includes the duration of the processing process in which the indicator field resides and the processing duration of a dependency table of the indicator field. The dependency table is a wide table used to process the indicator field.

[0049] Specifically, in some optional implementations, as shown in Table 3, the log file includes: the name of the wide table to be detected, the name of the indicator field, the processing order (the order of the processing process), the name of the processing process, the duration of the processing process, the name of the dependent table and the processing duration of the dependent table.

[0050] Table 3

[0051]

[0052] Step S20113, based on all the above fourth target data, multiple third target data are determined, and the processing time of one of the above indicator fields is the sum of the processing time of the above indicator field and the processing time of the dependency table of the above indicator field.

[0053] Specifically, when calculating the processing time of an indicator field, the present application takes into account the processing time of the indicator field and the processing time of the dependent table of the indicator field, thereby ensuring the accuracy of wide table stability detection.

[0054] The fourth target data also includes name information of each of the indicator fields in one of the running processes, where the name information includes the name of the indicator field, the name of the processing process in which the indicator field resides, and the name of the dependency table of the indicator field. In an optional embodiment, after step S2012 and before step S20113, the method further includes:

[0055] a determining step for determining, based on the name information of the first target indicator field, whether the fifth target data contains the name information of the second target indicator field, wherein the first target indicator field is the name of any one of the indicator fields included in the fifth target data, the fifth target data is any one of the fourth target data, the second target indicator field is the indicator field in the fifth target data that is different from the second target indicator field, the name of the processing procedure where the second target indicator field is located is the same as the name of the processing procedure where the first target indicator field is located, and the name of the dependency table of the second target indicator field is the same as the name of the dependency table of the first target indicator field;

[0056] a deleting step of, if the name information of the second target indicator field exists in the fifth target data, deleting the name information of the second target indicator field in the fifth target data and the processing time information of the second target indicator field in the fifth target data;

[0057] a first repeating step, repeating the determining step and the deleting step at least once until the name information of the second target indicator field does not exist in the fifth target data;

[0058] The second repetition step is to repeat the first repetition step at least once until all the processing of the fourth target data is completed.

[0059] Specifically, if the processing processes of multiple indicator fields are the same and the dependency tables of multiple indicator fields are the same, only any one indicator field is taken as the statistical item. As shown in Table 3, only one indicator field field_1 and indicator field field_2 is counted, and only one indicator field field_4 is counted.

[0060] Step S2012: Determine multiple pieces of the above-mentioned first target data based on each piece of the above-mentioned third target data and multiple preset mapping relationships. One of the above-mentioned indicator fields corresponds to one of the above-mentioned preset mapping relationships. The above-mentioned preset mapping relationship corresponding to the above-mentioned indicator field is the mapping relationship between the processing time of the above-mentioned indicator field and the above-mentioned processing speed type of the above-mentioned indicator field.

[0061] Specifically, in some optional implementations, as shown in Table 4, the name of the wide table to be detected is table_a, the name of the indicator field is field_1, and the preset mapping relationship corresponding to the indicator field field_1 is: <=5min corresponds to fast (indicated by 1), (5min, 10min] corresponds to medium fast (indicated by 2), (10min, 13min] corresponds to normal speed (indicated by 3), (13min, 16min] corresponds to medium slow (indicated by 4), and (16min, 20min] corresponds to slow (indicated by 5). The processing time thresholds of the indicator field field_1 are 5min, 10min, 13min and 16min respectively. There are differences in the processing time of different indicator fields. Therefore, the processing time threshold in the mapping relationship corresponding to each indicator field is different.

[0062] Table 4

[0063]

[0064] Step S202, determining a plurality of second target data according to the plurality of first target data;

[0065] Wherein, one of the second target data corresponds to one of the first target data, and one of the second target data includes the information entropy of all the processing speed types of the corresponding first target data;

[0066] In an optional implementation, the above step S202 may be implemented as follows:

[0067] According to the first target data and E ij =-P ij log2P ij , determine the information entropy of the processing speed type j in the i-th operation process, where E ij is the information entropy of the processing speed type j in the i-th operation process, P ij It is the ratio of the number of the processing speed type j included in the i-th first target data to the total number of the processing speed types included in the first target data.

[0068] Specifically, as shown in Table 5, the information entropy of the processing speed types (1, 2, 3, 4, and 5) in the 1st operation process, the 2nd operation process, the 3rd operation process, the 4th operation process, the 5th operation process, the 6th operation process, the 7th operation process, and the 8th operation process are obtained.

[0069] Table 5

[0070]

[0071] Step S203, calculating the average value of all the information entropies of all the second target data to obtain target information entropy;

[0072] Specifically, according to Determine the sum of the information entropy of the processing speed type j in the i-th operation process, where E i is the sum of the information entropy of the processing speed type j in the i-th operation process, according to The average values of the information entropy of the processing speed types (1, 2, 3, 4, and 5) in the 1st, 2nd, 3rd, 4th, 5th, 6th, 7th, and 8th runs are determined, as shown in Table 5. The target information entropy is 0.6374.

[0073] Step S204, calculating the difference between 1 and the target information entropy to obtain a stable value;

[0074] The stability value reflects the stability of the wide table to be detected. A larger stability value indicates a stronger stability of the wide table to be detected.

[0075] Specifically, the target information entropy before the wide table to be detected is 0.6374, and the stable value is 0.3626. As shown in Table 6, the target information entropy after the wide table to be detected is 0.5469, and the stable value is 0.4531. That is, the larger the stable value after optimization, the more stable the optimized wide table is.

[0076] Table 6

[0077]

[0078]

[0079] In an optional embodiment, the above method includes:

[0080] Obtaining the above-mentioned stable values of the plurality of above-mentioned wide tables to be detected;

[0081] Sort the above stable values in ascending order to obtain a stable value sequence;

[0082] According to the names of the wide tables to be detected corresponding to the top M stable values in the stable value sequence, an alarm message is generated, where the alarm message indicates that the wide table to be detected is unstable.

[0083] Specifically, the stability value of each wide table in the wide table layer is calculated, and the stability values are arranged in order from small to large. The names of the wide tables corresponding to the top 30 stable values are taken. The wide tables corresponding to these 30 stable values are unstable and need to be optimized.

[0084] Through the above embodiments, the processing speed types of multiple indicator fields are obtained during multiple running processes of the wide table to be detected, and a stable value reflecting the stability of the wide table to be detected is calculated based on the processing speed types of multiple indicator fields during multiple running processes of the wide table to be detected. Compared with the existing analysis method for the stability of the wide table, the wide table stability is generally analyzed only when the wide table operation information has a large fluctuation and causes adverse effects, and timeliness cannot be guaranteed. The present application can detect the stability of the wide table to be detected in real time during the running process of the wide table to be detected, thereby ensuring the timeliness of the wide table stability detection. The existing analysis method for the stability of the wide table generally relies on personal experience to perform a simple analysis and deduction of the log file, and then judge the stability of the wide table, which is highly subjective and objectivity cannot be guaranteed. The processing speed types of multiple indicator fields during multiple running processes of the wide table to be detected in the present application automatically determine the stable value reflecting the stability of the wide table to be detected, without the need for manual analysis, thereby ensuring the objectivity of the wide table stability detection. This method solves the problems of the existing analysis method for the stability of the wide table, which is untimely and highly subjective.

[0085] In order to enable those skilled in the art to more clearly understand the technical solution of the present application, the implementation process of the wide-surface stability detection method of the present application will be described in detail below with reference to specific embodiments.

[0086] This embodiment relates to a specific method for detecting wide-table stability, comprising the following steps:

[0087] Step S1: Obtain the names of multiple fields and the types of each field from the log file;

[0088] Step S2: when the type of the above field is number type, int type or decimal type, determining the name of the above field to be the name of the above indicator field;

[0089] Step S3: Based on the names of all the indicator fields, a plurality of fourth target data are obtained from the log file, wherein each piece of the fourth target data includes at least one processing duration information of each of the indicator fields during the operation, wherein the processing duration information of the indicator field includes the duration of the processing process in which the indicator field is located and the processing duration of a dependency table of the indicator field, where the dependency table is a wide table used to process the indicator field;

[0090] Step S4: a determination step, used to determine whether the fifth target data contains the name information of the second target indicator field based on the name information of the first target indicator field, the first target indicator field is the name of any one of the indicator fields included in the fifth target data, the fifth target data is any one of the fourth target data, the second target indicator field is the indicator field in the fifth target data that is different from the second target indicator field, and the name of the processing process where the second target indicator field is located is the same as the name of the processing process where the first target indicator field is located, and the name of the dependency table of the second target indicator field is the same as the name of the dependency table of the first target indicator field;

[0091] Step S5: a deleting step, in which, if the name information of the second target indicator field exists in the fifth target data, the name information of the second target indicator field in the fifth target data and the processing time information of the second target indicator field in the fifth target data are deleted;

[0092] Step S6: a first repetition step, repeating the above determination step and the above deletion step at least once, until the name information of the above second target indicator field does not exist in the above fifth target data;

[0093] Step S7: a second repetition step, repeating the first repetition step at least once until all the fourth target data are processed;

[0094] Step S8: Determine multiple pieces of third target data based on all pieces of the fourth target data, where the processing time of one indicator field is the sum of the processing time of the processing process where the indicator field is located and the processing time of the dependency table of the indicator field;

[0095] Step S9: Determine multiple pieces of the first target data based on each piece of the third target data and multiple preset mapping relationships, where each indicator field corresponds to one preset mapping relationship, and the preset mapping relationship corresponding to the indicator field is a mapping relationship between the processing time of the indicator field and the processing speed type of the indicator field;

[0096] Step S10: determining a plurality of second target data according to the plurality of first target data, wherein one piece of the second target data corresponds to one piece of the first target data, and one piece of the second target data includes information entropy of all the processing speed types of the corresponding first target data;

[0097] Step S11: Calculate the average value of all the information entropies of all the second target data to obtain the target information entropy;

[0098] Step S12: Calculate the difference between 1 and the target information entropy to obtain a stability value. The stability value reflects the stability of the wide table to be detected. The larger the stability value, the stronger the stability of the wide table to be detected.

[0099] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0100] The embodiments of the present application also provide a device for detecting wide-meter stability. It should be noted that the device for detecting wide-meter stability in the embodiments of the present application can be used to execute the detection method for wide-meter stability provided in the embodiments of the present application. The device is used to implement the above-mentioned embodiments and preferred implementation methods, and those that have been explained will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware for a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and conceivable.

[0101] The following introduces the wide-meter stability detection device provided in the embodiment of the present application.

[0102] Figure 3 Schematic diagram of a wide range stability detection device according to an embodiment of the present application. Figure 3 As shown, the device includes:

[0103] A first acquisition unit 10 is used to acquire multiple pieces of first target data;

[0104] Wherein, one of the first target data includes a processing speed type of a plurality of the indicator fields during a running process, one processing speed type indicates the magnitude of the processing speed of one of the indicator fields, and the wide table to be tested is a wide table of stability to be tested;

[0105] Specifically, the wide table to be detected runs 5 to 10 times. In an optional implementation, as shown in Table 1, the wide table to be detected runs 8 times. Each serial number in the serial number column represents an indicator field. During multiple runs of the wide table to be detected, processing speed types of multiple indicator fields are obtained. The processing speed types include: fast (indicated by 1), medium fast (indicated by 2), normal speed (indicated by 3), medium slow (indicated by 4), and slow (indicated by 5).

[0106] Table 1

[0107]

[0108]

[0109] In an optional implementation, the first acquiring unit includes:

[0110] an acquisition subunit, configured to acquire a plurality of pieces of third target data, wherein one piece of the third target data includes processing time of a plurality of the indicator fields in one of the running processes;

[0111] One of the above-mentioned operation processes includes multiple processing processes, and multiple of the above-mentioned indicator fields are processed in the above-mentioned processing processes. In an optional embodiment, the above-mentioned acquisition subunit includes:

[0112] A first acquisition module is configured to acquire the names of the plurality of indicator fields from the wide table to be detected;

[0113] In an optional implementation, the above step S20111 may be implemented as follows:

[0114] From the above log file, obtain the names of multiple fields and the types of each of the above fields;

[0115] When the type of the above field is number type, int type or decimal type, the name of the above field is determined to be the name of the above indicator field.

[0116] Specifically, in some optional implementations, as shown in Table 2, the log file includes: the name of the wide table to be detected, the names of multiple fields and the types of each field, and the number type field, the int type field and the decimal type field are all indicator fields.

[0117] Table 2

[0118] The name of the wide table to be tested The name of the field Field type table_a field_1 varchar table_a field_2 date table_a field_3 number table_a field_4 varchar table_a field_5 int table_a field_6 decimal table_a field_7 int

[0119] a second acquisition module, configured to acquire, from the log file, a plurality of fourth target data items based on the names of all the indicator fields, each item of the fourth target data item comprising at least one processing duration information of each of the indicator fields during the operation process, the processing duration information of the indicator fields comprising a duration of the processing process in which the indicator field resides and a processing duration of a dependency table of the indicator field, the dependency table being a wide table used for processing the indicator field;

[0120] Specifically, in some optional implementations, as shown in Table 3, the log file includes: the name of the wide table to be detected, the name of the indicator field, the processing order (the order of the processing process), the name of the processing process, the duration of the processing process, the name of the dependent table and the processing duration of the dependent table.

[0121] Table 3

[0122]

[0123] A determination module is used to determine multiple third target data based on all the above fourth target data, and the processing time of one of the above indicator fields is the sum of the time of the above processing process where the above indicator field is located and the processing time of the dependency table of the above indicator field.

[0124] Specifically, when calculating the processing time of an indicator field, the present application takes into account the processing time of the indicator field and the processing time of the dependent table of the indicator field, thereby ensuring the accuracy of wide table stability detection.

[0125] The fourth target data also includes name information of each of the indicator fields in one of the running processes, the name information including the name of the indicator field, the name of the processing process in which the indicator field resides, and the name of the dependency table of the indicator field. In an optional embodiment, the apparatus further includes:

[0126] a second determining unit, configured to determine, based on the name information of the first target indicator field, whether the fifth target data contains the name information of the second target indicator field, the first target indicator field being the name of any one of the indicator fields included in the fifth target data, the fifth target data being any one of the fourth target data, the second target indicator field being the indicator field in the fifth target data that is different from the second target indicator field, the name of the processing procedure where the second target indicator field is located being the same as the name of the processing procedure where the first target indicator field is located, and the name of the dependency table of the second target indicator field being the same as the name of the dependency table of the first target indicator field;

[0127] a deleting unit configured to, in a deleting step, delete the name information of the second target indicator field in the fifth target data and the processing time information of the second target indicator field in the fifth target data if the name information of the second target indicator field exists in the fifth target data;

[0128] A first repeating unit is used for the first repeating step, repeating the determining step and the deleting step at least once until the name information of the second target indicator field does not exist in the fifth target data;

[0129] The second repeating unit is used for the second repeating step, repeating the first repeating step at least once until all the processing of the fourth target data is completed.

[0130] Specifically, if the processing processes of multiple indicator fields are the same and the dependency tables of multiple indicator fields are the same, only any one indicator field is taken as the statistical item. As shown in Table 3, only one indicator field field_1 and indicator field field_2 is counted, and only one indicator field field_4 is counted.

[0131] A determination subunit is used to determine multiple pieces of the above-mentioned first target data based on each piece of the above-mentioned third target data and multiple preset mapping relationships, one of the above-mentioned indicator fields corresponds to one of the above-mentioned preset mapping relationships, and the above-mentioned preset mapping relationship corresponding to the above-mentioned indicator field is the mapping relationship between the processing time of the above-mentioned indicator field and the above-mentioned processing speed type of the above-mentioned indicator field.

[0132] Specifically, in some optional implementations, as shown in Table 4, the name of the wide table to be detected is table_a, the name of the indicator field is field_1, and the preset mapping relationship corresponding to the indicator field field_1 is: <=5min corresponds to fast (indicated by 1), (5min, 10min] corresponds to medium fast (indicated by 2), (10min, 13min] corresponds to normal speed (indicated by 3), (13min, 16min] corresponds to medium slow (indicated by 4), and (16min, 20min] corresponds to slow (indicated by 5). The processing time thresholds of the indicator field field_1 are 5min, 10min, 13min and 16min respectively. There are differences in the processing time of different indicator fields. Therefore, the processing time threshold in the mapping relationship corresponding to each indicator field is different.

[0133] Table 4

[0134]

[0135] A first determining unit 20 is configured to determine a plurality of second target data according to the plurality of first target data;

[0136] Wherein, one of the second target data corresponds to one of the first target data, and one of the second target data includes the information entropy of all the processing speed types of the corresponding first target data;

[0137] In an optional implementation, the first determining unit is configured to:

[0138] According to the first target data and E ij =-P ij log2P ij , determine the information entropy of the processing speed type j in the i-th operation process, where E ij is the information entropy of the processing speed type j in the i-th operation process, P ij It is the ratio of the number of the processing speed type j included in the i-th first target data to the total number of the processing speed types included in the first target data.

[0139] Specifically, as shown in Table 5, the information entropy of the processing speed types (1, 2, 3, 4, and 5) in the 1st operation process, the 2nd operation process, the 3rd operation process, the 4th operation process, the 5th operation process, the 6th operation process, the 7th operation process, and the 8th operation process are obtained.

[0140] Table 5

[0141]

[0142] A first calculation unit 30 is configured to calculate an average value of all the information entropies of all pieces of the second target data to obtain a target information entropy;

[0143] Specifically, according to Determine the sum of the information entropy of the processing speed type j in the i-th operation process, where E i is the sum of the information entropy of the processing speed type j in the i-th operation process, according to The average values of the information entropy of the processing speed types (1, 2, 3, 4, and 5) in the 1st, 2nd, 3rd, 4th, 5th, 6th, 7th, and 8th runs are determined, as shown in Table 5. The target information entropy is 0.6374.

[0144] The second calculation unit 40 is used to calculate the difference between 1 and the target information entropy to obtain a stable value;

[0145] The stability value reflects the stability of the wide table to be detected. A larger stability value indicates a stronger stability of the wide table to be detected.

[0146] Specifically, the target information entropy before the wide table to be detected is 0.6374, and the stable value is 0.3626. As shown in Table 6, the target information entropy after the wide table to be detected is 0.5469, and the stable value is 0.4531. That is, the larger the stable value after optimization, the more stable the optimized wide table is.

[0147] Table 6

[0148]

[0149]

[0150] In an optional embodiment, the above method includes:

[0151] A second acquiring unit, configured to acquire the aforementioned stable values of the plurality of aforementioned wide tables to be detected;

[0152] A sorting unit is used to sort the stable values in ascending order to obtain a stable value sequence;

[0153] The alarm unit is configured to generate an alarm message according to the name of the wide table to be detected corresponding to the top M stable values in the stable value sequence, wherein the alarm message indicates that the wide table to be detected is unstable.

[0154] Specifically, the stability value of each wide table in the wide table layer is calculated, and the stability values are arranged in order from small to large. The names of the wide tables corresponding to the top 30 stable values are taken. The wide tables corresponding to these 30 stable values are unstable and need to be optimized.

[0155] Through the above embodiments, the processing speed types of multiple indicator fields are obtained during multiple running processes of the wide table to be detected, and a stable value reflecting the stability of the wide table to be detected is calculated based on the processing speed types of multiple indicator fields during multiple running processes of the wide table to be detected. Compared with the existing analysis method for the stability of the wide table, the wide table stability is generally analyzed only when the wide table operation information has a large fluctuation and causes adverse effects, and timeliness cannot be guaranteed. The present application can detect the stability of the wide table to be detected in real time during the running process of the wide table to be detected, thereby ensuring the timeliness of the wide table stability detection. The existing analysis method for the stability of the wide table generally relies on personal experience to perform a simple analysis and deduction of the log file, and then judge the stability of the wide table, which is highly subjective and objectivity cannot be guaranteed. The processing speed types of multiple indicator fields during multiple running processes of the wide table to be detected in the present application automatically determine the stable value reflecting the stability of the wide table to be detected, without the need for manual analysis, thereby ensuring the objectivity of the wide table stability detection. This method solves the problems of the existing analysis method for the stability of the wide table, which is untimely and highly subjective.

[0156] The wide-meter stability detection device includes a processor and a memory. The first acquisition unit, the first determination unit, the first calculation unit, and the second calculation unit are all stored as program units in the memory. The processor executes the program units stored in the memory to implement the corresponding functions. The above modules are all located in the same processor; alternatively, the above modules can be located in different processors in any combination.

[0157] The processor contains a kernel, which retrieves the corresponding program unit from the memory. One or more kernels can be configured, and kernel parameters can be adjusted to address the issues of existing wide table stability analysis methods, which suffer from delayed analysis and high subjectivity.

[0158] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0159] An embodiment of the present invention provides a computer-readable storage medium, which includes a stored program. When the program is run, the device where the computer-readable storage medium is located is controlled to execute the wide table stability detection method.

[0160] Specifically, the wide table stability detection method includes:

[0161] Step S201, obtaining multiple pieces of first target data;

[0162] Wherein, one of the first target data includes a processing speed type of a plurality of the indicator fields during a running process, one processing speed type indicates the magnitude of the processing speed of one of the indicator fields, and the wide table to be tested is a wide table of stability to be tested;

[0163] Step S202, determining a plurality of second target data according to the plurality of first target data;

[0164] Wherein, one of the second target data corresponds to one of the first target data, and one of the second target data includes the information entropy of all the processing speed types of the corresponding first target data;

[0165] Step S203, calculating the average value of all the information entropies of all the second target data to obtain target information entropy;

[0166] Step S204, calculating the difference between 1 and the target information entropy to obtain a stable value;

[0167] The stability value reflects the stability of the wide table to be detected. A larger stability value indicates a stronger stability of the wide table to be detected.

[0168] An embodiment of the present invention provides a processor, which is used to run a program, wherein the wide table stability detection method is executed when the program is running.

[0169] Specifically, the wide table stability detection method includes:

[0170] Step S201, obtaining multiple pieces of first target data;

[0171] Wherein, one of the first target data includes a processing speed type of a plurality of the indicator fields during a running process, one processing speed type indicates the magnitude of the processing speed of one of the indicator fields, and the wide table to be tested is a wide table of stability to be tested;

[0172] Step S202, determining a plurality of second target data according to the plurality of first target data;

[0173] Wherein, one of the second target data corresponds to one of the first target data, and one of the second target data includes the information entropy of all the processing speed types of the corresponding first target data;

[0174] Step S203, calculating the average value of all the information entropies of all the second target data to obtain target information entropy;

[0175] Step S204, calculating the difference between 1 and the target information entropy to obtain a stable value;

[0176] The stability value reflects the stability of the wide table to be detected. A larger stability value indicates a stronger stability of the wide table to be detected.

[0177] An embodiment of the present invention provides a device, comprising a processor, a memory, and a program stored in the memory and executable on the processor. When the processor executes the program, at least the following steps are performed:

[0178] Step S201, obtaining multiple pieces of first target data;

[0179] Wherein, one of the first target data includes a processing speed type of a plurality of the indicator fields during a running process, one processing speed type indicates the magnitude of the processing speed of one of the indicator fields, and the wide table to be tested is a wide table of stability to be tested;

[0180] Step S202, determining a plurality of second target data according to the plurality of first target data;

[0181] Wherein, one of the second target data corresponds to one of the first target data, and one of the second target data includes the information entropy of all the processing speed types of the corresponding first target data;

[0182] Step S203, calculating the average value of all the information entropies of all the second target data to obtain target information entropy;

[0183] Step S204, calculating the difference between 1 and the target information entropy to obtain a stable value;

[0184] The stability value reflects the stability of the wide table to be detected. A larger stability value indicates a stronger stability of the wide table to be detected.

[0185] The devices in this article can be servers, PCs, PADs, mobile phones, etc.

[0186] The present application also provides a computer program product, which, when executed on a data processing device, is adapted to execute a program for initializing at least the following method steps:

[0187] Step S201, obtaining multiple pieces of first target data;

[0188] Wherein, one of the first target data includes a processing speed type of a plurality of the indicator fields during a running process, one processing speed type indicates the magnitude of the processing speed of one of the indicator fields, and the wide table to be tested is a wide table of stability to be tested;

[0189] Step S202, determining a plurality of second target data according to the plurality of first target data;

[0190] Wherein, one of the second target data corresponds to one of the first target data, and one of the second target data includes the information entropy of all the processing speed types of the corresponding first target data;

[0191] Step S203, calculating the average value of all the information entropies of all the second target data to obtain target information entropy;

[0192] Step S204, calculating the difference between 1 and the target information entropy to obtain a stable value;

[0193] The stability value reflects the stability of the wide table to be detected. A larger stability value indicates a stronger stability of the wide table to be detected.

[0194] Obviously, those skilled in the art will appreciate that the various modules or steps of the present invention described above can be implemented using a general-purpose computing device, can be centralized on a single computing device, or can be distributed across a network of multiple computing devices. They can be implemented using program code executable by the computing device, and thus, can be stored in a storage device and executed by the computing device. In some cases, the steps shown or described herein can be performed in a different order than that shown, or can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any particular combination of hardware and software.

[0195] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0196] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0197] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0198] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0199] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0200] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0201] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0202] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0203] From the above description, it can be seen that the above embodiments of the present application achieve the following technical effects:

[0204] 1) In the wide table stability detection method of the present application, the processing speed types of multiple indicator fields are obtained during multiple running processes of the wide table to be detected, and a stable value reflecting the stability of the wide table to be detected is calculated based on the processing speed types of multiple indicator fields during multiple running processes of the wide table to be detected. Compared with the existing wide table stability analysis method, the wide table stability is generally analyzed only when the wide table operation information has large fluctuations and causes adverse effects, and timeliness cannot be guaranteed. The present application can detect the stability of the wide table to be detected in real time during the running process of the wide table to be detected, thereby ensuring the timeliness of the wide table stability detection. The existing wide table stability analysis method generally relies on personal experience to perform a simple analysis and deduction of the log file, and then judge the wide table stability, which is highly subjective and objectivity cannot be guaranteed. The present application automatically determines the stable value reflecting the stability of the wide table to be detected based on the processing speed types of multiple indicator fields during multiple running processes of the wide table to be detected, without the need for manual analysis, thereby ensuring the objectivity of the wide table stability detection. This method solves the problems of the existing wide table stability analysis method that the analysis is untimely and highly subjective.

[0205] 2) In the wide table stability detection device of the present application, the processing speed types of multiple indicator fields are obtained during multiple running processes of the wide table to be detected, and a stable value reflecting the stability of the wide table to be detected is calculated based on the processing speed types of multiple indicator fields during multiple running processes of the wide table to be detected. Compared with the existing wide table stability analysis method, the wide table stability is generally analyzed only when the wide table operation information has a large fluctuation and causes adverse effects, and timeliness cannot be guaranteed. The present application can detect the stability of the wide table to be detected in real time during the running process of the wide table to be detected, thereby ensuring the timeliness of the wide table stability detection. The existing wide table stability analysis method generally relies on personal experience to perform a simple analysis and deduction of the log file, and then judge the wide table stability, which is highly subjective and objectivity cannot be guaranteed. The processing speed types of multiple indicator fields during multiple running processes of the wide table to be detected in the present application automatically determine the stable value reflecting the stability of the wide table to be detected, without the need for manual analysis, thereby ensuring the objectivity of the wide table stability detection. This method solves the problems of the existing wide table stability analysis method that the analysis is untimely and highly subjective.

[0206] The above description is merely a preferred embodiment of the present application and is not intended to limit the present application. Various modifications and variations are possible for those skilled in the art. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present application shall be included within the scope of protection of the present application.

Claims

1. A method for detecting wide-surface stability, characterized in that: The wide table to be detected includes multiple indicator fields, and the wide table to be detected is run multiple times. The method includes: Acquire multiple pieces of first target data, each piece of the first target data including a processing speed type of multiple indicator fields during a running process, wherein each processing speed type indicates a magnitude of a processing speed of one indicator field, and the wide table to be tested is a wide table of stability to be tested; Determining a plurality of second target data according to the plurality of first target data, wherein one piece of the second target data corresponds to one piece of the first target data, and one piece of the second target data includes information entropy of all the processing speed types of the corresponding first target data; Calculating an average value of all the information entropies of all pieces of the second target data to obtain a target information entropy; The difference between 1 and the target information entropy is calculated to obtain a stability value, where the stability value reflects the stability of the wide table to be detected. A larger stability value indicates a stronger stability of the wide table to be detected.

2. The method according to claim 1, characterized in that In determining a plurality of second target data according to the plurality of first target data, the method further includes: According to the first target data and E ij =-P ij log2 P ij , determine the information entropy of the processing speed type j during the i-th operation, where E ij is the information entropy of the processing speed type j during the i-th operation, P ij It is the ratio of the number of the processing speed type j contained in the i-th first target data to the total number of the processing speed types contained in the first target data.

3. The method according to claim 1, characterized in that Get multiple pieces of first target data, including: Acquire multiple pieces of third target data, where each piece of the third target data includes processing time of multiple indicator fields during one of the running processes; Based on each piece of the third target data and multiple preset mapping relationships, multiple pieces of the first target data are determined, one indicator field corresponds to one preset mapping relationship, and the preset mapping relationship corresponding to the indicator field is the mapping relationship between the processing time of the indicator field and the processing speed type of the indicator field.

4. The method according to claim 3, characterized in that One of the operation processes includes a plurality of processing processes, wherein a plurality of the indicator fields are processed in the processing process to obtain a plurality of third target data, including: Obtaining the names of the plurality of indicator fields from the wide table to be detected; Obtaining, from the log file, a plurality of fourth target data items based on the names of all the indicator fields, each item of the fourth target data item at least including processing duration information of each indicator field during the running process, the processing duration information of the indicator field including the duration of the processing process in which the indicator field resides and the processing duration of a dependency table of the indicator field, the dependency table being a wide table used for processing the indicator field; Based on all the fourth target data, multiple third target data are determined, and the processing time of an indicator field is the sum of the processing time of the processing process where the indicator field is located and the processing time of the dependency table of the indicator field.

5. The method according to claim 4, characterized in that The fourth target data also includes name information of each indicator field in a running process, the name information including the name of the indicator field, the name of the processing process in which the indicator field is located, and the name of the dependency table of the indicator field. After obtaining multiple fourth target data from the log file based on the names of all the indicator fields, and before determining multiple third target data based on all the fourth target data, the method further includes: a determining step for determining, based on the name information of the first target indicator field, whether the fifth target data contains the name information of the second target indicator field, wherein the first target indicator field is the name of any one of the indicator fields included in the fifth target data, the fifth target data is any one of the fourth target data, the second target indicator field is the indicator field in the fifth target data that is different from the second target indicator field, the name of the processing procedure where the second target indicator field is located is the same as the name of the processing procedure where the first target indicator field is located, and the name of the dependent table of the second target indicator field is the same as the name of the dependent table of the first target indicator field; a deleting step, if the name information of the second target indicator field exists in the fifth target data, deleting the name information of the second target indicator field in the fifth target data and the processing time information of the second target indicator field in the fifth target data; a first repeating step of repeating the determining step and the deleting step at least once until the name information of the second target indicator field does not exist in the fifth target data; The second repetition step is to repeat the first repetition step at least once until all the processing of the fourth target data is completed.

6. The method according to claim 4, characterized in that Obtain the names of the plurality of indicator fields from the wide table to be detected, including: Obtaining, from the log file, the names of multiple fields and the type of each field; In the case that the type of the field is number type, int type or decimal type, the name of the field is determined to be the name of the indicator field.

7. The method according to claim 1, characterized in that The method comprises: Acquiring the stable values of a plurality of the wide tables to be detected; Sorting the stable values in ascending order to obtain a stable value sequence; An alarm message is generated according to the names of the wide tables to be detected corresponding to the top M stable values in the stable value sequence, where the alarm message indicates that the wide table to be detected is unstable.

8. A wide range stability detection device, characterized in that: The wide table to be detected includes multiple indicator fields, and the wide table to be detected is run multiple times. The device includes: a first acquiring unit, configured to acquire a plurality of first target data, wherein each first target data piece comprises a processing speed type of a plurality of the indicator fields during a running process, wherein a processing speed type indicates a magnitude of a processing speed of one of the indicator fields, and the wide table to be tested is a wide table of stability to be tested; a first determining unit, configured to determine a plurality of second target data according to the plurality of first target data, wherein one piece of the second target data corresponds to one piece of the first target data, and one piece of the second target data includes information entropy of all the processing speed types of the corresponding first target data; a first calculating unit, configured to calculate an average value of all the information entropies of all pieces of the second target data to obtain a target information entropy; The second calculation unit is used to calculate the difference between 1 and the target information entropy to obtain a stability value, where the stability value reflects the stability of the wide table to be detected. The larger the stability value, the stronger the stability of the wide table to be detected.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the wide table stability detection method according to any one of claims 1 to 7.

10. A processor, characterized in that: The processor is used to run a program, wherein the program, when running, executes the wide table stability detection method according to any one of claims 1 to 7.

Images