Insight data determination method and device, computer storage medium and electronic device
By building an operational data matrix and applying frequent item sets and collaborative filtering methods, the insight data is determined and displayed, and the problem of low-information data acquisition efficiency in the existing technology is solved, real-time updates and efficient insight data display are achieved.
Patent Information
- Application Number
- CN202010730829.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-07-27
- Publication Date
- 2024-12-17
- Estimated Expiration
- 2040-07-27
AI Technical Summary
There are limitations in obtaining insight data in the prior art, and the data insight process has low input-output and is disturbed by cognitive limitations and fluctuations in the data field, and is less efficient.
By obtaining the user's operation data for the target database, building an operation data matrix, and using frequent item sets, collaborative filtering and other methods to determine the target operation data set, generate an insight data report or an interactive insight data page, and automatically update the interface display.
It breaks through the cognitive limitations of the data field, improves the output efficiency of insight data, and realizes real-time updates and automatic displays of insight data.
Smart Images

Figure CN113297040B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to computer application technology, and specifically to a method and device for determining insight data, an interactive method and device for data insight, a data insight system, and a computer storage medium and electronic device. Background Art
[0002] Data exists in every aspect of life, including the use of application software, purchase of goods, travel navigation, etc. Behind all of these, data processing is required. Obviously, the development of computer and Internet technology will inevitably highlight the importance of data, data analysis, and data insights.
[0003] So, what is data, what is data analysis, and what is data insight?
[0004] Generally speaking, data is raw information that has not been processed too much. Data analysis is the discovery of patterns and trends from this raw information, while data insight is the value derived from data analysis, including decision-making operations, predicting opportunities, etc. In other words, data insight is a process that relies on data analysis and can obtain more favorable guiding data through data insight. The data obtained through data insight can be called insight data.
[0005] However, for professional data analysts, data scientists, and algorithm engineers, research on domain data requires a lot of time spent on data exploration and data analysis. In this process, it is necessary to continuously explore data in multiple dimensions to accumulate domain data knowledge and gain insights into the data. However, data insight is usually a process with relatively low input-output ratios, which is not only limited by the knowledge of the data domain, but also disturbed by data fluctuations. Summary of the invention
[0006] The present application provides a method for determining insight data to solve the problem of limitations in obtaining insight data in the prior art.
[0007] The present application provides a method for determining insight data, including:
[0008] Obtain user operation data on the target database;
[0009] Constructing an operation data matrix according to the operation data and the operation execution order for the operation data;
[0010] Determining a target operation data set according to the operation data matrix;
[0011] The target operation data in the target operation data set is determined as insight data for output.
[0012] In some embodiments, obtaining the user's operation data on the target database includes:
[0013] The operation log of the user is obtained according to the execution order of the operation data of the user based on the insight data visualization interface or the external data interface.
[0014] In some embodiments, it also includes:
[0015] Collecting operation logs generated based on the insight data visualization interface or the external data interface according to the execution order of the user's operation data;
[0016] Storing the collected operation logs in a log database;
[0017] The obtaining of the user's operation data includes:
[0018] The operation log is obtained from the log database.
[0019] In some embodiments, collecting the operation log generated based on the insight data visualization interface or the external data interface according to the execution order of the user's operation data includes:
[0020] According to the set collection cycle and the execution order of the user's operation data, the operation logs generated based on the insight data visualization interface or the external data interface are collected.
[0021] In some embodiments, obtaining the user's operation data on the target database includes:
[0022] Based on the insight data visualization interface or the external data interface, the operation data is obtained by querying, browsing and selecting at least one of the operation modes.
[0023] In some embodiments, obtaining the user's operation data on the target database includes:
[0024] Based on the insight data visualization interface or the external data interface, the operation data of the user is obtained within a set time range.
[0025] In some embodiments, obtaining the operation data of the user within a set time range based on the insight data visualization interface or the external data interface includes:
[0026] Based on the insight data visualization interface or the external data interface, the operation data of the user is obtained within a time range between at least two start times of executing insight data tasks.
[0027] In some embodiments, constructing an operation data matrix according to the operation data and the order of executing operations on the operation data includes:
[0028] The maximum value of the number of operations in the obtained operation data is used as the number of columns;
[0029] Fill the columns whose operation times do not meet the maximum value requirement with null values;
[0030] The number of users in the obtained operation data is taken as the number of rows;
[0031] An operation data matrix is constructed according to the number of columns and the number of rows, and the acquired operation data, in accordance with the operation execution order.
[0032] In some embodiments, determining a target operation data set according to the operation data matrix includes:
[0033] Using a frequent item set approach, target operation data that meets a selection threshold requirement is selected from the operation data matrix;
[0034] The operation data set is determined according to the selected target operation data.
[0035] In some embodiments, the step of determining the target operation data in the operation data set as insight data for output includes:
[0036] Generate an insight data report page according to the target operation data in the operation data set;
[0037] The insight data report page is displayed on an insight data visualization interface, wherein the insight data is displayed in the insight data report page.
[0038] In some embodiments, the step of determining the target operation data in the target operation data set as insight data for output includes:
[0039] Generate an insight data report page according to the target operation data in the target operation data set, wherein the insight data is displayed in the insight data report page;
[0040] The original insight data page displayed on the insight data visualization interface is replaced with the insight data report page.
[0041] In some embodiments, constructing an operation data matrix according to the operation data and the order of executing operations on the operation data includes:
[0042] The maximum value of the number of operations in the obtained operation data is used as the number of columns;
[0043] Fill the columns whose operation times do not meet the maximum value requirement with null values;
[0044] The number of users in the obtained operation data is taken as the number of rows;
[0045] Constructing a first operation data matrix according to the number of columns and the number of rows, and the acquired operation data and in accordance with the operation execution order;
[0046] Replacing the parameters in the operation data in the first operation data matrix with template parameters to obtain a converted first operation data template matrix;
[0047] Merging adjacent and identical operation data templates in the first operation data template matrix to obtain a second operation data template matrix;
[0048] The second operation data template matrix is determined as the operation data matrix.
[0049] In some embodiments, determining a target operation data set according to the operation data matrix includes:
[0050] Selecting a target operation data template that meets the selection requirements from the second operation data template matrix by using a frequent item set method;
[0051] Determining the target operation data template set according to the selected target operation data;
[0052] The target operation data template set is determined as the target operation data set.
[0053] In some embodiments, the step of determining the target operation data in the target operation data set as insight data for output includes:
[0054] Generate an interactive insight data report page operable for parameters according to the target operation data template in the target operation data template set, wherein the interactive insight data report page can display the insight data matching the operation according to the user's operation;
[0055] The interactive insight data report page is displayed on the insight data visualization interface.
[0056] In some embodiments, the step of determining the target operation data in the target operation data set as insight data for output includes:
[0057] Generate an interactive insight data report page operable for parameters according to the target operation data template in the target operation data set, wherein the interactive insight data report page can display the insight data matching the operation according to the user's operation;
[0058] The original insight data page displayed on the insight data visualization interface is replaced with the interactive insight data report page.
[0059] In some embodiments, constructing an operation data matrix according to the operation data and the order of executing operations on the operation data includes:
[0060] The maximum value of the number of operations in the obtained operation data is used as the number of matrix columns;
[0061] Fill the columns whose operation times do not meet the maximum value requirement with null values;
[0062] Using the number of users in the obtained operation data as the number of matrix rows;
[0063] Constructing a first operation data matrix according to the number of columns and the number of rows, and the acquired operation data and in accordance with the operation execution order;
[0064] Replacing the parameters in the operation data in the first operation data matrix with template parameters to obtain a converted first operation data template matrix;
[0065] Merging adjacent and identical operation data in the first operation data template matrix to obtain a second operation data template matrix;
[0066] constructing a third operation data template matrix according to the frequency or number of times the user uses the data template in the second operation data template matrix;
[0067] The third operation data template matrix is determined as the operation data matrix.
[0068] In some embodiments, determining a target operation data set according to the operation data matrix includes:
[0069] By adopting a collaborative filtering method, in the third operation data template matrix, a target operation data template whose usage times meet the selection similarity requirement is selected;
[0070] Determining a target operation data template usage set according to the selected target operation data template;
[0071] The target operation data template usage set is determined as the target operation data set.
[0072] In some embodiments, the step of determining the target operation data in the target operation data set as insight data for output includes:
[0073] Using the target operation data template in the set according to the target operation data template, generating an interactive insight data report page that matches the operation data of the user and has operable parameters, wherein the interactive insight data report page can display the insight data that matches the operation according to the operation of the user;
[0074] The interactive insight data report page is displayed on the insight data visualization interface.
[0075] In some embodiments, the step of determining the target operation data in the target operation data set as insight data for output includes:
[0076] Using the target operation data template in the set according to the target operation data template, generating an interactive insight data report page that matches the operation data of the user and has operable parameters, wherein the interactive insight data report page can display the insight data that matches the operation according to the operation of the user;
[0077] The original insight data page displayed on the insight data visualization interface is replaced with the interactive insight data report page.
[0078] In some embodiments, the step of determining the target operation data in the target operation data set as insight data for output includes:
[0079] Determine the target operation data in the target operation data set as insight data and store it in an insight database;
[0080] The insight data is obtained from the insight database for output.
[0081] The present application also provides a device for determining insight data, including:
[0082] An acquisition unit, used for acquiring user operation data;
[0083] A construction unit, configured to construct an operation data matrix according to the operation data and an operation execution sequence for the operation data;
[0084] A determination unit, configured to determine a target operation data set according to the operation data matrix;
[0085] An output unit is used to determine the target operation data in the target operation data set as insight data for output.
[0086] This application also provides an interactive method for data insight, including:
[0087] Sending an operation data query request based on the query operation interface;
[0088] According to the received operation data query request, the user's operation data on the target database is collected, and according to the operation data and the operation execution order of the operation data, an operation data matrix is constructed, and according to the operation data matrix, a target operation data set is determined, and the target operation data in the target operation data set is determined as insight data for output;
[0089] The query operation interface generates an insight data interface capable of displaying the insight data according to the received insight data, and displays the insight data on the query operation interface.
[0090] The present application also provides a data insight system, comprising: an operation data acquisition module, a target database, a data insight module, and an insight data interface generation module;
[0091] The operation data collection module is used to collect the user's operation data on the target database;
[0092] The data insight module is used to construct an operation data matrix according to the operation data and the operation execution order for the operation data; determine a target operation data set according to the operation data matrix; and determine the target operation data in the target operation data set as insight data;
[0093] The insight data interface generation module is used to generate an insight data interface capable of displaying the insight data according to the insight data.
[0094] In some embodiments, it also includes: an operation log database for storing the operation data collected by the operation data collection module.
[0095] In some embodiments, it also includes:
[0096] The insight database is used to store the insight data determined by the data insight module; the insight data interface generation module obtains the insight data from the insight database and generates the interactive interface.
[0097] In some embodiments, it also includes:
[0098] A query operation module is used to provide a query interface for users to perform data queries;
[0099] The operation data collection module is used to collect the user's operation data on the target database based on the query interface;
[0100] The insight data interface generation module is used to regenerate the query interface according to the insight data to generate the insight data interface capable of displaying the insight data.
[0101] The present application also provides a computer storage medium for storing data generated by a network platform, and a program for processing the data generated by the network platform;
[0102] When the program is read and executed, the following steps are performed:
[0103] Obtain user operation data on the target database;
[0104] Constructing an operation data matrix according to the operation data and the operation execution order for the operation data;
[0105] Determining a target operation data set according to the operation data matrix;
[0106] Determine the target operation data in the target operation data set as insight data for output;
[0107] Alternatively, perform the following steps:
[0108] Sending an operation data query request based on the query operation interface;
[0109] According to the received operation data query request, the user's operation data on the target database is collected, and according to the operation data and the operation execution order of the operation data, an operation data matrix is constructed, and according to the operation data matrix, a target operation data set is determined, and the target operation data in the target operation data set is determined as insight data for output;
[0110] The query operation interface receives the insight data and generates an insight data interface capable of displaying the insight data according to the insight data.
[0111] The present application also provides an electronic device, comprising:
[0112] processor;
[0113] The memory is used to store a program for processing data generated by the network platform, and when the program is read and executed by the processor, the following steps are performed:
[0114] Obtain user operation data on the target database;
[0115] Constructing an operation data matrix according to the operation data and the operation execution order for the operation data;
[0116] Determining a target operation data set according to the operation data matrix;
[0117] Determine the target operation data in the target operation data set as insight data for output;
[0118] Alternatively, perform the following steps:
[0119] Sending an operation data query request based on the query operation interface;
[0120] According to the received operation data query request, the user's operation data on the target database is collected, and according to the operation data and the operation execution order of the operation data, an operation data matrix is constructed, and according to the operation data matrix, a target operation data set is determined, and the target operation data in the target operation data set is determined as insight data for output;
[0121] The query operation interface receives the insight data and generates an insight data interface capable of displaying the insight data according to the insight data.
[0122] Compared with the prior art, this application has the following advantages:
[0123] The method for determining insight data provided in the present application obtains the user's operation data on a target database; constructs an operation data matrix according to the operation data and the order of executing operations on the operation data; determines a target operation data set according to the operation data matrix; determines the target operation data in the target operation data set as insight data for output, thereby being able to automatically update the insight data content output and displayed on the interface according to changes in the operation data, breaking through the limitations of data field cognition and improving the efficiency of insight data output. BRIEF DESCRIPTION OF THE DRAWINGS
[0124] Figure 1 is a flow chart of an embodiment of a method for determining insight data provided by the present application;
[0125] Figure 2 is a structural schematic diagram of an embodiment of a device for determining insight data provided by the present application;
[0126] Figure 3 This is a data interaction diagram of an embodiment of an interactive method for insight data provided by the present application;
[0127] Figure 4 It is a structural diagram of a data insight system embodiment provided by the present application. DETAILED DESCRIPTION
[0128] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application, so the present application is not limited by the specific implementation disclosed below.
[0129] The terms used in this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The descriptions used in this application and the appended claims, such as "a", "first", and "second", are not limitations on quantity or sequence, but are used to distinguish the same type of information from each other.
[0130] Combined with the background technology part, it can be seen that insight data plays a vital role in the development of the industry. The core idea of the technical concept of this solution is to improve the production efficiency of data insight on the basis of reducing the investment cost of data insight. In view of this concept, this application provides a method for determining insight data, please refer to Figure 1 As shown, Figure 1 : is a flowchart of an embodiment of a method for determining insight data provided by the present application, the embodiment of the method for determining insight data comprising:
[0131] Step S101: Acquire the user's operation data on the target database;
[0132] The operation data in step S101 may be the operation data of the user on the database. The acquired operation data may be the operation data of a single user or the operation data of at least two or more users.
[0133] In this embodiment, the specific implementation process of step S101 may include:
[0134] Step S101-1: Obtain the user's operation log according to the execution order of the user's operation data based on the insight data visualization interface or the external data interface
[0135] That is, in this embodiment, the operation data may be an operation log, i.e., an SQL operation log. There are multiple ways to obtain the operation log, for example, the one described in the above step 101-1 may be based on an insight data visualization interface or an external data interface. The following describes two methods of obtaining the operation log:
[0136] Method 1: Insight data visualization interface
[0137] The insight data visualization interface is an operation interface provided by the data insight system. The specific data insight system will be described later and will be omitted here. The insight data visualization interface can perform data operations and display relevant data for data operations.
[0138] In this embodiment, the user's operation log is obtained through the insight data visualization interface. The operation log can be collected by setting a tracking point on the insight data visualization interface and collecting the operation log according to the execution order of the user's operation data. The collected operation log can be stored in a log database, and then the user's operation log can be obtained from the log database. Then, the operation log may include user information, operation object information, and data information. Then the user's operation can be for the target database.
[0139] Taking into account the situation that in the process of determining insight data, when obtaining data logs through the insight data visualization interface provided by the insight system, the insight system itself does not have data logs or has limited data logs, therefore, the data logs can be obtained in the second way, that is, using the external data interface to obtain the user's historical operation logs. Of course, the insufficient amount of operation logs provided by the insight system itself is one of the reasons for adopting the second way. However, without considering the above reasons, the second way can also be used to obtain data logs.
[0140] Method 2: External data interface
[0141] The external data interface can be understood as an operation on the target database, and the operation log generated by the operation on the external data interface can also be stored in the log database, and then the user's operation log is obtained from the log database.
[0142] The above content is an example of the method of obtaining the user's operation log. In fact, the purpose of step S101 is to obtain the user's historical operation log for the target database. The log will record relevant data content about the operation. As for how to obtain it, it is not limited by the above method.
[0143] It should be noted that when obtaining user operation logs, it is usually possible to collect the SQL input by the user, that is, to collect the query by SQL text input, or the user's browsing operation on a data library, including: click operation; or selection operation on a data library; of course, it can also include the stay time on the data chart when the data is displayed in the form of data charts, etc. In other words, the operation log can come from any operation behavior on data or data representation, and the operation behavior that does not belong to SQL operation can also be converted into SQL operation, so that the insight system can better identify or record it.
[0144] To ensure the real-time nature of the acquired operation logs, the operation logs generated based on the insight data visualization interface or the external data interface can be collected according to the set collection cycle and the execution order of the user's operation data. Similarly, the user's operation data can also be acquired according to a set time range, that is: based on the insight data visualization interface or the external data interface, the user's operation data is acquired within a set time range. In this embodiment, the user's operation data can be acquired based on the insight data visualization interface or the external data interface, and the user's operation log is acquired within the time range (Δt) between at least two execution start times of the insight data task. The acquired operation log Wherein, U represents user identification information, S represents operation log, and j represents the number of users. The user who obtains the operation log can be a single user or at least two users. In this embodiment, the operation logs of all users within the time range of Δt are mainly used, and the user can be a certified user with the ability to obtain insight data.
[0145] Step S102: constructing an operation data matrix according to the operation data and the operation execution sequence for the operation data.
[0146] The purpose of step S102 is to construct an operation data matrix based on the operation logs of all users, so as to facilitate subsequent insight analysis of the operation data.
[0147] It should be noted that, in this embodiment, the operation data mainly refers to the operation log, that is, the SQL operation log. Therefore, the operation data involved below is the SQL operation log.
[0148] In this embodiment, three methods of constructing the operation data matrix are provided, which will be described in turn below;
[0149] Build method 1:
[0150] Step S102-11: taking the maximum number of operations in the acquired operation data as the number of columns;
[0151] Step S102-12: Fill the columns whose operation times do not meet the maximum value requirement with null values;
[0152] Step S102-13: taking the number of users in the obtained operation data as the number of rows;
[0153] Step S102-13: constructing an operation data matrix according to the number of columns and the number of rows, and the acquired operation data, in accordance with the operation execution order; as follows:
[0154]
[0155] Among them, 1, … n represent the sequential execution times of SQL operations by users, and n is the maximum value of the number of times of executing SQL operations among all users. If user U i executes SQL less than n times, null (empty value) is filled in the matrix. S is the operation log.
[0156] Construction method 2:
[0157] Step S102-21: Use the maximum value of the number of operations in the obtained operation data as the number of columns;
[0158] Step S102-22: Fill the columns whose number of operations does not meet the maximum value requirement with empty values;
[0159] Step S102-23: Use the number of users in the obtained operation data as the number of rows;
[0160] Step S102-24: According to the number of columns and the number of rows, and the obtained operation data, construct the first operation data matrix in the order of operation execution; as follows:
[0161]
[0162] In the first operation data matrix, 1, … n represent the sequential execution times of SQL operations by users, and n is the maximum value of the number of times of executing SQL operations among all users. If user Ui executes SQL less than n times, null (empty value) is filled in the matrix. S is the operation log.
[0163] Step S102-25: Replace the parameters in the operation data in the first operation data matrix with template parameters to obtain the converted first operation data template matrix;
[0164] In this embodiment, the template parameter can be "?", or other parameters that can represent templatization. The first operation data template matrix can be as follows:
[0165]
[0166] Step S102-26: Merge adjacent and identical operation data templates in the first operation data template matrix to obtain the second operation data template matrix;
[0167] The purpose of step S102-26 is to merge the arrays of adjacent and identical operation logs representing the same user in the first operation data template matrix obtained in step S102-25, and record the merged result as of The second operation data template matrix may be obtained as follows: The second operation data template matrix may be obtained as follows:
[0168]
[0169] It is understandable that after merging, the second operation data template matrix is obtained. When the number of matrix columns does not meet the maximum value requirement, it can also be filled with null values. For example: before conversion, SP = ["select*from tableA where id = ?", "select*from tableA where id = ?", "select*from tableB where id = ?"] --- three operation templates of user A, ["select*from tableC group by name, -"] --- one operation template of user B, "-" means no (blank value), after conversion: SP = [("select*from tableA where id = ?") + , "select*from tableB where id=?"], ["select*from tableC group by name,-,-"].
[0170] It should be noted that the n value in the merged second operation data template matrix may change, and the number of columns of the second operation data template matrix is determined according to the maximum n value after the merger.
[0171] Step S102-27: Determine the second operation data template matrix as the operation data matrix.
[0172] Build method 3:
[0173] Step S102-31: taking the maximum number of operations in the acquired operation data as the number of matrix columns;
[0174] Step S102-32: Fill the columns whose operation times do not meet the maximum value requirement with null values;
[0175] Step S102-33: using the number of users in the obtained operation data as the number of matrix rows;
[0176] Step S102-34: construct a first operation data matrix according to the number of columns and the number of rows, and the acquired operation data, in accordance with the operation execution order; as follows:
[0177]
[0178] Among them, 1, … n represent the sequential times of SQL operations executed by the user, and n is the maximum value of the number of SQL operations executed among all users. If the number of times user U i executes SQL < n, then null (empty value) is filled in the matrix. S is the operation log.
[0179] Step S102-35: Replace the parameters in the operation data in the first operation data matrix with template parameters to obtain a converted first operation data template matrix;
[0180] In this embodiment, the template parameter can be "?", or other parameters that can represent templatization. The first operation data template matrix can be as follows:
[0181]
[0182] Step S102-36: Merge adjacent and identical operation data in the first operation data template matrix to obtain a second operation data template matrix;
[0183] The purpose of step S102-36 is to merge the arrays of adjacent and identical operation logs representing the same user in the first operation data template matrix obtained in step S102-35, and record them as after merging. The obtained second operation data template matrix can be as follows: The second operation data template matrix can be as follows:
[0184]
[0185] It can be understood that after merging to obtain the second operation data template matrix, when the number of matrix columns does not meet the maximum requirement, it can also be filled with empty values.
[0186] Step S102-37: Construct a third operation data template matrix according to the frequency or number of times the user uses the data template in the second operation data template matrix;
[0187] In this embodiment, the form of the third operation data template matrix is as follows:
[0188]
[0189] Among them, represents the frequency of user U j using SP n (SQL Pattern).
[0190] Step S102-38: Determine the third operation data template matrix as the operation data matrix.
[0191] Step S103: determining a target operation data set according to the operation data matrix;
[0192] The purpose of step S103 is to perform data analysis on the operation data matrix to obtain a set including target operation logs. In this embodiment, the target operation data set can be understood as an insight data set.
[0193] The specific implementation process of step S103 can match the above-constructed operation data matrix, that is, step S103 is described respectively corresponding to the above-construction methods 1, 2 and 3.
[0194] Determine method 1 (corresponding to construction method 1):
[0195] Step S103-11: selecting target operation data that meets the selection threshold requirement from the operation data matrix by using a frequent item set method;
[0196] The frequent itemsets are obtained by using an iterative algorithm for layer-by-layer search. In this embodiment, each row of the operation data matrix can be used as a data set to determine the support of each array and obtain the first candidate itemset; for example: and The support of each array in , such as: Includes: A , S C , S D , S0 four operation logs, Includes: B , S C , S E , S0, Includes: A , S B , S C , S E , Includes: B , S E , S0, S0; the first candidate item set is {S A}=50%(support), {S B}=75%,{S C}=75%,{S D}=25%,{S E}=75%.
[0197] Then select or prune the support of each first candidate item set, and select the data set that meets the support requirement as the first candidate frequent item set; for example, after selection, the first candidate frequent item set can be: {S A}=50%,{S B}=75%,{SC}=75%,{S E}=75%, discarding 25% of support, that is, the support threshold is 50%.
[0198] Combine the arrays in each item set of the first candidate frequent item set to obtain the second candidate item set, calculate the support of the second candidate item set, and determine the second candidate frequent item set whose support meets the support requirement; for example: {S A , S B}=25%,{S A , S C}=50%,{S A , S E}=25%,{S B , S C}=50%,{S B , S E}=75%,{S C , S E}=50%, and the ones that meet the support requirement are {S A , S C}=50%,{S B , S C}=50%,{S B , S E}=75%,{S C , S E}=50%, which is the second candidate frequent item set.
[0199] Combine the arrays in each data set in the second candidate frequent item set to obtain the third candidate item set, calculate the support of each data set in the third candidate item set, and use the one that meets the support requirement as the final frequent item set, that is, the target operation data template. For example, the array elements included in the second candidate frequent item set are A, B, C, and E. After combination, the third candidate item set is {S A , S B , S C},{S A , S C , S E}, {S A , S B , S E}, {S B , S C , S E The corresponding support degrees are 25%, 25%, 25%, and 50% respectively. The only one that meets the support requirement is {S B , S C , S E}=50%, so {S B , S C, S E} is determined as a target operation data set for the operation data matrix, where S B , S C , S E Manipulate data for the target.
[0200] Frequent item sets can be understood as an iterative process. The above is only a brief description. The specific number of iterations is related to the number of arrays. Since frequent item sets belong to the prior art, only a general description is given here.
[0201] It should be noted that the selection requirement may be a set support threshold, and the support threshold may be set according to actual needs.
[0202] Step S103 - 12: Determine the target operation data set according to the selected target operation data.
[0203] The step S103-12 may select the top-K SQL operation log items as the target operation data, thereby determining the target operation data set, and the K value may be a preset value. The target operation data set may be recorded as SI = {SI1, ..., SI k}, using the above example, SI = {SI B , SI C , SI E}.
[0204] Determine method 2 (corresponding to construction method 2):
[0205] Step S103-21: using a frequent itemset method, selecting a target operation data template that meets the selection requirements from the second operation data template matrix;
[0206] Step S103-21 is similar to the above step S103-11. In this embodiment, each row of the second operation data matrix can be used as a data set to determine the support of each array to obtain the first candidate item set; for example: and The support of each template array in , such as: Includes: SP A , SP C , SP D , SP0 four operation logs, Includes: SP B , SP C , SP E 、SP0, Includes: SP A , SP B , SP C , SP E , Includes: SP B , SP E , SP0, SP0; the first candidate item set is {SP A}=50%(support), {SP B = 75%, {SP C = 75%, {SP D}=25%,{SP E Finally, it is determined that the target operation data template that meets the selection requirements can be S B , S C , S E .
[0207] Step S103-22: determining the target operation data template set according to the selected target operation data template;
[0208] The step S103-23 may select the top-K SQL operation log template items as the target operation data, thereby determining the target operation data set, and the K value may be a preset value. The target operation data set may be recorded as SPI = {SPI1, ..., SPI k}, using the above example, SPI = {SPI B , SPI C , SPI E}.
[0209] Step S103 - 23 : Determine the target operation data template set as the target operation data set.
[0210] Determination method 3 (corresponding to construction method 3):
[0211] Step S102-31: adopting a collaborative filtering method, selecting a target operation data template whose usage times meet the selection similarity requirement in the third operation data template matrix;
[0212] In this embodiment, the collaborative filtering method can actually be understood as a recommendation method. For example, user U1 uses the template For 2 times, use template For 3 times, use the template 0 times, using template 0 times; User U2 uses the template For 2 times, use template For 1 time, use template For 2 times, use template 0 times; User U3 uses the template For 2 times, use template For 1 time, use template For 2 times, use template 0 times; User U4 uses the template 0 times, using template For 2 times, use template For 2 times, use template For 1 time.
[0213] Right now:
[0214] 2 times, 3 times, 0 times, 0 times;
[0215] 2 times, 1 time, 2 times, 0 times;
[0216] 2 times, 1 time, 2 times, 0 times;
[0217] 0 times, 2 times, 2 times, 1 time.
[0218] The similarity between user operations can be obtained based on the number of times the user template is used. Then, the SQL operation template that meets the similarity requirement is selected based on the similarity value as the SQL operation template that the user may use or the SQL operation template recommended to the user, thereby determining the target operation template. For example, based on the similarity between the operation templates of U1 and U2, the SQL operation template of U2 can be selected. The template is recommended to U1. Finally, the recommended operation data template is used as the selected target operation data template.
[0219] Collaborative filtering belongs to the prior art, so the above content is only a summary description.
[0220] Step S103-32: determining a target operation data template usage set according to the selected target operation data template;
[0221] The target operation data template usage set in step S103-32 can be recorded as
[0222] Step S102-33: Determine the target operation data template usage set as the target operation data set.
[0223] Step S104: determining the target operation data in the target operation data set as insight data for output.
[0224] The purpose of step S104 is to determine the target operation data as insight data for display so that the user can intuitively know. In this embodiment, different target operation data can be output in different ways. Similarly, based on the above three construction methods and determination methods, insight data can be displayed in different output methods.
[0225] In this embodiment, the insight data may be displayed through an insight data visualization interface, which is described below in conjunction with the above three methods for determining insight data.
[0226] Display method 1 (corresponding to determination method 1):
[0227] In the first embodiment, step S104 includes:
[0228] Step S104-1-11: generating an insight data report page according to the target operation data in the target operation data set, wherein the insight data is displayed in the insight data report page;
[0229] The target operation data in the target operation data set in step S104-1-11 are arranged in the order of execution, so an insight data report can be generated according to the arrangement order of the elements in the target operation data set, and the insight data report can be in the form of at least one of a trend chart, a pie chart or a table. If the target operation data, i.e., the insight data, comes from the operation data of multiple users, then the insight data report can be visible to multiple users, and correspondingly, if it comes only from a single user, it can be visible only to the single user. Therefore, the insight data report generated based on the above-mentioned construction method 1 and determination method 1 is a report that is not interactive.
[0230] Step S104-1-12: Displaying the insight data report page on the insight data visualization interface, wherein the insight data is displayed in the insight data report page.
[0231] The specific implementation process of step S104-1-12 is to output the insight data report generated in step S104-1-11 to the insight data visualization interface for display, so as to facilitate users to obtain insight data.
[0232] It should be noted that if the insight data visualization interface is in a cold start state, that is, there is no historical insight data report to display, the insight data report in step S104-1-12 is directly displayed. If it is not in a cold start state, the historical insight data report can be replaced by the insight data report in step S104-1-12. If the insight data report in step S104-1-12 is based on the historical insight data report and is generated when the insight data is updated, the historical insight data report can be updated and adjusted according to the updated insight data.
[0233] In the second embodiment, step S104 may include:
[0234] Step S104-1-21: generating an insight data report page according to the target operation data in the target operation data set, wherein the insight data is displayed in the insight data report page;
[0235] Step S104-1-22: Replace the original insight data page displayed on the insight data visualization interface with the insight data report page.
[0236] The insight data report page in the above-mentioned first and second embodiments can be a global insight data report page or an insight data report page for a single user. As for which report page it is, it can be determined based on the way the operation data is obtained. If the data is obtained for multiple users, it can be a global insight data report page. If the data is obtained for a single user, it can be an insight data report page for a single user.
[0237] Display method 2 (corresponding to determination method 2):
[0238] In the first embodiment, step S104 includes:
[0239] Step S104-2-11: Generate an interactive insight data report page with operable parameters according to the target operation data template in the target operation data template set, wherein the interactive insight data report page can display the insight data matching the operation according to the user's operation; wherein the interactive insight data report page can have a report graphic with a drop-down filter and an input box, and the drop-down filter can be selected according to the user's needs to view the operation data options corresponding to the insight data. The report graphic can be at least one of a trend chart, a pie chart and a table. The specific implementation process of step S104-2-11 can refer to the above step S104-1-11.
[0240] Step S104-2-12: Display the interactive insight data report page on the insight data visualization interface.
[0241] In the second embodiment, step S104 may include:
[0242] Step S104-2-21: Generate an interactive insight data report page with operable parameters according to the target operation data template in the target operation data set, wherein the interactive insight data report page can display the insight data matching the operation according to the user's operation; wherein the interactive insight data report page can have a report graphic with a drop-down filter and an input box, and the drop-down filter can be selected according to the user's needs to view the operation data options corresponding to the insight data. The report graphic can be at least one of a trend chart, a pie chart and a table. The specific implementation process of step S104-2-11 can refer to the above step S104-1-11.
[0243] Step S104-2-22: Replace the original insight data page displayed on the insight data visualization interface with the interactive insight data report page. For step S104-2-22, reference can also be made to the above step S104-1-22.
[0244] Display method 3 (corresponding to determination method 3):
[0245] In the first embodiment, step S104 includes:
[0246] Step S104-3-11: Generate an interactive insight data report page that matches the user's operation data and has operable parameters according to the target operation data template using the target operation data template in the set, wherein the interactive insight data report page can display the insight data that matches the operation according to the user's operation;
[0247] Step S104-3-12: Display the interactive insight data report page on the insight data visualization interface.
[0248] In the second embodiment, step S104 includes:
[0249] Step S104-3-21: Generate an interactive insight data report page that matches the user's operation data and has operable parameters according to the target operation data template using the operation data template in the set, wherein the interactive insight data report page can display the insight data that matches the operation according to the user's operation;
[0250] The step S104-3-21 is similar to the step S104-2-21, and the similarities are: the interactive insight data report page can have a report graphic with a drop-down filter and an input box, and the drop-down filter can be selected according to the user's needs to view the operation data options corresponding to the insight data. The report graphic can be at least one of a trend chart, a pie chart, and a table. The difference is that the interactive insight data report page in step S104-3-21 can generate a corresponding interactive insight data report page for each user in the operation data template matrix, that is, each user U i The visible pages correspond to the SPR according to Each operation log (SQL Pattern) in the report will be sequentially constructed into a report graphic (trend chart, pie chart, table) with a drop-down filter and input box. Therefore, in this embodiment, the interactive insight data report page can be a personalized interactive insight data report page.
[0251] Step S104-3-22: Replace the original insight data page displayed on the insight data visualization interface with the interactive insight data report page.
[0252] It should be noted that both the above display methods 2 and 3 are based on the analysis of the template matrix to obtain insight data. The template matrix is for multiple users, so the interactive insight data report page is global. Of course, it is not ruled out that the template matrix analysis is only for a single user.
[0253] Based on the above content, it can be understood that step S104 may also include:
[0254] Determine the target operation data in the target operation data set as insight data and store it in an insight database;
[0255] The insight data is obtained from the insight database for output.
[0256] Because the insight data stored in the insight database can be updated in real time according to the user's operation log, and thus the insight data visualization interface can obtain the latest insight data updated in real time from the insight database library to generate corresponding reports for display output.
[0257] In summary, the insight data determination method embodiment provided in the present application obtains insight data based on analysis of the user's operation data, and the insight data visualization interface can automatically update the insight data content output and displayed on the interface according to the real-time update of the insight data, thereby breaking through the limitations of cognition in the protective gear field and improving the efficiency of insight data output.
[0258] Based on the above content, the present application also provides a device for determining insight data, such as Figure 2 As shown, the determination device embodiment includes:
[0259] An acquisition unit 201 is used to acquire user operation data;
[0260] The acquisition unit 201 includes: a log acquisition subunit, which is used to acquire the user's operation log according to the execution order of the user's operation data based on the insight data visualization interface or the external data interface.
[0261] The system further comprises: a collection unit and a storage unit, wherein the collection unit is used to collect operation logs generated based on the insight data visualization interface or the external data interface according to the execution order of the user's operation data, and the storage unit is used to store the collected operation logs in a log database.
[0262] The collection unit may be specifically configured to collect operation logs generated based on the insight data visualization interface or the external data interface according to a set collection cycle and the execution order of the user's operation data.
[0263] The acquisition unit 201 may be specifically configured to acquire the operation log from the log database in the storage unit.
[0264] The acquisition unit 201 may also be used to acquire the operation data based on an insight data visualization interface or an external data interface in at least one of a text input mode and a component operation mode.
[0265] The acquisition unit 201 may also be used to acquire the user's operation data within a set time range based on the insight data visualization interface or the external data interface. Specifically, the user's operation data may be acquired within a time range between at least two execution start times of the insight data task based on the insight data visualization interface or the external data interface.
[0266] A construction unit 202, configured to construct an operation data matrix according to the operation data and an operation execution sequence for the operation data;
[0267] The building block includes three embodiments, which will be described below respectively.
[0268] The first embodiment includes:
[0269] A column number determination subunit, used for taking the maximum number of operations in the acquired operation data as the number of matrix columns;
[0270] A filling subunit, used to fill the column whose operation times do not meet the maximum value requirement with a null value;
[0271] A row number determination subunit, used to use the number of users in the acquired operation data as the number of matrix rows;
[0272] A construction subunit is used to construct an operation data matrix according to the number of columns and the number of rows, and the acquired operation data, in accordance with the operation execution order.
[0273] The second embodiment comprises:
[0274] A column number determination subunit, used for taking the maximum number of operations in the acquired operation data as the number of matrix columns;
[0275] A filling subunit, used to fill the column whose operation times do not meet the maximum value requirement with a null value;
[0276] A row number determination subunit, used to use the number of users in the acquired operation data as the number of matrix rows;
[0277] A construction subunit, configured to construct a first operation data matrix according to the number of columns and the number of rows, and the acquired operation data, in accordance with the operation execution order;
[0278] a conversion subunit, configured to replace parameters in the operation data in the first operation data matrix with template parameters to obtain a converted first operation data template matrix;
[0279] a merging subunit, configured to merge adjacent and identical operation data templates in the first operation data template matrix to obtain a second operation data template matrix;
[0280] A determination subunit is used to determine the second operation data template matrix as the operation data matrix.
[0281] The third embodiment comprises:
[0282] A column number determination subunit, used for taking the maximum number of operations in the acquired operation data as the number of matrix columns;
[0283] A filling subunit, used to fill the column whose operation times do not meet the maximum value requirement with a null value;
[0284] A row number determination subunit, used to use the number of users in the acquired operation data as the number of matrix rows;
[0285] A first construction subunit, configured to construct a first operation data matrix according to the number of columns and the number of rows, and the acquired operation data, in accordance with the operation execution order;
[0286] a conversion subunit, configured to replace parameters in the operation data in the first operation data matrix with template parameters to obtain a converted first operation data template matrix;
[0287] a merging subunit, configured to merge adjacent and identical operation data in the first operation data template matrix to obtain a second operation data template matrix;
[0288] A second constructing subunit, configured to construct a third operation data template matrix according to the frequency or number of times the user uses the data template in the second operation data template matrix;
[0289] The determination subunit is used to determine the third operation data template matrix as the operation data matrix.
[0290] A determination unit 203, configured to determine a target operation data set according to the operation data matrix;
[0291] The determining unit 203 also has three implementation modes based on the three embodiments of the constructing unit 202 , which are described below corresponding to the description of the constructing unit 202 .
[0292] In the first embodiment, the determining unit 203 includes:
[0293] Selecting a subunit, using a frequent item set method, to select target operation data that meets the selection threshold requirement in the operation data matrix;
[0294] The set determination subunit is used to determine the target operation data set according to the selected target operation data.
[0295] In the second embodiment, the determining unit 203 includes:
[0296] A selection subunit, configured to select a target operation data template that meets the selection requirement from the second operation data template matrix by adopting a frequent item set method;
[0297] A first determining subunit, configured to determine the target operation data template set according to the selected target operation data;
[0298] The second determining subunit is configured to determine the target operation data template set as the target operation data set.
[0299] In the third embodiment, the determining unit 203 includes:
[0300] A selection subunit is used to select, in the third operation data template matrix, a target operation data template whose usage times meet the selection similarity requirement by adopting a collaborative filtering method;
[0301] A first determining subunit, configured to determine a target operation data template usage set according to the selected target operation data template;
[0302] The second determining subunit is configured to determine the target operation data template usage set as the target operation data set.
[0303] The output unit 204 is used to determine the target operation data in the target operation data set as insight data for output.
[0304] The output unit 204 corresponds to the construction unit 202 and the determination unit 203 and also includes three implementation modes, which are described in turn below. The description order is the same as that of the above embodiment.
[0305] In the first embodiment, the output unit 204 has two sub-implementations, and the first sub-implementation includes:
[0306] A generating subunit, configured to generate an insight data report page according to the target operation data in the target operation data set;
[0307] A display subunit is used to display the insight data report page on the insight data visualization interface, wherein the insight data is displayed in the insight data report page.
[0308] The second sub-implementation method includes:
[0309] A generating subunit, configured to generate an insight data report page according to the target operation data in the target operation data set, wherein the insight data is displayed in the insight data report page;
[0310] The replacement subunit is used to replace the original insight data page displayed on the insight data visualization interface with the insight data report page.
[0311] In the second embodiment, the output unit 204 also has two sub-implementations. The first sub-implementation includes:
[0312] A generating subunit, configured to generate an interactive insight data report page operable for parameters according to the target operation data template in the target operation data template set, wherein the interactive insight data report page can display the insight data matching the operation according to the user's operation;
[0313] The display subunit is used to display the interactive insight data report page on the insight data visualization interface.
[0314] The second self-implementation method includes:
[0315] A generating subunit, configured to generate an interactive insight data report page operable for parameters according to the target operation data template in the target operation data set, wherein the interactive insight data report page can display the insight data matching the operation according to the user's operation;
[0316] The replacement subunit is used to replace the original insight data page displayed on the insight data visualization interface with the interactive insight data report page.
[0317] In the third embodiment, the output unit 204 also has two sub-implementation modes, and the first sub-implementation mode includes:
[0318] a generating subunit, configured to generate, according to the target operation data template, a target operation data template in a set, an interactive insight data report page that matches the operation data of the user and has operable parameters, wherein the interactive insight data report page can display the insight data that matches the operation according to the operation of the user;
[0319] The display subunit is used to display the interactive insight data report page on the insight data visualization interface.
[0320] The second sub-implementation includes:
[0321] A generating subunit, configured to generate an interactive insight data report page that matches the user's operation data and has operable parameters based on the target operation data template using the operation data template in the set, wherein the interactive insight data report page can display the insight data that matches the operation based on the user's operation;
[0322] The replacement subunit is used to replace the original insight data page displayed on the insight data visualization interface with the interactive insight data report page.
[0323] In this embodiment, the output unit 204 may include:
[0324] A storage unit, configured to determine the target operation data in the target operation data set as insight data and store them in an insight database;
[0325] The output subunit is used to obtain the insight data from the insight database in the storage unit for output. The output subunit may specifically obtain the insight data from the insight database and display it in the form of a report on the insight data visualization interface. The report may be interactive or non-interactive, as described in step S103 above.
[0326] Based on the above content, this application also provides an interactive method for data insight, please refer to Figure 3 As shown, the interaction method embodiment includes:
[0327] Step S301: sending a data query request for a target database based on a query operation interface;
[0328] Step S302: according to the data query request, collect the user's operation data on the target database, and build an operation data matrix according to the operation data and the operation execution order of the operation data, determine the target operation data set according to the operation data matrix, and determine the target operation data in the target operation data set as insight data for output;
[0329] Step S303: the query operation interface generates an insight data interface capable of displaying the insight data according to the received insight data, and displays the insight data on the query operation interface. Displaying here can be understood as rendering the insight data interface.
[0330] Regarding the above steps S301 to S303, reference may be made to the above contents in the embodiment of the method for determining insight data, which will not be repeated here.
[0331] Based on the above content, this application also provides a data insight system, please refer to Figure 4 As shown, the data insight system embodiment includes: an operation data collection module 401 , a target database 402 , a data insight module 403 and an insight data interface generation module 404 .
[0332] The operation data collection module 401 is used to collect the user's operation data on the target database 402;
[0333] The data insight module 403 is used to construct an operation data matrix according to the operation data and the operation execution order for the operation data; determine a target operation data set according to the operation data matrix; and determine the target operation data in the target operation data set as insight data;
[0334] The insight data interface generation module 404 is used to generate an insight data interface capable of displaying the insight data according to the insight data.
[0335] It may also include: a query operation module 405, which is used to provide a query interface for users to perform data query;
[0336] The operation data collection module 401 is used to collect the user's operation data on the target database based on the query interface;
[0337] The insight data interface generation module 404 is used to regenerate the query interface according to the insight data, and generate the insight data interface capable of displaying the insight data.
[0338] It can be understood that, in this embodiment, the acquisition of the operation data may be a query operation performed by the user based on the query interface provided by the query operation module 405, or a query operation performed based on an external data interface.
[0339] It is understandable that the following may also be included: the insight database 406 is used to store the insight data determined by the data insight module 403; the insight data interface generation module 404 obtains the insight data from the insight database 406 and generates the interactive interface, and the interactive interface and the query interface may be displayed on the same terminal device, i.e., the insight data system platform. The determination of the insight data may refer to the description of the above steps S102 and S103.
[0340] It can be understood that the target database 402 in this embodiment can be an independent target database in various fields or a comprehensive database.
[0341] It is understandable that it may also include: an operation log database 407, which is used to store the operation data collected by the operation data collection module 401, and the operation data collected by the operation data collection module 401 may be operation log data. The operation log database 407 may store and process the operation data collected by the operation data collection module 401 through the operation data storage module 408, and then store it in the operation log database 407. The data insight module 403 may obtain operations such as constructing a matrix and other related insight analysis between the operation data obtained according to a predetermined time period or frequency period through the operation database. For the specific content, please refer to the description of the above steps S101 to S104, which will not be repeated here.
[0342] Based on the above content, the present application also provides a computer storage medium for storing data generated by a network platform, and a program for processing the data generated by the network platform;
[0343] When the program is read and executed, the following steps are performed:
[0344] Get user operation data;
[0345] Constructing an operation data matrix according to the operation data and the operation execution order for the operation data;
[0346] Determining a target operation data set according to the operation data matrix;
[0347] The target operation data in the target operation data set is determined as insight data for output.
[0348] Based on the above content, the present application also provides an electronic device, including:
[0349] processor;
[0350] The memory is used to store a program for processing data generated by the network platform, and when the program is read and executed by the processor, the following steps are performed:
[0351] Get user operation data;
[0352] Constructing an operation data matrix according to the operation data and the operation execution order for the operation data;
[0353] Determining a target operation data set according to the operation data matrix;
[0354] The target operation data in the target operation data set is determined as insight data for output.
[0355] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0356] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0357] 1. Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include non-transitory media such as modulated data signals and carrier waves.
[0358] 2. Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems or computer program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0359] Although the present application is disclosed as above in the form of a preferred embodiment, it is not intended to limit the present application. Any technical personnel in this field may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.
Claims
1. A method for determining insight data, comprising: Obtain user operation data on the target database; Constructing an operation data matrix according to the operation data and the operation execution order for the operation data; Determining a target operation data set according to the operation data matrix; Determine the target operation data in the target operation data set as insight data for output; The step of constructing an operation data matrix according to the operation data and the operation execution sequence for the operation data includes: The maximum value of the number of operations in the obtained operation data is used as the number of columns; Fill the columns whose operation times do not meet the maximum value requirement with null values; The number of users in the obtained operation data is taken as the number of rows; An operation data matrix is constructed according to the number of columns and the number of rows, and the acquired operation data, in accordance with the operation execution order.
2. The method for determining insight data according to claim 1, wherein obtaining the user's operation data on the target database comprises: The operation log of the user is obtained according to the execution order of the operation data of the user based on the insight data visualization interface or the external data interface.
3. The method for determining insight data according to claim 1, further comprising: Collecting operation logs generated based on the insight data visualization interface or the external data interface according to the execution order of the user's operation data; Storing the collected operation logs in a log database; The obtaining of the user's operation data includes: The operation log is obtained from the log database.
4. The method for determining insight data according to claim 3, wherein collecting the operation log generated based on the insight data visualization interface or the external data interface according to the execution order of the user's operation data comprises: According to the set collection cycle and the execution order of the user's operation data, the operation logs generated based on the insight data visualization interface or the external data interface are collected.
5. The method for determining insight data according to claim 1, wherein obtaining the user's operation data on the target database comprises: Based on the insight data visualization interface or the external data interface, the operation data is obtained by querying, browsing and selecting at least one of the operation modes.
6. The method for determining insight data according to claim 1, wherein obtaining the user's operation data on the target database comprises: Based on the insight data visualization interface or the external data interface, the operation data of the user is obtained within a set time range.
7. The method for determining insight data according to claim 6, wherein the step of obtaining the user's operation data within a set time range based on the insight data visualization interface or the external data interface comprises: Based on the insight data visualization interface or the external data interface, the operation data of the user is obtained within a time range between at least two start times of executing insight data tasks.
8. The method for determining insight data according to claim 1, wherein determining a target operation data set according to the operation data matrix comprises: Using a frequent item set approach, target operation data that meets a selection threshold requirement is selected from the operation data matrix; The target operation data set is determined according to the selected target operation data.
9. The method for determining insight data according to claim 8, wherein the step of determining the target operation data in the target operation data set as insight data for output comprises: Generate an insight data report page according to the target operation data in the target operation data set; The insight data report page is displayed on an insight data visualization interface, wherein the insight data is displayed in the insight data report page.
10. The method for determining insight data according to claim 8, wherein the step of determining the target operation data in the target operation data set as insight data for output comprises: Generate an insight data report page according to the target operation data in the target operation data set, wherein the insight data is displayed in the insight data report page; The original insight data page displayed on the insight data visualization interface is replaced with the insight data report page.
11. The method for determining insight data according to claim 1, wherein the step of constructing an operation data matrix according to the operation data and the order of executing operations on the operation data comprises: The maximum value of the number of operations in the obtained operation data is used as the number of columns; Fill the columns whose operation times do not meet the maximum value requirement with null values; The number of users in the obtained operation data is taken as the number of rows; Constructing a first operation data matrix according to the number of columns and the number of rows, and the acquired operation data and in accordance with the operation execution order; Replacing the parameters in the operation data in the first operation data matrix with template parameters to obtain a converted first operation data template matrix; Merging adjacent and identical operation data templates in the first operation data template matrix to obtain a second operation data template matrix; The second operation data template matrix is determined as the operation data matrix.
12. The method for determining insight data according to claim 11, wherein determining the target operation data set according to the operation data matrix comprises: Selecting a target operation data template that meets the selection requirements from the second operation data template matrix by using a frequent item set method; Determining the target operation data template set according to the selected target operation data; The target operation data template set is determined as the target operation data set.
13. The method for determining insight data according to claim 11, wherein the step of determining the target operation data in the target operation data set as insight data for output comprises: Generate an interactive insight data report page operable for parameters according to the target operation data template in the target operation data template set, wherein the interactive insight data report page can display the insight data matching the operation according to the user's operation; The interactive insight data report page is displayed on the insight data visualization interface.
14. The method for determining insight data according to claim 12, wherein the step of determining the target operation data in the target operation data set as insight data for output comprises: Generate an interactive insight data report page operable for parameters according to the target operation data template in the target operation data set, wherein the interactive insight data report page can display the insight data matching the operation according to the user's operation; The original insight data page displayed on the insight data visualization interface is replaced with the interactive insight data report page.
15. The method for determining insight data according to claim 1, wherein constructing an operation data matrix according to the operation data and the order of executing operations on the operation data comprises: The maximum value of the number of operations in the obtained operation data is used as the number of matrix columns; Fill the columns whose operation times do not meet the maximum value requirement with null values; Using the number of users in the obtained operation data as the number of matrix rows; Constructing a first operation data matrix according to the number of columns and the number of rows, and the acquired operation data and in accordance with the operation execution order; Replacing the parameters in the operation data in the first operation data matrix with template parameters to obtain a converted first operation data template matrix; Merging adjacent and identical operation data in the first operation data template matrix to obtain a second operation data template matrix; constructing a third operation data template matrix according to the frequency or number of times the user uses the data template in the second operation data template matrix; The third operation data template matrix is determined as the operation data matrix.
16. The method for determining insight data according to claim 15, wherein determining a target operation data set according to the operation data matrix comprises: By adopting a collaborative filtering method, in the third operation data template matrix, a target operation data template whose usage times meet the selection similarity requirement is selected; Determining a target operation data template usage set according to the selected target operation data template; The target operation data template usage set is determined as the target operation data set.
17. The method for determining insight data according to claim 16, wherein the step of determining the target operation data in the target operation data set as insight data for output comprises: Using the target operation data template in the set according to the target operation data template, generating an interactive insight data report page that matches the operation data of the user and has operable parameters, wherein the interactive insight data report page can display the insight data that matches the operation according to the operation of the user; The interactive insight data report page is displayed on the insight data visualization interface.
18. The method for determining insight data according to claim 16, wherein the step of determining the target operation data in the target operation data set as insight data for output comprises: Using the target operation data template in the set according to the target operation data template, generating an interactive insight data report page that matches the operation data of the user and has operable parameters, wherein the interactive insight data report page can display the insight data that matches the operation according to the operation of the user; The original insight data page displayed on the insight data visualization interface is replaced with the interactive insight data report page.
19. The method for determining insight data according to claim 1, wherein the step of determining the target operation data in the target operation data set as insight data for output comprises: Determine the target operation data in the target operation data set as insight data and store it in an insight database; The insight data is obtained from the insight database for output.
20. An apparatus for determining insight data, comprising: An acquisition unit, used for acquiring user operation data; A construction unit, configured to construct an operation data matrix according to the operation data and an operation execution sequence for the operation data; A determination unit, configured to determine a target operation data set according to the operation data matrix; an output unit, configured to determine the target operation data in the target operation data set as insight data for output; The building block comprises: A column number determination subunit, used for taking the maximum number of operations in the acquired operation data as the number of matrix columns; A filling subunit, used to fill the column whose operation times do not meet the maximum value requirement with a null value; A row number determination subunit, used to use the number of users in the acquired operation data as the number of matrix rows; A construction subunit is used to construct an operation data matrix according to the number of columns and the number of rows, and the acquired operation data, in accordance with the operation execution order.
21. An interactive method for data insight, comprising: Sending a data query request for a target database based on a query operation interface; According to the data query request, the user's operation data on the target database is collected, and according to the operation data and the operation execution order of the operation data, an operation data matrix is constructed, and according to the operation data matrix, a target operation data set is determined, and the target operation data in the target operation data set is determined as insight data for output; The query operation interface generates an insight data interface capable of displaying the insight data according to the received insight data, and displays the insight data on the query operation interface.
22. A data insight system, comprising: Operate data acquisition module, target database, data insight module and insight data interface generation module; The operation data collection module is used to collect the user's operation data on the target database; The data insight module is used to construct an operation data matrix according to the operation data and the operation execution sequence for the operation data; and determine a target operation data set according to the operation data matrix; determining target operation data in the target operation data set as insight data; The insight data interface generation module is used to generate an insight data interface capable of displaying the insight data according to the insight data.
23. The data insight system according to claim 22, further comprising: The operation log database is used to store the operation data collected by the operation data collection module.
24. The data insight system according to claim 22, further comprising: An insight database, used to store the insight data determined by the data insight module; The insight data interface generation module obtains the insight data from the insight database and generates an interactive interface.
25. The data insight system according to claim 22, further comprising: A query operation module is used to provide a query interface for users to perform data queries; The operation data collection module is used to collect the user's operation data on the target database based on the query interface; The insight data interface generation module is used to regenerate the query interface according to the insight data to generate the insight data interface capable of displaying the insight data.
26. A computer storage medium for storing data generated by a network platform and a program for processing the data generated by the network platform; When the program is read and executed, the following steps are performed: obtaining the user's operation data on the target database; Constructing an operation data matrix according to the operation data and the operation execution order for the operation data; Determining a target operation data set according to the operation data matrix; Determine the target operation data in the target operation data set as insight data for output; or, perform the following steps: Sending an operation data query request based on the query operation interface; According to the received operation data query request, the user's operation data on the target database is collected, and according to the operation data and the operation execution order of the operation data, an operation data matrix is constructed, and according to the operation data matrix, a target operation data set is determined, and the target operation data in the target operation data set is determined as insight data for output; The query operation interface receives the insight data, and generates an insight data interface capable of displaying the insight data according to the insight data; The step of constructing an operation data matrix according to the operation data and the operation execution sequence for the operation data includes: The maximum value of the number of operations in the obtained operation data is used as the number of columns; Fill the columns whose operation times do not meet the maximum value requirement with null values; The number of users in the obtained operation data is taken as the number of rows; An operation data matrix is constructed according to the number of columns and the number of rows, and the acquired operation data, in accordance with the operation execution order.
27. An electronic device comprising: processor; The memory is used to store a program for processing data generated by the network platform, and when the program is read and executed by the processor, the following steps are performed: Obtain user operation data on the target database; According to the operation data and the operation execution order for the operation data, an operation data matrix is constructed; according to the operation data matrix, a target operation data set is determined; Determine the target operation data in the target operation data set as insight data for output; or, perform the following steps: Sending an operation data query request based on the query operation interface; According to the received operation data query request, the user's operation data on the target database is collected, and according to the operation data and the operation execution order of the operation data, an operation data matrix is constructed, and according to the operation data matrix, a target operation data set is determined, and the target operation data in the target operation data set is determined as insight data for output; The query operation interface receives the insight data, and generates an insight data interface capable of displaying the insight data according to the insight data; The step of constructing an operation data matrix according to the operation data and the operation execution sequence for the operation data includes: The maximum value of the number of operations in the obtained operation data is used as the number of columns; Fill the columns whose operation times do not meet the maximum value requirement with null values; The number of users in the obtained operation data is taken as the number of rows; An operation data matrix is constructed according to the number of columns and the number of rows, and the acquired operation data, in accordance with the operation execution order.
