Information processing device, analysis method, and analysis program
The information processing apparatus and method address the limitation of existing technologies by generating insight subjects and calculating evaluation values to detect insights between multiple data sets, enhancing the discovery of composite insights and reducing analysis time.
Patent Information
- Application Number
- JP2022571910
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-12-22
- Filing Date
- 2021-10-25
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-10-25
AI Technical Summary
Existing data analysis technologies, such as those described in Patent Document 1, are unable to detect insights between multiple data sets, limiting the discovery of composite insights that can be obtained by analyzing data sets from different sources.
An information processing apparatus and method that generates insight subjects by associating data items across multiple data sets and calculates an evaluation value, known as an insight score, to determine the presence or absence of insights in combinations of grouped subjects, allowing for the detection of cross-sectional composite insights.
Enables the discovery of insights across multiple data sets, reducing the time and effort required for analysis and visualization, and facilitating the detection of composite insights that may not be apparent from individual data sets alone.
Smart Images

Figure 0007586196000001 
Figure 0007586196000002 
Figure 0007586196000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device or the like that analyzes a data set. [Background technology]
[0002] In recent years, in various fields, data is collected and analyzed to find knowledge that is meaningful to people. Such knowledge is called insight. In general data analysis work, analysts find insights by repeating the cycle of setting a hypothesis, analyzing and visualizing data based on the set hypothesis, and verifying the hypothesis.
[0003] The data analysis work described above to find insights requires a great deal of time and effort, and therefore technology to automate this work is being developed. For example, Patent Document 1 below discloses a system that automatically provides insights from a data set. An analyst simply inputs the multidimensional data to be analyzed into the system described in Patent Document 1. This causes the system to automatically determine an insight, and the determined insight is displayed on a screen. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] US Patent No. 2020 / 0257682 Summary of the Invention [Problem to be solved by the invention]
[0005] The technology described in Patent Document 1 has room for improvement in that it cannot detect insights between multiple data sets. For example, by analyzing both a data set consisting of product sales data of one company and a data set consisting of product sales data of another company, it is possible to find insights that cannot be obtained from one data set alone.
[0006] However, the technology described in Patent Document 1 does not anticipate detecting such insights between multiple data sets. Therefore, it goes without saying that the technology described in Patent Document 1 cannot detect insights between multiple data sets.
[0007] One aspect of the present invention has been made in consideration of the above problems, and one example of a purpose of the present invention is to provide an information processing device or the like that enables detection of insights among multiple data sets. [Means for solving the problem]
[0008] An information processing device according to one embodiment of the present invention includes a classification means for grouping insight subjects, which are data generated from each of a plurality of data sets by associating a plurality of data items contained in the respective data sets, according to the insight to be detected, and an evaluation means for calculating an evaluation value for determining whether or not an insight exists for a combination of the grouped plurality of insight subjects.
[0009] An analysis method according to one embodiment of the present invention includes at least one processor grouping insight subjects, which are data generated from each of a plurality of datasets by associating a plurality of data items contained in the dataset, for each insight to be detected, and calculating an evaluation value for determining whether or not an insight exists for a combination of the grouped plurality of insight subjects.
[0010] An analysis program according to one embodiment of the present invention causes a computer to perform the following processes: grouping insight subjects, which are data generated from each of a plurality of data sets by associating a plurality of data items contained in the respective data sets, for each insight to be detected; and calculating an evaluation value for determining whether or not an insight exists for a combination of the grouped plurality of insight subjects. Effect of the Invention
[0011] One aspect of the present invention enables discovery of insights across multiple data sets. [Brief description of the drawings]
[0012] [Figure 1] 1 is a block diagram showing a configuration of an information processing device according to a first exemplary embodiment of the present invention. [Diagram 2] FIG. 1 is a flow chart showing the flow of an analysis method according to a first exemplary embodiment of the present invention. [Diagram 3] FIG. 11 is a diagram showing an overview of a process executed by an information processing device according to a second exemplary embodiment of the present invention. [Figure 4] FIG. 11 is a block diagram showing a configuration of an information processing device according to a second exemplary embodiment of the present invention. [Diagram 5] FIG. 4 is a flow chart showing the flow of an analysis method according to a second exemplary embodiment of the present invention. [Figure 6] FIG. 2 is a diagram showing an example of analysis target data and insight subjects generated from the analysis target data. [Figure 7] 11A and 11B are diagrams illustrating examples of evaluation result data and output data. [Figure 8] FIG. 11 is a block diagram showing a configuration of an information processing device according to an exemplary embodiment 3 of the present invention. [Figure 9] FIG. 11 is a flow chart showing the flow of an analysis method according to an exemplary embodiment 3 of the present invention. [Figure 10] 11 is a diagram for explaining a method for calculating an insight score and a method for detecting an outlier. [Figure 11]FIG. 2 is a diagram illustrating an example of a computer that executes instructions of a program, which is software that realizes each function of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Example 1 A first exemplary embodiment of the present invention will be described in detail with reference to the drawings. This exemplary embodiment is a basic form of the exemplary embodiments described later.
[0014] (Configuration of information processing device 1) The configuration of an information processing device 1 according to this exemplary embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the information processing device 1. As shown in the figure, the information processing device 1 includes a classification unit 11 and an evaluation unit 12.
[0015] The classification unit 11 groups insight subjects, which are data generated by associating multiple data items included in each of multiple data sets, for each insight to be detected. When grouping, the classification unit 11 groups insight subjects for which an evaluation value can be calculated by the evaluation unit 12. In the following, the insight to be detected is called an insight type. It is sufficient that at least one insight type is set. Details of the insight types will be described in the second exemplary embodiment.
[0016] Then, the evaluation unit 12 calculates an evaluation value for determining the presence or absence of an insight for each combination of the grouped insight subjects. Hereinafter, this evaluation value will be referred to as an insight score.
[0017] For example, when a dataset showing monthly sales records of a certain store is the subject of analysis, data showing daily total sales at the store (data in which a date is associated with a data item of total sales) can be the insight subject. Similarly, data showing daily sales of a certain product at the store (data in which a date is associated with a data item of sales of a certain product) can be the insight subject. Such insight subjects can be visualized in the form of, for example, a chart, and therefore the insight subjects can also be called visualization patterns. It can also be said that an insight subject characterizes each visualization pattern obtained from a dataset that is multidimensional data. In this case, one visualization pattern is associated with one insight subject.
[0018] Then, if the insight to be detected, i.e., the insight type, is, for example, a correlation between insight subjects, the classification unit 11 groups the insight subjects for which an insight score (e.g., a correlation coefficient) for determining the presence or absence of a correlation can be calculated. For example, in the above example, the classification unit 11 may group insight subjects that indicate the relationship between the date and sales at each store. This allows the evaluation unit 12 to calculate an insight score for the date and sales at each store. The insight score can be a great help to the user in discovering an insight even if it is output as is. In addition, by using the insight score, it is also possible to automatically detect a combination of insight subjects that has a high insight score, i.e., a high possibility of being an insight.
[0019] As described above, the information processing device 1 according to this exemplary embodiment is configured to include a classification unit 11 that groups insight subjects generated from each of a plurality of data sets according to the insight to be detected, and an evaluation unit 12 that calculates an evaluation value for determining whether or not an insight exists for a combination of the grouped plurality of insight subjects.
[0020] Therefore, the information processing device 1 according to this exemplary embodiment has an effect of enabling the detection of insights among a plurality of data sets. In other words, the information processing device 1 according to this exemplary embodiment makes it possible to present to a user data that may lead to the discovery of a composite insight (hereinafter, referred to as a cross-sectional composite insight) obtained by cross-analyzing a plurality of data sets.
[0021] The functions of the information processing device 1 described above can also be realized by a program. The analysis program according to this exemplary embodiment causes a computer to execute a process of grouping insight subjects generated from each of a plurality of data sets for each insight to be detected, and a process of calculating an evaluation value for determining the presence or absence of an insight for a combination of the grouped plurality of insight subjects. Therefore, according to the analysis program according to this exemplary embodiment, it is possible to obtain an effect of enabling the detection of an insight between a plurality of data sets, that is, a cross-sectional composite insight.
[0022] (Analysis method flow) The flow of the analysis method according to this exemplary embodiment will be described with reference to Fig. 2. Fig. 2 is a flow diagram showing the flow of the analysis method according to this exemplary embodiment.
[0023] In S11, at least one processor groups the insight subjects generated from each of the multiple data sets by insight type. Then, in S12, at least one processor calculates an insight score, which is an evaluation value for determining whether or not an insight exists, for a combination of the multiple insight subjects grouped in S11. This ends the analysis method of FIG. 2.
[0024] The processes of S11 to S12 may be executed by one processor, or the processes of S11 and S12 may be executed by different processors. In the latter case, the processors may be included in one information processing device, or may be included in different information processing devices. Furthermore, at least one processor that executes the processes of S11 to S12 may be included in the information processing device 1.
[0025] As described above, the analysis method according to the present exemplary embodiment is configured to include a process in which at least one processor groups the insight subjects generated from each of a plurality of data sets by insight type, and calculates an insight score for determining whether or not an insight exists for a combination of the grouped plurality of insight subjects. Therefore, the analysis method according to the present exemplary embodiment has an effect of enabling the detection of insights between a plurality of data sets, that is, cross-sectional composite insights.
[0026] Exemplary embodiment 2 (overview) A second exemplary embodiment of the present invention will be described in detail with reference to the drawings. In this exemplary embodiment, an information processing device 2 that receives input of a plurality of data sets and outputs information related to insights about the data sets will be described. FIG. 3 is a diagram showing an overview of the processing executed by the information processing device 2.
[0027] First, the information processing device 2 acquires analysis target data 211a and 211b to be analyzed. Both of the analysis target data 211a and 211b are multidimensional data sets including a plurality of records. When there is no need to distinguish between the analysis target data 211a and 211b, they are simply referred to as analysis target data 211. Both of the analysis target data 211a and 211b shown in FIG. 3 are data in a table format.
[0028] Next, the information processing device 2 generates insight subjects from each of the acquired analysis target data 211a and 211b. In the example of Fig. 3, three insight subjects I1 to I3 are generated from the analysis target data 211a, and two insight subjects I4 and I5 are generated from the analysis target data 211b.
[0029] Next, the information processing device 2 groups the generated insight subjects I1 to I5. In the example of FIG. 3, the insight subjects I1 and I5 are grouped together. 1 Insight subjects I3 and I4 are classified into group G 2 Group G 1 and G 2 The insight types of the groups may be the same or different. 1 and G 2 If the insight types are the same, each group will contain different insight subjects.
[0030] Then, the information processing device 2 calculates an insight score, which is an evaluation value for determining whether or not there is an insight, for a combination of insight subjects included in each group. In the example of FIG. 3, the insight score of insight subjects I1 and I5 is calculated to be 0.6, and the insight score of insight subjects I3 and I4 is calculated to be 0.9. The insight score may indicate the degree of correlation between the insight subjects, for example, as a numerical value from 0 to 1 (the larger the numerical value, the higher the degree of correlation). In this case, insight subjects I3 and I4 are highly correlated.
[0031] Here, insight subject I3 is generated from the analysis target data 211a. Meanwhile, insight subject I4 is generated from the analysis target data 211b. The knowledge that insight subjects I3 and I4 are highly correlated is useful to people. In other words, the information processing device 2 makes it possible to detect insights between multiple data sets, that is, cross-sectional composite insights. Note that, as will be described in detail below, the information processing device 2 makes it possible to detect various insights other than correlations.
[0032] (Configuration of information processing device 2) 4 is a block diagram showing the configuration of the information processing device 2. The information processing device 2 includes a control unit 20 that controls each unit of the information processing device 2, and a storage unit 21 that stores various data used by the information processing device 2. The information processing device 2 also includes a communication unit 22 that allows the information processing device 2 to communicate with other devices, an input unit 23 that accepts input to the information processing device 2, and an output unit 24 that allows the information processing device 2 to output data. In the following, an example will be described in which the output unit 24 is a display device that displays and outputs data, but the output mode of the output unit 24 is arbitrary, and may be one that outputs data in the form of, for example, print output or audio output. The input unit 23 and the output unit 24 may also be external devices attached to the information processing device 2.
[0033] The control unit 20 includes a data acquisition unit 201, a subject generation unit 202, a notation unification unit 203, a classification unit 204, a granularity unification unit 205, an evaluation unit 206, and an output data generation unit 207. The storage unit 21 stores analysis target data 211, evaluation result data 212, and output data 213.
[0034] The data to be analyzed 211 is data to be analyzed by the information processing device 2. The data to be analyzed 211 includes a plurality of data sets. Each data set is multidimensional data including a plurality of records. The evaluation result data 212 is data indicating the result of the evaluation of the data to be analyzed 211 by the evaluation unit 206. The output data 213 is data for presenting the result of the analysis of the data to be analyzed 211 by the information processing device 2 to a user, that is, data related to an insight into the data to be analyzed 211.
[0035] The data acquisition unit 201 acquires a plurality of data sets to be analyzed by the information processing device 2, and stores them in the storage unit 21 as analysis target data 211. The data acquisition unit 201 only needs to acquire the analysis target data 211 by the time the analysis starts and store it in the storage unit 21. The method of acquiring the analysis target data 211 is not particularly limited. For example, the data acquisition unit 201 may acquire a data set input by a user of the information processing device 2 via the input unit 23. Also, for example, the data acquisition unit 201 may acquire the analysis target data 211 from an external device by communication via the communication unit 22.
[0036] The subject generation unit 202 generates insight subjects from each of a plurality of data sets included in the analysis target data 211. More specifically, the subject generation unit 202 generates insight subjects from each of a plurality of data sets by associating a plurality of data items included in the data set. For example, when a certain data set is multidimensional data including data items of date, sales, and location, the subject generation unit 202 generates an insight subject that associates date with sales, or an insight subject that associates location with sales.
[0037] The notation unification unit 203 unifies the notation of data in each insight subject. More specifically, the notation unification unit 203 extracts similar words from among the words included in each insight subject, and replaces the words with one word to unify the notation in each insight subject. Note that the above "similar" includes similarity in meaning as well as similarity in word strings.
[0038] For example, "Tokyo" representing the sales location of a product in one dataset is a word similar in meaning and character string to "Tokyo" representing the sales location of a product in another dataset, and these can also be called spelling variations. Also, for example, "Prefecture" representing the sales location of a product in one dataset is a word similar in meaning to "Location" representing the sales location of a product in another dataset.
[0039] Any method can be applied as a method for extracting such similar words. The spelling unification unit 203 may extract words with spelling variations such as "Tokyo" and "Tokyo Metropolis". In this case, the spelling unification unit 203 may extract words with a close edit distance between the words. The edit distance is also called the Levenshtein distance and is a distance indicating how different two character strings are. When calculating the edit distance, the spelling unification unit 203 calculates how many times a character string constituting one of the words to be compared (deletion, insertion, replacement) must be changed to convert the character string constituting the other word to be compared. In addition, the analysis target data 211 may extract similar words based on, for example, the Jaro-Winkler distance, which is a distance that measures the length of two character strings and the necessity of replacement (partial match).
[0040] In addition, when extracting words with similar meanings, the analysis target data 211 may represent each word included in each data set as a distributed representation, and extract words with high similarity of the distributed representation. For example, a program such as word2vec may be used to derive the distributed representation.
[0041] After extracting similar words, the notation unifying unit 203 unifies the notations of those words. For example, the notation unifying unit 203 may unify the notations of two similar words by replacing all instances of one word with the other word. The notation unifying unit 203 may also unify the notations of two similar words by replacing the two similar words with a word of a higher concept that includes those words.
[0042] The classification unit 204 groups the insight subjects generated by the subject generation unit 202. More specifically, the classification unit 204 groups the insight subjects for which an insight score, which is an evaluation value for determining whether or not an insight exists, can be calculated. This makes it possible to detect an insight based on the insight score. Note that one group can include any number of insight subjects. Furthermore, one group can include insight subjects obtained from different data sets. It is preferable that one group includes at least one insight subject.
[0043] In addition, when the notation unifying unit 203 unifies notations for multiple insight subjects, the evaluation unit 206 groups the insight subjects with unified notations. Notations are often inconsistent between different data sets, and inconsistent notations generally often hinder evaluation, but the information processing device 2 can perform evaluation even in such cases. That is, in addition to the effects of the information processing device 1 according to the first exemplary embodiment, the information processing device 2 can also provide an effect of being able to detect cross-cutting composite insights even for data sets with inconsistent notations.
[0044] For example, if there are multiple insight subjects showing sales by year, the series names of these insight subjects are all "Year" and "Sales", so the classification unit 204 classifies them into one group. Even if some of these insight subjects have a series name written in a different way, such as "Sales", the notation unification unit 203 unifies the notation, so the classification unit 204 can classify them into one group.
[0045] Here, as described above, grouping is performed for each insight type. Therefore, a criterion for grouping may be previously determined for each insight type. An example of the insight type is correlation. When grouping insight subjects whose insight type is correlation, the classification unit 204 may group insight subjects whose strength of correlation can be evaluated, in other words, whose correlation coefficient can be calculated. When grouping insight subjects whose insight type is outlier, the classification unit 204 may group insight subjects whose outliers can be detected, that is, whose distance between corresponding data can be calculated. Specifically, for example, the classification unit 204 may classify insight subjects whose words indicating the series names are the same into one group.
[0046] Any insight type other than correlation can be used. When detecting cross-sectional composite insights, for example, insight types such as cross-measure correlation, two-dimensional clustering, and attribution may be set.
[0047] Also, for example, the classification unit 204 may group single point insights, i.e., insight subjects that have a non-ordinal dimension with one insight subject as input. Such grouping makes it possible to detect insights such as Outstanding No. 1, Outstanding No. Last, Outstanding Top 2, or Evenness.
[0048] Furthermore, the classification unit 204 may group single shape insights, that is, insight subjects that have an ordinal dimension on the horizontal axis with one insight subject as input. An example of data that has an order on the horizontal axis is time series data. Such grouping makes it possible to detect insights such as change points, trends, seasonality, and outliers. The insight types to be set need only include at least one type capable of detecting a cross-sectional composite insight (e.g., correlation, etc.), and may also include one for detecting a non-cross-sectional composite insight (e.g., change point, etc.).
[0049] The granularity unification unit 205 unifies the granularity of data for each insight subject. This process is performed for data with inconsistent granularity, since it is a process for enabling the evaluation unit 206 to evaluate the relevance between insight subjects. The unification of granularity may be performed for insight subjects generated from a data set, or may be performed in advance for multiple data sets to be analyzed. The granularity of data indicates the level of detail (unit) of a series of data.
[0050] For example, if one insight subject and another insight subject both show monthly sales, but the former shows monthly sales and the latter shows bimonthly (odd-numbered) sales, the granularity of these data does not match. In this case, it may be impossible to evaluate the distance or similarity between the two data.
[0051] The granularity unifying unit 205 performs a process of unifying the granularity of such data. For example, the granularity unifying unit 205 may unify the granularity by complementing the data using missing value complementation, or may unify the granularity by downsampling. Missing value complementation is a process of predicting and complementing missing parts from other data, and a specific example of this is interpolation. Downsampling is a process of adjusting the sampling granularity to a coarser one.
[0052] When performing missing value imputation in the above example, the granularity unifying unit 205 imputes sales of even-numbered months in other insight subjects. Also, when performing downsampling in the above example, the granularity unifying unit 205 causes only sales of odd-numbered months in a certain insight subject to be used for evaluation by the evaluation unit 206.
[0053] The evaluation unit 206 calculates an insight score for a combination of multiple insight subjects classified into the same group by the classification unit 204, generates evaluation result data 212 indicating the calculation result, and stores the data in the storage unit 21. For example, the evaluation unit 206 uses a function f T The above evaluation may be performed using the following:
[0054] f T is a function that is predefined for each insight type T, and is designed to have a high value when an insight subject that gives the insight to be detected is input. Let G T Then, the insight score is expressed by the following formula:
[0055] (Insight Score)=f T (I1,I2,…,I n |I i ∈G T ) The evaluation unit 206 may group multiple insight subjects classified into the same group into a pair and calculate the insight score for each pair. In this case, f T For example, when three insight subjects I1 to I3 are grouped, the evaluation unit 206 evaluates each pair of I1 and I2, I1 and I3, and I2 and I3 as f T The insight score for each set is calculated by inputting the following:
[0056] The method of calculating the insight score may be determined according to the insight type. For example, when evaluating the degree of linear correlation between a pair of insight subjects, the evaluation unit 206 calculates the Pearson correlation coefficient f T Alternatively, the evaluation unit 206 may calculate the insight score using, for example, the Spearman rank correlation coefficient, the cosine similarity, the Euclidean distance between corresponding data, the EMD (Earth Mover's distance), or the like.
[0057] In addition, when the granularity unifying unit 205 unifies the granularity of data of insight subjects, the evaluation unit 206 calculates an insight score for a combination of multiple insight subjects with unified granularity. The granularity of data is often inconsistent between different data sets, and inconsistent granularity generally often impedes evaluation, but the information processing device 2 can perform evaluation even in such cases. That is, in addition to the effect of the information processing device 1 according to the exemplary embodiment 1, the information processing device 2 can obtain an effect of being able to detect cross-sectional composite insights even for data sets including data with inconsistent granularity.
[0058] The output data generation unit 207 generates output data 213 using the evaluation result data 212. Although the output data generation unit 207 is not an essential component of the information processing device 2, providing the output data generation unit 207 makes it possible to present the results of analysis by the information processing device 2 to the user in a manner that is easier to recognize.
[0059] (Analysis method flow) The flow of the analysis method according to this exemplary embodiment will be described with reference to Fig. 5 to Fig. 7. Fig. 5 is a flow diagram showing the flow of the analysis method. Fig. 6 is a diagram showing an example of analysis target data 211 and insight subjects generated from the analysis target data 211. Fig. 7 is a diagram showing examples of evaluation result data 212 and output data 213.
[0060] In S21, the data acquisition unit 201 accepts input of a plurality of data sets and stores them in the storage unit 21 as analysis target data 211. For example, the data acquisition unit 201 accepts input of the analysis target data 211 shown in FIG. 6 via the input unit 23. The analysis target data 211 includes a data set (D S ) and a dataset showing monthly supermarket sales by prefecture (D T ) are included.
[0061] In S22, the subject generation unit 202 generates insight subjects from each data set included in the analysis target data 211. For example, the data set D shown in FIG. S , D T When using the dataset D S From Insight Subject I S 1 and I S 2 and generate the dataset D T From Insight Subject I T 1 and I T 2 can be generated.
[0062] Insight Subject I SFigure 1 shows the sales of convenience stores by prefecture. S 1 is shown as a bar graph of sales (horizontal axis is prefecture, vertical axis is sales). Also, Insight Subject I S 2 shows the monthly sales of convenience stores, and in Fig. 6, S 2 is shown as a line graph of sales (horizontal axis is date, vertical axis is sales).
[0063] Similarly, Insight Subject I T Figure 1 shows supermarket sales by prefecture, and Figure 6 shows I T 1 is shown as a bar graph of sales (horizontal axis is prefecture, vertical axis is sales). Also, Insight Subject I T 2 shows the monthly sales in supermarkets, and in Fig. 6, I T 2 is shown as a line graph of sales (horizontal axis is date, vertical axis is sales).
[0064] The insight subject I may also have the following data format, for example: I={subspace, breakdown, measure, aggregation} The above “subspace” indicates how the records in the multi-dimensional data set are filtered. The above “subspace” corresponds to the legend of each chart. For example, I in Figure 6 S The “subspace” in the line graph of 2 is “Tokyo.” If you do not want to filter, you can use a symbol such as “*.”
[0065] The "breakdown" above indicates the columns that are used as keys to aggregate a multidimensional data set. The "breakdown" above corresponds to the horizontal axis of each chart. For example, I in Figure 6 S The “breakdown” in the line graph in 2 is “date.”
[0066] The above "measure" indicates a column used as numerical data in a multidimensional data set. The above "measure" corresponds to the vertical axis of each chart. For example, I in Figure 6 S The “measure” in the line graph in 2 is the numerical data for “sales.”
[0067] The above "aggregation" indicates the method (e.g., function) used to aggregate data for each "breakdown." Examples of the above "aggregation" include sum, average, maximum value, minimum value, etc. If the function used for aggregation is "sum," "aggregation" may be omitted.
[0068] For example, I shown in Figure 6 S If it is 2, then I S 2={{*, Tokyo}, date, sales}. In S22, the subject generation unit 202 may generate insight subjects in such a data format from each data set included in the data to be analyzed 211.
[0069] In S23, the notation unification unit 203 unifies the notation of data in each insight subject generated in S22. For example, S 1, I S 2. I T 1, I T Among the two, I S The horizontal axis label "Prefecture" in 1 and I T The meaning of the label "Location" on the horizontal axis in 1 is similar. S The series names "Tokyo", "Osaka", and "Kanagawa" are I T The meaning and spelling of each of the series names "Tokyo", "Osaka", and "Kanagawa" in I1 are similar. The spelling unification unit 203 extracts such words and unifies their spellings. For example, the spelling unification unit 203 extracts I S The label on the horizontal axis in 1 may be replaced with "Location", and the series names "Tokyo", "Osaka", and "Kanagawa" may be replaced with "Tokyo", "Osaka", and "Kanagawa", respectively.
[0070] In S24, the classification unit 204 groups the insight subjects generated in S22 and whose notations have been unified in S23. For example, S 1, I S 2. I T 1, I T Assume that insight subjects with the same labels on the vertical and horizontal axes are grouped together in the table 2. In this case, the classification unit 204 classifies the insight subjects with the same labels on the vertical and horizontal axes as the insight subjects with the same labels on the ... S 1 and I T Group 1. I S Such grouping is possible because the "Prefecture" in 1 has already been replaced by "Location" by the notation unification unit 203. Also, the classification unit 204 classifies I, which has the vertical axis label "Sales" and the horizontal axis label "Date". S 2 and I T Group 2.
[0071] I S 1 and I T The group containing 1 is G 1 , I S 2 and I T Group containing 2 is G 2 Then, the grouping result is expressed as follows: I S 1,I T 1∈G 1 I S 2,I T 2∈G 2 In S25, the granularity unification unit 205 unifies the granularity of the data included in the insight subjects grouped in S24. For example, S The "date" of 2 is the 1st of an odd-numbered month, while I T The "date" in 2 is the first day of each month. The granularity unification unit 205 extracts data with different granularities like this and performs processing to unify the granularity of the data. For example, the granularity unification unit 205 performs processing such as TThe granularity of the "date" data may be unified by extracting (i.e., downsampling) data of odd-numbered months from the "date" data of I. S The granularity of the "date" data may be made uniform by complementing the missing values of the data for the even-numbered months of 2. Note that missing value complementation is also effective when there is a discrepancy in the sampling dates of the data. For example, when granularity of the data for the 1st of each month and the data for the 15th of each month is to be made uniform, the granularity unifying unit 205 may generate the data for the 1st of each month by complementing the missing values of the data for the 15th of each month.
[0072] In S26, the evaluation unit 206 evaluates the combinations of insight subjects grouped in S24 and having the unified data granularity in S25, and stores the evaluation results in the storage unit 21 as evaluation result data 212. More specifically, the evaluation unit 206 performs a process for each group in which insight subjects included in the same group are grouped together, and an insight score for the group is calculated.
[0073] For example, the evaluation unit 206 may T (I i ,I j The insight score may be calculated using a score function expressed by the formula: 1 The insight score for T (I S 1,I T 1) Group G 2 The insight score for T (I S 2,I T 2).
[0074] The evaluation unit 206 may generate evaluation result data 212 as shown in FIG. 7, for example, by listing the evaluation results as described above. The evaluation result data 212 shown in FIG. 7 is data in a table format indicating combinations of insight subjects and insight scores calculated for the combinations. The evaluation result data 212 shown in FIG. 7 also indicates a "rank" indicating the ranking of the insight scores and an "insight type." In this way, the evaluation unit 206 may generate evaluation result data 212 including various information related to the evaluation in addition to combinations of insight subjects and insight scores calculated for the combinations.
[0075] In S27, the output data generation unit 207 generates output data 213 using the evaluation result data 212 generated in S26, and outputs it to the output unit 24. For example, when the evaluation result data 212 shown in Fig. 7 is used, the output data generation unit 207 generates output data 213 indicating the combination of insight subjects with the highest insight score (rank), and outputs it to the output unit 24. This ends the processing in Fig. 5.
[0076] The output data 213 may be a visualization of the insight so that the user can easily recognize the insight. The visualization method may be determined according to the insight type. For example, when the insight type is "correlation", the output data generating unit 207 may generate, as the output data 213, a chart (e.g., a two-dimensional scatter plot) suitable for expressing a correlation as information related to the insight.
[0077] The lower part of FIG. 7 shows an example of information about the insight for the combination of insight subjects shown in the evaluation result data 212 with the highest insight score (i.e., rank 1). Specifically, the information about the insight shown in FIG. 7 includes a scatter diagram showing the correlation between sales of supermarkets and convenience stores, and insight information showing details of the insight. The insight information shows details of each insight subject and the data set on which it is based, in addition to the insight type and insight score. By outputting such information to the output unit 24, the user of the information processing device 2 can easily recognize the insight that there is a strong correlation between the trends in sales of supermarkets and convenience stores.
[0078] Of course, the information generated by the output data generation unit 207 may be any information that can enable the user to recognize the insight, and is not limited to the example in Fig. 7. For example, the output data generation unit 207 may generate a chart of each insight subject for the combination of insight subjects with the highest insight score, and use this as the output data 213.
[0079] It is not necessary to generate new output data 213 when presenting the analysis result to the user. For example, the evaluation unit 206 may present the analysis result to the user by causing the output unit 24 to output all or a part of the evaluation result data 212 shown in FIG. 7. The evaluation unit 206 may also output data constituting each insight subject that has been ranked 1 or each insight subject whose insight score is equal to or greater than a predetermined threshold. In this way, the manner in which the analysis result is output is arbitrary and is not limited to the example shown in FIG. 7. The user may also be allowed to select a visualization method for the analysis result. In this case, the output data generation unit 207 visualizes the analysis result by the method selected by the user.
[0080] In this way, the information processing device 2 can output charts, data, etc. that may lead to the discovery of insights as the results of analyzing multiple data sets. This eliminates the need to manually compare charts. Furthermore, even if the user ultimately considers the insights, the user can easily narrow down the data sets that are likely to be useful for the analysis. This makes it possible to significantly reduce the time required for analysis and visualization.
[0081] In addition, by using the information processing device 2, there is no room for inconsistencies in judgment criteria that occur when the user performs all the analysis. Furthermore, it is possible to reduce the risk of overlooking something that occurs when the user performs the analysis. In addition, when a large-scale data set is the subject of analysis, it is difficult for the user to discover composite insights, but the information processing device 2 makes it easy to discover composite insights (including cross-sectional composite insights).
[0082] 5, the process of S23 may be performed before the process of S24, for example, between S21 and S22. The process of S25 may be performed before the process of S26, for example, between S21 and S22.
[0083] (Modifications for handling differences in granularity) The evaluation unit 206 may evaluate the insight subjects by an evaluation method capable of calculating an insight score for a combination of multiple insight subjects with different data granularities. In this way, in addition to the effects of the information processing device 1 according to the first exemplary embodiment, an effect is obtained that it is possible to detect cross-sectional composite insights even for a data set including data with non-uniform granularity. In this case, an effect is also obtained that the granularity unification unit 205 can be omitted.
[0084] For example, when the data on the horizontal axis in the insight subject has an order (is an ordinal dimension), the evaluation unit 206 may calculate the insight score by DTW (Dynamic Time Warping) or functional data analysis. An example of data with an order is time series data. In DTW, s = (s1, ..., s n ) and t = (t1,…,t m ) is calculated by brute-force calculation of the distance between elements, and the shortest path from end (1,1) to end (n,n) of the cost matrix W is obtained by dynamic programming. According to DTW, it is possible to calculate the distance and similarity between data with different sample sizes, and such distance and similarity can be used to calculate the insight score. In addition, when using functional data analysis, the evaluation unit 206 derives a continuous function that expresses the records of each insight subject, calculates the distance and similarity between the insight subjects via the function, and can use them to calculate the insight score.
[0085] Exemplary embodiment 3 A third exemplary embodiment of the present invention will be described in detail with reference to the drawings. In the above exemplary embodiment, when the insight subjects are grouped, three or more insight subjects may be classified into one group. In such a case, the above-mentioned score function f T (I i ,I j ) does not allow three or more insight subjects to be evaluated together. In addition, Patent Document 1 does not describe or suggest a method for evaluating three or more insight subjects together.
[0086] In this exemplary embodiment, an evaluation method capable of collectively evaluating three or more insight subjects will be described with reference to Figs. 8 to 10. Fig. 8 is a block diagram showing a configuration of an information processing device 3 according to this exemplary embodiment. Fig. 9 is a flow diagram showing a flow of an analysis method according to this exemplary embodiment. Fig. 10 is a diagram explaining a method of calculating an insight score and a method of detecting an outlier.
[0087] (Configuration of information processing device 3) As shown in Fig. 8, the information processing device 3 includes an evaluation unit 31 and an outlier detection unit 32. When it is not necessary to detect outliers, the outlier detection unit 32 may be omitted. The evaluation unit 31 calculates an insight score for a combination of a plurality of grouped insight subjects, similar to the evaluation unit 12 shown in Fig. 1 and the evaluation unit 206 shown in Fig. 4. The evaluation unit 31 differs from the evaluation units 12 and 206 in that it can evaluate three or more insight subjects together, in other words, it can calculate one insight score indicating the presence or absence of insight in three or more insight subjects.
[0088] Specifically, the evaluation unit 31 calculates an insight score for a combination of grouped insight subjects based on the degree of bias of the contribution of each principal component obtained by performing principal component analysis on the grouped insight subjects. The principal component analysis can be performed on any number of insight subjects. Therefore, according to the information processing device 3 according to this exemplary embodiment, in addition to the effects of the information processing devices 1 and 2 according to exemplary embodiments 1 and 2, an effect of being able to collectively evaluate three or more insight subjects can be obtained. Details of the evaluation method and the reason why such evaluation is possible will be described later with reference to FIG. 9 and FIG. 10.
[0089] The outlier detection unit 32 detects outliers included in the data by expressing the data included in the grouped insight subjects using the principal components obtained by the principal component analysis by the evaluation unit 31. Therefore, according to the information processing device 3 according to this exemplary embodiment, in addition to the effects of the information processing devices 1 and 2 according to the exemplary embodiments 1 and 2, an effect of efficient outlier detection using the results of the principal component analysis performed for evaluation can be obtained. Details of the outlier detection method and the reason why outliers can be detected by such a method will be described later with reference to Figs. 9 and 10.
[0090] (Flow of processing executed by information processing device 3) The flow of the process executed by the information processing device 3 will be described with reference to Fig. 9. Note that it is assumed that a plurality of insight subjects have already been grouped before the process of Fig. 9. That is, although not shown in Fig. 8, in this exemplary embodiment, it is assumed that the information processing device 3 has a configuration equivalent to the classification unit 11 (exemplary embodiment 1) or the classification unit 204 (exemplary embodiment 2). Note that the information processing device 3 may have some or all of the various configurations (e.g., the data acquisition unit 201, the subject generation unit 202, etc.) that the information processing device 2 has.
[0091] In S31, the evaluation unit 31 evaluates a group of insight subjects. More specifically, the evaluation unit 31 first identifies data to be subjected to principal component analysis for each insight subject included in the group to be evaluated. For example, when the insight subjects are expressed in the form of I={subspace, breakdown, measure, aggregation}, the evaluation unit 31 may subject the data of the "measure" item in each insight subject to principal component analysis.
[0092] Next, the evaluation unit 31 performs principal component analysis on the data specified as the target of the principal component analysis. For example, the evaluation unit 31 may generate a multidimensional correlation matrix from the data of the "measure" item for each insight subject, and perform the principal component analysis using this correlation matrix. The principal component analysis calculates eigenvalues and eigenvectors.
[0093] Next, the evaluation unit 31 calculates the contribution rate of each principal component using the calculated eigenvalue. Since the contribution rate of each principal component can be regarded as the amount of information in its axis direction (eigenvector), the strength of correlation between insight subjects can be quantitatively evaluated by examining the degree of bias in the contribution rate of each principal component.
[0094] For example, Fig. 10 shows a bar graph 1001 showing the contribution rate of each principal component calculated by performing principal component analysis on uncorrelated insight subjects, and a bar graph 1002 showing the contribution rate of each principal component calculated by performing principal component analysis on correlated insight subjects. In Fig. 10, PC1 is the first principal component, PC2 is the second principal component, and PC3 is the third principal component.
[0095] In bar graph 1001, the contribution rates of PC1 to PC3 are roughly the same, and the degree of bias between the principal components is small. On the other hand, in bar graph 1002, the contribution rate of PC1 is the highest, the contribution rate of PC2 is about half that of PC1, and the contribution rate of PC3 is considerably small, resulting in a large degree of bias overall. In this way, the presence or absence of correlation between insight subjects is clearly reflected in the degree of bias in the contribution rates of each principal component.
[0096] Therefore, if the degree of bias of the contribution rate of each principal component is quantitatively evaluated, the evaluation result can be used as the insight score. For example, the contribution rate of the first principal component can be used as the insight score. This is because, as shown in FIG. 10, when the degree of bias of the contribution rate of each principal component is large (bar graph 1002), the contribution rate of the first principal component PC1 is large compared to when the degree of bias is small (bar graph 1001).
[0097] 10, when the degree of bias in the contribution rate of each principal component is large (bar graph 1002), there is one (specifically PC1) with a particularly high contribution rate among PC1 to PC3. On the other hand, when the degree of bias in the contribution rate of each principal component is small (bar graph 1001), there is no one with a particularly high contribution rate. For this reason, for example, the insight score can be calculated using a score function that inputs the contribution rate of each principal component and outputs a higher value as the input contribution rates include particularly high ones.
[0098] In addition, when it is desired to detect a nonlinear correlation between insight subjects, the evaluation unit 31 may execute kernel principal component analysis using an arbitrary kernel instead of normal principal component analysis. In addition, when a correlation matrix cannot be calculated due to differences in the sampling granularity of records, the evaluation unit 31 may execute functional principal component analysis using functional data analysis.
[0099] In S32, the outlier detection unit 32 detects outliers included in each grouped insight subject. For example, if an evaluation is performed using data of the "measure" item for each insight subject in S31, the outlier detection unit 32 also detects outliers in the data of the "measure" item for each insight subject.
[0100] The outlier detection is performed by representing the data contained in the grouped multiple insight subjects using the principal components obtained by the principal component analysis performed for the evaluation in S31.
[0101] 1003 in Fig. 10 plots points representing sample data using the first principal component PC1 and the second principal component PC2 obtained by performing principal component analysis on the sample data on a coordinate plane with PC2 on the vertical axis and PC1 on the horizontal axis. Data that is distant from other data in the plot after principal component analysis is also distant from other data in the original sample data. Therefore, data that is distant from other data, such as the plot indicated as "outlier" in 1003, can be detected as an outlier.
[0102] For example, the outlier detection unit 32 performs Hotelling's T 2 Calculate the statistics and calculate the T 2 Data with significant statistics may be detected as outliers. 1004 in FIG. 10 shows T 2 The statistical quantity is the sample number on the horizontal axis and T on the vertical axis. 2The plot in the figure, 1003, is an outlier. 2 The statistical value is larger than that of the other plots. Therefore, the outlier detection unit 32 detects that T 2 Statistics can be used to detect outliers.
[0103] Also, T 2 Statistics are distributed as F and χ 2 It is known that the distribution follows. Therefore, the outlier detection unit 32 may calculate the score using a p-value obtained based on a statistical test. In this case, the outlier detection unit 32 may detect the outlier using the calculated score.
[0104] This completes the process in Fig. 9. The evaluation result of S31 and the outliers detected in S32 may be stored as evaluation result data. The evaluation result data may be output as is, or, as in the second exemplary embodiment, output data may be generated from the evaluation result data and the generated output data may be output.
[0105] [Reference example] The above-mentioned evaluation method by the evaluation unit 31 is suitable for detecting cross-sectional composite insights, and is also suitable for detecting insights that are not cross-sectional, that is, in one data set. Therefore, the above-mentioned information processing device 3 does not necessarily need to have a configuration equivalent to the classification unit 204 (exemplary embodiment 2) or the classification unit 11 (exemplary embodiment 1).
[0106] The information processing device 3 according to this reference example includes an acquisition unit that acquires multiple insight subjects to be evaluated, and the above-mentioned evaluation unit 31. The multiple insight subjects acquired by the acquisition unit may be generated from at least one data set. In other words, this reference example differs from each of the above-mentioned exemplary embodiments in that it is not essential to use multiple insight subjects generated from multiple data sets.
[0107] According to the information processing device of this reference example, the evaluation unit 31 calculates an insight score for a combination of the insight subjects based on the degree of bias of the contribution of each principal component obtained by performing principal component analysis on the multiple insight subjects acquired by the acquisition unit. This solves the conventional problem that three or more insight subjects could not be evaluated together.
[0108] The analysis method according to the present reference example includes at least one processor acquiring a plurality of insight subjects to be evaluated, and calculating an insight score for the combination of the insight subjects based on the degree of bias of the contribution of each principal component obtained by performing principal component analysis on the acquired plurality of insight subjects.The analysis program according to the present reference example causes a computer to execute a process of acquiring a plurality of insight subjects to be evaluated, and a process of calculating an insight score for the combination of the insight subjects based on the degree of bias of the contribution of each principal component obtained by performing principal component analysis on the acquired plurality of insight subjects.These analysis methods and analysis programs can also solve the conventional problem that it was not possible to evaluate three or more insight subjects at once.
[0109] [Modifications] In the above-mentioned exemplary embodiment 1, the processing performed by one information processing device 1 may be shared among multiple information processing devices. In other words, a part of the processing performed by the information processing device 1 may be executed by at least one other information processing device. In other words, when each of the above-mentioned processes is performed by at least one processor, the at least one processor may be included in one information processing device 1, or may be included in each of different information processing devices. This also applies to the information processing device 2 in the above-mentioned exemplary embodiment 2 and the information processing device 3 in the above-mentioned exemplary embodiment 3.
[0110] [Software implementation example] Some or all of the functions of the information processing devices 1 to 3 may be realized by hardware such as an integrated circuit (IC chip), or may be realized by software.
[0111] In the latter case, the information processing devices 1 to 3 are realized, for example, by a computer that executes instructions of a program, which is software that realizes each function. An example of such a computer (hereinafter, referred to as computer C) is shown in FIG. 11. The computer C includes at least one processor C1 and at least one memory C2. The memory C2 stores a program P for operating the computer C as the information processing devices 1 to 3. In the computer C, the processor C1 reads and executes the program P from the memory C2, thereby realizing each function of the information processing devices 1 to 3.
[0112] The processor C1 may be, for example, a central processing unit (CPU), a graphic processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a microcontroller, or a combination of these. The memory C2 may be, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a combination of these.
[0113] The computer C may further include a RAM (Random Access Memory) for expanding the program P during execution and for temporarily storing various data. The computer C may further include a communication interface for transmitting and receiving data to and from other devices. The computer C may further include an input / output interface for connecting input / output devices such as a keyboard, a mouse, a display, and a printer.
[0114] Furthermore, the program P can be recorded on a non-transitory tangible recording medium M that can be read by the computer C. Such a recording medium M can be, for example, a tape, a disk, a card, a semiconductor memory, or a programmable logic circuit. The computer C can obtain the program P via such a recording medium M. Furthermore, the program P can be transmitted via a transmission medium. Such a transmission medium can be, for example, a communication network or broadcast waves. The computer C can also obtain the program P via such a transmission medium.
[0115] [Additional Note 1] The present invention is not limited to the above-described embodiment, and various modifications are possible within the scope of the claims. For example, embodiments obtained by appropriately combining the technical means disclosed in the above-described embodiment are also included in the technical scope of the present invention.
[0116] [Additional Note 2] Some or all of the above-described embodiments can be described as follows. However, the present invention is not limited to the following described aspects.
[0117] (Appendix 1) An information processing device comprising: a classification means for grouping insight subjects, which are data generated by associating a plurality of data items included in each of a plurality of data sets, for each insight to be detected, and an evaluation means for calculating an evaluation value for determining the presence or absence of an insight for a combination of the grouped plurality of insight subjects. With this configuration, it is possible to detect an insight between a plurality of data sets.
[0118] (Appendix 2) The information processing device according to claim 1, further comprising a notation unification means for unifying notations in the plurality of insight subjects, wherein the classification means groups the insight subjects having unified notations. With this configuration, it becomes possible to detect cross-cutting composite insights even in a data set having inconsistent notations.
[0119] (Appendix 3) The information processing device according to claim 1 or 2, further comprising a granularity unifying means for unifying the granularity of data in the plurality of insight subjects, wherein the evaluation means calculates the evaluation value for the plurality of insight subjects with the unified granularity. With this configuration, it becomes possible to detect cross-cutting composite insights even for a data set including data with non-uniform granularity.
[0120] (Appendix 4) The information processing device according to claim 1 or 2, wherein the evaluation means calculates the evaluation value by dynamic time warping or functional data analysis. With this configuration, it is possible to detect cross-cutting composite insights even for a data set including data with non-uniform granularity.
[0121] (Appendix 5) The information processing device according to any one of appendices 1 to 4, wherein the evaluation means calculates the evaluation value based on the degree of bias of the contribution of each principal component obtained by performing principal component analysis on the grouped multiple insight subjects. With this configuration, it becomes possible to collectively evaluate three or more insight subjects.
[0122] (Appendix 6) The information processing device according to claim 5, further comprising an outlier detection means for detecting outliers included in the data by expressing the data included in the grouped insight subjects using principal components obtained by the principal component analysis. With this configuration, efficient outlier detection can be achieved by utilizing the results of the principal component analysis performed for evaluation.
[0123] (Appendix 7) An analysis method including: at least one processor grouping insight subjects, which are data generated from a plurality of data sets by associating a plurality of data items included in the respective data sets, for each insight to be detected; and calculating an evaluation value for determining the presence or absence of an insight for a combination of the grouped plurality of insight subjects. This configuration makes it possible to detect insights among a plurality of data sets.
[0124] (Appendix 8) An analysis program that causes a computer to execute a process of grouping insight subjects, which are data generated by associating multiple data items included in each of multiple data sets, for each insight to be detected, and a process of calculating an evaluation value for determining whether or not an insight exists for a combination of the grouped multiple insight subjects. This configuration makes it possible to detect insights between multiple data sets.
[0125] (Appendix 9) An information processing device comprising at least one processor that executes a process of grouping insight subjects, which are data generated from each of a plurality of datasets by associating a plurality of data items contained in the dataset, for each insight to be detected, and a process of calculating an evaluation value for determining whether or not an insight exists for a combination of the grouped plurality of insight subjects.
[0126] The information processing device may further include a memory that stores a program for causing the processor to execute the grouping process and the evaluation process. The program may be recorded in a computer-readable, non-transitory, tangible recording medium. [Explanation of symbols]
[0127] 1. Information processing device 11 Classification section (classification means) 12 Evaluation section (evaluation means) 2. Information processing equipment 203 Notation Unification Department (Notation Unification Means) 204 Classification section (classification means) 205 Particle size unification department (particle size unification means) 206 Evaluation section (evaluation means) 3. Information processing equipment 31 Evaluation section (evaluation means) 32 Outlier detection unit (outlier detection means)
Claims
1. A classification means for grouping insight subjects, which are data generated from each of a plurality of data sets by associating a plurality of data items included in the respective data sets, according to the insights to be detected; An evaluation means for calculating an evaluation value for determining whether or not an insight exists for a combination of the grouped plurality of insight subjects; A granularity unification means for unifying the granularity of data in the plurality of insight subjects, The evaluation means calculates the evaluation value for the plurality of insight subjects having a uniform granularity. Information processing device.
2. A notation unification means for unifying notations in the plurality of insight subjects, The information processing apparatus according to claim 1 , wherein the classification means groups the insight subjects having a unified notation.
3. The information processing device described in claim 1, wherein the evaluation means calculates the evaluation value by dynamic time warping or functional data analysis.
4. An information processing device described in any one of claims 1 to 3, wherein the evaluation means calculates the evaluation value based on the degree of bias in contribution of each principal component obtained by performing principal component analysis on the grouped multiple insight subjects.
5. An information processing device as described in claim 4, comprising an outlier detection means for detecting outliers contained in the data by representing the data contained in the grouped multiple insight subjects using principal components obtained by the principal component analysis.
6. At least one processor, Grouping insight subjects, which are data generated from each of a plurality of data sets by associating a plurality of data items included in the respective data sets, for each insight to be detected; Calculating an evaluation value for determining whether or not an insight exists for a combination of the grouped plurality of insight subjects; and unifying the granularity of data across the plurality of insight subjects; In the step of calculating the evaluation value, the at least one processor calculates the evaluation value for a plurality of the insight subjects having a uniform granularity. Analysis method.
7. A computer comprising: A process of grouping insight subjects, which are data generated from each of a plurality of datasets by associating a plurality of data items included in the dataset, for each insight to be detected; A process of calculating an evaluation value for determining whether or not an insight exists for a combination of the grouped plurality of insight subjects; A process for unifying the granularity of data in the plurality of insight subjects. In the process of calculating the evaluation value, the computer calculates the evaluation value for a plurality of the insight subjects having a uniform granularity. Analysis program.
8. A classification means for grouping insight subjects, which are data generated from each of a plurality of data sets by associating a plurality of data items included in the respective data sets, according to the insights to be detected; An evaluation means for calculating an evaluation value for determining the presence or absence of an insight for a combination of the grouped multiple insight subjects, the evaluation means calculating the evaluation value based on the degree of bias of the contribution of each principal component obtained by performing a principal component analysis on the grouped multiple insight subjects; and an outlier detection means for detecting outliers contained in the data by representing the data contained in the grouped insight subjects using principal components obtained by the principal component analysis.
9. At least one processor, Grouping insight subjects, which are data generated from each of a plurality of data sets by correlating a plurality of data items included in the respective data sets, by the insight to be detected; and Calculating an evaluation value for determining whether or not an insight exists for a combination of the grouped plurality of insight subjects; In the step of calculating the evaluation value, the at least one processor calculates the evaluation value based on a degree of bias in contribution of each principal component obtained by performing a principal component analysis on the grouped multiple insight subjects; The at least one processor detects outliers in the data by expressing the data included in the grouped insight subjects using principal components obtained by the principal component analysis; Analytical methods including:
10. A computer comprising: A process of grouping insight subjects, which are data generated from each of a plurality of datasets by associating a plurality of data items included in the dataset, for each insight to be detected; A process of calculating an evaluation value for determining the presence or absence of an insight for a combination of the grouped multiple insight subjects, the process calculating the evaluation value based on the degree of bias of the contribution of each principal component obtained by performing a principal component analysis on the grouped multiple insight subjects; and detecting outliers contained in the data by representing the data contained in the grouped insight subjects using the principal components obtained by the principal component analysis.
Citation Information
Patent Citations
Behavior pattern search system and behavior pattern search method
JP2019148897A
Information processing program, information processing method, and information processing device
JP2020187511A
Sense-of-value cluster generation device, computer program, sense-of-value cluster imparting method, database integration method, and advertisement providing method
JP2021043899A
Automatic insights for multi-dimensional data
US20200257682A1
Information processing system, information processing method, and information processing program
WO2017163277A1
