Information processing device, information processing method, and information processing program

Abstract

In order to accurately correct errors in data attributes without the need for a large amount of training data, an information processing device (1) is provided with: a data acquisition unit (11) that acquires target data; an erroneous attribute identification unit (12) that identifies an erroneous attribute, which is an attribute including an error, from among a plurality of attributes included in processed data obtained by applying a prescribed process to the target data; a reference attribute identification unit (13) that identifies a reference attribute, which is an attribute similar to the erroneous attribute and is included in the target data; a prediction unit (14) that predicts amendment content for the erroneous attribute; and a correction unit (15) that corrects the amendment content with reference to the reference attribute.

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Techniques for integrating diverse databases (heterogeneous databases) with different attributes are known. Non-Patent Document 1 describes a technique for classifying a large number of items into 35 product categories, in which classified data is used as training data to learn a predictive model that predicts categories from explanatory variables such as product names, and new input data is automatically classified using this predictive model. By using the technique described in Non-Patent Document 1, errors discovered when integrating heterogeneous databases can be corrected. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Yandi Xia, et. al.,'Large-Scale Categorization of Japanese Product Titles Using Neural Attention Models', Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, pages 663-668, April, 2017 Summary of the Invention [Problem to be solved by the invention]

[0004] however, Non The technology described in Patent Document 1 requires a large amount of training data to learn a prediction model, and has the problem that errors cannot be corrected with high accuracy when there is a small amount of training data.

[0005] One aspect of the present invention has been made in consideration of the above-mentioned problems, and one of its objectives is to provide a technology that can correct errors related to data attributes with high accuracy without requiring a large amount of training data. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present invention comprises a data acquisition means for acquiring target data, an error attribute identification means for identifying an error attribute, which is an attribute containing an error, from among a plurality of attributes contained in processed data obtained by applying a predetermined process to the target data, a reference attribute identification means for identifying a reference attribute, which is an attribute similar to the error attribute and is contained in the target data, a prediction means for predicting the correction content for the error attribute, and a correction means for correcting the correction content by referring to the reference attribute.

[0007] An information processing method according to one aspect of the present invention includes acquiring target data, identifying an error attribute, which is an attribute containing an error, from among multiple attributes contained in processed data obtained by applying a predetermined process to the target data, identifying a reference attribute, which is an attribute similar to the error attribute and is contained in the target data, predicting correction details for the error attribute, and correcting the correction details by referring to the reference attribute.

[0008] An information processing program according to one aspect of the present invention causes a computer to perform the following processes: a process of acquiring target data; a process of identifying an error attribute, which is an attribute containing an error, from among multiple attributes contained in processed data obtained by applying a predetermined process to the target data; a process of identifying a reference attribute, which is an attribute similar to the error attribute and is contained in the target data; a process of predicting correction details for the error attribute; and a process of correcting the correction details by referring to the reference attribute. [Effects of the Invention]

[0009] According to one aspect of the present invention, errors related to data attributes can be corrected with high accuracy without requiring a large amount of training data. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a configuration of an information processing device according to a first exemplary embodiment. [Figure 2] 1 is a flowchart showing the flow of an information processing method according to the first exemplary embodiment. [Figure 3] FIG. 10 is a block diagram showing the configuration of an information processing device according to a second exemplary embodiment. [Figure 4] 10A and 10B are diagrams showing specific examples of reference data and target data according to the second exemplary embodiment. [Figure 5] 10 is a flowchart showing the flow of processing executed by an information processing device according to the second exemplary embodiment. [Figure 6] FIG. 10 is a diagram showing a specific example of metadata according to the second exemplary embodiment. [Figure 7] FIG. 10 is a diagram showing a specific example of processed data according to the second exemplary embodiment. [Figure 8] FIG. 10 is a diagram showing a specific example of an error determination condition according to the second exemplary embodiment. [Figure 9] 10A and 10B are diagrams illustrating specific examples of corrections made by a correction unit according to the second exemplary embodiment. [Figure 10] FIG. 10 is a diagram showing a specific example of integrated data according to the second exemplary embodiment. [Figure 11] FIG. 1 is a block diagram illustrating a configuration of a computer that functions as an information processing device according to each exemplary embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Exemplary Embodiment 1 A first exemplary embodiment of the present invention will be described in detail with reference to the drawings. This exemplary embodiment is a basic form of the exemplary embodiments described below.

[0012] <Configuration of information processing device 1> The configuration of an information processing device 1 according to this exemplary embodiment will be described with reference to FIG. 1. FIG. 1 is a block diagram showing the configuration of the information processing device 1. The information processing device 1 is, for example, a data integration device that integrates data, a classification device that classifies data, or a conversion device that converts data. The information processing device 1 includes a data acquisition unit 11, an error attribute identification unit 12, a reference attribute identification unit 13, a prediction unit 14, and a correction unit 15. The data acquisition unit 11 is configured to realize data acquisition means in this exemplary embodiment. The error attribute identification unit 12 is configured to realize error attribute identification means in this exemplary embodiment. The reference attribute identification unit 13 is configured to realize reference attribute identification means in this exemplary embodiment. The prediction unit 14 is configured to realize prediction means in this exemplary embodiment. The correction unit 15 is configured to realize correction means in this exemplary embodiment.

[0013] The data acquisition unit 11 acquires target data. Here, the target data is data to which a predetermined process is applied, and as an example, a database containing one or more records. However, the target data is not limited to the above-mentioned example and may be other data. The target data includes one or more attributes. The attributes included in the target data indicate the characteristics of the target data or the characteristics of the data included in the target data, and as an example, are fields included in the database that is the target data. However, the attributes included in the target data are not limited to the above-mentioned example and may be other attributes.

[0014] The error attribute identification unit 12 identifies an error attribute, which is an attribute containing an error, from among multiple attributes contained in processed data obtained by applying a predetermined process to target data. Here, the predetermined process is a process applied to the target data, and an example is a process of converting records contained in a database that is the target data into the data format of another database. Note that the predetermined process is not limited to this and may be any process that is applied to the target data. The attribute contained in the processed data indicates the characteristics of the processed data or the characteristics of the data contained in the processed data, and an example is a field contained in a database that is the processed data. However, the attribute contained in the processed data is not limited to the above example and may be another attribute. An attribute containing an error includes, for example, an attribute whose attribute value does not satisfy a predetermined condition or an attribute whose attribute value is not set.

[0015] The reference attribute identification unit 13 identifies a reference attribute, which is an attribute similar to the error attribute and is included in the target data. For example, the reference attribute identification unit 13 identifies, as the reference attribute, an attribute from among multiple attributes included in the target data, whose similarity to the error attribute identified by the error attribute identification unit 12 satisfies a predetermined condition. More specifically, for example, the reference attribute identification unit 13 may identify the reference attribute using a so-called schema matching technique, in which schema definitions of two tables are provided in a file and the similarity between the fields of the two tables is output. Examples of schema matching techniques include the technique disclosed in the non-patent document "Bernstein, Philip A., Jayant Madhavan, and Erhard Rahm. "Generic schema matching, ten years later." Proceedings of the VLDB Endowment 4.11 (2011): 695-701." However, the technique by which the reference attribute identification unit 13 identifies the reference attribute is not limited to the above example, and the reference attribute identification unit 13 may identify the reference attribute using other techniques.

[0016] The prediction unit 14 predicts correction details for the error attribute. Here, the correction details indicate how to correct the processed data, and include, for example, the attribute value of the error attribute included in the processed data after correction. For example, the prediction unit 14 may predict, as multiple candidate correction details, multiple attribute values ​​that can be set for the error attribute of the processed data.

[0017] The correction unit 15 corrects the correction content by referring to the reference attribute. For example, the correction unit 15 may identify the post-correction correction content from the multiple correction content candidates predicted by the prediction unit 14 by referring to the reference attribute. More specifically, for example, the correction unit 15 may identify the post-correction correction content by referring to (i) multiple correction content candidates, (ii) a first certainty, (iii) one or more attribute value candidates for the reference attribute, (iv) a second certainty, and (v) a similarity between each of the correction content candidates and each of the attribute value candidates. In this case, (i) the multiple correction content candidates are multiple correction content candidates predicted by the prediction unit 14. (ii) the first certainty is a certainty for each of the multiple correction content candidates. (iii) The one or more attribute value candidates for the reference attribute are a set of attribute values ​​that can be set for the reference attribute. (iv) the second certainty is a certainty for each of the one or more attribute value candidates.

[0018] (v) Examples of methods for calculating the similarity between each correction content candidate and each attribute value candidate include the following first to third methods. A first example is a method of collecting words included in attribute values ​​to create a token set and calculating the similarity between the sets. In this case, examples of the similarity between sets are the Jaccard coefficient, the Dice coefficient, or the Simpson coefficient. A second example is a method of treating attribute values ​​as single character strings and calculating the similarity between attribute values. In this case, examples of the similarity between attribute values ​​are the Hamming distance or the Levenshtein distance. A third example is a method of obtaining embedding vectors of attribute values ​​and then calculating the distance between the vectors using a distance function. In this case, the embedding vectors can be obtained using, for example, the word2vec algorithm. Examples of the distance function are functions that calculate the Euclidean distance or the Manhattan distance. However, the method for calculating the similarity is not limited to the above examples, and similarity may be calculated using other methods.

[0019] As described above, the information processing device 1 according to this exemplary embodiment is configured to acquire target data, identify an error attribute that is an attribute containing an error from among multiple attributes included in processed data obtained by applying a predetermined process to the target data, identify a reference attribute that is an attribute similar to the error attribute and included in the target data, predict correction details for the error attribute, and amend the correction details by referring to the reference attribute. Therefore, the information processing device 1 according to this exemplary embodiment has the effect of being able to correct errors related to data attributes with high accuracy without requiring a large amount of training data.

[0020] <Information processing method> The flow of information processing method S1 according to this exemplary embodiment will be described with reference to FIG. 2. FIG. 2 is a flow diagram showing the flow of information processing method S1. In step S11, data acquisition unit 11 acquires target data. In step S12, error attribute identification unit 12 identifies an error attribute, which is an attribute containing an error, from among multiple attributes included in processed data obtained by applying a predetermined process to the target data. In step S13, reference attribute identification unit 13 identifies a reference attribute, which is an attribute similar to the error attribute and is included in the target data. In step S14, prediction unit 14 predicts the correction content for the error attribute. In step S15, correction unit 15 corrects the correction content by referring to the reference attribute.

[0021] As described above, the information processing method S1 according to this exemplary embodiment is configured to acquire target data, identify an error attribute that is an attribute containing an error from among multiple attributes included in processed data obtained by applying a predetermined process to the target data, identify a reference attribute that is an attribute similar to the error attribute and included in the target data, predict correction details for the error attribute, and correct the correction details by referring to the reference attribute. Therefore, the information processing method S1 according to this exemplary embodiment has the effect of being able to correct errors related to data attributes with high accuracy without requiring a large amount of training data.

[0022] Exemplary Embodiment 2 A second exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first exemplary embodiment are given the same reference numerals, and their description will not be repeated.

[0023] (Configuration of information processing device) The configuration of an information processing device 1A according to this exemplary embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the configuration of the information processing device 1A. As an example, the information processing device 1A is a device that integrates multiple databases having different attributes. The information processing device 1A includes a control unit 10A, a storage unit 20A, an input / output unit 30A, and a communication unit 40A.

[0024] The communication unit 40A communicates with devices external to the information processing device 1A via a communication line. Examples of the communication line include a wireless LAN (Local Area Network), a wired LAN, a WAN (Wide Area Network), a public line network, a mobile data communication network, or a combination thereof. The communication unit 40A transmits data supplied from the control unit 10A to other devices, and supplies data received from other devices to the control unit 10A.

[0025] Input / output devices such as a keyboard, a mouse, a display, a printer, and a touch panel are connected to the input / output unit 30A. The input / output unit 30A receives various types of information input to the information processing device 1A from the connected input devices. Furthermore, the input / output unit 30A outputs various types of information to the connected output devices under the control of the control unit 10A. An example of the input / output unit 30A is an interface such as a USB (Universal Serial Bus).

[0026] As shown in FIG. 3, the control unit 10A includes a data acquisition unit 11, an initialization unit 111, an error attribute identification unit 12, a reference attribute identification unit 13, a prediction unit 14, a correction unit 15, and a converted data generation unit 16.

[0027] The data acquisition unit 11 acquires target data in the same manner as in the exemplary embodiment 1. For example, the data acquisition unit 11 acquires the target data from another device via the communication unit 40A or the input / output unit 30A. For example, the target data is a database including a plurality of records.

[0028] The initialization unit 111 applies initialization processing to the target data as a predetermined processing. Here, as the initialization processing, the initialization unit 111 references correspondence information indicating the correspondence between at least one of a plurality of attributes included in the target data and at least one of a plurality of attributes included in the reference data, and generates, as processed data, data from the target data that includes the same attributes as the plurality of attributes included in the reference data.

[0029] As in the first exemplary embodiment, the error attribute identifying unit 12 identifies an error attribute, which is an attribute containing an error, from among multiple attributes contained in processed data obtained by applying a predetermined process to target data. Details of the process of identifying the error attribute will be described later. As in the first exemplary embodiment, the reference attribute identifying unit 13 identifies a reference attribute, which is an attribute similar to the error attribute and is contained in the target data. Details of the process of identifying the reference attribute will be described later.

[0030] The prediction unit 14 predicts the correction content for the error attribute, as in the first exemplary embodiment. The process of predicting the correction content will be described in detail later. The correction unit 15 corrects the correction content by referring to the reference attribute, as in the first exemplary embodiment. The process of correcting the correction content will be described in detail later.

[0031] The converted data generating unit 16 generates converted data corresponding to the target data using the correction content corrected by the correcting unit 15. The process of generating converted data will be described in detail later.

[0032] (Storage unit 20A) The storage unit 20A stores various types of data referenced by the control unit 10A. As an example, the storage unit 20A stores reference data SD, target data TD, error determination conditions EC, and converted data TD2, as shown in FIG.

[0033] The reference data SD is data that serves as a reference for data conversion or integration, and is, for example, a database containing one or more records. When the reference data SD is a database containing n records, the reference data SD is a set {sd i} of records sd1, sd2, ..., sd n i∈[n] , where i and n are natural numbers equal to or greater than 1, and n is the number of records included in the standard data SD.

[0034] The target data TD is data acquired by the data acquisition unit 11, and is the target of conversion or integration executed by the information processing device 1A. As an example, the target data TD is a database including one or more records, and is a database including attributes different from those of the reference data SD. When the target data TD is a database including m records, the target data TD is a set {tdj} of records td1, td2, ... tdm. j∈[m] , where j , m is a natural number equal to or greater than 1, and m is the number of records included in the target data TD.

[0035] FIG. 4 illustrates specific examples of reference data SD and target data TD. In the example of FIG. 4, the reference data SD and target data TD are databases containing multiple records. The reference data SD illustrated in FIG. 4 includes fields (attributes) for "product name," "price," and "category." The reference data SD also includes a record sd1 in which the attribute values ​​for "product name," "price," and "category" are "AAA baby bottle," "980," and "baby products," a record sd2 in which the attribute values ​​for "BBB chocolate," "300," and "sweets," and a record sd3 in which the attribute values ​​for "Yuki CCC lotion," "5000," and "cosmetics." The records included in the reference data SD are not limited to the above example, and the reference data SD may include records with various other attribute values. While FIG. 4 illustrates an example in which the reference data SD contains three records, the number of records included in the reference data SD may be greater or less than this.

[0036] The target data TD illustrated in FIG. 4 includes fields for "item," "type," "p," and "company." The target data TD also includes a record td1 in which the attribute values ​​of "item," "type," "p," and "company" are "Snow XXX," "Food," "300," and "Company1," a record td2 in which the attribute values ​​of "YYY Soft," "Food," "980," and "Company2," and a record td3 in which the attribute values ​​of "Rubber Band ZZ 100g," "Household Goods," "410," and "Company3." The records included in the target data TD are not limited to the above example; the target data TD may include records with various other attribute values. While FIG. 4 illustrates an example in which the target data TD contains three records, the target data TD may contain more or fewer records.

[0037] The error determination condition EC is a condition for determining whether the processed data obtained by applying a predetermined process to the target data contains an error. Specific examples of the error determination condition EC will be described later.

[0038] The converted data TD2 is data obtained by converting the target data TD by the converted data generation unit 16. When the target data TD is a database including m records, the converted data TD2 is a set {td2j} of converted records td2j obtained by converting records tdj included in the target data TD. j∈[m] It can be expressed as:

[0039] <Flow of information processing method by information processing device 1A> The flow of the information processing method S1A executed by the information processing device 1A configured as above will be described with reference to Fig. 5. Fig. 5 is a flow diagram showing the flow of the information processing method S1A. Note that the content that has already been explained will not be explained again. As an example, the information processing method S1A is a method of integrating the target data TD illustrated in Fig. 4 with the reference data SD.

[0040] (Step S11) In step S11, the data acquisition unit 11 acquires the target data TD. For example, the data acquisition unit 11 may receive the target data TD from another device via the communication unit 40A, or may acquire the target data TD input via the input / output unit 30A. The data acquisition unit 11 may also acquire the target data TD by reading the target data TD from the storage unit 20A or an external storage device.

[0041] Furthermore, in step S11, the data acquiring unit 11 may acquire the error determination condition EC and the metadata M. In this case, for example, the data acquiring unit 11 may receive the error determination condition EC and the metadata M from another device via the communication unit 40A, or may acquire the error determination condition EC and the metadata M input via the input / output unit 30A. Furthermore, the data acquiring unit 11 may acquire the error determination condition EC and the metadata M by reading out the error determination condition EC and the metadata M from the storage unit 20A or an external storage device. The timing at which the data acquiring unit 11 acquires the target data TD, the error determination condition EC, and the metadata M may be the same or different.

[0042] The metadata M is a collection of various information related to the reference data SD and the target data TD. As an example, the metadata M includes a dictionary that indicates the correspondence between the attributes of the reference data SD and the attributes of the target data TD. Furthermore, as an example, the metadata M may include at least one of the attribute names, titles, and descriptions of the reference data SD and the target data TD. The metadata M is an example of the correspondence information related to this specification. Specific examples of the metadata M will be described later.

[0043] (Step S110) Step S110 is the start of a loop process for the records of the target data TD. Here, the loop variable j in the loop process for the records is a natural number that satisfies 1≦j≦m. In the following description, the record tdj included in the target data TD is also referred to as the "target record tdj." Furthermore, the record sdi included in the reference data SD is also referred to as the "reference record sdi."

[0044] (Step S111) In step S111, the initialization unit 111 refers to the correspondence information and executes an initialization process to initialize the target records tdj of the target data TD. More specifically, the initialization unit 111 refers to the correspondence information and selects from the target records tdj records that include the same attributes as the attributes included in the reference data SD as processed records t init Generate it as:

[0045] Fig. 6 is a diagram showing a specific example of metadata M, which is an example of correspondence information. In the example of Fig. 6, the metadata M includes information indicating that "product name" corresponds to "item," information indicating that "price" corresponds to "p," and an explanation of the reference data SD.

[0046] FIG. 7 shows the processed record t obtained by applying the initialization process to the target record tdj of the target data TD shown in FIG. init 7, the initialization unit 111 sets the target record tdj to the processed record tdj that includes the same attributes as the "product name", "price", and "category" included in the reference data SD in FIG. init At this time, the initialization unit 111 refers to the metadata M shown in FIG. init The initialization unit 111 also refers to the metadata M and sets the attribute value of "item" of the processed record td1, which is the attribute corresponding to "product name", to "snow XXX". init The attribute value of "price" in the processed record td1 is set to "300", which is the attribute value of "p" in the target record td1 that corresponds to "price". initAmong the fields included in the above, for the field "category" for which no corresponding relationship is indicated in the metadata M, no attribute value is set.

[0047] The attribute "Category" that has no attribute value set is init In this way, the attributes of the reference data SD and the attributes of the target data TD do not necessarily correspond to each other, so the processed record t init may contain error attributes.

[0048] (Step S112) In step S112 of FIG. 5, the error attribute identification unit 12 init There is an error attribute in t, i.e., the processed record t init For each of the multiple attributes included in the attribute list, it is determined whether the attribute value of the attribute satisfies a predetermined condition. The predetermined condition is, for example, the error determination condition EC stored in the storage unit 20A.

[0049] FIG. 8 is a diagram showing a specific example of the error determination condition EC. In the example of FIG. 8, the error determination condition EC includes "rule1" and "rule2." "rule1" is a rule that determines whether the processed record t init is less than 0 or no value is set in the "price" field, an error is detected. init This rule states that if the value of the "category" field included in the processed record t in Figure 7 is not "baby products," "sweets," or "cosmetics," it is determined to be an error. init In this case, the error attribute identification unit 12 determines whether the error determination condition EC in Fig. 8 is satisfied for each of "product name," "price," and "category." Note that the predetermined condition according to this specification is not limited to the example in Fig. 8, and may be any condition for determining whether the processed data includes an error.

[0050] Processed records tinit If there is an error attribute (YES in step S112), the error attribute identifying unit 12 proceeds to the processing of step S12. On the other hand, if there is no error attribute (NO in step S112), the error attribute identifying unit 12 skips steps S12 to S15 and proceeds to step S150.

[0051] (Step S12) In step S12, the error attribute identifying unit 12 identifies an error attribute based on the determination result. In other words, the error attribute identifying unit 12 identifies a set F of error attributes k. In the example of FIG. 7, init Among the "product name", "price" and "category" of the processed record t init Since the attribute value of "category" in the processed record t in FIG. 7 is not "baby products," "sweets," or "cosmetics," the error attribute identifying unit 12 identifies "category" as an error attribute k based on the error determination condition EC. init The error attribute k included in is "category". In addition, since the other attributes satisfy the error determination condition EC, the set F of error attribute k is a set consisting of only "category" elements.

[0052] (Step S13) In step S13, the reference attribute identification unit 13 identifies a reference attribute k' that is an attribute similar to the error attribute k and is included in the target data TD. As an example, the reference attribute identification unit 13 identifies a reference attribute that is an attribute semantically or linguistically similar to the error attribute k and is included in the target data TD. More specifically, as an example, the reference attribute identification unit 13 may identify the reference attribute using a so-called schema matching technique in which schema definitions of two tables are provided in a file and the similarity between the fields of the two tables is output.

[0053] More specifically, with regard to schema matching, the reference attribute identification unit 13 may identify reference attributes similar to the error attribute by, for example, attribute names, descriptions, stemming, tokenization, string and substring matching, and language matching techniques based on information retrieval techniques. In this case, the reference attribute identification unit 13 may also use auxiliary information such as a thesaurus, acronyms, dictionaries, and mismatch lists. Note that the methods for identifying reference attributes are not limited to these, and the reference attribute identification unit 13 may also use other methods to identify reference attributes similar to the error attribute.

[0054] In the example of FIG. 4, the reference attribute specification unit 13 specifies "type" as the reference attribute k' from among a plurality of fields included in the target data TD.

[0055] (Step S14) In step S14, the prediction unit 14 predicts a correction content Pk for the error attribute k. As an example, the prediction unit 14 predicts a correction content Pk including a plurality of correction content candidates yck for the error attribute k. In other words, the prediction unit 14 predicts a plurality of correction content candidates yck for the error attribute k. As specific examples of methods by which the prediction unit 14 predicts the correction content candidates yck, (i) a method using a prediction model and (ii) a method using a similarity vector will be described.

[0056] (Method using predictive models) For example, the prediction unit 14 calculates the feature vector vtj of the target record tdj included in the target data TD, inputs the calculated feature vector vtj to the prediction model f, and outputs a correction content candidate yck corresponding to the value output by the prediction model f. Here, the number of dimensions of the feature vector vtj is, for example, the number of attributes included in the target data TD. For example, the feature vectors vt1 to vt3 of the records td1 to td3 in FIG. 4 are expressed as {0.9, 0.2, -0.1, 1.5, 0.3}, {0.6, -0.3, 0.1, 0.7, -1.2}, and {0.4, 0.6, -0.8, 0.9, -0.3}, respectively.

[0057] The number of dimensions of the feature vector vtj is not limited to the number of attributes included in the target data TD. For example, the prediction unit 14 may use an embedding vector of the target data TD as the feature vector vtj. In this case, the prediction unit 14 may use an existing algorithm such as word2vec to acquire the embedding vector.

[0058] The correction content Pk of the error attribute k is, for example,

number

[0059] where the attribute value c∈N k is the attribute value of the correction candidate for the error attribute k, and k is a set of attribute values ​​c. The number of correction candidates for each error attribute k∈F is |N k |

[0060] The correction content candidate yck is a correction candidate for the attribute value of the error attribute k. The first certainty sck is the certainty for each of the multiple correction content candidates yck. That is, in the above formula (1), the correction content Pk is a set of pairs of the correction content candidate yck and the first certainty sck of the correction content candidate yck.

[0061] As an example, the prediction unit 14 calculates the first confidence factor sck using the prediction model f. However, the unit that performs the calculation process of the first confidence factor sck is not limited to the prediction unit 14, and may be a unit other than the prediction unit 14, for example, the correction unit 15. Furthermore, the calculation process of the first confidence factor sck may be performed by a device other than the information processing device 1A. For example, the first confidence factor sck calculated by another device may be acquired by the data acquisition unit 11 or the like via the input / output unit 30A or the communication unit 40A.

[0062] The prediction model f is constructed by machine learning, for example. For example, the prediction model f may be a prediction model that receives a feature vector vtj as input and outputs a pair of a correction content candidate yck and a first confidence score sck. The learning of the prediction model f may be performed by the control unit 10A of the information processing device 1A, or by another device. The machine learning method for the prediction model is not limited, and for example, a decision tree-based, linear regression, or neural network method may be used, or two or more of these methods may be used. Examples of decision tree-based methods include LightGBM (Light Gradient Boosting Machine), random forest, and XGBoost. Examples of linear regression methods include Bayesian linear regression, support vector regression, Ridge regression, Lasso regression, and ElasticNet. Examples of neural networks include deep learning.

[0063] (Example of a predictive model 1: Regression model (supervised learning)) As an example, the prediction model f is a regression model f1 generated by supervised learning. In this case, the input of the regression model f1 is the feature vector vtj of the target record tdj, and the output of the regression model f1 includes a pair of a correction content candidate yck for the error attribute k and a first confidence score sck. In other words, the prediction unit 14 identifies the correction content Pk based on the value obtained by inputting the feature vector vtj into the regression model f1.

[0064] (Training a regression model) The regression model f1 is constructed by machine learning using training data including, for example, feature vectors vsi representing each record sdi included in the reference data SD and attribute values ​​tsi[k] of attribute k included in the reference data SD. Here, the number of dimensions of the feature vectors vsi is, for example, the number of attributes included in the reference data SD. For example, the feature vectors vs1 to vs3 of records sd1 to sd3 in the reference data SD shown in FIG. 4 are expressed as {0.7, -0.4, 0.1, 0.8, -1.0}, {0.1, 0.4, -0.1, -1.2, 0.7}, and {0.9, 0.6, -0.3, 0.4, -0.8}, respectively.

[0065] The number of dimensions of the feature vector vsi is Standard data SD The number of attributes included in the feature vector vsi is not limited to the number of attributes included in the feature vector vsi. For example, the prediction unit 14 may use an embedding vector of the reference data SD as the feature vector vsi. In this case, the prediction unit 14 may use an existing algorithm such as word2vec to acquire the embedding vector.

[0066] (Example of a predictive model 2: Classification model (supervised learning)) Furthermore, the prediction model f used by the prediction unit 14 may be, for example, a classification model f2 generated by supervised learning. In this case, the attribute value of attribute k of the reference data SD is data for identifying a category. In this case, the input to the classification model f2 is the feature vector vtj of the target record tdj, and the output of the classification model f2 is a pair of a correction content candidate yck for the error attribute k and a first confidence score sck. In other words, the prediction unit 14 identifies the correction content Pk based on the value obtained by inputting the feature vector vtj of the target data TD into the classification model f2.

[0067] (Classification model training) The classification model f2 is constructed by machine learning using training data including, for example, the feature vector vsi and the attribute value tsi[k] of the attribute k included in the reference data SD. More specifically, for example, the information processing device 1A or the like trains the classification model f2 so as to minimize the following loss function E(θ):

number

[0068] In equation (2), y c i takes the value "1" if the attribute value tsi[k] belongs to category c, and takes the value "0" otherwise. Also, f(vsi;θ) c represents the first confidence for category c.

[0069] In step S14, the processed record t init 7, the output of the prediction model f includes, for example, the confidence levels of the attribute values ​​of the correction candidates "baby products," "sweets," and "cosmetics" in the error attribute k "category." The prediction unit 14 outputs a correction content Pk corresponding to the value output by the prediction model.

[0070] (Method using similarity vectors) As another example, the prediction unit 14 may calculate a similarity vector between a target record tdj included in the target data TD and each reference record sdi included in the reference data SD, and output the attribute value included in the reference record sdi that has the highest matching probability obtained from the calculated similarity vector as the correction content candidate yck. In this case, as an example, the prediction unit 14 calculates n × m similarity vectors and searches a similar record set, which is a set of reference records sdi that are similar to the target record tdj, using the calculated similarity vector. Furthermore, the prediction unit 14 aggregates the attribute values ​​of the error attribute k in the similar record set, and outputs the correction content candidate yck for the error attribute k and a first confidence score sck of the correction content candidate yck.

[0071] (Step S15) In step S15, the correction unit 15 corrects the correction content Pk by referring to the reference attribute k'. In this exemplary embodiment, the correction unit 15 identifies the correction content after correction from a plurality of correction content candidates yck by referring to the reference attribute k'.

[0072] More specifically, as an example, the correction unit 15 calculates the evaluation function f(yck) of the correction content candidate yck, and identifies the correction content candidate yck with the highest value of the evaluation function f(yck) among the multiple correction content candidates yck as the correction content after correction.

[0073] As an example, the evaluation function f(yck) is expressed using (i) a first certainty sck, (ii) a second certainty pu, and (iii) a similarity sim(yck,u). In other words, the correction unit 15 acquires the first certainty sck, one or more attribute value candidates u, and the second certainty pu, calculates the similarity sim(yck,u), and specifies the correction content after correction by referring to the multiple correction content candidates yck, the first certainty sck, the one or more attribute value candidates u, the second certainty pu, and the calculated similarity sim(yck,u).

[0074] Here, the second certainty pu is the certainty for each of one or more attribute value candidates u for the reference attribute k'. The one or more attribute value candidates u for the reference attribute k' are candidates for the attribute value of the reference attribute k'. For example, if the reference attribute k' is "type" included in the target data TD, the attribute value candidates u are "food," "household goods," etc., which can be attribute values ​​of "type."

[0075] As a calculation method of the second confidence factor pu, for example, the correction unit 15 may calculate the second confidence factor pu using a prediction model f3 that outputs the second confidence factor pu for an attribute value candidate u∈U. The prediction model f3 may be constructed by machine learning, for example. The prediction model f3 may be a prediction model that receives a feature vector vtj as input and outputs a second confidence factor pu for the attribute value u. The prediction model f3 may be trained by the control unit 10A of the information processing device 1A or by another device. The machine learning method for the prediction model is not limited, and may be, for example, a decision tree-based, linear regression, or neural network method, or two or more of these methods. Examples of decision tree-based methods include LightGBM, random forest, and XGBoost. Examples of linear regression methods include Bayesian linear regression, support vector regression, Ridge regression, Lasso regression, and ElasticNet. Examples of neural networks include deep learning.

[0076] As an example, the prediction model f3 is constructed by machine learning using training data including the feature vector of each record included in the database and the attribute value of the attribute k included in the database.

[0077] However, the unit that performs the calculation process of the second confidence factor pu is not limited to the correction unit 15, and may be a unit other than the correction unit 15, for example, the prediction unit 14. Furthermore, the calculation process of the second confidence factor pu may be performed by a device other than the information processing device 1A. For example, the second confidence factor pu calculated by another device may be acquired by the data acquisition unit 11 or the like via the input / output unit 30A or the communication unit 40A.

[0078] The similarity sim(yck,u) is the similarity between each of the multiple correction content candidates yck and each of the one or multiple attribute value candidates u. For example, the correction unit 15 may create a token set by collecting words included in the multiple correction content candidates yck, and may also create a token set by collecting words included in one or multiple attribute value candidates u, and calculate the similarity between these token sets as the similarity sim(yck,u). In this case, the similarity between the sets may be, for example, the Jaccard coefficient, the Dice coefficient, or the Simpson coefficient.

[0079] As another example, the correction unit 15 may calculate the similarity between the attribute values ​​by regarding the attribute values ​​as a single character string, and calculate the similarity sim(yck,u) based on the calculated similarity between the attribute values. In this case, the similarity between the attribute values ​​may be, for example, the Hamming distance or the Levenshtein distance.

[0080] As another example, the correction unit 15 may acquire an embedding vector of an attribute value and then calculate the distance between the vectors using a distance function. In this case, the embedding vector may be acquired using, for example, the word2vec algorithm. The distance function may be, for example, a function that calculates Euclidean distance or Manhattan distance. However, the method for calculating the similarity (yck,u) is not limited to the above example, and the correction unit 15 may calculate the similarity (yck,u) using other methods.

[0081] The evaluation function f(yck) used by the correction unit 15 when specifying the correction content after correction is, for example, expressed as follows using the first confidence sck, the second confidence pu, and the similarity sim(yck,u):

number

[0082] In equation (3), the similarity between the attribute value candidate u and the correction content candidate yck is weighted by the second confidence pu. However, if the attribute value u of the reference attribute k' is known, the evaluation function f(yck) can be calculated as follows without considering the weighting of the second confidence pu:

number

[0083] The evaluation function f(yck) used by the correction unit 15 is not limited to the above example, and the correction unit 15 may use another evaluation function to identify the correction content after correction. The correction unit 15 may simply correct the correction content Pk by referring to the reference attribute k', and may identify the correction content after correction based on the result of multiplying the first certainty sck of the correction content candidate yck by the similarity sim(yck,u), for example.

[0084] 9 is a diagram showing a specific example of correction of correction content P performed by correction unit 15. In FIG. 9, correction content P11 is correction content predicted by prediction unit 14, and includes multiple correction content candidates yck for "category" which is error attribute k, namely "baby products," "sweets," and "cosmetics," and a first certainty factor sck of each correction content candidate yck. In the example of FIG. 9, among "baby products," "sweets," and "cosmetics," "cosmetics" has the highest first certainty factor sck.

[0085] The similarity sim11 indicates the similarity sim(yck,u) calculated by the correction unit 15 for each of the multiple correction content candidates yck, namely, "baby products," "sweets," and "cosmetics." In the example of FIG. 9, among "baby products," "sweets," and "cosmetics," Sweets " has the highest similarity (yck,u).

[0086] Correction content P21 after correction indicates the correction result obtained by the correction unit 15 correcting correction content P11 by referring to the reference attribute k'. Correction content P21 indicates multiple correction content candidates yck for the error attribute k, "category", namely "baby products", "sweets", and "cosmetics", and the values ​​of the evaluation function f(yck) of each correction content candidate yck. In the example of FIG. 9, of "baby products", "sweets", and "cosmetics", the value of the evaluation function f(yck) of "sweets" is the largest.

[0087] (Step S150) Step S150 is the end of the loop processing for the records included in the target data TD.

[0088] (Step S16) In step S16, the converted data generation unit 16 generates a converted record td2j corresponding to the record tdj of the target data TD using the correction content corrected by the correction unit 15. The converted data generation unit 16 also integrates the generated converted record td2j with the reference data SD to generate an integrated data ID. However, among the records tdj included in the target data TD, records tdj that do not include an error attribute have not been converted, so in this case the converted data generation unit 16 simply substitutes the unconverted record tdj for the converted record td2j.

[0089] FIG. 10 is a diagram showing a specific example of an integrated data ID. The integrated data ID is data obtained by integrating the converted record td2j with the reference data SD. More specifically, the integrated data ID shown in FIG. 10 is standard It includes the record {sdi} of the data SD and the converted record {td2j} obtained by converting the record {tdj} of the target data TD.

[0090] 10, record td21 includes an attribute value of "sweets" in the "category" field. Here, if the prediction result by the prediction unit 14 is used as is, the attribute value with the highest first certainty calculated by the prediction unit 14 is "cosmetics" (see correction content P11 in FIG. 9). value In this case, the attribute value of "category" in record td21 is not appropriate.

[0091] On the other hand, in the information processing device 1A according to this exemplary embodiment, the processed record t init and corrects the predicted correction content Pk by referring to a reference attribute k' that is similar to the error attribute k. For example, even if the accuracy of the correction content predicted by the information processing device 1A is not sufficient, by correcting the predicted correction content by referring to a reference attribute k' that is similar to the error attribute k, errors can be corrected with higher accuracy without requiring a large amount of training data.

[0092] (Application example of information processing device 1A) In the above-described exemplary embodiment 2, the information processing device 1A is mainly described as integrating multiple databases, but the information processing device 1A is not limited to being a device that integrates data. For example, the information processing device 1A can also be used as a conversion device that converts target data into a reference data format, or a classification device that reclassifies data.

[0093] When the information processing device 1A is used as a conversion device, the information processing device 1A acquires target data that is the target of the conversion process, and converts the acquired target data into converted data using the correction content corrected by the correction unit 15. In this case, the target data that is the target of the conversion process is, for example, a database including multiple records. Also, the converted data is, for example, a database including attributes different from those of the target data.

[0094] In this case, similar to the above-described exemplary embodiment 2, the information processing device 1A identifies an error attribute, which is an attribute containing an error, from among multiple attributes included in processed data obtained by applying a predetermined process to the target data, and identifies a reference attribute, which is an attribute similar to the error attribute and included in the target data. The information processing device 1A also predicts correction details for the error attribute and corrects the correction details by referring to the reference attribute. The information processing device 1A also generates converted data corresponding to the target data using the correction details corrected by the correction unit 15.

[0095] Furthermore, when the information processing device 1A is used as a reclassification device, the information processing device 1A acquires target data to be classified and reclassifies the acquired target data using the correction content corrected by the correction unit 15. In this case, the target data to be reclassified is, for example, a database including multiple records. Furthermore, the converted data generated by the reclassification is, for example, a database including attributes different from those of the target data. The records included in the converted data are classified by the attribute values ​​included in the converted data.

[0096] In this case, similar to the above-described exemplary embodiment 2, the information processing device 1A identifies an error attribute, which is an attribute containing an error, from among multiple attributes included in processed data obtained by applying a predetermined process to the target data, and identifies a reference attribute, which is an attribute similar to the error attribute and included in the target data. The information processing device 1A also predicts correction details for the error attribute and corrects the correction details by referring to the reference attribute. The information processing device 1A also generates converted data corresponding to the target data using the correction details corrected by the correction unit 15.

[0097] Examples of applications for reclassifying data include updating product classification taxonomies (classification systems) in e-commerce, document classification, and other classifications such as financial products. Examples of document classification include reclassification of patent documents and academic papers (e.g., arXiv). Another example is the classification of diseases by the World Health Organization (WHO).

[0098] [Software implementation example] Some or all of the functions of the information processing devices 1 and 1A may be realized by hardware such as an integrated circuit (IC chip), or may be realized by software.

[0099] In the latter case, the information processing devices 1 and 1A are realized, for example, by a computer that executes instructions of a program, which is software that realizes each function. An example of such a computer (hereinafter referred to as computer C) is shown in FIG. 11. The computer C includes at least one processor C1 and at least one memory C2. The memory C2 stores a program P for operating the computer C as the information processing device 1 and 1A. In the computer C, the processor C1 reads and executes the program P from the memory C2, thereby realizing each function of the information processing device 1 and 1A.

[0100] The processor C1 may be, for example, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a microcontroller, or a combination thereof. The memory C2 may be, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a combination thereof.

[0101] The computer C may further include a RAM (Random Access Memory) for expanding the program P during execution and for temporarily storing various data. The computer C may also include a communication interface for transmitting and receiving data to and from other devices. The computer C may also include an input / output interface for connecting input / output devices such as a keyboard, mouse, display, and printer.

[0102] Furthermore, the program P can be recorded on a non-transitory tangible recording medium M that can be read by the computer C. Such a recording medium M can be, for example, a tape, a disk, a card, a semiconductor memory, or a programmable logic circuit. The computer C can acquire the program P via such a recording medium M. The program P can also be transmitted via a transmission medium. Such a transmission medium can be, for example, a communication network or broadcast waves. The computer C can also acquire the program P via such a transmission medium.

[0103] [Appendix 1] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. For example, embodiments obtained by appropriately combining the technical means disclosed in the above-described embodiments are also included in the technical scope of the present invention.

[0104] [Appendix 2] Some or all of the above-described embodiments can also be described as follows: However, the present invention is not limited to the following described aspects.

[0105] (Appendix 1) A data acquisition means for acquiring target data; an error attribute specifying means for specifying an error attribute, which is an attribute including an error, from among a plurality of attributes included in processed data obtained by applying a predetermined process to the target data; a reference attribute specifying means for specifying a reference attribute which is an attribute similar to the error attribute and is included in the target data; a prediction means for predicting correction details regarding the error attribute; a correction means for correcting the correction content by referring to the reference attribute; An information processing device comprising:

[0106] According to the above configuration, errors related to data attributes can be corrected with high accuracy without requiring a large amount of training data.

[0107] (Appendix 2) The prediction means predicting a plurality of correction content candidates for the error attribute; The correction means Identifying correction content after correction from the plurality of correction content candidates by referring to the reference attribute. 2. The information processing device according to claim 1.

[0108] According to the above configuration, the information processing device identifies the correction content from multiple correction content candidates by referring to a reference attribute similar to the error attribute. This allows for error correction with high accuracy without requiring a large amount of training data, compared to when the correction content is not identified by referring to the reference attribute.

[0109] (Appendix 3) The correction means a first certainty level which is a certainty level regarding each of the plurality of correction content candidates; one or more candidate attribute values ​​for the reference attribute; and a second certainty factor that is a certainty factor for each of the one or more attribute value candidates; Get calculating a similarity between each of the plurality of correction content candidates and each of the one or more attribute value candidates; Identifying the correction content after the correction by referring to the plurality of correction content candidates, the first certainty, the one or more attribute value candidates, the second certainty, and the similarity; 3. The information processing device according to claim 2.

[0110] According to the above configuration, the correction content after correction is specified by referring to the multiple correction content candidates, the first certainty factor, one or multiple attribute value candidates, the second certainty factor, and the similarity factor. This makes it possible to correct errors with high accuracy without requiring a large amount of training data.

[0111] (Appendix 4) The prediction means Calculating a feature vector of a target record included in the target data, inputting the calculated feature vector into a prediction model, and outputting correction content candidates according to the value output by the prediction model. 4. The information processing device according to claim 2 or 3.

[0112] According to the above configuration, the information processing device predicts correction content candidates according to values ​​output by a prediction model. If there is insufficient training data for the prediction model, the reliability of the correction content candidates according to the output of the prediction model may be low. In contrast, according to the above configuration, by correcting the predicted correction content candidates according to the reference attributes, errors can be corrected with high accuracy even when the reliability of the correction content candidates is low.

[0113] (Appendix 5) The prediction means A similarity vector between a target record included in the target data and each reference record included in the reference data is calculated, and an attribute value included in the reference record having a higher matching probability obtained from the calculated similarity vector is output as the correction content candidate. 5. An information processing device according to any one of appendices 2 to 4.

[0114] According to the above configuration, by correcting the correction content candidate in accordance with the reference attribute, even if the correction content candidate has low reliability, it is possible to correct the error with high accuracy.

[0115] (Appendix 6) The reference attribute specifying means Identifying a reference attribute, which is an attribute that is semantically or linguistically similar to the error attribute and is included in the target data. 6. An information processing device according to any one of appendices 1 to 5.

[0116] According to the above configuration, the error can be corrected with higher accuracy by correcting the correction content using a reference attribute that is semantically or linguistically similar to the error attribute.

[0117] (Appendix 7) further comprising an initialization unit that applies an initialization process to the target data as the predetermined process; The initialization means performs the initialization process as follows: generating, from the target data, data including the same attributes as the plurality of attributes included in the reference data, as the processed data, by referring to correspondence information indicating a correspondence relationship between at least one of a plurality of attributes included in the target data and at least one of a plurality of attributes included in the reference data; 7. An information processing device according to any one of appendices 1 to 6.

[0118] According to the above configuration, the correction content of the processed data obtained by performing initialization processing on the target data is corrected by referring to a reference attribute similar to the error attribute, thereby enabling errors contained in the processed data to be corrected with high accuracy without requiring a large amount of training data.

[0119] (Appendix 8) The error attribute specifying means For each of a plurality of attributes included in the processed data, it is determined whether the attribute value of the attribute satisfies a predetermined condition, and the error attribute is identified based on the determination result. 8. The information processing device according to claim 7.

[0120] According to the above configuration, the correction content is corrected by referencing a reference attribute similar to the erroneous attribute identified based on the result of determining whether the attribute value satisfies a predetermined condition, thereby enabling high-precision correction of errors without requiring a large amount of training data.

[0121] (Appendix 9) The apparatus includes a converted data generating means for generating converted data corresponding to the target data using the correction content corrected by the correcting means. 9. An information processing device according to any one of appendices 1 to 8.

[0122] According to the above configuration, when converting target data into converted data, a large amount of training data is not required, and conversion-related errors can be corrected with high accuracy.

[0123] (Appendix 10) Obtaining target data; Identifying an error attribute, which is an attribute including an error, from among a plurality of attributes included in processed data obtained by applying a predetermined process to the target data; Identifying a reference attribute that is an attribute similar to the error attribute and is included in the target data; predicting a correction for the error attribute; amending the correction content by referring to the reference attribute; An information processing method comprising:

[0124] According to the above information processing method, the same effects as those of the above information processing device can be achieved.

[0125] (Appendix 11) On the computer, A process of acquiring target data; A process of identifying an error attribute, which is an attribute including an error, from among a plurality of attributes included in processed data obtained by applying a predetermined process to the target data; A process of identifying a reference attribute that is an attribute similar to the error attribute and is included in the target data; A process of predicting correction content for the error attribute; a process of correcting the correction content by referring to the reference attribute; An information processing program that executes the above.

[0126] According to the above configuration, the same effects as those of the above-mentioned information processing device can be achieved.

[0127] [Appendix 3] Some or all of the above-described embodiments can also be expressed as follows.

[0128] The system includes at least one processor, and the processor performs a data acquisition process for acquiring target data, an error attribute identification process for identifying an error attribute that is an attribute containing an error among a plurality of attributes included in processed data obtained by applying a predetermined process to the target data, a reference attribute identification process for identifying a reference attribute that is an attribute similar to the error attribute and is included in the target data, a prediction process for predicting a correction content for the error attribute, and a correction process for correcting the correction content by referring to the reference attribute. Execute Information processing device.

[0129] The information processing device may further include a memory that stores a program for causing the processor to execute the data acquisition process, the error attribute identification process, the reference attribute identification process, the prediction process, and the correction process. The program may be recorded on a computer-readable, non-transitory, tangible recording medium. [Explanation of symbols]

[0130] 1, 1A Information processing equipment 10A Control unit 11 Data Acquisition Section 12 Error attribute specification part 13 Reference attribute identification part 14 Prediction Department 15 Correction unit 16 Converted data generation unit 20A storage section 30A input / output section 40A Communications Department 111 Initialization section C1 processor C2 Memory

Claims

1. A data acquisition means for acquiring target data; an error attribute specifying means for specifying an error attribute, which is an attribute including an error, from among a plurality of attributes included in processed data obtained by applying a predetermined process to the target data; a reference attribute specifying means for specifying a reference attribute which is an attribute similar to the error attribute and is included in the target data; a prediction means for predicting correction details regarding the error attribute; a correction means for correcting the correction content by referring to the reference attribute; An information processing device comprising:

2. The prediction means predicting a plurality of correction content candidates for the error attribute; The correction means Identifying correction content after correction from the plurality of correction content candidates by referring to the reference attribute. The information processing device according to claim 1 .

3. The correction means a first certainty factor that is a certainty factor regarding each of the plurality of correction content candidates; one or more candidate attribute values ​​for the reference attribute; and obtaining a second certainty factor that is a certainty factor for each of the one or more attribute value candidates; calculating a similarity between each of the plurality of correction content candidates and each of the one or more attribute value candidates; Identifying the correction content after the correction by referring to the plurality of correction content candidates, the first certainty, the one or more attribute value candidates, the second certainty, and the similarity. The information processing device according to claim 2 .

4. The prediction means Calculating a feature vector of a target record included in the target data, inputting the calculated feature vector into a prediction model, and outputting correction content candidates according to the value output by the prediction model.

4. The information processing device according to claim 2 or 3.

5. The prediction means A similarity vector between a target record included in the target data and each reference record included in the reference data is calculated, and an attribute value included in the reference record having a higher matching probability obtained from the calculated similarity vector is output as the correction content candidate. The information processing device according to claim 2 .

6. The reference attribute specifying means Identifying a reference attribute, which is an attribute that is semantically or linguistically similar to the error attribute and is included in the target data. The information processing device according to claim 1 .

7. further comprising an initialization unit that applies an initialization process to the target data as the predetermined process; The initialization means performs the initialization process as follows: By referring to correspondence information indicating a correspondence relationship between at least one of a plurality of attributes included in the target data and at least one of a plurality of attributes included in the reference data, data including the same attributes as the plurality of attributes included in the reference data is generated from the target data as the processed data. The information processing device according to claim 1 .

8. The error attribute specifying means For each of a plurality of attributes included in the processed data, it is determined whether the attribute value of the attribute satisfies a predetermined condition, and the error attribute is identified based on the determination result of whether the attribute value of the attribute satisfies the predetermined condition. The information processing device according to claim 7 .

9. Obtaining target data; Identifying an error attribute, which is an attribute including an error, from among a plurality of attributes included in processed data obtained by applying a predetermined process to the target data; Identifying a reference attribute that is an attribute similar to the error attribute and is included in the target data; predicting a correction for the error attribute; amending the correction content by referring to the reference attribute; An information processing method performed by a computer.

10. On the computer, A process of acquiring target data; A process of identifying an error attribute, which is an attribute including an error, from among a plurality of attributes included in processed data obtained by applying a predetermined process to the target data; A process of identifying a reference attribute that is an attribute similar to the error attribute and is included in the target data; A process of predicting correction content for the error attribute; a process of correcting the correction content by referring to the reference attribute; An information processing program that executes the above.

Images