Information processing device and information processing method
The diagnostic system addresses the risk of reduced accuracy by updating classification rules based on textual data similarity and co-occurrence analysis, ensuring stable and accurate data processing.
Patent Information
- Application Number
- JP2021067550
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-04-13
- Publication Date
- 2025-04-21
- Estimated Expiration
- 2041-04-13
AI Technical Summary
Existing diagnostic systems face a risk of reducing data processing accuracy when changing rules for classifying input data, particularly if machine learning-based diagnosis results are inconsistent with pre-defined rules.
The system employs a method where textual data is used to generate classification criteria, with the first rule updated based on similarity with reference data exceeding a given value, and new rules are extracted using co-occurrence words that appear with a frequency greater than or equal to the original rule words.
This approach prevents a reduction in data processing accuracy by stabilizing the classification rules, ensuring that pre-defined rules remain effective while allowing for adjustments based on machine learning insights.
Smart Images

Figure 0007665391000007 
Figure 0007665391000008 
Figure 0007665391000009
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device and an information processing method for processing various types of data. [Background technology]
[0002] A diagnostic system is known in which diagnostic data obtained from a diagnostic subject is diagnosed according to predetermined rules, and separately, diagnostic data is diagnosed according to rules learned by machine learning using the diagnostic data, the respective diagnostic results are compared to extract discrepant results, and the extracted discrepant diagnostic results are used to update the predetermined rules (Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication No. 2017 / 081984 Summary of the Invention [Problem to be solved by the invention]
[0004] In the above conventional technology, when the diagnostic results are inconsistent, the predetermined rule is changed to make the diagnostic result according to the predetermined rule consistent with the diagnostic result according to the rule learned by machine learning. Therefore, in the above conventional technology, when the diagnostic result according to the predetermined rule is appropriate, but the diagnostic result according to the rule learned by machine learning is inappropriate, the predetermined rule that has obtained an appropriate diagnostic result may be changed to one that only obtains an inappropriate diagnostic result. This causes a problem of a decrease in the data processing accuracy of the diagnostic system.
[0005] An object of the present invention is to provide an information processing apparatus and an information processing method capable of suppressing a decrease in data processing accuracy caused by changing rules for classifying input data. [Means for solving the problem]
[0006] The present invention relates to It is text data written in natural language. Enter power de Data, Processing criteria are text data that indicate classification criteria for classifying input data according to importance. The first rule generated from the data and the second rule, which is different from the first rule, The text data includes input data associated with the importance of the input data. When classifying using a second rule learned by machine learning using training data, Processing criteria Data and Including at least one of input data and training data, Reference data for updating Regulation 1 and Indicates the degree to which Similarity The similarity is the frequency of occurrence of words that appear in the processing reference data used when generating the first rule and that overlap with words that appear in the reference data. The first rule is updated using reference data whose similarity is equal to or greater than a predetermined value. power de The data is classified using the updated first and second rules. The updated first rule further includes a new rule that is extracted from the reference data and generated using co-occurrence words that appear together with the words included in the first rule at a frequency equal to or higher than a predetermined frequency. This solves the above problem. Effect of the Invention
[0007] According to the present invention, it is possible to suppress a decrease in data processing accuracy caused by changing the rules for classifying input data. [Brief description of the drawings]
[0008] [Figure 1] 1 is a block diagram showing an information processing system including an information processing device according to the present invention. [Diagram 2] 2 is an example of an image displayed on the display device of FIG. 1. [Diagram 3] 2 is a flowchart showing an example of a processing procedure in the information processing system of FIG. 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0010] [Information Processing System] Fig. 1 is a block diagram showing an information processing system 1 according to the present invention. The information processing system 1 shown in Fig. 1 can be used when acquiring product defect information in the market from, for example, texts posted on websites or social networking services (SNS), posts on electronic bulletin boards on an intranet within a company, and product repair reports sent to manufacturers by retailers that sold the products, and automatically classifying the acquired information according to its importance.
[0011] The information processing system 1 is a system including at least one database and an electronic computer that processes input data. As shown in Fig. 1, the information processing system 1 includes a first database 11, a second database 12, a third database 13, a fourth database 14, a communication device 15, a display device 16, and an information processing device 17. The first database 11 stores input data that is input to the information processing device 17 and processed, the second database 12 stores learning data used for machine learning executed by the information processing device 17, the third database 13 stores processing criterion data indicating a predetermined criterion for processing (e.g., classifying) the data input to the information processing device 17, and the fourth database 14 stores corpus data used in processing in the information processing device 17.
[0012] The input data stored in the first database 11 is not particularly limited as long as it is text data written in a natural language. Examples of text data include text posted to websites and SNS, posts to an intranet bulletin board, information entered into an in-house system, and product repair reports sent from a dealer that sold the product to the manufacturer. The input data in this embodiment particularly includes a quality report (technical report) sent from a dealer that sold the vehicle to the automobile company that manufactured the vehicle. The quality report includes at least information on defects in the market of the sold vehicle, such as the location where the defect occurred, the state of the defect, the cause of the defect and countermeasures, the maintenance state and repair history of the vehicle where the defect occurred, the date and time of the defect occurrence, and the date and time of the response.
[0013] The data stored in the first database 11 also includes reference data for updating the rules generated by the classification rule generation unit 24, which will be described later, in the rule update unit 26. The reference data is data that can be used to update the first rules, which will be described later, and includes data that was previously input and classified by the input data classification unit 27 and the classification results, data classified by another information processing device having the same classification function as in this embodiment, and classification standards of other countries that correspond to the Japanese classification for classifying vehicle defects according to importance.
[0014] The learning data stored in the second database 12 is not particularly limited as long as it can be used for machine learning executed by the information processing device 17, and is, for example, text data including documents such as laws, regulations, and guidelines related to vehicles and safety that are published by the Ministry of Land, Infrastructure, Transport and Tourism, etc. The learning data also includes input data previously processed by the information processing device 17. In this case, the learning data includes data previously input and processed by the information processing device 17 and at least the processing results at that time, and these pieces of information are associated and stored in the second database 12. For example, when input data including vehicle defect information is classified according to a classification standard described later or according to rules learned by machine learning in the information processing device 17, the input data, the classification result of the input data according to the importance of the defect, and the classification method are associated with each other and stored in the second database 12 as learning data.
[0015] The processing standard data stored in the third database 13 is data that specifies the standards used when processing input data in the information processing device 17, and is, for example, data that indicates classification standards used when classifying data input to the information processing device 17. The processing standard data is text data such as sentences written in natural language and formulas written in mathematical symbols, and examples of the data include documents related to laws and safety standards published by the Ministry of Land, Infrastructure, Transport and Tourism and the like, operating procedure manuals for classifying defects in products such as vehicles according to their severity, product cautions, and product usage manuals.
[0016] The corpus data stored in the fourth database 14 is corpus data used in processing in the information processing device 17, particularly when learning some rules by machine learning. A corpus is a structured collection of materials to be analyzed when input data is analyzed, and is a collection of written materials and recorded language materials. The type of corpus is not particularly limited, and examples include a raw corpus that is simply a collection of documents, a balanced corpus that is a balanced collection of various types of documents, a tagged corpus to which parts of speech and syntactic structures are assigned, and a parallel corpus that matches text in a certain language with its translated text. For example, if the input data is Japanese, the Balanced Corpus of Contemporary Written Japanese (BCCWJ) or the Corpus of Spoken Japanese (CSJ) can be used, and if the input data is English, the Corpus of Contemporary American English (COCA) can be used.
[0017] The first database 11 is connected to the input device 11a by known means such as wired or wireless LAN in a state in which data can be transmitted and received, and a user of the information processing system 1 inputs data to be processed by the information processing device 17 to the first database 11 using the input device 11a. The input device 11a is a device by which the user of the information processing system 1 inputs data to be processed by the information processing device 17 to the first database 11, and is, for example, a keyboard, a microphone, a touch panel, or the like connected to a display. The input device 11a may be provided together with the first database 11, or may be provided at a location away from the first database 11 and / or the information processing device 17 depending on the convenience of the user of the information processing system 1.
[0018] As shown in FIG. 1, the first database 11 is connected to a communication device 15 by a known communication means such as a wired or wireless LAN, and the information processing device 17 acquires input data stored in the first database 11 through the communication device 15. The communication device 15 is a device for transmitting and receiving data between the information processing device 17 and an external device, and is not particularly limited as long as it is a communication device capable of communicating with other devices through a network such as the Internet. Although there is one communication device 15 shown in FIG. 1, the number of communication devices 15 is not particularly limited, and multiple communication devices 15 may be used. When multiple communication devices 15 are used, the connection relationship between each device included in the information processing system 1 and the communication device 15 is not particularly limited.
[0019] 1, similarly to the first database 11, the second database 12, the third database 13, and the fourth database 14 are also connected to the communication device 15. The information processing device 17 acquires learning data from the second database 12, acquires processing reference data from the third database 13, and acquires corpus data from the fourth database 14, via the communication device 15. These databases do not need to be provided together with the information processing device 17, and at least one of the first database 11, the second database 12, the third database 13, and the fourth database 14 may be provided in a location away from the information processing device 17, for example, as the server 12a shown in FIG.
[0020] Furthermore, the information processing device 17 is also connected to the display device 16, and the processing result of the input data performed by the information processing device 17 is displayed on the display device 16. The display device 16 is a device for notifying the user of the processing status of the data input to the information processing device 17, and examples thereof include a liquid crystal display and a projector. The display device 16 in FIG. 1 is connected to the information processing device 17 in a state in which data can be exchanged, but the connection method is not particularly limited, and known communication means such as wired or wireless LAN can be used. The display device 16 may be provided together with the information processing device 17, or may be connected to the communication device 15 and provided at a location away from the information processing device 17 according to the convenience of the user of the information processing system 1.
[0021] The information processing device 17 is a device for processing input data acquired from the first database 11 using learning data acquired from the second database 12, processing reference data acquired from the third database 13, and corpus data acquired from the fourth database 14, and notifying a user of the processing result using the display device 16. The information processing device 17 realizes processing of the input data and notification of the processing result to the user by a processor 18. The processor 18 includes a ROM (Read Only Memory) 182 in which a program is stored, a CPU (Central Processing Unit) 181 which is an operating circuit for functioning as the information processing device 17 by executing the program stored in the ROM 182, and a RAM (Random Access Memory) 183 which functions as an accessible storage device.
[0022] [Input data processing section] The program used in the information processing device 17 of this embodiment includes an input data processing unit 2, which is a functional block for enabling the information processing device 17 to process input data and notify the user of the processing result. The input data processing unit 2 has a function of acquiring necessary data from each of the databases 11 to 14, classifying the input data according to a certain rule, and notifying the user of the classification result via the display device 16. As shown in FIG. 1, the input data processing unit 2 includes a data acquisition unit 21, a word occurrence extraction unit 22, a co-occurrence word extraction unit 23, a classification rule generation unit 24, a similarity calculation unit 25, a rule update unit 26, an input data classification unit 27, a display image generation unit 28, and a data output unit 29. Each unit is extracted and shown in FIG. 1 for convenience.
[0023] 1 includes all of the above-mentioned functional blocks, but it is not necessary for a single information processing device 17 to include all of the functional blocks, and some of the above-mentioned functional blocks may be provided in other devices included in the information processing system 1, or in another information processing device not shown. For example, in the information processing system 1 of FIG. 1, the display image generating unit 28 may be provided in the display device 16. In this case, the functions of the display image generating unit 28 are executed using the CPU, ROM, and RAM of the display device 16.
[0024] In addition, it is not necessary to execute all the processes of each functional block in a single information processing device, and the functions of each functional block may be realized across a plurality of information processing devices connected in a state in which data can be exchanged. For example, in the information processing system 1 of FIG. 1, among the processes executed by the occurring word extraction unit 22, a part of the processes may be executed by the server 12a, and the remaining processes may be executed by the information processing device 17. In this case, a part of the processes for realizing the functions of the occurring word extraction unit 22 is performed using the CPU, ROM, and RAM of the server 12a. As another example, among the processes executed by each functional block of the co-occurrence word extraction unit 23 and the classification rule generation unit 24, a part of the processes may be executed by the server 12a, and the remaining processes may be executed by the information processing device 17.
[0025] The functions performed by each functional block of the input data processing unit 2 will be described below.
[0026] The data acquisition unit 21 has a function of acquiring, as necessary, the input data stored in the first database 11, the learning data stored in the second database 12, the processing reference data stored in the third database 13, and the corpus data stored in the fourth database 14. Furthermore, the data acquisition unit 21 of this embodiment acquires data stored in the first database 11 as reference data. The data acquired by the data acquisition unit 21 is used in other functional blocks described below.
[0027] The word extraction unit 22 has a function of extracting words that appear in the data acquired by the data acquisition unit 21. The word extraction unit 22 has a function of extracting words used in text data included in the input data and reference data of the first database 11, the learning data of the second database 12, the processing reference data of the third database 13, and the corpus data of the fourth database 14. When the text data processed by the word extraction unit 22 is an Indo-European language in which words are written with spaces (blanks) between each other (word segmentation), such as English, German, or French, the word extraction unit 22 extracts the words separated by spaces as they are, and attaches tags such as parts of speech to each word.
[0028] The word occurrence extraction unit 22 performs stemming on the extracted words as necessary, and deletes stop words from the extracted words. Stemming is a process for regarding a certain word and its derivatives as all having the same feature. For example, for the English verb "run", if inflections such as "ran" and "running" appear in the text data, all of these inflections are considered to have the same feature as "run". A stop word is a word that appears in documents on any topic and is considered to have no relation to the type of topic. Examples include basic words such as "the", "is", "have", "take", and "get". These processes can be performed, for example, by using a module such as "termextract" in the programming language "Python".
[0029] On the other hand, when the text data to be processed by the word extraction unit 22 is a language that does not separate words, such as Japanese, Chinese, or Thai, the word extraction unit 22 performs morpheme analysis on the text data. A morpheme is the smallest linguistic unit that has meaning, and in this embodiment, morpheme analysis refers to determining word divisions in the text data and determining the part of speech and the like for each divided word. For example, a sentence such as "The engine is making a strange sound and is not working" can be divided into "The engine is making a strange sound and is not working" by morpheme analysis, and the reading, root form, part of speech, conjugation form, and the like of each divided word are determined. Stop words such as particles and auxiliary verbs may be deleted from each of these divided words as necessary. Such processing can be performed using a morpheme analysis tool such as "MeCab", "JUMAN", or "ChaSen".
[0030] Instead of morphological analysis, an n-gram technique may be used. N-gram is a technique for breaking down a character string into n-character units (n is a natural number) and analyzing the character string based on the combination of adjacent characters.
[0031] The word occurrence extraction unit 22 also has a function of searching for compound words from the extracted words. The word occurrence extraction unit 22 detects compound words that combine two to five words into one, for example. For example, when the word "exhaust / gas" is extracted, the compound word "exhaust gas" is detected, and when the word "adaptive / cruise / control" is extracted, the compound word "adaptive cruise control" (ACC) is detected.
[0032] Then, the word extraction unit 22 stores the words extracted from the input data, the words extracted from the learning data, the words extracted from the processing reference data, and the words extracted from the corpus data individually in a storage unit such as RAM 183, and outputs them to other functional blocks as necessary.
[0033] Here, when the learning data processed by the word extraction unit 22 is input data previously processed by the information processing device 17, the association between the input data and the processing result is maintained for the extracted words. For example, when the learning data is input data including vehicle defect information classified according to classification criteria described below, the association between the classification result according to the importance of the defect and the classification method is maintained for the words extracted by the word extraction unit 22. Similarly, when the processing reference data is processed by the word extraction unit 22, the association between the extracted words and the classification criteria is maintained. For example, when the processing reference data is a work procedure manual for classifying defects of a product such as a vehicle according to the importance, the association between the extracted words and the importance is maintained. Note that when already structured corpus data is used, the process of extracting words from the corpus data by the word extraction unit 22 can be omitted as necessary.
[0034] The co-occurrence word extraction unit 23 has a function of extracting words that frequently occur together with each word extracted by the occurrence word extraction unit 22. For each word extracted by the occurrence word extraction unit 22, the co-occurrence word extraction unit 23 extracts words that occur frequently together with a certain word in the same text data as words that frequently occur together with that word. The occurrence frequency is the ratio of the number of times a word that occurs together with a certain word to the total number of extracted words. In this specification, words that frequently occur together with a certain word in the same text data are also referred to as "co-occurrence words".
[0035] When co-occurrence words are extracted from the words extracted by the word occurrence extraction unit 22, for example, a co-occurrence network is generated. A co-occurrence network is a diagram that visualizes the frequency of occurrence of a certain word and its co-occurrence word in text data, the distance between them when they occur, etc. The distance between a certain word and its co-occurrence word means how many words are separated between the word and its co-occurrence word. Such a co-occurrence network can be generated using a program such as "KH Coder" or "Text Mining Studio".
[0036] When extracting co-occurrence words from the generated co-occurrence network, the co-occurrence word extraction unit 23 extracts, as co-occurrence words, words that appear together with a certain word and have a frequency of occurrence equal to or higher than a predetermined value. For example, among words that appear together with a certain word in the same text data, words that appear in the top 5 to 30 frequency of occurrence are extracted as co-occurrence words. Alternatively or in addition to this, the co-occurrence word extraction unit 23 extracts, as co-occurrence words, words that appear together with a certain word and whose distance between them is equal to or less than a predetermined distance when they appear. For example, among words that appear together with a certain word, words that are 1 to 10 words apart from each other are extracted as co-occurrence words. The predetermined value of the frequency of occurrence and the predetermined distance can be selected as appropriate values according to the type and amount of data from which the word extraction unit 22 has performed word extraction processing. In addition, the number of co-occurrence words extracted by the co-occurrence word extraction unit 23 may be different for each word, and the same word may be extracted as a co-occurrence word for different words.
[0037] When the co-occurrence network is generated by the co-occurrence word extraction unit 23, information other than text data may be used. In particular, when the words extracted from the learning data by the occurrence word extraction unit 22 are associated with previous processing results, the co-occurrence word extraction unit 23 can extract co-occurrence words for each group according to the previous processing results. For example, when the words extracted from the learning data by the occurrence word extraction unit 22 are associated with classifications according to the severity of vehicle defects, the co-occurrence word extraction unit 23 can extract co-occurrence words for each classification according to the severity of the defects. Then, the co-occurrence word extraction unit 23 stores the co-occurrence words extracted from the input data, the co-occurrence words extracted from the learning data, the co-occurrence words extracted from the processing reference data, and the co-occurrence words extracted from the corpus data in a storage unit such as the RAM 183 in association with the original data processed by the occurrence word extraction unit 22, and outputs them to other functional blocks as necessary. At this time, the extracted co-occurrence words may be listed for each word.
[0038] The classification rule generation unit 24 has a function of generating rules for processing input data using at least one of the words extracted by the occurrence word extraction unit 22 and the co-occurrence words extracted by the co-occurrence word extraction unit 23. The rules for processing input data are, in particular, rules for classifying input data. The classification rule generation unit 24 expresses text data included in the input data, learning data, processing reference data, and corpus data acquired by the data acquisition unit 21 as vectors using at least one of the words extracted by the occurrence word extraction unit 22 and the co-occurrence words extracted by the co-occurrence word extraction unit 23. The text data expressed as vectors becomes the rules used when the information processing device 17 processes the input data.
[0039] The classification rule generating unit 24 can generate a plurality of rules by selecting which data to use from the input data, the learning data, the processing reference data, and the corpus data, and also selecting whether to use the words extracted by the occurrence word extracting unit 22 or the co-occurrence words extracted by the co-occurrence word extracting unit 23. Among these rules, in this embodiment, the processing reference data expressed as a vector using the words extracted by the occurrence word extracting unit 22 is called a first rule, and the combination of co-occurrence words obtained by combining the co-occurrence words of the learning data extracted by the co-occurrence word extracting unit 23 is called a second rule. In this embodiment, the learning data, which is the original data of the second rule, includes at least past input data classified by the first classification unit 27a or the second classification unit 27b described later.
[0040] The first rule is a vector representation of a predetermined rule such as a document published by a government agency, a work procedure manual, a product warning label, or a user manual, while the second rule is a vector generated by changing the learning data used. Therefore, the information processing device 17 of this embodiment processes input data, and the processed input data is associated with the processing result and fed back as learning data, thereby automatically improving the second rule and enabling the input data to be processed more appropriately using the second rule. In other words, the second rule is a rule learned by machine learning using the learning data. Hereinafter, how the first rule and the second rule are generated will be described.
[0041] The processing standard data that is the source data for the first rule are documents published by public agencies, work instructions for classifying defects of products such as vehicles according to their importance, and product warnings or usage manuals, and are predetermined rules. Examples of documents published by public agencies include automobile recall and defect information published as a database by the Ministry of Land, Infrastructure, Transport and Tourism. Examples of work instructions include standards for classifying information on vehicle defects received from dealers according to three levels of importance: high, medium, and low. Such work instructions state, for example, that if the reported defect corresponds to "all the doors of the vehicle cannot be opened from the inside," the defect is classified as "high importance," if the defect corresponds to "some doors of the vehicle cannot be opened or unlocked from the inside," the defect is classified as "medium importance," and if the defect corresponds to "some doors of the vehicle cannot be opened or unlocked from the outside," the defect is classified as "low importance." For example, if the product is a hairspray that uses gas, a warning or instruction manual for the product would be something like "Do not place the product near open flames as it may explode or be damaged" written on the spray can.
[0042] In order to generate the first rule, the classification rule generating unit 24 obtains the words extracted from the processing reference data as described above from the word occurrence extracting unit 22. In this embodiment, it is assumed that the stemming process, the stop word removal, and the compound word search are performed in the word occurrence extracting unit 22 at this stage. The extracted words are listed for each text data or each sentence. Then, the extracted words are arranged horizontally as word labels, and for each text data or sentence, a one-row matrix is created by assigning, for example, 1 to the word that appears and 0 to the word that does not appear. This matrix with the word labels is also called a word vector. Then, this process is performed for each text data or sentence, and the generated word vectors are collected into one to become the first rule.
[0043] For example, in the above-mentioned operating procedure manual, for the phrase "All the doors of the vehicle do not open from the inside" classified as "high importance", the morphological analysis function of the word extraction unit 22 can extract words by dividing it into "vehicle / all / of / the / doors / do / not / open / from / the inside". From these extracted words, the particles "no", "ga" and "kara" are deleted as stop words. Although "nai" is an auxiliary verb and may be a stop word, it is not deleted and "akaka (original form: akaru) / nai" is extracted as the compound word "akanai". As a result, the word "vehicle / all / doors / inside / do not open" can be extracted from the processing reference data "All the doors of the vehicle do not open from the inside". Then, from these extracted words, a word vector shown in the "high" row of Table 1 below is generated for classifying the input data as "high importance".
[0044] Similarly, for "some of the doors of the vehicle cannot be opened or unlocked from the inside" classified as "medium importance", the morphological analysis function of the word extraction unit 22 extracts words by dividing them into "some of the doors of the vehicle cannot be opened from the inside, or cannot be unlocked", removes "of", "ga", "kara", "," and "or" as stop words, and extracts "cannot open" as the compound word "cannot open" and "cannot unlock" as the compound word "cannot unlock". As a result, the word "vehicle / some / door / inside / cannot open / cannot unlock" can be extracted from the processing reference data "some of the doors of the vehicle cannot be opened or unlocked from the inside". Then, from these extracted words, a word vector shown in the "medium" row of Table 1 below is generated for classifying the input data as "medium importance".
[0045] Similarly, for "Some doors of the vehicle cannot be opened from the outside or cannot be unlocked" classified as "low importance", the morphological analysis function of the word extraction unit 22 extracts words by dividing them into "Some doors of the vehicle cannot be opened from the outside, or cannot be unlocked", removes "of", "ga", "kara", "," and "or" as stop words, and extracts "cannot open" as the compound word "cannot open" and "cannot unlock" as the compound word "cannot unlock". As a result, the word "vehicle / some / doors / outside / cannot open / cannot unlock" can be extracted from the processing reference data "Some doors of the vehicle cannot be opened from the outside or cannot be unlocked". Then, from these extracted words, a word vector shown in the "low" row of Table 1 below is generated for classifying the input data as "low importance".
[0046] [Table 1]
[0047] In this way, even when the processing reference data is processed by the word occurrence extraction unit 22, the association between the extracted words and the classification references is maintained, so that each word vector can be associated with the classification references.
[0048] On the other hand, in order to generate the second rule, the classification rule generating unit 24 acquires co-occurring words extracted from the learning data from the co-occurring word extracting unit 23. When generating the second rule, the classification rule generating unit 24 extracts combinations of words with strong co-occurrence relationships from the acquired list of co-occurring words. For example, the classification rule generating unit 24 extracts combinations of words that are in the top 5 most frequently occurring words among words that appear together with a certain word in the same text data, and that are 5 words or less away from each other. The conditions for the extraction can be set appropriately within a range in which the number of combinations to be extracted does not exceed the processing limit of the information processing device 17. Then, the extracted words are arranged horizontally as word labels, and 1 is assigned to the words extracted as the combination, and 0 is assigned to the other words, to create a word vector for each combination. This process is performed for each combination, and the generated word vectors are collected into one to become the second rule.
[0049] In this embodiment, the extracted co-occurrence words are listed for each word, and the acquired co-occurrence words are extracted for each group according to the previous processing result. By extracting the co-occurrence words for each group according to the previous processing result, each word vector can be associated with the processing result. For example, if the co-occurrence words used to obtain the second rule are extracted for each group according to the severity of the vehicle defect, the generated word vector can be associated with the severity of the defect. In other words, when the input data includes information on the vehicle defect, the second rule can be used as a rule for classifying the data according to the severity of the vehicle defect.
[0050] For example, when the learning data includes data that was previously input to the information processing device 17 and classified as "high importance" by the first classification unit or the second classification unit, the classification rule generation unit 24 acquires co-occurrence words of the data classified as "high importance" from the co-occurrence words extracted by the co-occurrence word extraction unit 23. When the co-occurrence words of the data classified as "high importance" are (door, front, right side, left side, strange sound, all, does not open), the classification rule generation unit 24 extracts "door, strange sound, all, does not open" as an example of a combination of co-occurrence words. Then, the words included in this combination are arranged horizontally as word labels, and a one-row matrix is created by assigning 1 to the words included in the combination and 0 to the other words. If the combination is "door, front, strange sound, all, does not open", a one-row matrix shown in the "high" row of Table 2 below, that is, a word vector, is generated. The input data is classified as "high importance" by this word vector.
[0051] Similarly, when data previously classified as "medium importance" by the first classification unit or the second classification unit is included in the learning data, the classification rule generation unit 24 acquires co-occurrence words of the data classified as "medium importance" from the co-occurrence words extracted by the co-occurrence word extraction unit 23. When the co-occurrence words of the data classified as "medium importance" are (vehicle, both sides, door, strange sound, behind, does not open), the classification rule generation unit 24 extracts "vehicle, door, strange sound, behind, does not open" as an example of a combination of co-occurrence words. Then, from this combination, a word vector shown in the "medium" row of Table 2 below is generated. The input data is classified as "medium importance" based on this word vector.
[0052] Similarly, when data previously classified as "low importance" by the first classification unit or the second classification unit is included in the learning data, the classification rule generation unit 24 acquires co-occurrence words of the data classified as "low importance" from the co-occurrence words extracted by the co-occurrence word extraction unit 23. When the co-occurrence words of the data classified as "low importance" are (vehicle, door, difficult to open, front, strange sound, rear), the classification rule generation unit 24 extracts "door, difficult to open, strange sound, rear" as an example of a combination of co-occurrence words. Then, from this combination, a word vector shown in the "low" row of Table 2 below is generated. The input data is classified as "low importance" based on this word vector.
[0053] [Table 2]
[0054] In this way, co-occurring words are extracted for each classification result of the learning data, so that each word vector can be associated with a classification criterion. Here, a process has been described in which the first and second rules are used to classify data according to the severity of a vehicle malfunction when the input data includes information about a vehicle malfunction, but the classification criterion is not limited to the severity of the vehicle malfunction, and may be the location where the vehicle malfunction occurred, the maintenance status of the vehicle where the malfunction occurred, etc. Also, the method of generating the first and second rules described above is merely an example, and other methods may be used.
[0055] The similarity calculation unit 25 has a function of calculating the similarity between data on which the rules (i.e., one or more word vectors) generated by the classification rule generation unit 24 are based and reference data for updating the rules generated by the classification rule generation unit 24 by the rule update unit 26. In particular, the similarity calculation unit 25 of this embodiment has a function of calculating the similarity between predetermined data on which the first rule is based (i.e., processing reference data) and reference data for updating the first rule. The reference data is acquired from the first database 11 by the data acquisition unit 21. In this embodiment, the reference data may include at least one of the input data and the learning data.
[0056] The similarity calculated by the similarity calculation unit 25 is an index indicating the degree to which a certain text data overlaps with another text data, and may take a positive value within the range of 0 to 1, for example. The higher the similarity value, the more similar the text data to be compared are, and the lower the similarity value, the more dissimilar the text data to be compared are. For example, the occurrence frequency of words that appear in the processing reference data and overlap with words that appear in the reference data is calculated as the similarity. The occurrence frequency of such overlapping words can be calculated by comparing a word vector generated from the processing reference data with a word vector generated from the reference data. Specifically, the word label of the word vector generated from the processing reference data is compared with the word label attached to the reference data, and overlapping words are extracted. Then, the occurrence frequency of the extracted overlapping words is calculated as the similarity.
[0057] Here, when generating a word vector from the processing reference data, the same method as the method of generating a word vector of the first rule described above can be used, and when generating a word vector from the reference data, the same method as the method of generating a word vector of the first rule described above can be used. For example, when the reference data includes input data such as "The front door of the vehicle cannot be opened from the inside" and "All the doors cannot be opened from the outside", word vectors such as data 1 and data 2 in Table 3 below are generated through morphological analysis, removal of stop words, and extraction of compound words. Also, when the reference data includes learning data or data classified by another information processing device having a classification function similar to that of this embodiment, the co-occurrence word extraction unit 23 may extract co-occurrence words from the reference data and generate a word vector using the extracted co-occurrence words, as in the method of generating a word vector of the second rule described above. For example, when the co-occurrence words of the data classified as "high importance" are (vehicle, door, inside, does not open), the classification rule generation unit 24 extracts "door, inside, does not open" as an example of a combination of co-occurrence words, and generates a word vector such as data 3 in Table 3 below from this combination.
[0058] [Table 3]
[0059] The similarity in this embodiment is, for example, the similarity between a sentence of text data included in the predetermined processing reference data and a sentence of text data included in the reference data. The similarity is calculated from a word vector generated from the predetermined processing reference data and a word vector generated from the reference data. Specifically, the word vector generated from the predetermined processing reference data is compared with the word vector generated from the reference data, and the word label of the word vector is compared with an input value of 0 or 1 indicating the occurrence of a word corresponding to the word label. Next, it is determined whether the input value of 0 or 1 indicating the occurrence of a corresponding word in a certain word label differs or matches between the two word vectors. Then, the number of input values that match or differ is calculated as the similarity.
[0060] If the number of differences between the input values of 0 or 1 for word labels in two word vectors is small, it is understood that the two word vectors and the sentences corresponding to them are similar. On the other hand, if the number of differences between the input values of 0 or 1 for word labels in two word vectors is large, it is understood that the sentences corresponding to the two word vectors have many differences and are not similar. Note that when calculating the similarity between a word vector generated from a predetermined processing standard data and a word vector generated from reference data, the cosine similarity between the word vectors may be calculated.
[0061] Alternatively or additionally, the similarity in this embodiment may be the similarity between a word of text data included in the predetermined processing reference data and a word of text data included in the reference data. When the meaning of a word is taken into consideration, co-occurring words of the words are compared. That is, when the meaning of a word is similar to that of another word, the co-occurring words of the word are also similar to that of the other word. In this embodiment, by using a co-occurring word list extracted from corpus data as an index, the co-occurring words of a word in the corpus data can be compared with the co-occurring words of the other words to calculate the similarity of the meaning between the words. For example, the Simpson-Jaccard coefficient can be used to compare the co-occurring words of the word. The Simpson-Jaccard coefficient is an index obtained by arithmetically averaging the Jaccard coefficient and the Simpson coefficient, and is expressed by the following formula (1).
[0062]
number
[0063] Here, w1 and w2 in equation (1) represent words, Jaccard(w1,w2) is the Jaccard coefficient, and Simpson(w1,w2) is the Simpson coefficient.
[0064] Specifically, the word labels of the word vectors generated from the processing reference data are compared with the word labels of the word vectors generated from the reference data to extract overlapping words. Next, for the extracted overlapping words, a co-occurrence word list extracted from the corpus data is obtained. The co-occurrence word list is generated by the co-occurrence word extraction unit 23. Then, the Simpson-Jaccard coefficient is calculated using the overlapping words and the co-occurrence word list extracted from the corpus data.
[0065] As an example, the similarity between the word label [part, inside] of the word vector generated from the processing reference data and the word label [left, inside] of the word vector generated from the reference data is calculated as the Simpson-Jaccard coefficient. If it is known from the co-occurrence word list extracted from the corpus data that the similarity between [part] and [left] is 0.7, and the similarity between [inside] and [inside] is 0.9, the Simpson-Jaccard coefficient in this case is (0.7+0.9) / 2=0.8, and a similarity of 0.8 is calculated as the average similarity. Note that the similarity between completely matching words is calculated as 1.
[0066] In this way, by considering the similarity of the meanings of the word labels (i.e., the similarity between words) in addition to the similarity of the input values of the word vectors (i.e., the similarity between sentences of the text data), the similarity between the predetermined processing reference data and the reference data can be calculated more accurately. For example, if the word vector generated from the processing reference data is [door, inside, does not open] and the word vector generated from the reference data is [door, outside, does not open], the number of differences in the input values of the word vectors is 1, so the similarity between the two word vectors as sentences of the text data is calculated to be high. However, since the word labels [inside] and [outside] have opposite meanings, when the meanings of the words are also taken into account, the similarity between the two word vectors is calculated to be low.
[0067] As another method of calculating the similarity, the similarity calculation unit 25 may compare the word labels of the word vectors generated from the processing reference data with the word labels of the word vectors generated from the reference data, and calculate the similarity between all words appearing in the text data of the processing reference data and all words appearing in the text data of the reference data. The similarity between words is calculated using the above-mentioned Simpson-Jaccard coefficient or the like. In this case, a co-occurrence network may be generated using the word labels of the processing reference data and the word labels of the reference data to calculate the similarity. By extracting co-occurrence words using the co-occurrence network, words that are highly similar to each other among words appearing in two pieces of text data can be extracted.
[0068] Furthermore, the similarity calculation unit 25 may extract sentences (i.e., word vectors) of the text data of the reference data that are similar to sentences (i.e., word vectors) of the processing reference data based on the extracted co-occurring words. In addition, the similarity of the extracted reference data word vectors to the word vectors of the processing reference data may be calculated. This makes it possible to efficiently extract word vectors with high similarity when at least one of the reference data and the processing reference data includes multiple data.
[0069] The rule update unit 26 has a function of updating the rule for classifying the input data in the input data classification unit 27 by using the reference data. Specifically, the rule update unit 26 has a function of updating the first rule by using the reference data whose similarity calculated by the similarity calculation unit 25 is equal to or greater than a predetermined value. The predetermined value can be set to an appropriate value according to the method of calculating the similarity. For example, when the number of matches between the processing reference data, the word vector, and the word vector value (0 or 1) of the reference data is calculated as the similarity, the predetermined value is set to 3, and reference data whose number of matches is 3 or more is used. Alternatively, when the number of differences between the processing reference data, the word vector, and the word vector value (0 or 1) of the reference data is calculated as the similarity, reference data whose number of differences is 3 or less may be used. Furthermore, when the Simpson-Jaccard coefficient of the word label of the processing reference data and the word label of the reference data is calculated as the similarity, the predetermined value is set to 0.6, and reference data whose similarity is 0.6 or more is used.
[0070] In addition, when the similarity between a sentence of text data included in the predetermined processing reference data and a sentence of text data included in the reference data, and the similarity between a word of text data included in the predetermined processing reference data and a word of text data included in the reference data are calculated, the reference data having either one of the similarities equal to or greater than a predetermined value may be used, or only the reference data having both similarities equal to or greater than a predetermined value may be used. For example, the rule update unit 26 may use reference data having a difference in the number of values (0 or 1) between the word vector of the processing reference data and the word vector of the reference data of 3 or less, and having a Simpson-Jaccard coefficient of 0.6 or more between the word label of the processing reference data and the word label of the reference data.
[0071] Updating the first rule using reference data means, for example, extracting from the reference data those similar to the processing reference data that is the basis of the first rule, and adding the extracted reference data to the processing reference data in association with it. Specifically, the word vectors of the reference data are compared with the word vectors of the processing reference data, and those word vectors of the reference data that have a similarity to the word vectors of the processing reference data that is equal to or greater than a predetermined value are extracted. Then, in the first rule, the word vectors of the extracted reference data are inserted below the word vectors of the processing reference data.
[0072] For example, suppose that the word vector shown in the "High" row of Table 1 is generated for the classification criterion "All vehicle doors cannot be opened from the inside" that classifies input data as "high importance," and then the word vector corresponding to the data "All vehicle doors cannot be opened" shown in Table 4 below is extracted from the word vectors of the reference data. "High importance" is associated with this word vector as the importance of the defect.
[0073] [Table 4]
[0074] In this case, the rule update unit 26 inserts the word vector shown in Table 4 below under the word vector in the row of "high" in the first rule, as shown in Table 5 below. The inserted word vector is a word vector added by the rule update unit 26, and is inserted with, for example, "(high)" in parentheses to indicate that it is associated with "high."
[0075] [Table 5]
[0076] In this way, the rule update unit 26 can increase the number of word vectors that make up the first rule, thereby increasing the number of input data that can be classified by the first rule while suppressing a decrease in data processing accuracy caused by changing the rules for classifying input data. Furthermore, the rule update unit 26 does not necessarily need to increase the word vectors constituting the first rule, and may, for example, replace the word vectors constituting the first rule with word vectors of reference data having a similarity equal to or greater than a predetermined value.
[0077] Moreover, the rule update unit 26 has a function of learning a second rule using data classified by a first classification unit 27a (described later) according to not only the first rule but also the updated first rule. Specifically, the data input to the first classification unit 27a is associated with the classification result and stored as learning data in the second database 12. This feedback changes the co-occurrence words extracted by the co-occurrence word extraction unit 23, and the second rule generated by the classification rule generation unit 24 is learned to perform classification according to a predetermined classification criterion.
[0078] Furthermore, the rule update unit 26 may generate new rules using word vectors of reference data having a similarity equal to or greater than a predetermined value. In particular, new rules may be generated using co-occurrence words that appear at a frequency equal to or greater than a predetermined frequency together with the words included in the first rule, extracted from reference data having a similarity equal to or greater than a predetermined value. Specifically, the similarity calculation unit 25 generates a co-occurrence network using word labels of the processing reference data and the reference data, and when co-occurrence words are extracted, combines the co-occurrence words to generate word vectors similar to the word vectors of the processing reference data. This makes it possible to further increase the number of first rules.
[0079] The input data classification unit 27 has a function of classifying data input by the input device 11a according to a rule. In particular, the input data classification unit 27 of this embodiment includes a first classification unit 27a that classifies the input data according to the first rule updated by the function of the rule update unit 26, and a second classification unit 27b that classifies the input data according to the second rule. As described above, the first rule associates a word vector with a classification criterion, and the second rule associates a word vector with a previous processing result. Therefore, the first classification unit 27a compares the word vector of the input data with the word vector of the first rule, and if the similarity is equal to or greater than a predetermined value, the input data can be classified according to the associated classification criterion. Similarly, the second classification unit 27b compares the word vector of the input data with the word vector of the second rule, and if the similarity is equal to or greater than a predetermined value, the input data can be classified according to the associated previous processing result.
[0080] In the input data classification unit 27 of this embodiment, if there is a word vector of the input data that matches the word vector constituting the first rule, the data is classified according to the first rule. On the other hand, if there is a word vector of the input data that does not match the word vector constituting the first rule, the data is classified according to the second rule. For example, when the input data includes information on a malfunction of a vehicle, the input data is classified into three or more groups (for example, three groups of high importance, medium importance, and low importance) according to the importance of the malfunction of the vehicle, if the word vector of the input data matches the first rule, the data is classified by the first classification unit 27a, and if the word vector of the input data does not match the first rule, the data is classified by the second classification unit 27b. This makes it possible to avoid classifying data twice according to the updated first rule and the second rule, and to shorten the processing time in the information processing device 17.
[0081] The display image generating unit 28 has a function of generating an image to be displayed on the display device 16 to notify the user of the processing status of the input data. The image generated by the display image generating unit 28 may indicate the progress of the processing or the processing result, and may include, for example, at least one of the similarity calculated by the similarity calculating unit 25, the reference data having a similarity equal to or greater than a predetermined value, the updated first rule, and the updated portion of the updated first rule.
[0082] Fig. 2 is a diagram showing an example of an image displayed on the display device 16 of Fig. 1. The image shown in Fig. 2 is an image displayed on the display device 16 when input data, including information on a vehicle malfunction, is classified into three groups, i.e., high importance, medium importance, and low importance, according to the importance of the vehicle malfunction. Fig. 2(A) is a first display image 3 showing the classification result of the input data, Fig. 2(B) is a second display image 4 showing the update result of the first rule and the calculation result of the similarity, and Fig. 2(C) is a third display image 5 showing the result when co-occurring words are extracted and an overview of the extraction process.
[0083] In the first display image 3 of FIG. 2(A) showing the classification result, "input data" is displayed in the upper left of the image. A plurality of pieces of input data may be input, and in that case, all the data can be confirmed by scrolling the screen using the triangular icon shown in the lower right of the input data. In the upper right of the image, the classification result of the input data is displayed, and it is displayed that the input data of FIG. 2(A) has been classified as "medium importance". In the lower left of the image, "rule-based model" is displayed as the "classification method", which indicates that the classification has been performed according to the updated first rule by the first classification unit 27a, and the applied rule is displayed in the lower right of the image. In addition, when classification has been performed by the second classification unit 27b, "machine learning model" is displayed in the lower left of the image.
[0084] In the second display image 4 of FIG. 2(B), which shows the update result and the similarity, the extracted "reference data" is displayed in the upper left of the image, and the extracted sentence is displayed below it as "extracted sentence". If co-occurrence words are extracted, the combination of co-occurrence words is displayed as a "keyword list" in the upper right of the image. For the "reference data" and "keyword list", all data can be confirmed by scrolling the screen using the triangular icon. At the bottom of the image, the classification result of the input data is displayed in the lower left as the "rule update result", and the first rule that was applied is displayed to the right of it. Then, in the lower right of the image, a sentence similar to the applied first rule that was extracted from the reference data is displayed. In the case of FIG. 2(B), "There is a strange sound coming from the left rear door" has a higher similarity than "There is a strange sound coming from the right front door", so "There is a strange sound coming from the left rear door" is added to the first rule.
[0085] In the third display image 5 in FIG. 2(C), which shows the results of co-occurrence word extraction, "reference data" is displayed on the right side of the image, and the generated co-occurrence network is displayed below that. Also, on the left side of the image, a "keyword list" is displayed showing the combinations of extracted co-occurrence words and "extraction conditions." The "extraction conditions" displayed include "word occurrence count," which indicates the frequency of word occurrence, and "co-occurrence threshold," which indicates the distance between words. Note that the displayed extraction conditions are merely examples, and other conditions can be displayed as necessary.
[0086] The data output unit 29 has a function of outputting the image data generated by the display image generation unit 28 to the display device 16. This allows an image to be displayed on the display device 16, making it possible to notify the user of the information processing system 1 of the processing status of the input data.
[0087] [Processing in information processing systems] The procedure for information processing device 17 to process information will be described with reference to Fig. 3. Fig. 3 is an example of a flowchart showing information processing in information processing system 1 of the present embodiment. The process described below is executed by processor 18 of information processing device 17 at predetermined time intervals.
[0088] First, in step S1, the data acquisition unit 21 acquires necessary data from each of the first database 11 to the fourth database 14. In the following step S2, the occurrence word extraction unit 22 extracts words used in the data acquired by the data acquisition unit 21 using a morphological analysis tool or the like. For example, from the data "all doors do not open from the inside", the words "vehicle / all / doors / inside / do not open" are extracted through morphological analysis, stop word deletion, and compound word extraction. In the following step S3, the co-occurrence word extraction unit 23 generates a co-occurrence network and extracts co-occurrence words, particularly for words extracted from the learning data, the processing reference data, and the corpus data. In the following step S4, the classification rule generation unit 24 generates a first rule using the words extracted from the processing reference data, and generates a second rule using the co-occurrence words extracted from the learning data.
[0089] Next, in step S5, the function of the similarity calculation unit 25 is used to calculate the similarity between the specified data on which the first rule is based and the reference data. Specifically, the word vectors of the processing reference data are compared with the word vectors of the reference data, and the number of overlaps of the word vectors, the similarity of the meanings of the words corresponding to the word labels, etc. are calculated as the similarity. In the following step S6, the function of the rule update unit 26 is used to update the first rule using reference data having a similarity equal to or greater than a predetermined value, and a new rule is added. In the following step S7, it is determined whether the input data can be classified according to the updated first rule.
[0090] If the word vectors of the input data match those of the first rule and it is determined that the data can be classified according to the updated first rule, the process proceeds to step S8a, where the first classification unit 27a classifies the data according to the updated first rule. On the other hand, if the word vectors of the input data do not match those of the first rule and it is determined that the data cannot be classified according to the updated first rule, the process proceeds to step S8b, where the second classification unit 27b classifies the data according to the second rule.
[0091] The results of these classification processes are processed in the following step S9, and an image to be displayed on the display device 16 is generated by the function of the display image generation unit 28. The generated image is output to the display device 16 by the function of the data output unit 29 in the following step S10. The image output from the data output unit 29 is then displayed on the display device 16, and the processing result is notified to the user of the information processing system 1. Furthermore, in step S11, the classification result of the first classification unit in step S8a is fed back to the learning data by the function of the rule update unit 26, and a second rule is learned.
[0092] [Embodiments of the present invention] As described above, the information processing device 17 of the present embodiment includes a similarity calculation unit 25 that calculates a similarity between predetermined data used when generating a first rule for classifying input data and reference data for updating the first rule, a rule update unit 26 that updates the first rule using the reference data in which the similarity calculated by the similarity calculation unit 25 is equal to or greater than a predetermined value, and an input data classification unit 27 that classifies the input data using the updated first rule and a second rule that is different from the first rule and has been learned by machine learning using learning data. This makes it possible to prevent a decrease in data processing accuracy caused by changing the rule for classifying input data, while avoiding double classification of data using the updated first rule and the second rule, thereby shortening the processing time in the information processing device 17.
[0093] According to the information processing device 17 of the present embodiment, the similarity is a similarity between a sentence of text data included in the predetermined data and a sentence of text data included in the reference data, and / or a similarity between a word of text data included in the predetermined data and a word of text data included in the reference data. This makes it possible to more accurately calculate the similarity between the predetermined processing reference data and the reference data.
[0094] According to the information processing device 17 of the present embodiment, the learning data includes data that was previously input and classified by the input data classification unit. This makes it possible to update the first rule and learn the second rule using the past input data, thereby further improving classification accuracy.
[0095] According to the information processing device 17 of the present embodiment, the reference data includes at least one of the input data and the learning data. This makes it possible to update the first rule and learn the second rule using the input data, thereby further improving classification accuracy.
[0096] Furthermore, according to the information processing device 17 of this embodiment, the rule update unit 26 learns the second rule by using the data classified by the input data classification unit 27 according to the updated first rule. This promotes learning of the second rule.
[0097] Moreover, according to the information processing device 17 of this embodiment, the updated first rules include new rules generated by the rule update unit 26 using the reference data whose similarity is equal to or greater than a predetermined value. This makes it possible to further increase the number of first rules.
[0098] Moreover, according to the information processing device 17 of this embodiment, the updated first rules include new rules generated using words that appear with a frequency equal to or higher than a predetermined frequency together with the words included in the first rules, which are extracted from the reference data. This makes it possible to further increase the number of first rules.
[0099] Moreover, the information processing device 17 of this embodiment further includes a display device 16 that displays at least one of the similarity, the reference data whose similarity is equal to or greater than a predetermined value, the updated first rule, and the updated part of the updated first rule. This makes it possible to notify the user of the information processing system 1 of the processing status of the input data.
[0100] According to the information processing method of the present embodiment, when input data is classified using a first rule generated from predetermined data and a second rule different from the first rule and learned by machine learning using learning data, the similarity between the predetermined data and reference data for updating the first rule is calculated, the first rule is updated using the reference data whose similarity is equal to or greater than a predetermined value, and the input data is classified using the updated first rule and the second rule. This makes it possible to prevent a decrease in data processing accuracy caused by changing the rule for classifying input data, while avoiding double classification of data using the updated first rule and the second rule, thereby shortening the processing time in the information processing device 17. [Explanation of symbols]
[0101] 1. Information processing system 11...First database (input data) 11a…Input device 12…Second database (learning data) 12a…Server 13...Third database (processing standard data) 14…Fourth database (corpus data) 15...Communication equipment 16...Display device 17...Information processing device 18…Processor 181…CPU 182...ROM 183…RAM 2...Input data processing section 21…Data acquisition section 22... Word extraction section 23...Collocation word extraction section 24...Classification rule generation unit 25…Similarity calculation unit 26…Rules Update Department 27...Input data classification section 27a…1st classification part 27b…Second classification section 28...Display image generating unit 29...Data output section 3…First display image 4...Second display image 5…Third display image
Claims
1. A similarity calculation unit which calculates a similarity indicating the degree of overlap between processing standard data, which is text data indicating classification criteria for classifying input data according to importance, and reference data for updating the first rule, which includes at least one of the input data and learning data, which is text data including the input data with the importance associated therewith, and which is a similarity indicating the frequency of occurrence of words that overlap with words that appear in the reference data among words that appear in the processing standard data used when generating the first rule; and a rule update unit that updates the first rule by using the reference data in which the similarity calculated by the similarity calculation unit is equal to or greater than a predetermined value; an input data classification unit that classifies the input data using the updated first rule and a second rule that is different from the first rule and that has been learned by machine learning using the learning data, An information processing device, wherein the first rule updated by the rule update unit includes new rules extracted from the reference data and generated using co-occurring words that appear together with the words included in the first rule with a frequency equal to or greater than a predetermined frequency.
2. 2. The information processing device according to claim 1, wherein the similarity is the similarity between a sentence of the text data included in the processing reference data and a sentence of the text data included in the reference data, and / or the similarity between a word of the text data included in the processing reference data and a word of the text data included in the reference data.
3. The information processing device according to claim 1 , wherein the rule update unit learns the second rule by using data classified by the input data classifying unit in accordance with the updated first rule.
4. The information processing device according to claim 1 , wherein the updated first rule includes a new rule generated by the rule update unit using the reference data whose similarity is equal to or greater than a predetermined value.
5. 5. The information processing device according to claim 1, further comprising a display device that displays at least one of the similarity, the reference data for which the similarity is equal to or greater than a predetermined value, the updated first rule, and an updated portion of the updated first rule.
6. An information processing method executed by an information processing device that classifies input data, which is text data written in a natural language, using a first rule generated from processing standard data, which is text data indicating classification standards for classifying the input data according to importance, and a second rule learned by machine learning using learning data, which is text data different from the first rule and includes the input data with which the importance is associated, The information processing device includes: calculating a similarity indicating a degree of overlap between the processing reference data and reference data for updating the first rule, the reference data including at least one of the input data and the learning data, the similarity being an occurrence frequency of words that appear in the processing reference data used when generating the first rule and that overlap with words that appear in the reference data; updating the first rule using the reference data whose similarity is equal to or greater than a predetermined value; classifying the input data using the updated first rule and the second rule; An information processing method, wherein the updated first rule includes a new rule extracted from the reference data and generated using co-occurring words that appear together with the words included in the first rule with a frequency equal to or greater than a predetermined frequency.
Citation Information
Patent Citations
Device, method and program for preparing database in which phrase included in document classified by category
JP2010198141A
Conversation summary generation system and conversation summary generation program
JP2013167985A
Information processing device, method and program
JP2015153013A
Learning program, learning method and learning device
JP2019139534A
System And Method For High Accuracy Product Classification With Limited Supervision
US20140297570A1