DATA REGISTRATION PROCESSING METHOD, DATA REGISTRATION PROCESSING PROGRAM AND DATA REGISTRATION PROCESSING APPARATUS

Abstract

To estimate the meaning of a text document to improve retrieval accuracy of a database which stores the text document.SOLUTION: A data registration processing apparatus 100 estimates the meaning of an input text document for retrieval output. The data registration processing apparatus 100 includes a knowledge table 102 formed by associating a word, a sentence including the word, and an attribute of the word. A control unit 101 extracts a meaningful word registered on the knowledge table 102, on the basis of the sentence including the word, from a text document of an input interaction sentence 150. Word groups of extracted words are rearranged in a determined order of nine attributes of 5W2H and action / state, to generate a summary sentence 180 composed of the rearranged word groups. The generated summary sentence 180 is recorded on a database in association with the text document, thereby improving accuracy of subsequent database retrieval.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a data registration processing method, a data registration processing program, and a data registration processing device. [Background technology]

[0002] There are systems that estimate dialogue and support operations based on this dialogue. For example, a system can be applied to support operations by estimating the dialogue between a caller who made a call from an emergency phone on the side of a highway and a controller who receives the call, and displaying the relevant page of an accident response manual to the controller. In such various types of operational support, there is a demand to create a database of the dialogue between the two parties, generate sentences such as summaries suitable for carrying out operations based on the dialogue, and use them for searches.

[0003] As a technology for generating summaries from such dialogue, for example, there is a technology that uses semantic search to extract word concatenation patterns from conversation data and creates summaries by pattern matching with summary templates. There is also a technology that estimates the type of conversation, extracts parts of the conversation as key points, and uses them as search targets. There is also a technology that takes discourse data as input, and outputs flow information consisting of the correspondence between statements of expressions that match a flow expression and flows as discourse semantics. Note that attributes are assigned to extracted words based on a dictionary in which words and labels have a 1:1 correspondence, for example, attribute labeling of words based on the 5W2H, etc. has become common. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2014-130613 A [Patent Document 2] International Publication No. 2020 / 036190 [Patent Document 3] JP 2011-134291 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional technologies have not been able to improve the accuracy of searching for documents such as necessary summaries from dialogues. Dialogue databases record the text of the dialogues, and contain words that become noise during searches. For this reason, when searching existing databases, there are cases where the desired information is not found due to the difference in the amount of text between the search keywords and the searched sentences, making it impossible to improve search accuracy.

[0006] Traditionally, semantic search has had two problems: 1) when there is a large difference in the amount of text in the search sentence and the sentence to be searched, and 2) when searching for an overview that is not the full text, such as in a web search.

[0007] 1. When there is a large difference in the amount of text between the search text and the text to be searched, many users are accustomed to keyword searches and often only search using keywords or short sentences. Generally, the text to be searched, such as in a manual search, is often long. On the other hand, the search text is often short, and unusual words contained in the search text have a large effect on the search results. Even if the text to be searched contains a text that is very similar in terms of semantics and grammar, in the distributed representation of the text used in the search, other texts become noise, making it difficult to obtain search results with a high degree of similarity. For example, a text (search text) that is very similar to the search text may be buried in other texts and not be found. The degree of similarity can be obtained from the number of matching words in a document, the distance between words in a document, etc. In this regard, it is desirable to realize a search that is independent of the amount of text in the text to be searched.

[0008] 2. Regarding summary searches that do not include the full text of a searched sentence, such as those in web searches, general search sites do not look at the full text of the searched sentence, so search results that meet the search request cannot be obtained. Search accuracy differs depending on the content creator (searched site).

[0009] In addition, there have been problems with the method of estimating the meaning of a sentence by analyzing the sentence and calculating the meaning from the sentence structure. This method itself can quantify the meaning of a sentence, so it is useful for comparing sentences, and in recent years, methods using deep learning for syntactic analysis (such as Google's BERT and related methods ALBERT and XLNet) have been published, improving the accuracy. However, at present, it is not possible to know the meaning of a target sentence from these numerical values ​​or vector values, and it is not possible for a computer to understand the meaning.

[0010] In one aspect, the present invention aims to estimate the meaning of a text document and improve the accuracy of searching a database in which the text document is recorded. [Means for solving the problem]

[0011] According to one aspect of the present invention, in a data registration process that infers semantic information contained in an input text document and searches and outputs it, the data registration process requires the following steps: extracting from the text document a word that is registered in a knowledge table in which a word, a sentence containing the word, and attributes of the word are associated with each other based on a sentence containing the word; rearranging a group of the extracted multiple words in a predetermined order of the attributes; creating a summary consisting of the rearranged group of words; and recording the summary in a database in association with the text document. Effect of the Invention

[0012] According to one aspect of the present invention, it is possible to estimate the meaning of a text document and improve the accuracy of searching a database in which the text document is recorded. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram for explaining an outline of the data registration process according to the present invention. [Diagram 2] FIG. 2 is a diagram showing the overall configuration of a search system including a data registration processing device according to an embodiment. [Diagram 3] FIG. 3 is a functional block diagram of a search system including a data registration processing device. [Figure 4] FIG. 4 is a diagram illustrating an example of a hardware configuration of the data registration processing device. [Diagram 5] FIG. 5 is an explanatory diagram of the process flow for each function of the data registration processing device. (Part 1) [Figure 6] FIG. 6 is an explanatory diagram of the process flow for each function of the data registration processing device. (Part 2) [Figure 7] FIG. 7 is an explanatory diagram of the process flow for each function of the data registration processing device (part 3). [Figure 8] FIG. 8 is a diagram showing the data structure of the knowledge table. [Figure 9] FIG. 9 is a diagram showing a specific example of the knowledge table. [Figure 10A] FIG. 10A is a diagram showing search targets and label classification for knowledge data. [Figure 10B] FIG. 10B is a diagram showing search targets and label classification for knowledge text. [Figure 11] FIG. 11 is an explanatory diagram of data modeling of basic knowledge. [Figure 12] FIG. 12 is a chart showing specific examples of basic knowledge. [Figure 13] FIG. 13 is an explanatory diagram of an example of using basic knowledge search. [Figure 14] FIG. 14 is an explanatory diagram of an example of label extraction from a business document and knowledge data label creation. [Figure 15] FIG. 15 is an explanatory diagram of an example of automatic labeling and summary creation for a business document. [Figure 16A] FIG. 16A is an explanatory diagram showing an example of a linking order for creating an overview. (Part 1) [Figure 16B] FIG. 16B is an explanatory diagram showing an example of the join order for creating an overview. (Part 2) [Figure 17] FIG. 17 is a flowchart of an example of the overall process of creating knowledge data. [Figure 18A]FIG. 18A is a flowchart of an example of knowledge data label creation. (Part 1) [Figure 18B] FIG. 18B is a flowchart of an example of knowledge data label creation. (Part 2) [Figure 18C] FIG. 18C is a diagram showing an example of a word dictionary. [Figure 19] FIG. 19 is a flowchart of an example of creating an overview. [Figure 20A] FIG. 20A is a flowchart of an example of semantic label creation. (Part 1) [Figure 20B] FIG. 20B is a flowchart of an example of semantic label creation. (Part 2) [Figure 21] FIG. 21 is an explanatory diagram showing an example of how an overview is used by a business application. [Figure 22] FIG. 22 is a process flowchart showing an example of how an overview is used by a business application. [Diagram 23] FIG. 23 is a diagram showing an example of using a business application based on a dialogue. (Part 1) [Figure 24] FIG. 24 is a diagram showing an example of using a business application based on a dialogue. (Part 2) DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, with reference to the drawings, embodiments of the disclosed data registration processing method, data registration processing program, and data registration processing device will be described in detail.

[0015] Fig. 1 is a diagram for explaining an outline of the data registration process according to the present invention. The computer that performs the data registration process according to the embodiment does not understand the meaning of a sentence by structural analysis that performs numerical calculations, but imitates human thinking. In the data registration process according to the embodiment, the meaning of a sentence is estimated using natural language sentence search and sentence classification.

[0016] For example, by defining the structure of a searched sentence and searching a database for the searched sentence with a label of the meaning contained within the sentence, the meaning of the sentence is inferred from the labels of the searched sentence and the searched sentence is labeled. Furthermore, a summary is created from the searched sentence. The summary is registered in the database together with the searched sentence and becomes the target of future searches.

[0017] The main text structure of this summary is defined as consisting of nine types of attribute text, consisting of 5W2H, actions, and states, and a summary is automatically generated from a long searched text such as a dialogue using labels. 5W2H are Who, When, Where, What, Why, How, and How much.

[0018] 1 includes a control unit 101 and a knowledge table 102. The knowledge table 102 holds associations between words, sentences containing the words, and attributes (5W2H+action / state).

[0019] The control unit 101 performs the following processes 1 to 3. 1. From the text document (searched sentence) to be analyzed, words registered in the knowledge table 102 are extracted based on sentences containing the words. 2. Rearrange the extracted words in a predetermined order based on the attributes, and generate a summary in natural language. 3. The summary consisting of the rearranged groups of words is associated with the text document (the text to be searched) and recorded in a database for use in future searches.

[0020] FIG. 1 shows an example of telephone response / handling work (control work) at a call center that receives calls from emergency phones on an expressway. Dialogue text 150 is a text document (searched text) of a conversation between a caller (speaker B) who reports a vehicle breakdown on the expressway and a controller (speaker A) who receives the call. Here, in a call (telephone call) between the caller and the controller, the caller is calling from a remote location and the call quality is often poor due to noise from other vehicles on the road. The controller also repeats the words spoken by the caller with clear pronunciation. This makes it possible to improve the accuracy of voice recognition by converting only the voice of the controller (speaker A) into text.

[0021] Then, the control unit 101 performs a search using, as a search sentence, a text sentence obtained by speech recognition processing of words uttered by a controller (speaker A) from among the dialogue sentences 150. During this search, the control unit 101 extracts words registered in the knowledge table 102 and assigns a semantic label La to the words included in the search sentence. The knowledge table 102 holds a large number (1:N) of words that are expected in advance in dialogues during air traffic control work, each of which is given a semantic label indicating a representative meaning. For example, when the word is a specific car name XX, N automobiles and car names are held in association with each other as the semantic label of one car name XX.

[0022] 1, the control unit 101 refers to the knowledge table 102 and extracts the semantic label La of the word "breakdown" from the text document of the controller (speaker A) saying "Oh, it's a breakdown" in the dialogue 150. The semantic label La is recorded (in a knowledge text table 803 described later) as knowledge text associated with the text sentence.

[0023] Next, the control unit 101 generates a summary 180 from the entire dialogue 150. At this time, the control unit 101 refers to the knowledge table 102, rearranges the extracted words in the order of their attributes, and generates the summary 180 equivalent to natural language. The attributes include, for example, 5W2H and actions / states, and the words (text sentences corresponding to the semantic label La) are rearranged in the order of the predetermined attributes.

[0024] The knowledge data (knowledge data label) Lb shown in Figure 1 associates 5W2H + actions / states with words. The order of 5W2H in the illustrated knowledge data label Lb is When, Where, Who, What, Why, How, How much, state, and action from the top. Here, the attribute of the word "light truck" in the knowledge data label Lb is "What."

[0025] Then, the control unit 101 mechanically combines the words obtained by rearranging the 5W2H and action / state attributes in a predetermined order to create the summary sentence 180. The order in which the attributes are combined is an order suited to the business content, in the above example, the business performance of the call center control business (controller A).

[0026] The control unit 101 notifies the controller performing control operations of the summary 180, and the controller can immediately present the necessary measures, etc. to the caller in accordance with the summary 180 notified by the control unit 101.

[0027] Here, since summary 180 is extracted by estimating the meaning of dialogue 150, the controller can easily read summary 180, which is useful for processing, without having to reread the entire lengthy dialogue 150. This allows the controller to easily use summary 180 to search for a manual to be presented to the caller, or to input items required for creating a ledger for each caller in the call center control operations, thereby enabling the call center control operations to be performed efficiently.

[0028] As a result, according to the embodiment, the dialogue can be summarized as a summary of a group of words with normalized word order, and the search accuracy of a database in which summaries are recorded in association with dialogue text documents can be improved. When searching for a searched sentence (text document), a summary with a word order regulated by attributes is searched for, which reduces the variation in the amount of text between the search keywords and the searched sentence, and improves the search accuracy rate.

[0029] Here, the data registration process of the embodiment responds to the following requests from users (e.g., the controllers mentioned above) and system developers. Users request that they be able to use various types of text searches. For example, they want to find semantically similar text from within a full text (a document with a large amount of text, such as a manual). They want to find a chapter / section that is closest to the summary or main points of the chapter / section. They want to use a search engine in a way that "humans unconsciously draw out knowledge."

[0030] The system builders are requesting a data structure that meets the above user requirements. To this end, we are responding to requests such as structuring data suitable for searches, automating the labeling required for inference, realizing a method for inferring the meaning of a search statement using a search, executing a search using a data structure, and utilizing the search results that infer the meaning of a statement on the application side.

[0031] Fig. 2 is an overall configuration diagram of a search system including a data registration processing device according to an embodiment. Fig. 2 shows an example of the control work of the call center as a specific example of the system. Controller A accepts a call from informant B who is calling from an emergency phone or the like. The work support PC 201 is operated by controller A and presents information for responding to informant B.

[0032] The dialogue between controller A and caller B is acquired by telephone voice acquisition device 202, and the dialogue is converted into a dialogue (text document) by voice acquisition PC 203, and recorded in processing server 204. In the illustrated example, voice acquisition PC 203 is configured to transfer the dialogue voice to speech-to-text server 205, and acquire a text document (dialogue text) of the voice corresponding to the dialogue voice from speech-to-text server 205. Speech-to-text server 205 may be configured using server 205a for speech recognition and server 205b for speech learning.

[0033] The processing server 204 corresponds to the data registration processing device 100 shown in Fig. 1. Controller A makes a request to the processing server 204 to search for knowledge required for the business, and the processing server 204 responds to the business support server 206 with knowledge information on various business operations corresponding to the knowledge search request. For example, during knowledge search, the processing server 204 generates a summary from the dialogue based on the above knowledge table 102, and outputs it to the business support server 206. The processing server 204 also outputs to the business support server 206 a dialogue text obtained by correcting a text document corresponding to the dialogue.

[0034] The operation support server 206 performs operation management processing by executing operation applications required for the control operations performed by controller A, and outputs an operation management screen 210 to controller A's operation support PC 201. The above system converts the contents of the call between controller A and informant B into text in real time. Controller A can perform control operations while making a call in real time based on the text document of the dialogue and the summary text displayed on the operation management screen 210 displayed on the operation support PC 201.

[0035] Fig. 3 is a functional block diagram of a search system including a data registration processing device. Each function corresponding to the system configuration of Fig. 2 is shown. The function of the processing server 204 will be mainly explained.

[0036] The processing server 204 has a voice data control unit 301, a knowledge search engine 302, a knowledge data conversion unit 303, and a knowledge database 304. The control functions of the processing server 204 (the knowledge search engine 302, the knowledge data conversion unit 303, etc.) correspond to the control unit 101 shown in Fig. 1. The knowledge database 304 includes the knowledge table 102 shown in Fig. 1.

[0037] The voice data control unit 301 acquires dialogue (text document) equivalent to a real-time dialogue from the voice capture PC 203 , and outputs it to the knowledge data conversion unit 303 .

[0038] The knowledge data conversion unit 303 assigns a label to the dialogue (searched sentence) to enable inference of meaning. As described above, the knowledge data conversion unit 303 generates a summary from the dialogue (searched sentence) and records it in the knowledge database 304 as knowledge data.

[0039] The knowledge search engine 302 performs processing related to searching for dialogues. The knowledge search engine 302 performs search processing etc. with dialogues (mainly summary sentences) recorded in the knowledge database 304 as searched sentences based on a search model 320 corresponding to a business application of the business support server 206. Then, the knowledge search engine 302 outputs the search results to the business application (business management screen 210) of the business support server 206. The search model 320 is created by a knowledge learning model creation unit 321, which creates and replaces other models (road model, police model, fire model in FIG. 1) according to the business content of the client who has introduced the system.

[0040] 3, the voice data control unit 301 converts the entire dialogue into text and outputs the data-formatted corrected text (full text) to the source data recording unit 310. The data formatting is performed using a correction dictionary recorded in the knowledge database 304. The source data recording unit 310 records the corrected text (full text) in the knowledge database 304.

[0041] The knowledge database 304 has a relational database (RDB) structure. The knowledge data conversion unit 303 improves search accuracy by organizing the data structure of the knowledge database 304 into a data structure suitable for searching dialogue sentences (searched sentences), thereby enabling searches to be performed that are not dependent on the amount of text in the entire dialogue sentences. For example, the knowledge data conversion unit 303 generates data such as the title, characteristic sentence, summary sentence, full text, etc. for each dialogue sentence (searched sentence).

[0042] Knowledge for generating summaries is set and stored in advance in the knowledge table 102 of the knowledge database 304. This knowledge is a group of information consisting of multiple texts and semantic labels. Using the knowledge table 102, the knowledge search engine 302 is able to search summaries as well as texts. For example, the business application (business management screen 210) of the business support server 206 performs search processes such as short sentence search other than text, title search, characteristic sentence search, and summary search.

[0043] The processing server 204 also has a function of a health monitoring unit 331 that performs a health check on each function, and a maintenance unit 332 for the knowledge database 304. It also has a function of a knowledge data management unit 333 that archives the knowledge data in the knowledge database 304.

[0044] Fig. 4 is a diagram showing an example of the hardware configuration of the data registration processing device. The data registration processing device 100 (processing server 204) shown in Fig. 2 and Fig. 3 can be configured with a general-purpose server or the like made up of the hardware shown in Fig. 4.

[0045] The data registration processing device 100 includes a CPU (Central Processing Unit) 401, a memory 402, a network interface (IF) 403, a recording medium IF 404, and a recording medium 405. Reference numeral 400 denotes a bus that connects each unit.

[0046] The CPU 401 is an arithmetic processing device that functions as a control unit that controls the entire data registration processing device 100. The memory 402 includes a non-volatile memory and a volatile memory. The non-volatile memory is, for example, a ROM (Read Only Memory) that stores the program of the CPU 401. The volatile memory is, for example, a DRAM (Dynamic Random Access Memory) or an SRAM (Static Random Access Memory) that is used as a work area for the CPU 401.

[0047] The network IF 403 is a communication interface for a network NW such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet. The data registration processing device 100 is communicatively connected to the network NW via the network IF 403. For example, the data registration processing device 100 is communicatively connected to an external device, such as the voice capture PC 203 and the business support server 206 shown in FIG. 2, via the network NW.

[0048] The recording medium IF 404 is an interface for reading and writing information processed by the CPU 401 to and from the recording medium 405. The recording medium 405 is a recording device that supplements the memory 402, and may be a hard disk drive (HDD), a solid state drive (SSD), a universal serial bus (USB) flash drive, or the like.

[0049] Each function of the data registration processing device 100 (control unit 101) is realized by the CPU 401 executing a program recorded in the memory 402 or the recording medium 405. The memory 402 and the recording medium 405 also store and hold information in a database of the data registration processing device 100, for example, the knowledge database 304 shown in Fig. 3, in an updatable manner.

[0050] 4. Furthermore, devices other than the processing server 204 shown in FIG. 2, such as the business support PC 201, the voice capture PC 203, the voice-to-text server 205, and the business support server 206, can also be configured with the same hardware as that shown in FIG.

[0051] (Data registration process by function) 5 to 7 are explanatory diagrams of the process flow for each function of the data registration processing device. Fig. 5 shows the process flow of an example of knowledge utilization of dialogue text by a business application of the business support server 206.

[0052] The voice during the dialogue is converted into text as dialogue by the voice-to-text server 205 via the voice capture PC 203. The voice data control unit 301 records the text of the dialogue (full text) in the knowledge database 304 (102) via the source data recording unit 310 as dialogue record data (full text).

[0053] Furthermore, the voice data control unit 301 transmits the text of the dialogue (full text) to the business application (business management screen) 210 of the business support server 206. The business application displays the dialogue (full text) on the business management screen 210.

[0054] Then, the business application requests the knowledge search engine 302 of the processing server 204 to perform semantic inference and keyword extraction (basic knowledge search) of the dialogue by operating the business management screen 210 (step S501). In this case, the session management unit 501 of the knowledge search engine 302 performs session management of the request using a WebAPI (Application Programming Interface) and executes a search process corresponding to the request.

[0055] The knowledge search engine 302 performs knowledge classification by executing a search process corresponding to the request, and returns basic business knowledge information to the business application (business management screen 210) (step S502). The business application automatically inputs the search result (business knowledge information) into the corresponding register location on the business management screen 210.

[0056] Thereafter, when searching for past dialogues on the business management screen 210, the business application sends a request to this effect to the knowledge search engine 302 of the processing server 204 (step S503). In this case, the knowledge search engine 302 performs knowledge classification in response to the request for searching for past dialogues, and returns business knowledge information of the past dialogues to the business application (business management screen 210) (step S504). Then, the business application displays similar examples of past dialogues and a business manual on the business management screen 210.

[0057] 6 shows the flow of processing for creating knowledge data after the dialogue is completed. The following describes the processing for creating knowledge data performed by the knowledge search engine 302 and the knowledge data conversion unit 303 of the processing server 204 after the dialogue is completed as shown in FIG.

[0058] When the voice data control unit 301 of the processing server 204 notifies the knowledge data conversion unit 303 of the end of the dialogue, the knowledge data conversion unit 303 reads the dialogue (full text) from the knowledge database 304 and creates knowledge data.

[0059] In the knowledge database 304, knowledge data, knowledge text, knowledge labels, knowledge text labels, etc. are recorded as the knowledge table 102. The data structure of these will be described later. Based on the knowledge table 102, the knowledge database 304 creates and outputs a model of search data to the knowledge search engine 302.

[0060] First, the knowledge data conversion unit 303 performs conversion processing on the dialogue (full text) based on each table of the knowledge table 102 (step S601).

[0061] Next, the knowledge data conversion unit 303 infers the type of dialogue content of the dialogue based on a search request from the knowledge search engine 302 (step S602). Next, the knowledge data conversion unit 303 extracts specific keywords from the dialogue based on the basic knowledge in the knowledge table 102 (step S603). Then, the knowledge data conversion unit 303 performs document summarization of the dialogue (step S604). This document summarization includes, for example, the creation of a digest (summary) from the dialogue using general-purpose technology (for example, LexRank made by AI Inc.) and the creation of the above-mentioned summary.

[0062] 7 is a diagram showing an example of output of knowledge data for a business application. Based on the business application of the business support server 206, for example, display items and operations on the business management screen 210, a search request for knowledge data for the acquired dialogue is output to the knowledge search engine 302 of the processing server 204.

[0063] The knowledge search engine 302 has managerial knowledge information A to C for each business type through knowledge learning. The business knowledge information has a search model, a classification model, and an index / dictionary. The knowledge search engine 302 then executes search processes A to C corresponding to a search request, and outputs information such as the type of dialogue, past similar examples, and a target business manual to the business application. Note that the search process, business knowledge information, and business knowledge data are shown as A to C as an example, but are not limited to these three. In the example of FIG. 7, for example, the learning model application unit 701 applies a learning model suitable for the business content, and selectively applies business knowledge information B and search process B corresponding to the search request.

[0064] Furthermore, the maintenance unit 332 refers to the knowledge database 304 by executing a predetermined maintenance tool, learns knowledge data A to C for each business, and creates business knowledge information A to C.

[0065] (About knowledge data structures) Next, the knowledge data structure of the knowledge table 102 will be described. In the embodiment, the knowledge indicated by the knowledge data structure is a group of information composed of a plurality of texts and semantic labels. This knowledge data structure is structured so that not only text search but also summary search can be performed. Specifically, it is possible to specify the search target as text (for example, summary, title, etc. other than dialogue (full text)).

[0066] In the embodiment, the summary is not created artificially, but is generated by a specific method. In order to create this summary, a structure is adopted in which a label and a category indicating the meaning are assigned to the text and the knowledge information containing the text. Specifically, one of nine standard labels for generating a knowledge summary is assigned (the above-mentioned "5W2H + action / state"). In addition, a structure is adopted in which a label and a category indicating the typical meaning of the text are assigned to the text.

[0067] Fig. 8 is a diagram showing the data structure of a knowledge table, and Fig. 9 is a diagram showing a specific example of a knowledge table. In Fig. 8, knowledge table 102 shows a total of six tables 801 to 806 as an ER diagram of a data structure in which multiple tables are associated with each other. Also, the association status between items in each of the tables 801 to 806 is indicated by 0 (no association), 1 (individual correspondence), and * (multiple correspondence).

[0068] The classification category table 801 is mutually related to the knowledge data table 802 and the knowledge text table 803. In the classification category table 801, information on the classification of words included in a search sentence (dialogue sentence) (ClassID, ClassType, ParentClassId, Level, Name) is recorded.

[0069] The knowledge data table 802 is interrelated with the classification category table 801, the knowledge text table 803, and the knowledge data label table 805. The knowledge data table 802 records information on KnowledgeId, Category, Title, Digest (digest text), Summary (summary text), and AllText (full text). Any of 5W2H+action / status is assigned to the Category as the category to which the knowledge data belongs. Also, a label with a representative meaning, for example, the name of a car, is assigned to the Title.

[0070] The knowledge text table 803 has a mutual relationship with the classification category table 801, the knowledge data table 802, and the knowledge text label table 804. The knowledge text table 803 records information on TextNo (ascending order number of a part of text in the entire text), TextCategory (classification), TextName, and Text for each KnowledgeId. A simple word belonging to the knowledge data, for example, "XX is the name of a car," is assigned to Text. A semantic label (a label with a meaning equivalent to TextCategory) is assigned to TextName. A type that embodies the text category (5W2H + action / state) to which the knowledge text corresponds, for example, "Object (What) - Car," is assigned to TextCategory.

[0071] The knowledge text label table 804 has a mutual relationship with the knowledge text table 803 and the label table 806. Each piece of information, such as TextNo, LabelID (semantic label ID), and LabelNo, for each KnowledgeId is recorded.

[0072] The knowledge data label table 805 (corresponding to the knowledge data label 170 in FIG. 1) is mutually related to the knowledge data table 802. In the knowledge data label table 805, each piece of information, KnowledgeId, LabelType, TypeNo, and LabelItem, is recorded.

[0073] The label table 806 has a mutual relationship with the knowledge text label table 804. In the label table 806, information such as Label ID and Label (semantic label) is recorded.

[0074] The knowledge table shown in Fig. 9 shows an example in which each table of the knowledge table 102 shown in Fig. 8 is applied to one piece of knowledge, for example, the dialogue of the air traffic control work. Note that the description of the classification category table is omitted.

[0075] In the knowledge text table 803 of FIG. 9(b), one piece of knowledge "K001" is set as KnowledgeId, and a part of the text in the whole text, for example, the ascending order number "1" to "5" for each spoken sentence, is set as TextNo "1". For example, "Yes, this is the Expressway Control Center. What's the matter?" is set as Text (sentence) in TextNo "1", and "" (NULL)" is set as TextName (sentence name) since there is no equivalent semantic label in the related knowledge text label table 804, and "Other dialogue" is set as TextCategory. In addition, "Oh, it's a breakdown" is set as Text (sentence) in TextNo "3". "Label003 ("Breakdown")" in the related knowledge text label table 804 of FIG. 9(d) is set as TextName (sentence name), and "Breakdown-related" is set as TextCategory.

[0076] Here, in the label table 806 in Fig. 9(c), a Label (semantic label) for each LabelID, for example, "greeting", "contact", "malfunction", etc., which indicate the meaning of the dialogue, are set. The knowledge text label table 804 in Fig. 9(d) refers to the label table 806, acquires the Label corresponding to the LabelID, and sets it as the TextName in the knowledge text table 803 in Fig. 9(b).

[0077] 9(d), the knowledge text label table 804 has TextNo, LabelID, and LabelNo set for each KnowledgeId as information on the text to which a semantic label is assigned, among the settings in the knowledge text table 803. For example, for TextNo "2" of KnowledgeId "K0001", LabelID "Label003 ("Fault")" and LabelNo "1" are set.

[0078] The knowledge data label table 805 in FIG. 9(e) is a table in which information for generating a summary is set. In the knowledge data label table 805, the 5W2H+action / status consisting of KnowledgeId "K0001" and LabelType "When", "Where" ... "Action", and "Status" are set. In addition, TypeNo and LabelItem are set. For example, in the LabelType "Where" of KnowledgeId "K0001", there are two "Where"s included in the dialogue, and TypeNo "1" and "2" are set, respectively. "XX road" is set as the LabelItem of TypeNo "1", and "Downstream N 29 (corresponding to the emergency telephone identification number)" is set as the LabelItem of TypeNo "2".

[0079] The knowledge data table 802 in Fig. 9(a) is interrelated with the classification category table 801, the knowledge text table 803, and the knowledge data label table 805, and records knowledge information obtained by knowledge learning. For example, as the KnowledgeId "K0001" in the knowledge data table 802, Category "Fault response - Level 2" and Title "2020 / 08 / 08 Downstream N29 Fault" are set. A summary sentence based on the above general-purpose technology is set in Digest, a fixed summary sentence consisting of 5W2H + action / status (the above summary sentence) is set in Summary, and a dialogue sentence (full sentence) is set in AllText.

[0080] In the above-described knowledge table 102, each of the tables 801 to 806 has blank fields in the initial state, but information is set in the fields of each of the tables 801 to 806 as knowledge data is created for a dialogue for each search process.

[0081] Fig. 9(f) is an example of output of the knowledge table 102, in which a knowledge ID is assigned to each piece of information set in the knowledge data label table 805 in Fig. 9(e), and the LabelItems of 5W2H+action / status are rearranged in a predetermined order adapted to air traffic control operations. The processing server 204 creates a summary (Summary in Fig. 9(a)) based on the output order of the LabelItems in the knowledge table 102 shown in Fig. 9(f).

[0082] Fig. 10A is a diagram showing search targets and label classification for knowledge data, and shows the same contents as knowledge data table 802 shown in Fig. 9(a).

[0083] Of the knowledge data in the knowledge data table 802 shown in FIG. 10A, Category is a classification target for text (dialogue), and the setting information "Road control - fault response" indicates the knowledge type label. Title "2020 / 08 / 08 Downbound N29 Fault" is the search target (search target 2) when searching for a title. Digest is a "summary sentence" extracted from the dialogue using general-purpose technology, and is the search target for representative sentences (search target 3). Summary is a standard summary sentence (above summary sentence) of the above 5W2H + action / status, and is a summary search (search target 4). This summary sentence can eliminate semantic fluctuations by connecting the 5W2H + action / status in a specified order to make it consistent.

[0084] Fig. 10B is a diagram showing the classification of search targets and labels for knowledge text. In Fig. 10B, the settings of TextCategory and TextName of the knowledge text in the knowledge text table 803 shown in Fig. 9(b) indicate semantic labels. The text is a search target (search target 1) during text search.

[0085] In a basic search, a text search of the above search target 1 is performed. This text search can handle sentences that have been divided into short sentences in conventional searches. It can also handle searches of knowledge titles (search target 2), summaries (search target 3), and overviews (search target 4). This makes it possible to handle long texts such as book-like chapters and sections of documents. In addition, by providing various label items (knowledge type labels, semantic labels), it becomes possible to determine the type of knowledge or the meaning of a sentence from the labels.

[0086] (Creating basic knowledge using knowledge data structures) As mentioned above, the basic knowledge is a large number of sentences with representative semantic labels attached to words and short sentences, and the "semantic type" and "semantic label" of a dialogue (text) can be obtained by searching the basic knowledge. Here, 5W2H+action / state is the "semantic type" that indicates the broad classification of the meaning of the sentence, and the text category and text name are the "semantic labels" that indicate the meaning of the sentence.

[0087] In addition, the number of knowledge elements contained in the dialogue (text) is found by basic knowledge search. If multiple knowledge elements (knowledge data) are obtained by the search, then there will be that many knowledge elements (meanings). Since each knowledge element has a label that indicates its meaning, it becomes possible to infer complex meanings.

[0088] Fig. 11 is an explanatory diagram of data modeling of basic knowledge. In the knowledge table 102, basic knowledge is data modeled, and a data structure that allows knowledge to be associated with multiple items (dialogue sentences) is used (see Fig. 8, etc.). The processing server 204 (knowledge search engine 302, knowledge data conversion unit 303) generates a large number of short sentences including general parts of speech and short sentences including industry-specific parts of speech as the setting contents (basic knowledge) of the knowledge table 102. For classification labels to classify categories, a list of multiple words that specify 5W2H + actions / states is created, and semantic labels are assigned to items 1 to N.

[0089] Then, the processing server 204 (knowledge search engine 302) creates various dictionaries, indexes, and models 1101 (search model 320 in FIG. 3) from the knowledge table 102 of basic knowledge. Also, the knowledge has a data structure associated with a plurality of items 1 to N. Each item 1 to N in the knowledge table 102 is associated with specific knowledge items 1 to N in the various dictionaries, indexes, and models 1101 by an associated ID. Also, within the various dictionaries, indexes, and models 1101, associations are made between each piece of knowledge, and between item 2 of a certain piece of knowledge and other pieces of knowledge.

[0090] The above data model and data structure make it possible to build a search system that searches and classifies basic knowledge. In other words, by searching for a sentence, it becomes possible to obtain the classification labels of knowledge that contains similar sentences and the semantic labels of similar sentences.

[0091] 12 is a table showing a specific example of basic knowledge, which shows specific setting data for the control work of the above-mentioned call center for the classification category table 801, the knowledge data table 802, and the knowledge text table 803 of the knowledge table 102.

[0092] A Title "Automobile-Model" of Category "What" in knowledge data table 802 is associated (1:N) with a plurality of TextCategory "What-Automobile-Model", TextName, and Text in knowledge text table 803. Similarly, a Title "Automobile-Model" of Category "What" is associated with a plurality of TextCategory "What-Automobile-Model", TextName, and Text in knowledge text table 803.

[0093] The basic knowledge sentences (the above knowledge table 102) are simple sentences that contain common words, so they can be easily created in large quantities. By looking at the "semantic type" and "semantic label" of sentences that are highly similar to the search sentence, it is possible to classify the meanings of the search sentence and the words contained in the search sentence. This makes it possible to assign the meanings defined in the computer and program of the data registration processing device 100 and to process each meaning.

[0094] In addition, most of the basic knowledge sentences can be reused regardless of the type of business to which they are applied, except for certain technical terms. Also, the amount of knowledge can be improved by adding knowledge sentences and semantic types and semantic labels.

[0095] (Semantic inference in search and classification processes) The data entry processing device 100 (knowledge search engine 302) performs search and classification in the search process (see FIG. 6, etc.). The knowledge search engine 302 can increase the variety of document search and classification (title search, summary search, short sentence / detailed search, etc.), stimulating use in various business operations.

[0096] In addition, in semantic inference, the knowledge search engine 302 is used in place of the human brain and is utilized in various business situations. By using the above knowledge data structure (knowledge table 102) and the knowledge search engine 302, semantic inference of business texts, for example, creating summaries and labeling dialogue texts, can be performed, thereby promoting the self-improvement of business knowledge.

[0097] 13 is an explanatory diagram of an example of using basic knowledge search. For example, a business application (business management screen 210) causes the knowledge search engine 302 to perform a basic knowledge search for the text of a business document (dialogue) "I had a collision on the Chugoku Expressway" by speaker B (step S1301). At this time, the knowledge search engine 302 refers to the basic knowledge (knowledge table 102) and obtains two search results.

[0098] Assume that the first result obtained through a basic knowledge search is KnowledgeId "K0003", LabelType "Where", TextName "Expressway", and text "The Chugoku Expressway is an expressway." The second result obtained is KnowledgeId "K0012", LabelType "Action", TextName "Accident", and text "A collision accident is a type of accident." "Where" and "Expressway", as well as "Action" and "Accident" are semantic types (semantic labels). Additionally, "The Chugoku Expressway is an expressway." and "A collision accident is a type of accident" are similar sentences to be searched.

[0099] Then, the knowledge search engine 302 responds with the semantic label "Where" being "Expressway" and the semantic label "Action" being "Accident" as the search result for the business application (business management screen 210) (step S1302).

[0100] This allows the business application (business management screen 210) to recognize that "Where" in the dialogue is "Expressway" and "Action" is "Accident." The business application (business management screen 210) can then assign semantic types and semantic labels to business documents (dialogue text), automating the labeling of document classification.

[0101] In this way, the business application (business management screen 210) can obtain the semantic labels of the searched sentences by searching the data registration processing device 100 (knowledge search engine 302) for sentences used in business from basic knowledge. By assigning semantic labels to the searched sentences (business sentences, dialogue sentences), it becomes possible to infer the meaning of the searched sentences. In addition, multiple search results can be recognized as including multiple different meanings of different types (5W2H+action / state). Then, the business application (business management screen 210) can automatically classify the business sentences using the obtained semantic labels.

[0102] (Automatic labeling and summary creation of business documents) The data registration processing device 100 automatically labels business documents and extracts words with standard labels through basic knowledge search. Here, the number and type of meanings contained in each sentence (short sentence) in the business document and the corresponding words are extracted. Then, standard labels of 5W2H + action / state are created to create an overview of multiple sentences (long sentences). This automatic labeling allows categorization of new business documents when searching business documents, for example, extraction of groups of similar business documents and categories.

[0103] The data registration processing device 100 also realizes a search for a long summary when creating a summary of a business document. That is, the data registration processing device 100 creates a summary from a business document (dialogue) using general-purpose technology, and also creates a summary using standard labels of "5W2H + action / status."

[0104] For labeling the business documents and creating the summary, the data registration processing device 100 uses the search results of the basic knowledge (knowledge table 102) to assign semantic labels to each sentence of the business documents. Note that basic knowledge documents are created as basic knowledge, and knowledge data is created (knowledge table 102) in advance.

[0105] As a result, the data registration processing device 100 can create digests and summaries of business documents by using the search results of basic knowledge. As a result, as described above, the use of summaries makes it easy to categorize new business documents. In addition, since the data registration processing device 100 mechanically and automatically assigns semantic labels to business documents, these can be used for subsequent document searches and classification. In addition, it becomes possible to determine closely related actions (such as selecting the type of business ledger or presenting a business manual) based on the results of the category classification.

[0106] 14 is an explanatory diagram of an example of label extraction from a business document and knowledge data label creation. An example will be described using a dialogue between a controller (speaker A) and a caller (speaker B) in the above-mentioned business application (business management screen 210).

[0107] The knowledge data conversion unit 303 of the data registration processing device 100 outputs the dialogue 150 to the knowledge search engine 302 by searching each sentence one by one (step S1401). The knowledge search engine 302 refers to the basic knowledge sentences (knowledge table 102) (step S1402) and outputs the search results to the knowledge data conversion unit 303 (step S1403). For example, the search results for a text document (area D in the figure) with Speaker A saying "Oh, it's N29 downward, isn't it?" include information on the meaning of the words "downward" and "N29 (emergency call)".

[0108] The knowledge data conversion unit 303 extracts meanings and words from the obtained search results (step S1404) to create a knowledge data label (the above-mentioned knowledge data label table) 805 (step S1405). Also, a semantic label La is created (step S1406). The created semantic label La is recorded in the knowledge text table 803.

[0109] As the knowledge data conversion unit 303 continues to search for dialogues, words classified by 5W2H+action / state are accumulated in the knowledge data label table 805, and can be used to create an overview.

[0110] Furthermore, the knowledge data conversion unit 303 associates the created semantic label La (803) with the dialogue 150. Of the texts of each person (speaker A) in the dialogue 150, semantic labels are assigned to those texts that are necessary for business. For example, the text of speaker A in the dialogue 150, "Ah, it's N29 downward, isn't it?" is assigned the semantic labels La "downward" and "N29". As shown in FIG. 14, words associated with multiple semantic labels La correspond to areas K in multiple text documents of speaker A in the dialogue 150.

[0111] FIG. 15 is an explanatory diagram of an example of automatic labeling of business documents and creation of a summary sentence. The data registration processing device 100 (knowledge search engine 302, knowledge data conversion unit 303) extracts a summary sentence 1501 from a dialogue sentence 150 (full text) using general-purpose technology. The data registration processing device 100 records the extracted summary sentence 1501 in the Digest of the knowledge data table 802 (step S1501). The data registration processing device 100 also sets the same category (in the illustrated example, "Road control-breakdown response") that was at the top of the search results obtained in a past dialogue sentence search to the Category of the knowledge data table 802. Furthermore, the Title may be set by extracting specific items (date, time, place, event, etc.) from the knowledge data label, or may be set manually.

[0112] The data registration processing device 100 also mechanically combines the labels in the created knowledge data label table 805 to create the summary 180. The data registration processing device 100 records the created summary 180 in the Summary of the knowledge data table 802 (step S1502).

[0113] Moreover, the data registration processing device 100 assigns a label to the text of the dialogue 150, and records it in the TextCategory, TextName fields of the knowledge text table 803 (step S1503).

[0114] 16A and 16B are explanatory diagrams showing examples of the order of combining summary sentences. The data registration processing device 100 can change the order of combining summary sentences according to the priority given to the type of business, etc. For example, FIG. 16A(a) shows an example of creating a summary sentence corresponding to the above-mentioned traffic control business, FIG. 16B(b) shows an example of creating a summary sentence corresponding to the above-mentioned emergency command business, and FIG. 16B(c) shows an example of creating a summary sentence corresponding to the above-mentioned fire command business.

[0115] 16A(a), i.e., in the knowledge data label table 805, the 5W2H + action / state are combined in the following order: When, Where, Who, What, Why, How, How much, state, action. In the summary 1601 (180) combined in this order, Where has a high priority after When, so that the locations required for traffic control can be quickly known.

[0116] In the knowledge data label table 805 for emergency dispatch operations shown in Figure 16B (b), the 5W2H + action / status are combined in the following order: When, Why, Who, status, How much, Where, How, What, action. In the summary text 1602 (180) combined in this order, Why, Who, and status have high priority after When, so the status of people required for emergency dispatch operations can be quickly known.

[0117] In the knowledge data label table 805 for firefighting command duties shown in Fig. 16B(c), the 5W2H + action / status are combined in the following order: When, Why, Where, What, status, Who, How much, How, action. In the summary text 1603 (180) combined in this order, Why, Where, and What have high priority after When, so the status of the firefighting target, which is necessary for firefighting command duties, can be known quickly.

[0118] (Data processing of data registration processing device) 17 is a flowchart of an example of the overall process of creating knowledge data, which shows an example of the process of creating knowledge data (corresponding to FIGS. 14 and 15) performed by the CPU 401 of the data registration processing device 100.

[0119] First, CPU 401 receives a notification of the end of a series of dialogues from voice capture PC 203 (step S1701). Next, CPU 401 creates an ID (knowledge ID) for the series of dialogues (step S1702). Next, CPU 401 creates a record in knowledge data table 802 (step S1703), and creates a record in knowledge text table 803 (step S1704).

[0120] Next, CPU 401 creates knowledge data label table 805 (step S1705). Next, CPU 401 creates a summary from the dialogue (step S1706), and records the summary in knowledge data table 802 (step S1707).

[0121] Next, the CPU 401 creates a semantic label La (step S1708), records the semantic label La in the knowledge text table 803 (step S1709), and ends the above processing.

[0122] 18A and 18B are flowcharts showing an example of knowledge data label creation, illustrating a detailed process example of creating the knowledge data label table 805 (step S1705 in FIG. 17) performed by the CPU 401 of the data registration processing device 100.

[0123] 18A, first, the CPU 401 acquires a dialogue (step S1801). Next, the CPU 401 executes a basic knowledge search using the dialogue as a search query (step S1802). This process corresponds to step S1401 of the short sentence search shown in FIG.

[0124] Next, the CPU 401 determines whether or not there is a search result for the basic knowledge search in step S1802 (step S1803). If there is a search result (step S1803: Yes), the CPU 401 proceeds to the process of step S1804, and if there is no search result (step S1803: No), the CPU 401 ends the above process.

[0125] In step S1804, CPU 401 executes a loop process the number of times corresponding to the number of search results (step S1804). In this loop process, CPU 401 determines whether or not the score is equal to or greater than a constant value (step S1805). The score corresponds to the weight of semantic labeling of a word. If the score is equal to or greater than the constant value (step S1805: Yes), CPU 401 proceeds to the process of step S1806, and if the score is less than the constant value (step S1805: No), CPU 401 proceeds to the process of step S1807.

[0126] In step S1806, CPU 401 creates knowledge data label table 805 (step S1806). This process corresponds to step S1405 in Fig. 14. After this, CPU 401 determines whether loop processing has been executed for the number of searches (step S1807), and if there are any unexecuted loops, returns to the process of step S1804, and if all have been executed, ends the above process.

[0127] Fig. 18B shows details of the process (step S1806) of creating the knowledge data label table 805 in Fig. 18A. First, the CPU 401 identifies one of the nine categories (attributes) of the search statement (5W2H+action / state) (step S1811).

[0128] Next, the CPU 401 divides the dialogue into words by segmentation, normalization, etc. (step S1812). Then, the CPU 401 executes a loop process the number of which is the number of divided words (step S1813). In this loop process, the CPU 401 searches for words in the "word dictionary corresponding to the category" (step S1814).

[0129] Fig. 18C is a diagram showing an example of a word dictionary. As shown in Fig. 18C(a), the word dictionary is a dictionary in which known words are preregistered, and is a hierarchical structure of dictionaries corresponding to categories (5W2H+action / state) and dictionaries corresponding to text names (e.g., date, time, duration). For example, the branch of the category "When" has a hierarchy in which the text names "date," "time," and "duration" are connected from the top.

[0130] Also, as shown in FIG. 18C(b), a “word dictionary corresponding to categories” 1820 has registered therein words corresponding to a certain category “vehicle type,” such as “large cargo vehicle, bus, passenger car, motorcycle, truck, 1-ton vehicle, 2-ton vehicle, rental car, 1BOX, etc.”

[0131] 18B, after the process of step S1814, CPU 401 determines whether or not there is a matching word (step S1815). If the word is in the "word dictionary corresponding to the category" (step S1815: Yes), CPU 401 proceeds to the process of step S1816, and if the word is not in the "word dictionary corresponding to the category" (step S1815: No), CPU 401 proceeds to the process of step S1817.

[0132] In step S1816, CPU 401 records the words for the identified category in knowledge data label table 805 (step S1816). After that, CPU 401 determines whether the loop processing has been executed for the number of divided words (step S1817). If there are any unexecuted loops, CPU 401 returns to the processing of step S1813, and if all have been executed, CPU 401 ends the above processing.

[0133] Fig. 19 is a flow chart of an example of creating a summary. This shows a detailed example of the process of creating the summary 180 (step S1706 in Fig. 17) performed by the CPU 401 of the data registration processing device 100. The CPU 401 acquires knowledge data labels from the knowledge data label table 805 created above (step S1901), and acquires a template corresponding to the summary combination definition (step S1902). This template defines the order of words recorded in the knowledge data label table 805, i.e., the output order of the summary, and is a template for creating a summary with the word order for each business content explained in Figs. 16A and 16B.

[0134] Next, CPU 401 performs loop processing of nine types of attributes of 5W2H+action / status (step S1903). For example, it is determined whether or not a knowledge label (knowledge data label, for example, "Where") of one of the nine types of attributes is in knowledge data label table 805 (step S1904). If the result of the determination is that there is a knowledge label (step S1904: Yes), CPU 401 proceeds to processing of step S1905, and if there is no knowledge label (step S1904: No), it proceeds to processing of determining whether or not to end the attribute loop processing (step S1908).

[0135] In step S1905, a loop process for the number of labels is performed (step S1905). In this loop process for the number of labels, CPU 401 reflects the knowledge label in the general combination definition (template) (step S1906). That is, the knowledge label is recorded in the template. After this, CPU 401 judges whether the loop process for the number of labels has been performed (step S1907), and if there is any unexecuted part, the process returns to the process of step S1905, and if all have been executed, the process proceeds to the process of step S1908. In step S1908, it is judged whether the loop process for nine attributes has been performed (step S1908), and if there is any unexecuted part, the process returns to the process of step S1903, and if all have been executed, the process ends.

[0136] 20A and 20B are flowcharts of an example of semantic label creation. An example of detailed processing of creating a semantic label La (see FIG. 14) (step S1708 in FIG. 17) performed by the CPU 401 of the data registration processing device 100 is shown. First, as shown in FIG. 20A, the CPU 401 acquires a dialogue (step S2001). Next, the CPU 401 executes a basic knowledge search using the dialogue as a search query (step S2002). This processing corresponds to step S1401 of the short sentence search shown in FIG. 14.

[0137] Next, the CPU 401 determines whether there is a search result for the basic knowledge search in step S2001 (step S2003). If there is a search result (step S2003: Yes), the CPU 401 proceeds to the process of step S2004, and if there is no search result (step S2003: No), the above process ends.

[0138] In step S2004, CPU 401 executes a loop process the number of times corresponding to the number of searches (step S2004). In this loop process, CPU 401 determines whether the score is equal to or greater than a constant value (step S2005). If the score is equal to or greater than the constant value (step S2005: Yes), CPU 401 proceeds to step S2006, and if the score is less than the constant value (step S2005: No), CPU 401 proceeds to step S2007.

[0139] In step S2006, CPU 401 creates semantic label La (step S2006). This process corresponds to step S1406 in Fig. 14. After that, CPU 401 determines whether the loop process has been performed for the number of searches (step S2007), and if there are any unexecuted loops, the process returns to step S2004, and if all have been executed, the process ends.

[0140] Fig. 20B shows details of the process of creating the semantic label table La (step S2006) in Fig. 20A. First, CPU 401 acquires the text name of the search result (step S2011).

[0141] Next, the CPU 401 divides the dialogue into words by segmentation, normalization, etc. (step S2012). Then, the CPU 401 executes a loop process the number of times corresponding to the divided words (step S2013). In this loop process, the CPU 401 searches for words in the "word dictionary corresponding to text name" (step S2014). At this time, the word dictionary to be referenced has the same contents as the "word dictionary corresponding to category name" 1820 shown in FIG. 18C(b).

[0142] After processing step S2014, CPU 401 determines whether or not there is a matching word (step S2015). If the word is in the "word dictionary corresponding to the text name" (step S2015: Yes), CPU 401 proceeds to processing step S2016. On the other hand, if the word is not in the "word dictionary corresponding to the text name" (step S2015: No), CPU 401 proceeds to processing step S2017.

[0143] In step S2016, CPU 401 records the word corresponding to the semantic label as semantic label La in knowledge text table 803 (step S2016). After that, CPU 401 determines whether the loop process has been performed for the number of divided words (step S2017). If there is any unexecuted process, CPU 401 returns to the process of step S2013, and if all processes have been executed, the above process ends.

[0144] 21 is an explanatory diagram showing an example of how the summary is used by a business application. An example of how the summary is used when the business support server 206 executes the business application for the control business will be described.

[0145] The business application of the business support server 206 adds the dialogue sentence 150 one sentence at a time and performs an overview search on the knowledge search engine 302 of the data registration processing device 100 (step S2101). The knowledge search engine 302 refers to the dialogue history sentence 2100 (step S2102) and outputs the search result to the business support server 206 (step S2103). For example, the overview search result includes the text document "This is the Expressway Control Center. What's the matter? Oh, it's broken," the words "expressway," "control," "center," "how," "breakdown," and the Category "road control-breakdown."

[0146] The business application 206 performs category classification / search from the obtained search results (step S2104). At this time, the business application 206 can select the type of record book corresponding to the search result category "road control-breakdown" (step S2105) and process the business manual display-breakdown response (step S2106).

[0147] Fig. 22 is a process flowchart of an example of using an overview by a business application. Fig. 22 shows an example of creating an overview executed by various business applications (CPU 401 mounted on the business support server 206) shown in Fig. 21 and the like.

[0148] First, the CPU 401 acquires a dialogue (step S2201). Next, the CPU 401 executes a category search of the past dialogue history using the dialogue as a search query (step S2202). This process corresponds to step S2101 in FIG.

[0149] Next, CPU 401 determines whether or not there is a result in the search executed in step S2201 (step S2203). If there is a result in the search (step S2203: Yes), CPU 401 proceeds to the process of step S2204, and if there is no result in the search (step S2203: No), the above process ends.

[0150] In step S2204, CPU 401 executes a loop process the number of which is the number of categories (step S2204). In this loop process, CPU 401 determines whether the score is equal to or greater than a constant value (step S2205). If the score is equal to or greater than the constant value (step S2205: Yes), CPU 401 proceeds to step S2206, and if the score is less than the constant value (step S2205: No), CPU 401 proceeds to step S2207.

[0151] In step S2206, CPU 401 executes a category determination action (step S2206). This process corresponds to steps S2105 and S2106 in Fig. 21. The category determination action can perform processes such as: 1. Present the relevant section of the business manual to the user; 2. Determine the type of record ledger and start automatically inputting the search results into the selected record ledger; 3. Search for materials related to the business and present them to the user.

[0152] Thereafter, CPU 401 determines whether the loop process has been performed for the number of categories (step S2207), and if there is any unexecuted process, returns to the process of step S2204, and if all have been executed, ends the above process.

[0153] 23 and 24 are diagrams showing examples of using a business application based on a dialogue. Fig. 23 shows an example in which the business support server 206 sets the display contents and display items required for control operations on the business management screen 210 based on the search results of the data registration processing device 100.

[0154] The business application of the business support server 206 performs a dialogue history search (step S2301), a basic knowledge search (step S2302), and a business manual search (step S2303) on the data registration processing device 100 (knowledge search engine 302).

[0155] For the dialogue history search (step S2301), the data registration processing device 100 (knowledge search engine 302) refers to the dialogue history data model 2301 and returns the search results to the business application. For the basic knowledge search (step S2302), the data registration processing device 100 (knowledge search engine 302) refers to the basic knowledge data model 2302 and returns the search results to the business application. For the business manual search (step S2303), the data registration processing device 100 (knowledge search engine 302) refers to the business manual data model 2203 and returns the search results to the business application. Here, the data registration processing device 100 (knowledge search engine 302) updates the dialogue history data model 2301 based on new dialogue history from the business application.

[0156] The business application displays various display screens corresponding to the search results on the business management screen 210. For example, when the dialogue log / keyword input screen 2311 is displayed on the business management screen 210, the dialogue 150 and the keywords (bold lines in the figure) in the dialogue 150 are displayed as the search results of the data registration processing device 100. The data registration processing device 100 (e.g., the knowledge search engine 302) searches whether the dialogue 150 contains important keywords that have been set in advance, and the business application highlights keyword K from the search results on the business management screen 210.

[0157] Furthermore, the business application automatically selects a record book (action item 2312) corresponding to the dialogue content of the dialogue 150 (see step S2105 in FIG. 21), and displays it on the business management screen 210. The action item 2312 consists of, for example, "type", "date and time", "route", and "direction" (corresponding to each label) as confirmation and communication items for air traffic control work, and confirmed information (text corresponding to each label).

[0158] For example, the business application can display action items 2312 on the business management screen 210 based on the basic knowledge search (step S2302) of the dialogue 150 in the data registration processing device 100 and the search results of the dictionary for each item. Then, the business application can automatically input the search results into each input item of the action items 2312, such as confirmation and communication items for control work and confirmed information.

[0159] Furthermore, the business application can automatically select a business manual 2313 corresponding to the dialogue content from the search results of the business manual search (step S2303) of the dialogue 150 in the data registration processing device 100. Then, the selected business manual 2313 can be displayed on the business management screen 210.

[0160] Furthermore, the business application can display a camera image 2314 including image capture information from the basic knowledge search (step S2302) of the dialogue 150 in the data registration processing device 100 and the search result of the camera-compatible dictionary on the business management screen 210. The camera image 2314 is an image captured by a camera corresponding to the "location" included in the dialogue 150.

[0161] As a result, the business application can display various display contents suitable for the meaning of the dialogue 150 on the business management screen 210 in cooperation with the data registration processing device 100. Then, controller A who performs management and control work can smoothly and efficiently perform control work for the other party (notifier B) while looking at the display contents displayed on the business management screen 210. For example, by the business application automatically inputting various search results of the data registration processing device 100, the controller can omit input operations on the business management screen 210 and concentrate on the call with notifier B.

[0162] 24 shows an example in which the business support server 206 creates a report on a control task on the task management screen 210 based on the search results of the data registration processing device 100. For example, assume that the business application displays a report 2401 on the task management screen 210 in response to an operation by controller A. In this case, the business application can automatically input each input item of the report 2401 based on the basic knowledge search (step S2302) of the dialogue sentence 150 in the data registration processing device 100 and the search results of the dictionary for each item. For example, the business application automatically inputs the summary sentence 180 into the accident response report sentence 2411 of the report sentence 2401, and automatically inputs text for each label of the summary sentence 180 into each item of the report content 2412.

[0163] This allows controller A to check whether he has heard anything necessary from caller B while looking at summary 180 entered into report 2401 .

[0164] In the embodiment described above, the dialogue 150 has been converted into text based on a phone call. However, this is not limited to this. Even if the dialogue 150 is a chat message, a summary or the like can be generated by a similar knowledge search.

[0165] According to the above-described embodiment, the data registration processing device estimates the meaning of an input text document and performs a search. This data registration processing program extracts words registered in a knowledge table in which words, sentences containing the words, and attributes of the words are associated with each other from the text document based on sentences containing the words, rearranges a group of the extracted words in a predetermined order of attributes, creates a summary consisting of the rearranged word group, and records the summary in a database in association with the text document. This normalizes the entire text document and creates a summary summarized by the word group, thereby improving the search accuracy of the database in which the text document is recorded. By extracting words registered in the knowledge table based on sentences containing the words, a summary based on knowledge of 1:N correspondence other than 1:1 correspondence can be created, and the summary can clearly indicate the meaning of the text document.

[0166] The data registration processing device also includes a process for converting the dialogue voice into text by speech recognition and generating a text document, thereby making it possible to easily show the meaning of the dialogue voice exchange.

[0167] The method may also include a process of acquiring the dialogue voice from the contents of a telephone conversation. This allows the voice that is the source of a text document to be generated from the contents of the telephone conversation. It also allows a summary text to be created that corresponds to the contents of the conversation in real time.

[0168] The dialogue voice may also be obtained from the voice of the operator in the telephone conversation. In this way, by generating a text document based on the voice of the system operator rather than the other party, the accuracy of voice recognition can be improved without being affected by the quality of the call or the speaking habits of different parties.

[0169] In addition, by recording in advance in the knowledge table information on the meaning types and labels of words that are highly similar to the text document, the meanings of words contained in the text document can be obtained based on the meaning type and label information during word extraction. This makes it possible for each extracted word to have a meaning, and for a summary sentence consisting of a group of words to provide a correct summary.

[0170] In addition, attributes include the 5W2H (When, Where, Who, What, Why, How, How much), states, and actions, and words can be extracted by searching documents that contain the words for each attribute that are preregistered in the knowledge table. This allows the word order of the summary to be normalized, making it possible to show the meaning of the entire text document with just the summary.

[0171] The words can be rearranged in a predetermined attribute order corresponding to the type of business that uses the summary. For example, it is possible to deal with the fact that the attributes of the word group that should be positioned at the beginning of the summary differ depending on the business, such as traffic control business, emergency command business, firefighting command business, etc., and it becomes possible to efficiently perform each different business.

[0172] In addition, when analyzing new text documents, the summary stored in the database will be included in the analysis. This will improve the accuracy of searches using the database. The summary will eliminate semantic fluctuations by keeping the meaning and order of words consistent. This will enable summary searches of books, such as chapters and sections of long documents, and long dialogues.

[0173] Furthermore, text documents may be classified based on semantic types and labels, which allows easy and accurate classification and search of text documents.

[0174] Alternatively, a summary of the entire text document may be created, recorded in the knowledge table, and used for text search. Text search can be used to search for sentences in which the entire text has been divided into short sentences.

[0175] In addition, the summary can be output to the device of the operator who is engaged in the dialogue. This allows the operator to obtain a summary that corresponds to the content of the dialogue, and even if the dialogue takes a long time (the text document increases), the operator can obtain a summary that appropriately summarizes the entire text document, allowing the operator to carry out their work efficiently.

[0176] In addition, the data registration device may be connected to a voice-to-text device that converts the dialogue into text by voice recognition, or to a business device where an operator performs control operations for the other party in the dialogue. This makes it possible to output a summary corresponding to the content of the dialogue to the business device.

[0177] For these reasons, according to the embodiment, for example, an overview obtained by summarizing an entire dialogue as a group of words with normalized word order is an overview in which important words are extracted and noise can be removed. This makes it possible to improve the accuracy of searching a database in which text documents such as dialogues are recorded. In addition, it is possible to improve the efficiency of searching long texts such as dialogues, enabling effective use of text.

[0178] The method for the data registration process described in the embodiment of the present invention can be realized by having a processor of a server or the like execute a program prepared in advance. This method is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disk), or a flash memory, and is executed by being read from the recording medium by a computer. This method may also be distributed via a network such as the Internet.

[0179] The following supplementary notes are further disclosed regarding the above-described embodiment.

[0180] (Appendix 1) A data registration processing method for estimating semantic information contained in an input text document and retrieving and outputting the information, extracting, from the text document, a word registered in a knowledge table in which the word, the sentence containing the word, and an attribute of the word are associated with each other, based on a sentence containing the word; rearrange the extracted words in a predetermined order according to the attributes; creating an overview consisting of the rearranged group of words, and recording the overview in a database in association with the text document; A data registration processing method, the processing being executed by a computer.

[0181] (Appendix 2) The dialogue is converted into text by speech recognition, and the text document is generated. 2. The data registration processing method according to claim 1, further comprising the steps of:

[0182] (Appendix 3) The audio of the dialogue is obtained from the contents of a telephone conversation. 3. The data registration processing method according to claim 1 or 2, further comprising the steps of:

[0183] (Appendix 4) The voice of the dialogue is obtained from the voice of the operator in the telephone conversation. 4. The data registration processing method according to claim 3, further comprising the steps of:

[0184] (Appendix 5) The knowledge table stores information on the meanings and labels of words that have a high similarity to the text document, In the word extraction, the meanings of words included in the text document are obtained based on the meaning type and label information. 5. A data registration processing method according to any one of claims 1 to 4.

[0185] (Appendix 6) The attributes include the 5W2H (When, Where, Who, What, Why, How, How much), states, and actions. The extraction of the words is performed by searching for documents including the registered words for each of the attributes that are registered in advance in the knowledge table. 6. A data registration processing method according to any one of claims 1 to 5.

[0186] (Appendix 7) The words are rearranged in a predetermined order of the attributes corresponding to the type of business in which the summary is used. 7. A data registration processing method according to any one of claims 1 to 6.

[0187] (Appendix 8) When analyzing new text documents, the summary stored in the database is included. 7. A data registration processing method according to any one of claims 1 to 6.

[0188] (Appendix 9) Classifying the text document based on the semantic type and label. 9. The data registration processing method according to any one of claims 5 to 8, further comprising the steps of:

[0189] (Supplementary Note 10) The data registration processing method according to any one of Supplementary Notes 1 to 9, further comprising creating a summary of the entire text document, recording the summary in the knowledge table, and using the summary for text search.

[0190] (Appendix 11) The summary is output to an operator's device that performs the dialogue. 11. The data registration processing method according to any one of claims 1 to 10, comprising the steps of:

[0191] (Appendix 12) A data registration processing program that estimates semantic information contained in an input text document and searches and outputs the information, extracting, from the text document, a word registered in a knowledge table in which the word, the sentence containing the word, and an attribute of the word are associated with each other, based on a sentence containing the word; rearrange the extracted words in a predetermined order according to the attributes; creating an overview consisting of the rearranged group of words, and recording the overview in a database in association with the text document; A data registration processing program that causes a computer to execute a process.

[0192] (Appendix 13) A data entry processing device that estimates semantic information contained in an input text document and searches and outputs the information, a knowledge table in which words, sentences containing the words, and attributes of the words are associated with each other in advance; a control unit that extracts the words registered in the knowledge table from the text document based on a sentence including the words, rearranges a group of the extracted words in a predetermined order of the attributes, creates a summary consisting of the rearranged group of words, and records the summary in a database in association with the text document; A data registration processing device comprising:

[0193] (Supplementary Note 14) The control unit is a speech-to-text conversion device that converts the text document into text by speech recognition of a dialogue; A service device is connected to the other party of the conversation, and an operator controls the other party. outputting the summary corresponding to the content of the dialogue to the business device; 14. The data registration processing device according to claim 13. [Explanation of symbols]

[0194] 100 Data registration processing device 101 Control section 102 Knowledge Table 150 dialogues 160 Text Labels 170 Knowledge Data Labels 180 Summary text 204 Processing Server 206 Business support server (business application) 210 Business management screen 302 Knowledge Search Engine 303 Knowledge Data Conversion Department 304 Knowledge Database 401 CPU (control unit) 402 Memory 403 Network Interface (IF) 404 Recording Media IF 801 Classification Category Table 802 Knowledge Data Table 803 Knowledge Text Table 804 Knowledge Text Label Table 805 Knowledge Data Label Table 806 Label Table Controller A (Speaker) B. Reporter (speaker)

Claims

1. A data entry processing method for estimating semantic information contained in an input text document and retrieving and outputting the information, extracting, from the text document, a word registered in a knowledge table in which the word, the sentence containing the word, and an attribute of the word are associated with each other, based on a sentence containing the word; rearrange the extracted words in a predetermined order according to the attributes; creating an overview consisting of the rearranged group of words, and recording the overview in a database in association with the text document; A data registration processing method, the processing being executed by a computer.

2. Converting the dialogue into text through speech recognition and generating the text document; 2. The data registration processing method according to claim 1, further comprising the step of:

3. Acquiring the audio of the dialogue from the contents of a telephone conversation; 3. The data registration processing method according to claim 2, further comprising a process of:

4. The voice of the dialogue is acquired from the voice of the operator in the telephone conversation.

4. The data registration processing method according to claim 3, further comprising the step of:

5. The knowledge table stores information on the meanings and labels of words that have a high similarity to the text document, In the word extraction, the meanings of words included in the text document are obtained based on the meaning type and label information.

5. The data registration processing method according to claim 1,

6. The attributes include 5W2H (When, Where, Who, What, Why, How, How much), state, and action; The extraction of the words is performed by searching for documents including the registered words for each of the attributes that are registered in advance in the knowledge table.

6. The data registration processing method according to claim 1,

7. the words are rearranged in a predetermined order of the attributes corresponding to a business type in which the summary is used; 7. The data registration processing method according to claim 1,

8. When analyzing new text documents, the summaries stored in the database are included.

7. The data registration processing method according to claim 1,

9. document classifying the text documents based on the semantic types and labels; 9. The data registration processing method according to claim 5, further comprising the step of:

10. 10. The data entry processing method according to claim 1, further comprising the steps of: creating a summary of the entire text document; recording the summary in the knowledge table; and using the summary in a text search.

11. outputting the summary to an apparatus of an operator who is to carry out the dialogue; 5. The data registration processing method according to claim 2, further comprising the step of:

12. A data entry processing program that estimates semantic information contained in an input text document and searches and outputs the information, extracting, from the text document, a word registered in a knowledge table in which the word, the sentence containing the word, and an attribute of the word are associated with each other, based on a sentence containing the word; rearrange the extracted words in a predetermined order according to the attributes; creating an overview consisting of the rearranged group of words, and recording the overview in a database in association with the text document; A data registration processing program that causes a computer to execute a process.

13. A data entry processing device that estimates semantic information contained in an input text document and searches and outputs the information, a knowledge table in which words, sentences containing the words, and attributes of the words are associated with each other in advance; a control unit that extracts the words registered in the knowledge table from the text document based on a sentence including the words, rearranges a group of the extracted words in a predetermined order of the attributes, creates a summary consisting of the rearranged group of words, and records the summary in a database in association with the text document; A data registration processing device comprising:

Images