Information processing program, information processing method, and information processing device

Abstract

To extract a characteristic word of a document accurately.SOLUTION: An information processing apparatus generates a list 911 of words appearing in each of subdivided sections 901 formed by dividing a document 900 by page. The information processing apparatus calculates a word score in each subdivided section 901, for each of the words included in the list 911 of words corresponding to each subdivided section 901. The information processing apparatus extracts a word having a word score equal to or larger than a first threshold, as an important word which represents characteristics of each subdivided section 901. The information processing apparatus calculates a word score in a document 900, for each important word included in an important word group formed by collecting important words from a list of important words without duplication. The information processing apparatus determines the first to fifth important words in a descending ranking of the calculated word scores of the important words included in the important word group, as characteristic words of the document 900.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present invention relates to an information processing program, an information processing method, and an information processing device. [Background technology]

[0002] Conventionally, there are techniques for extracting feature words that represent the characteristics of a document from a document. For example, there is a technique called TF (Term Frequency)-IDF (Inverse Document Frequency) that extracts feature words of a target document among multiple documents. For example, when trying to assign tags to documents to make them easier to search, feature words of the document may be extracted and used as tags.

[0003] Prior art techniques include, for example, analyzing the layout of a Web page, extracting sections contained in the Web page, determining the use type of each section, and calculating the importance by weighting according to the use type of the section in which the basic character string appears. There is also a technique for dividing an original document to generate page documents, setting document information of the page documents, extracting tags from the main text of the page documents, and setting the tags to the document information. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2008-262506 A [Patent Document 2] JP 2018-195305 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the conventional technology, it is difficult to extract feature words of a document with high accuracy. For example, TF-IDF may be used to extract feature words of a target document among multiple documents. In this case, non-characteristic words that commonly appear in the header or footer of each page of the target document may be erroneously extracted as feature words because they appear relatively frequently in the target document.

[0006] In one aspect, the present invention aims to accurately extract characteristic words from a document. [Means for solving the problem]

[0007] According to one embodiment, an information processing program, an information processing method, and an information processing device are proposed that obtain multiple parts by dividing a target document in accordance with specific conditions, extract feature words representing characteristics of each of the obtained multiple parts from each of the obtained parts based on a first likelihood for each word contained in each of the obtained parts to be a feature word representing a characteristic of the part, and determine feature words representing characteristics of the target document from the feature word set that summarizes the extracted feature words based on a second likelihood for each feature word contained in the feature word set to be a feature word representing a characteristic of the target document. Effect of the Invention

[0008] According to one aspect, it is possible to extract characteristic words of a document with high accuracy. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of an information processing method according to an embodiment. [Diagram 2] FIG. 2 is an explanatory diagram illustrating an example of an information processing system 200. As shown in FIG. [Diagram 3] FIG. 3 is a block diagram showing an example of a hardware configuration of the information processing device 100. As shown in FIG. [Figure 4]FIG. 4 is an explanatory diagram of an example of the contents of the overall frequency management table 400. As shown in FIG. [Diagram 5] FIG. 5 is an explanatory diagram of an example of the contents of the partial frequency management table 500. As shown in FIG. [Figure 6] FIG. 6 is an explanatory diagram showing an example of the contents of the important word management table 600. As shown in FIG. [Figure 7] FIG. 7 is a block diagram showing an example of a functional configuration of the information processing device 100. As shown in FIG. [Figure 8] FIG. 8 is an explanatory diagram showing the flow of operations of the information processing device 100. [Figure 9] FIG. 9 is an explanatory diagram (part 1) showing an example of the operation of the information processing device 100. [Figure 10] FIG. 10 is an explanatory diagram (part 2) showing an example of the operation of the information processing device 100. [Figure 11] FIG. 11 is an explanatory diagram (part 3) showing an example of the operation of the information processing device 100. [Figure 12] FIG. 12 is a flowchart illustrating an example of an overall processing procedure. [Figure 13] FIG. 13 is a flowchart illustrating an example of a partial process procedure. [Figure 14] FIG. 14 is a flowchart illustrating an example of a procedure of the first generation process. [Figure 15] FIG. 15 is a flowchart illustrating an example of a procedure of the second generation process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of an information processing program, an information processing method, and an information processing device according to the present invention will be described in detail with reference to the drawings.

[0011] (An example of an information processing method according to an embodiment) 1 is an explanatory diagram showing an example of an information processing method according to an embodiment. An information processing device 100 is a computer for extracting characteristic words representing characteristics of a document from the document.

[0012] Here, for example, when attempting to assign tags to documents in order to make the documents easier to search, it may be desirable to extract characteristic words from the documents and use them as tags.

[0013] In contrast, conventionally, a technique called TF-IDF is used to extract feature words from a target document among multiple documents. Specifically, for each word that appears in the target document, the likelihood (TF x IDF) of the word being a feature word that represents the characteristics of the target document is calculated, and words with a calculated likelihood equal to or greater than a threshold are extracted as feature words of the target document.

[0014] The TF for a word is an evaluation value based on the frequency of occurrence of the word in the target document. The TF for a word indicates how important the word is in the target document. Specifically, the TF for a first word is the number of times the first word appears in the target document / the total number of times all words appear in the target document. Specifically, the TF for the first word is larger the more frequently the first word appears in the target document, indicating that the importance of the first word is high in the target document. Therefore, the larger the TF for a word is, and the higher the importance of the word is determined to be in the target document, the larger the likelihood of the word = TF x IDF is likely to be.

[0015] The IDF for a word is an evaluation value based on the number of documents in which the word appears among a plurality of documents including the target document. The IDF for a word indicates how versatile the word is. Specifically, the IDF for a first word is log(total number of documents / number of documents in which the first word appears). Specifically, the IDF for the first word becomes smaller as the number of documents in which the first word appears increases, indicating that the first word is versatile and not distinctive, and indicating that the importance of the first word in the target document is low. Therefore, the smaller the IDF for a word is, and the lower the importance of the word is determined to be in the target document, the smaller the likelihood of the word=TF×IDF is.

[0016] In this way, conventionally, the accuracy of extracting characteristic words from a target document is improved by calculating the likelihood (TF x IDF) of each word that appears in the target document as a characteristic word of the target document from two different perspectives.

[0017] However, in the past, it was sometimes difficult to extract feature words from a target document with high accuracy. For example, even if a certain word has a relatively low importance in the target document and is therefore inappropriate as a feature word for the target document, it may be extracted as a feature word for the target document because it appears relatively frequently in the target document.

[0018] The inappropriate words may be, for example, contained in a template in the target document. The inappropriate words may be, for example, contained in a template document that was the basis of the target document and remain in the target document. The inappropriate words may be, for example, contained in an incidental part of the target document that is not related to the subject of the target document.

[0019] Specifically, if a template containing a word that is inappropriate as a feature word of the target document appears multiple times in the target document, the word is determined to appear relatively frequently in the target document, and is erroneously extracted as a feature word of the target document. The template may be included in the header or footer of the target document, for example. More specifically, if a word that is inappropriate as a feature word of the target document appears relatively frequently in the target document, the TF for the word becomes large, and the likelihood = TF × IDF for the word becomes large, and the word is erroneously extracted as a feature word of the target document.

[0020] In this embodiment, an information processing method capable of extracting characteristic words of a target document with high accuracy will be described.

[0021] In FIG. 1, (1-1) the information processing device 100 acquires a plurality of parts 111 obtained by dividing a target document 110 according to a specific condition. The target document 110 includes, for example, a plurality of pages. The target document 110 does not need to be divided by page. The target document 110 may include a relatively large number of generic and uncharacteristic words. In the example of FIG. 1, the uncharacteristic words are specifically words such as "Copyright" included in the footer of each page of the target document 110. The specific condition indicates, for example, dividing the target document 110 based on page breaks. The specific condition may also indicate, for example, dividing the target document 110 based on specific keywords.

[0022] The information processing device 100, for example, divides the target document 110 according to a specific condition, thereby acquiring a plurality of parts 111 obtained by dividing the target document 110. In the example of FIG. 1, the information processing device 100 specifically acquires a plurality of parts 111-i obtained by dividing the target document 110. In the example of FIG. 1, i=1 to 4. This allows the information processing device 100 to acquire a plurality of parts 111 each including a relatively small amount of uncharacteristic words and phrases that are included relatively frequently in the target document 110. Even if a generic and uncharacteristic word and phrase appears relatively frequently in the target document 110, the information processing device 100 can easily correctly evaluate that the word and phrase is not a characteristic word and phrase when the part 111 is used as a reference.

[0023] (1-2) The information processing device 100 extracts, from each of the acquired multiple parts 111, a feature word that represents the feature of the part 111. For example, the information processing device 100 extracts, from each of the parts 111, a feature word that represents the feature of the part 111, based on a first likelihood of each word included in the part 111 as a feature word that represents the feature of the part 111. The first likelihood is, for example, TF×IDF for the words in the part 111. The information processing device 100 generates a list 121 of feature words extracted from each of the parts 111.

[0024] In the example of Fig. 1, the information processing device 100 specifically extracts characteristic words that represent the characteristics of each part 111-i from the part 111-i, and generates a list 121-i of extracted characteristic words. In the example of Fig. 1, i = 1 to 4. As a result, even if a generic and non-characteristic word appears relatively frequently in the target document 110, the information processing device 100 can correctly evaluate it as not being a characteristic word based on the part 111, and extract characteristic words that represent the characteristics of the part 111.

[0025] (1-3) The information processing device 100 determines a feature word that represents the feature of the target document 110 from a feature word set that is a compilation of the extracted feature words. The feature word set is obtained, for example, by collecting the extracted feature words without duplication. The information processing device 100 determines a feature word that represents the feature of the target document 110 from the feature word set based on a second likelihood of each feature word included in the feature word set as a feature word that represents the feature of the target document 110. The information processing device 100 outputs, for example, a list 130 of the determined feature words. Specifically, the information processing device 100 stores the list 130 of the determined feature words in association with the target document 110.

[0026] This allows the information processing device 100 to accurately determine characteristic words that represent the characteristics of the target document 110. The information processing device 100 can, for example, use the portion 111 as a reference to exclude generic and uncharacteristic words that appear relatively frequently in the target document 110 from candidates for characteristic words that represent the characteristics of the target document 110. Then, the information processing device 100 can determine characteristic words that represent the characteristics of the target document 110 after excluding generic and uncharacteristic words from candidates for characteristic words that represent the characteristics of the target document 110. This allows the information processing device 100 to improve the accuracy of determining characteristic words that represent the characteristics of the target document 110.

[0027] The information processing device 100 may further provide the user with a service of searching for documents that satisfy a specified condition from among a plurality of documents based on the stored list of characteristic words 130. Specifically, the information processing device 100 accepts a condition designation based on an operational input by the user, and searches for documents that satisfy the specified condition based on the specified condition. The information processing device 100 then displays on a display the list of characteristic words 130 associated with the searched document together with the searched document, thereby providing the user with a service of searching for documents that satisfy the specified condition from among a plurality of documents. This allows the information processing device 100 to easily understand the content of the searched document based on the list of characteristic words 130.

[0028] Here, a case has been described in which the information processing device 100 divides the target document 110 according to a specific condition to obtain a plurality of divided parts 111 of the target document 110, but the present invention is not limited to this. For example, the information processing device 100 may receive a plurality of divided parts 111 of the target document 110 from another computer that divides the target document 110 according to a specific condition.

[0029] Here, the case has been described where the information processing device 100 displays on the display the list of characteristic words 130 associated with the searched document together with the document, and provides the user with a service for searching for documents that satisfy a specified condition from among multiple documents, but this is not limited to the case. For example, the information processing device 100 may transmit the list of characteristic words 130 associated with the searched document together with the document to another computer, and provide the user with a service for searching for documents that satisfy a specified condition from among multiple documents.

[0030] Here, the case has been described where the information processing device 100 provides a user with a service for searching for documents that satisfy a specified condition from among a plurality of documents, but the present invention is not limited to this. For example, the information processing device 100 may provide a user with a service for creating a summary of a document. In this case, the information processing device 100 determines characteristic words of the document and creates a summary of the document using the characteristic words of the document.

[0031] In this manner, the information processing device 100 may operate independently or may cooperate with another computer. An example of the case where the information processing device 100 cooperates with another computer will be described later specifically with reference to FIG. 2.

[0032] (An example of the information processing system 200) Next, an example of an information processing system 200 to which the information processing device 100 shown in FIG. 1 is applied will be described with reference to FIG.

[0033] 2 is an explanatory diagram showing an example of an information processing system 200. In FIG. 2, the information processing system 200 includes the information processing device 100, a document storage device 201, and a client device 202.

[0034] In the information processing system 200, the information processing device 100 and the document storage device 201 are connected via a wired or wireless network 210. The network 210 is, for example, a local area network (LAN), a wide area network (WAN), the Internet, etc. In the information processing system 200, the information processing device 100 and the client device 202 are connected via the wired or wireless network 210.

[0035] The information processing device 100 is a computer that provides a service of searching for documents. The documents are, for example, papers, proposals, design documents, contracts, or newspaper articles. The information processing device 100 acquires a plurality of documents from the document storage device 201. The information processing device 100 calculates the TF×IDF in each of the acquired documents for each word that appears in the document, and stores the calculated TF×IDF in the document in an overall frequency management table 400 described later in FIG. 4.

[0036] The information processing device 100 divides each of the multiple documents according to a specific condition, thereby acquiring multiple parts into which the document is divided. The information processing device 100 may acquire the multiple parts into which each of the multiple documents is divided by receiving them from the document storage device 201. The information processing device 100 calculates the TF×IDF for each word appearing in each of the multiple parts, and stores the TF×IDF in the part in a part frequency management table 500 described later in FIG. 5.

[0037] The information processing device 100 determines characteristic words that represent characteristics of each of a plurality of documents by referring to various tables described later in Fig. 4 and Fig. 5, associates them with the documents, and stores them in the important word management table 600 described later in Fig. 6. The characteristic words that represent characteristics of a document can be, for example, tags of the documents.

[0038] The information processing device 100 receives a condition for searching documents from the client device 202. The condition is, for example, that the document contains a specific keyword. The condition may be, for example, that the document is associated with a specific feature word. The information processing device 100 searches for one or more documents that satisfy the received condition from among a plurality of documents. The information processing device 100 refers to the key word management table 600 and acquires the feature words associated with each of the one or more searched documents.

[0039] The information processing device 100 transmits each of the one or more retrieved documents and the characteristic words associated with the document to the client device 202. The information processing device 100 is, for example, a server or a PC (Personal Computer).

[0040] The document storage device 201 is a computer that stores documents. The document storage device 201 accepts document input based on an operation input by an administrator of a service that searches for documents, and stores the accepted document. The document storage device 201 may collect documents from other computers to store them. The document storage device 201 provides the stored documents to the information processing device 100. The document storage device 201 may further divide each of the stored documents according to specific conditions, generate multiple parts by dividing the document, and provide the divided parts to the information processing device 100. The document storage device 201 is, for example, a server or a PC.

[0041] The client device 202 is a computer used by a user of the document search service. The client device 202 transmits document search conditions to the information processing device 100 based on an operational input by the user. The client device 202 receives each of the one or more searched documents and characteristic words associated with the document from the information processing device 100.

[0042] The client device 202 outputs each of the one or more retrieved documents and the characteristic words associated with the document so that the user can refer to the document. For example, the client device 202 displays each of the one or more retrieved documents and the characteristic words associated with the document on a display. The client device 202 is, for example, a PC, a tablet terminal, or a smartphone.

[0043] Here, the document search service is applied to applications such as searching for proposals that meet conditions such as a time period, trend, or target demographic specified by a user from among a number of proposals, each of which is a document.

[0044] Here, the case where the information processing device 100 and the document storage device 201 are different devices has been described, but the present invention is not limited to this. For example, the information processing device 100 may have a function as the document storage device 201 and operate as the document storage device 201. Here, the case where the information processing device 100 and the client device 202 are different devices has been described, but the present invention is not limited to this. For example, the information processing device 100 may have a function as the client device 202 and operate as the client device 202.

[0045] (Example of hardware configuration of information processing device 100) Next, an example of the hardware configuration of the information processing device 100 will be described with reference to FIG.

[0046] Fig. 3 is a block diagram showing an example of a hardware configuration of the information processing device 100. In Fig. 3, the information processing device 100 has a CPU (Central Processing Unit) 301, a memory 302, a network I / F (Interface) 303, a recording medium I / F 304, and a recording medium 305. In addition, each component is connected to each other via a bus 300.

[0047] Here, the CPU 301 is responsible for the overall control of the information processing device 100. The memory 302 has, for example, a read only memory (ROM), a random access memory (RAM), and a flash ROM. Specifically, for example, the flash ROM and the ROM store various programs, and the RAM is used as a work area for the CPU 301. The programs stored in the memory 302 are loaded into the CPU 301, causing the CPU 301 to execute the coded processes.

[0048] The network I / F 303 is connected to the network 210 through a communication line, and is connected to other computers via the network 210. The network I / F 303 manages an internal interface with the network 210, and controls input and output of data from other computers. The network I / F 303 is, for example, a modem or a LAN adapter.

[0049] The recording medium I / F 304 controls reading / writing data from / to the recording medium 305 under the control of the CPU 301. The recording medium I / F 304 is, for example, a disk drive, a solid state drive (SSD), a universal serial bus (USB) port, etc. The recording medium 305 is a non-volatile memory that stores data written under the control of the recording medium I / F 304. The recording medium 305 is, for example, a disk, a semiconductor memory, a USB memory, etc. The recording medium 305 may be detachable from the information processing device 100.

[0050] In addition to the above-mentioned components, the information processing device 100 may have, for example, a keyboard, a mouse, a display, a printer, a scanner, a microphone, a speaker, etc. Furthermore, the information processing device 100 may have a plurality of recording medium I / Fs 304 and recording media 305. Furthermore, the information processing device 100 may not have the recording medium I / Fs 304 and the recording media 305.

[0051] (Contents of the overall frequency management table 400) Next, an example of the contents of the total frequency management table 400 will be described with reference to Fig. 4. The total frequency management table 400 is realized by, for example, a storage area such as the memory 302 or the recording medium 305 of the information processing device 100 shown in Fig. 3.

[0052] Fig. 4 is an explanatory diagram showing an example of the contents stored in the total frequency management table 400. As shown in Fig. 4, the total frequency management table 400 has fields for ID, file ID, word ID, number of occurrences, and word score. The total frequency management table 400 stores total frequency information as record 400-a by setting information for each word in each field. a is an arbitrary integer.

[0053] The ID field is set with an ID that identifies a record. The file ID field is set with a file ID that identifies a document. The word ID field is set with a word ID that identifies a word that appears in the document. The occurrence count field is set with the number of occurrences of the word in the document. The word score field is set with the TF×IDF of the word in the document as a word score.

[0054] (Contents of partial frequency management table 500) Next, an example of the contents stored in the partial frequency management table 500 will be described with reference to Fig. 5. The partial frequency management table 500 is realized by, for example, a storage area such as the memory 302 or the recording medium 305 of the information processing device 100 shown in Fig. 3.

[0055] Fig. 5 is an explanatory diagram showing an example of the contents stored in the partial frequency management table 500. As shown in Fig. 5, the partial frequency management table 500 has fields for ID, file ID, segment ID, word ID, occurrence count, and word score. The partial frequency management table 500 stores partial frequency information as record 500-b by setting information in each field for each word. b is an arbitrary integer.

[0056] The ID field is set with an ID that identifies the record. The file ID field is set with a file ID that identifies the document. The segment ID field is set with a segment ID that identifies one of the multiple segments into which the document is divided. The word ID field is set with a word ID that identifies a word that appears in one of the segments. The occurrence count field is set with the number of occurrences of the word in one of the segments. The word score field is set with the TF×IDF of the word in one of the segments as the word score.

[0057] (Storage contents of important word management table 600) Next, an example of the contents stored in the important word management table 600 will be described with reference to Fig. 6. The important word management table 600 is realized by a storage area such as the memory 302 or the recording medium 305 of the information processing device 100 shown in Fig. 3.

[0058] Fig. 6 is an explanatory diagram showing an example of the contents stored in the important word management table 600. As shown in Fig. 6, the important word management table 600 has fields for ID, file ID, word ID, rank, and word score. The important word management table 600 stores important word information as record 600-c by setting information in each field for each word. c is an arbitrary integer.

[0059] The ID field is set with an ID that identifies the record. The file ID field is set with a file ID that identifies the document. The word ID field is set with a word ID that identifies a word that is a characteristic word of the document. The rank field is set with a rank that indicates the rank given to one or more words that are characteristic words of the document when the words are ranked in order of likelihood as characteristic words of the document. The smaller the word rank value, the more likely the word is to be a characteristic word of the document. The word score field is set with the TF×IDF of the word in the document as the word score.

[0060] (Example of Hardware Configuration of Document Storage Device 201) A specific example of the hardware configuration of the document storage device 201 is similar to the example of the hardware configuration of the information processing device 100 shown in FIG. 3, and therefore a description thereof will be omitted.

[0061] (Example of Hardware Configuration of Client Device 202) Specifically, an example of the hardware configuration of the client device 202 is similar to the example of the hardware configuration of the information processing device 100 shown in FIG. 3, and therefore a description thereof will be omitted.

[0062] (Example of functional configuration of information processing device 100) Next, an example of a functional configuration of the information processing device 100 will be described with reference to FIG.

[0063] 7 is a block diagram showing an example of a functional configuration of the information processing device 100. The information processing device 100 includes a storage unit 700, an acquisition unit 701, a division unit 702, a first extraction unit 703, a second extraction unit 704, and an output unit 705.

[0064] The storage unit 700 is realized by, for example, a storage area such as the memory 302 or the recording medium 305 shown in Fig. 3. In the following, a case where the storage unit 700 is included in the information processing device 100 will be described, but this is not limiting. For example, the storage unit 700 may be included in a device different from the information processing device 100, and the stored contents of the storage unit 700 may be accessible from the information processing device 100.

[0065] The acquiring unit 701 to the output unit 705 function as an example of a control unit. Specifically, the acquiring unit 701 to the output unit 705 realize their functions by, for example, causing the CPU 301 to execute a program stored in a storage area such as the memory 302 or the recording medium 305 shown in Fig. 3, or by the network I / F 303. The processing results of each functional unit are stored in, for example, a storage area such as the memory 302 or the recording medium 305 shown in Fig. 3.

[0066] The storage unit 700 stores various information that is referred to or updated in the processing of each functional unit. The storage unit 700 stores, for example, a plurality of documents. The document is data including a plurality of words. The document is data representing, for example, a sentence including a plurality of words. The document may be, for example, data representing a table. The document may be, for example, data representing a combination of a sentence and a chart. The document is, for example, acquired by the acquisition unit 701 and stored by the storage unit 700. The document may be, for example, stored in advance by the storage unit 700.

[0067] The storage unit 700 stores, for example, a plurality of parts obtained by dividing a document according to a specific condition. The specific condition indicates, for example, dividing a document by page. The specific condition may indicate, for example, dividing a document by slide. The specific condition may indicate, for example, dividing a document before and after a keyword included in the document. The plurality of parts are acquired, for example, by the acquisition unit 701 and stored by the storage unit 700. The plurality of parts may be generated, for example, by the division unit 702 and stored by the storage unit 700. The plurality of parts may be stored, for example, in advance by the storage unit 700. The storage unit 700 may store, for example, a specific condition for dividing a document. The specific condition is stored, for example, in advance by the storage unit 700.

[0068] The storage unit 700 stores, for example, a first likelihood of each word included in each of the multiple parts as a characteristic word of the part. The characteristic word of a part is a word that represents the characteristic of the part. The first likelihood is, for example, TF×IDF. Specifically, the storage unit 700 stores the part frequency management table 500 shown in FIG. 5. The first likelihood is, for example, calculated by the first extraction unit 703 and stored by the storage unit 700. The storage unit 700 stores, for example, a characteristic word of each of the multiple parts in association with the part. The characteristic word of the part is, for example, extracted by the first extraction unit 703 and stored by the storage unit 700.

[0069] The storage unit 700 stores, for example, a second likelihood of a characteristic word of at least one of a plurality of parts into which a document is divided as a characteristic word of the document. The second likelihood is, for example, TF×IDF. Specifically, the storage unit 700 stores the overall frequency management table 400 shown in FIG. 4. The second likelihood is, for example, calculated by the second extraction unit 704 and stored by the storage unit 700. The storage unit 700 stores, for example, characteristic words of a document in association with the document. The characteristic words of a document are words and phrases that express characteristics of the document. The characteristic words of a document are, for example, determined by the second extraction unit 704 and stored in the storage unit 700.

[0070] The acquisition unit 701 acquires various information used for processing by each functional unit. The acquisition unit 701 stores the acquired various information in the storage unit 700 or outputs it to each functional unit. The acquisition unit 701 may also output the various information stored in the storage unit 700 to each functional unit. The acquisition unit 701 acquires various information based on, for example, an operation input by a user. The acquisition unit 701 may receive various information from, for example, a device different from the information processing device 100.

[0071] The acquiring unit 701 acquires a target document. The acquiring unit 701 acquires the target document, for example, by reading each of the multiple documents stored in the storage unit 700 as the target document. The acquiring unit 701 may acquire the target document, for example, by reading any of the multiple documents stored in the storage unit 700 as the target document. The acquiring unit 701 may acquire the target document, for example, by receiving it from another computer.

[0072] The acquiring unit 701 acquires a plurality of parts obtained by dividing the target document. The acquiring unit 701 acquires the plurality of parts obtained by dividing each of the plurality of documents stored in the storage unit 700, for example, by reading them out as the plurality of parts obtained by dividing the target document. The acquiring unit 701 may acquire the plurality of parts obtained by dividing any one of the plurality of documents stored in the storage unit 700, for example, by reading them out as the plurality of parts obtained by dividing the target document. For example, when the acquiring unit 701 does not divide the target document by its own device, the acquiring unit 701 may acquire the plurality of parts obtained by dividing the target document by receiving them from another computer.

[0073] The acquisition unit 701 may receive a start trigger for starting the processing of any of the functional units. The start trigger may be, for example, a predetermined operation input by a user. The start trigger may be, for example, a receipt of predetermined information from another computer. The start trigger may be, for example, a result of any of the functional units outputting predetermined information. Specifically, the acquisition unit 701 may receive the acquisition of a target document as a start trigger for starting the processing of the division unit 702, the first extraction unit 703, and the second extraction unit 704. Specifically, the acquisition unit 701 may receive the acquisition of a target document and a plurality of parts obtained by dividing the target document as a start trigger for starting the processing of the first extraction unit 703 and the second extraction unit 704.

[0074] The dividing unit 702 obtains a plurality of parts obtained by dividing the target document. For example, the dividing unit 702 obtains a plurality of parts by dividing the target document according to a specific condition. Specifically, the dividing unit 702 obtains a plurality of parts obtained by dividing the target document by page units. Specifically, the dividing unit 702 may obtain a plurality of parts obtained by dividing the target document by dividing the target document before and after a keyword included in the target document.

[0075] In this way, if the target document contains a relatively large number of non-characteristic words, the dividing unit 702 can generate a plurality of parts each containing a relatively small amount of the words. Then, the dividing unit 702 can make each of the plurality of parts into which the target document is divided available as a criterion for determining characteristic words for the target document, in addition to the target document itself.

[0076] The first extraction unit 703 extracts a characteristic word of each of the acquired parts from the plurality of parts. For example, the first extraction unit 703 extracts a characteristic word of each of the parts from the respective parts based on a first likelihood of each word included in each of the parts being a characteristic word of the part.

[0077] Specifically, the first extraction unit 703 calculates a first likelihood for each word included in each part based on an evaluation value based on the frequency with which the word appears in the part and an evaluation value based on the number of parts in which the word appears among the multiple parts.Then, specifically, the first extraction unit 703 extracts characteristic words of each part based on the calculated first likelihood.More specifically, the first extraction unit 703 extracts, from among words included in each part, words whose calculated first likelihood is equal to or greater than a threshold as characteristic words of the part.

[0078] As a result, even if generic and uncharacteristic words and phrases appear relatively frequently in the target document, the first extraction unit 703 can correctly evaluate each part as a criterion and extract characteristic words for each part. Therefore, the first extraction unit 703 can narrow down candidates for characteristic words when determining characteristic words for the target document, and can accurately determine characteristic words for the target document.

[0079] The first extraction unit 703 may extract characteristic words of each of the acquired parts based on a plurality of documents including the target document. Specifically, the first extraction unit 703 calculates a first likelihood for each word included in each part based on the plurality of documents. Then, specifically, the first extraction unit 703 extracts characteristic words of each part based on the calculated first likelihood.

[0080] As a result, even if generic and uncharacteristic words and phrases appear relatively frequently in the target document, the first extraction unit 703 can correctly evaluate each part as a criterion and extract characteristic words for each part. Therefore, the first extraction unit 703 can narrow down candidates for characteristic words when determining characteristic words for the target document, and can accurately determine characteristic words for the target document.

[0081] The second extraction unit 704 determines feature words of the target document from a feature word set that is a compilation of the feature words extracted by the first extraction unit 703. The feature word set is generated by compiling the feature words extracted by the first extraction unit 703 without duplication. The second extraction unit 704 determines feature words of the target document from the feature word set, for example, based on a second likelihood of each feature word included in the feature word set as a feature word of the target document.

[0082] Specifically, the second extraction unit 704 calculates a second likelihood for each feature word based on an evaluation value based on the frequency with which the feature word appears in the target document and an evaluation value based on the number of documents in which the feature word appears among a plurality of documents including the target document.Then, specifically, the second extraction unit 704 determines a feature word of the target document from the feature word set based on the calculated second likelihood.More specifically, the second extraction unit 704 determines a feature word of the target document from the feature word set whose calculated second likelihood is equal to or greater than a threshold value as a feature word of the target document.

[0083] In this way, the second extraction unit 704 can determine the feature words of the target document from the feature word set after the candidates for feature words when determining the feature words of the target document are narrowed down to the feature words included in the feature word set. Therefore, the second extraction unit 704 can determine the feature words of the target document with high accuracy.

[0084] Here, the case where the first extraction unit 703 extracts a characteristic word of each part from the part has been described, but this is not limiting. For example, after the first extraction unit 703 calculates the first likelihood for each word included in each part, there may be a case where the first extraction unit 703 does not extract a characteristic word of the part from each part.

[0085] In this case, the second extraction unit 704 calculates, for example, a second likelihood for each term contained in the target document as a characteristic term of the target document. Specifically, the second extraction unit 704 calculates the second likelihood for each term based on an evaluation value based on the frequency with which the term appears in the target document and an evaluation value based on the number of documents in which the term appears among multiple documents including the target document.

[0086] Then, the second extraction unit 704 determines characteristic words of the target document from among phrases included in the target document based on, for example, the first likelihood calculated by the first extraction unit 703 and the second likelihood calculated by the second extraction unit 704. Specifically, the second extraction unit 704 calculates, for each phrase, the product of the first likelihood calculated by the first extraction unit 703 and the second likelihood calculated by the second extraction unit 704 as a third likelihood. Specifically, the second extraction unit 704 determines, as characteristic words of the target document, phrases whose calculated third likelihood is equal to or greater than a threshold value.

[0087] This allows the second extraction unit 704 to determine characteristic words of the target document based on various likelihoods obtained from different perspectives for the target document unit and each of the multiple parts into which the target document is divided. This allows the second extraction unit 704 to accurately determine characteristic words of the target document.

[0088] The output unit 705 outputs the processing result of at least one of the functional units. The output format is, for example, display on a display, printout on a printer, transmission to an external device via the network I / F 303, or storage in a storage area such as the memory 302 or the recording medium 305. In this way, the output unit 705 can notify the user of the processing result of at least one of the functional units, thereby improving the convenience of the information processing device 100.

[0089] The output unit 705 outputs the target document in association with the characteristic words of the target document determined by the second extraction unit 704. For example, the output unit 705 may transmit the target document in association with the characteristic words of the target document determined by the second extraction unit 704 to a search unit (not shown) that searches for documents. The search unit may be included in, for example, the information processing device 100. The search unit may be included in, for example, another computer.

[0090] As a result, the output unit 705 can make the characteristic words of the target document available when the search unit searches for the target document, making it easier to search for the target document. The output unit 705 can make it possible for the search unit to output search results including the characteristic words of the target document together with the searched target document, making it easier for viewers of the search results to understand the contents of the searched target document.

[0091] The output unit 705 may, for example, associate the target document with the characteristic words of the target document determined by the second extraction unit 704, and transmit them to another computer. The other computer is, for example, the client device 202. The output unit 705 may, for example, associate the target document with the characteristic words of the target document determined by the second extraction unit 704, and display them so that the user can refer to them. In this way, the output unit 705 can make it easier for the user to understand the contents of the target document.

[0092] (Operation flow of information processing device 100) Next, the flow of operations of the information processing device 100 will be described with reference to FIG.

[0093] Fig. 8 is an explanatory diagram showing the flow of operations of the information processing device 100. In Fig. 8, the information processing device 100 acquires a document group 800. The document group 800 includes, for example, document A. In the following explanation, a case where the information processing device 100 processes document A will be explained. A case where the information processing device 100 processes another document is also similar to the case explained below.

[0094] (8-1) The information processing device 100 divides the document A into page units and acquires a page group 810. The page group 810 includes, for example, page 1, page 2, and page 3.

[0095] (8-2) The information processing device 100 performs a morphological analysis on each page and generates a list of words appearing on each page. The words may be limited to nouns, for example. For each word included in the list of words appearing on each page, the information processing device 100 calculates a TF related to the frequency of appearance of the word and an IDF related to the number of pages in document A that include the word, and calculates TF×IDF as a word score.

[0096] The information processing device 100 may calculate, for each word included in the list of words appearing on each page, a TF relating to the frequency of appearance of the word and an IDF relating to the number of documents including the word in the document set 800, and calculate TF×IDF. The information processing device 100 stores the calculated word scores in the partial frequency management table 500.

[0097] The information processing device 100 refers to the partial frequency management table 500 and extracts, for each page, words whose calculated TF×IDF is equal to or greater than a first threshold value as characteristic words of the page. The information processing device 100 may also refer to the partial frequency management table 500 and extract, for each page, words up to a predetermined rank when the words are arranged in descending order of the calculated TF×IDF as characteristic words of the page.

[0098] (8-3) The information processing device 100 executes a morphological analysis on the document A and generates a list of words appearing in the document A. The information processing device 100 generates a word group by collecting words extracted as characteristic words of at least any of the pages from the generated word list.

[0099] (8-4) For each word included in the generated word group, the information processing device 100 calculates a TF related to the appearance frequency of the word and an IDF including the word in the document group 800, and calculates TF×IDF as a word score. The information processing device 100 stores the calculated word score in the overall frequency management table 400.

[0100] (8-5) The information processing device 100 refers to the overall frequency management table 400 and determines words whose calculated TF×IDF is equal to or greater than the second threshold as characteristic words of document A. As a result, the information processing device 100 narrows down candidates for characteristic words of the document before determining the characteristic words of the document, and therefore can determine the characteristic words of the document with high accuracy.

[0101] (An example of the operation of the information processing device 100) Next, an example of the operation of the information processing device 100 will be described with reference to FIGS.

[0102] 9 to 11 are explanatory diagrams showing an example of the operation of the information processing device 100. In FIG. 9, (9-1) the information processing device 100 acquires a document 900. The document 900 is, for example, a proposal. The document 900 includes a fixed phrase such as Copyright 2021 XXX LIMITED in the footer of each page.

[0103] The pages are, for example, P1, P2 to P3, P4 to P5, and P6. In the example of Fig. 9, P2 to P3 and P4 to P5 are treated as one page. The information processing device 100 divides the document 900 into page units and generates a plurality of division parts 901.

[0104] (9-2) The information processing device 100 performs a morphological analysis on each of the segment parts 901 and generates a list 911 of words appearing in each of the segment parts 901.

[0105] (9-3) The information processing device 100 calculates, for each word included in the word list 911 corresponding to each segment 901, the TF×IDF for that segment 901 as the word score for that segment 901. As indicated by reference numeral 921 in FIG. 9, the word score for each word included in the word list 911 is calculated. In the example of FIG. 9, the word score is a value in parentheses added after the word. The information processing device 100 stores the calculated word score in the part frequency management table 500. Next, the description will move to FIG. 10.

[0106] 10, (10-1) the information processing device 100 extracts words having a word score equal to or greater than a first threshold from a word list 911 corresponding to each segment 901 as important words expressing the characteristics of the segment 901. The first threshold is, for example, 0.5. The information processing device 100 generates a list 1001 of important words that compiles the extracted important words for each segment 901.

[0107] (10-2) The information processing device 100 generates an important word group 1010 by collecting important words without duplication from the list of important words 1001. The information processing device 100 calculates the TF×IDF in the document 900 for each important word included in the important word group 1010 as a word score in the document 900. As shown in FIG. 10, the word score of each word included in the important word group 1010 is calculated. In the example of FIG. 10, the word score is a value in parentheses added after the word. The information processing device 100 ranks the important words included in the important word group 1010 in descending order of the calculated word scores.

[0108] (10-3) As a result of the ranking, the information processing device 100 determines the top five important words indicated by reference numeral 1020 as characteristic words of the document 900. The information processing device 100 associates the determined characteristic words of the document 900 with the document 900 as tags and stores them in the important word management table 600. As a result, the information processing device 100 narrows down candidates for characteristic words of the document 900 before determining characteristic words of the document 900, and therefore can determine characteristic words of the document 900 with high accuracy. Next, we move on to the description of FIG. 11.

[0109] 11, it is assumed that the information processing device 100 determines characteristic words for a plurality of documents 900 and stores them as tags in the important word management table 600, similarly to Figs. 9 and 10. It is assumed that the information processing device 100 receives conditions for searching the documents 900 in an input field 1101 of a search screen 1100.

[0110] The information processing device 100 searches for documents 900 that satisfy the received conditions from among a plurality of documents 900. The information processing device 100 refers to the key word management table 600 and displays a thumbnail image 1110 of each of the searched documents 900, together with a list 1111 of tags of the documents 900, on the search screen 1100. This enables the information processing device 100 to make it easier for the searcher to understand the contents of each of the searched documents 900.

[0111] (Overall processing procedure) Next, an example of an overall processing procedure executed by the information processing device 100 will be described with reference to Fig. 12. The overall processing is realized by, for example, the CPU 301, storage areas such as the memory 302 and the recording medium 305, and the network I / F 303 shown in Fig. 3.

[0112] Fig. 12 is a flowchart showing an example of an overall process procedure. In Fig. 12, the information processing device 100 executes a first generation process described later in Fig. 14 to generate an overall frequency management table 400 for each of a plurality of documents (step S1201).

[0113] Next, the information processing device 100 selects a document to be analyzed from among the documents included in the multiple documents and that have not yet been selected as a document to be analyzed (step S1202). Then, the information processing device 100 divides the selected document to be analyzed according to specific conditions, and obtains multiple delimited parts into which the document to be analyzed is divided (step S1203).

[0114] Next, the information processing device 100 executes a partial process described later in Fig. 13 (step S1204). Then, the information processing device 100 refers to the overall frequency management table 400 related to the selected document to be analyzed, and calculates the score of each of the one or more important words (step S1205).

[0115] Next, the information processing device 100 determines, based on the calculated score, from one or more important words, important words that will become characteristic words of the selected document to be analyzed (step S1206).Then, the information processing device 100 stores the determined important words in the important word management table 600 in association with the selected document to be analyzed (step S1207).

[0116] Next, the information processing device 100 determines whether or not all documents have been selected as documents to be analyzed (step S1208). If there are documents that have not yet been selected (step S1208: No), the information processing device 100 returns to the process of step S1202. On the other hand, if all documents have been selected (step S1208: Yes), the information processing device 100 ends the entire process.

[0117] (Partial Processing Steps) Next, an example of a partial process procedure executed by the information processing device 100 will be described with reference to Fig. 13. The partial process is realized by, for example, the CPU 301, storage areas such as the memory 302 and the recording medium 305, and the network I / F 303 shown in Fig. 3.

[0118] Fig. 13 is a flowchart showing an example of a part processing procedure. In Fig. 13, the information processing device 100 executes a second generation process described later in Fig. 15 to generate a part frequency management table 500 for each of the acquired multiple division parts (step S1301).

[0119] Next, the information processing device 100 selects a segment to be analyzed from among the segment parts that are included in the multiple segment parts and that have not yet been selected as a segment to be analyzed (step S1302).Then, the information processing device 100 performs a morphological analysis on the selected segment to be analyzed, and generates a list of words that appear in the segment to be analyzed (step S1303).

[0120] Next, the information processing device 100 refers to the part frequency management table 500 for the segment part of the selected analysis target, and calculates the score of each word included in the generated word list (step S1304). Then, the information processing device 100 extracts words that are important words for the segment part of the selected analysis target from the generated word list based on the calculated score (step S1305).

[0121] Next, the information processing device 100 stores the determined words as important words in the important word management table 600 in association with the selected segment to be analyzed (step S1306). Then, the information processing device 100 judges whether or not all segment parts have been selected as segment parts to be analyzed (step S1307). If there are segment parts that have not yet been selected (step S1307: No), the information processing device 100 returns to the process of step S1302. On the other hand, if all segment parts have been selected (step S1307: Yes), the information processing device 100 ends the partial process.

[0122] (First generation process procedure) Next, an example of a first generation process procedure executed by the information processing device 100 will be described with reference to Fig. 14. The first generation process is realized by, for example, the CPU 301, storage areas such as the memory 302 and the recording medium 305, and the network I / F 303 shown in Fig. 3.

[0123] Fig. 14 is a flowchart showing an example of a procedure of the first generation process, in which the information processing device 100 selects a document to be measured from among documents that are included in a plurality of documents and have not yet been selected (step S1401).

[0124] Next, the information processing device 100 performs a morphological analysis on the selected measurement target document and extracts one or more words appearing in the measurement target document (step S1402). Then, the information processing device 100 generates an overall frequency management table 400 for the selected measurement target document based on the extracted one or more words (step S1403).

[0125] Next, the information processing device 100 determines whether all documents have been selected as documents to be measured (step S1404). If there are documents that have not yet been selected (step S1404: No), the information processing device 100 returns to the process of step S1401. On the other hand, if all documents have been selected (step S1404: Yes), the information processing device 100 ends the first generation process.

[0126] (Second generation process procedure) Next, an example of a procedure of the second generation process executed by the information processing device 100 will be described with reference to Fig. 15. The second generation process is realized by, for example, the CPU 301, storage areas such as the memory 302 and the recording medium 305, and the network I / F 303 shown in Fig. 3.

[0127] Fig. 15 is a flowchart showing an example of a procedure of the second generation process, in which the information processing device 100 selects a measurement target segment from among a plurality of segment segments that have not yet been selected (step S1501).

[0128] Next, the information processing device 100 performs a morphological analysis on the segment of the selected measurement target and extracts one or more words appearing in the segment of the measurement target (step S1502).Then, the information processing device 100 generates a part frequency management table 500 for the segment of the selected measurement target based on the one or more extracted words (step S1503).

[0129] Next, the information processing device 100 determines whether or not all the separators have been selected as separators to be measured (step S1504). If there are separators that have not yet been selected (step S1504: No), the information processing device 100 returns to the process of step S1501. On the other hand, if all the separators have been selected (step S1504: Yes), the information processing device 100 ends the second generation process.

[0130] Here, the information processing device 100 may execute some of the steps in the flowcharts of FIGS. 12 to 15 in a different order.

[0131] As described above, the information processing device 100 can obtain a plurality of parts obtained by dividing a target document according to a specific condition. The information processing device 100 can extract characteristic words of the parts from each of the obtained plurality of parts based on a first likelihood of each word contained in each part as a characteristic word of the part. The information processing device 100 can determine characteristic words of the target document from a characteristic word set based on a second likelihood of each characteristic word contained in a characteristic word set that summarizes the extracted characteristic words as a characteristic word of the target document. This allows the information processing device 100 to accurately determine characteristic words of the target document.

[0132] According to the information processing device 100, for each term included in each part, a first likelihood can be calculated based on an evaluation value based on the frequency of the term appearing in the part and an evaluation value based on the number of parts in which the term appears among the multiple parts. According to the information processing device 100, a feature word of the part can be extracted from each part based on the calculated first likelihood. According to the information processing device 100, for each feature word, a second likelihood can be calculated based on an evaluation value based on the frequency of the feature word appearing in the target document and an evaluation value based on the number of documents in which the feature word appears among the multiple documents including the target document. According to the information processing device 100, a feature word of the target document can be determined from the feature word set based on the calculated second likelihood. Thereby, the information processing device 100 can accurately calculate the first likelihood and the second likelihood, and can accurately determine the feature word of the target document.

[0133] According to the information processing device 100, among the words included in each part, words having the calculated first likelihood equal to or greater than a threshold value can be extracted as characteristic words of the part. This allows the information processing device 100 to narrow down candidates for characteristic words of the target document.

[0134] According to the information processing device 100, it is possible to calculate a first likelihood for each word included in each of the acquired multiple parts. According to the information processing device 100, it is possible to calculate a second likelihood for each word included in the target document. According to the information processing device 100, it is possible to determine characteristic words of the target document from among the words included in the target document based on the calculated first likelihood and the calculated second likelihood. This makes it possible to omit the operation of narrowing down characteristic words of the target document and reduce the amount of processing.

[0135] According to the information processing device 100, it is possible to obtain a plurality of parts obtained by dividing a target document by page units. This makes it possible for the information processing device 100 to easily obtain a plurality of parts each containing a relatively small amount of uncharacteristic words and phrases that are contained relatively frequently in the target document.

[0136] According to the information processing device 100, it is possible to obtain a plurality of parts obtained by dividing the target document around a keyword contained in the target document. This makes it possible for the information processing device 100 to easily obtain a plurality of parts each containing a relatively small amount of uncharacteristic words and phrases contained relatively frequently in the target document.

[0137] According to the information processing device 100, it is possible to extract characteristic words for each of the acquired parts based on a plurality of documents including the target document. This allows the information processing device 100 to extract characteristic words for each part with high accuracy.

[0138] The information processing method described in this embodiment can be realized by executing a prepared program on a computer such as a PC or a workstation. The information processing program described in this embodiment is recorded on a computer-readable recording medium, and is executed by being read from the recording medium by the computer. The recording medium may be a hard disk, a flexible disk, a CD (Compact Disc)-ROM, an MO (Magneto Optical disc), a DVD (Digital Versatile Disc), or the like. The information processing program described in this embodiment may also be distributed via a network such as the Internet.

[0139] The following supplementary notes are further disclosed regarding the above-described embodiment.

[0140] (Appendix 1) Obtain multiple parts by dividing the target document according to specific conditions, extracting, from each of the acquired plurality of parts, a feature word that represents a feature of the part, based on a first likelihood of each word contained in each of the acquired plurality of parts as a feature word that represents a feature of the part; determining, from the feature word set, a feature word that represents a feature of the target document, based on a second likelihood, for each feature word included in a feature word set that summarizes the extracted feature words, as a feature word that represents a feature of the target document; An information processing program that causes a computer to execute a process.

[0141] (Appendix 2) The extraction process is calculating the first likelihood for each word included in each of the portions based on an evaluation value based on a frequency at which the word appears in the portion and an evaluation value based on a number of portions in which the word appears among the plurality of portions, and extracting, from each of the portions, a characteristic word that represents a characteristic of the portion based on the calculated first likelihood; The process of determining includes: The information processing program described in Appendix 1, characterized in that for each of the feature words, the second likelihood is calculated based on an evaluation value based on the frequency with which the feature word appears in the target document and an evaluation value based on the number of documents in which the feature word appears among a plurality of documents including the target document, and a feature word that represents a characteristic of the target document is determined from the set of feature words based on the calculated second likelihood.

[0142] (Appendix 3) The extraction process is An information processing program as described in Appendix 2, characterized in that among the words contained in each of the parts, words whose calculated first likelihood is equal to or greater than a threshold are extracted as characteristic words representing the characteristics of the part.

[0143] (Appendix 4) For each word contained in each of the acquired plurality of parts, a first likelihood is calculated as a feature word representing a feature of the part, based on an evaluation value based on a frequency at which the word appears in the part and an evaluation value based on a number of parts in which the word appears among the plurality of parts; calculating a second likelihood for each term contained in the target document as a characteristic term representing a characteristic of the target document based on an evaluation value based on a frequency at which the term appears in the target document and an evaluation value based on a number of documents in which the term appears among a plurality of documents including the target document; determining, from among words contained in the target document, a characteristic word that represents a characteristic of the target document, based on the calculated first likelihood and the calculated second likelihood; 4. The information processing program according to any one of claims 1 to 3, which causes the computer to execute a process.

[0144] (Supplementary Note 5) The information processing program according to any one of Supplementary Notes 1 to 4, wherein the plurality of parts are obtained by dividing the target document on a page-by-page basis.

[0145] (Supplementary Note 6) The information processing program according to any one of Supplementary Notes 1 to 5, characterized in that the multiple parts are obtained by dividing the target document before and after a keyword contained in the target document.

[0146] (Appendix 7) The extraction process is An information processing program described in any one of Appendices 1 to 6, characterized in that characteristic words that represent characteristics of each of the acquired multiple parts are extracted from each of the multiple parts based on multiple documents including the target document.

[0147] (Appendix 8) Obtain multiple parts by dividing the target document according to specific conditions, extracting, from each of the acquired plurality of parts, a feature word that represents a feature of the part, based on a first likelihood of each word contained in each of the acquired plurality of parts as a feature word that represents a feature of the part; determining, from the feature word set, a feature word that represents a feature of the target document, based on a second likelihood, for each feature word included in a feature word set that summarizes the extracted feature words, as a feature word that represents a feature of the target document; An information processing method characterized in that the processing is executed by a computer.

[0148] (Appendix 9) Obtain multiple parts by dividing the target document according to specific conditions, extracting, from each of the acquired plurality of parts, a feature word that represents a feature of the part, based on a first likelihood of each word contained in each of the acquired plurality of parts as a feature word that represents a feature of the part; determining, from the feature word set, a feature word that represents a feature of the target document, based on a second likelihood, for each feature word included in a feature word set that summarizes the extracted feature words, as a feature word that represents a feature of the target document; An information processing device comprising a control unit. [Explanation of symbols]

[0149] 100 Information processing device 110 Documents 111,901 parts 121,130,911,1001,1111 List 200 Information Processing Systems 201 Document storage device 202 Client device 210 Network 300 Bus 301 CPU 302 Memory 303 Network Interface 304 Recording media I / F 305 Recording media 400 Overall Frequency Management Table 500 Partial Frequency Management Table 600 Important Words Management Table 700 Storage section 701 Acquisition Department 702 Split part 703 1st extraction part 704 Second extraction part 705 Output section 800 Document Set 810 Pages 900 Documents 921,1020 code 1010 Important Word Group 1100 Search screen 1101 Input field 1110 Thumbnail Images

Claims

1. Obtaining multiple parts by dividing the target document according to specific conditions; extracting, from each of the acquired plurality of parts, a feature word that represents a feature of the part, based on a first likelihood of each word or phrase contained in each of the acquired plurality of parts being a feature word that represents a feature of the part; determining, from the feature word set, a feature word that represents a feature of the target document, based on a second likelihood of each feature word included in a feature word set that summarizes the extracted feature words as a feature word that represents a feature of the target document; An information processing program that causes a computer to execute a process.

2. The extraction process includes: calculating the first likelihood for each word included in each of the portions based on an evaluation value based on a frequency at which the word appears in the portion and an evaluation value based on a number of portions in which the word appears among the plurality of portions, and extracting, from each of the portions, a characteristic word that represents a characteristic of the portion based on the calculated first likelihood; The process of determining includes: The information processing program described in claim 1, characterized in that for each of the feature words, the second likelihood is calculated based on an evaluation value based on the frequency with which the feature word appears in the target document and an evaluation value based on the number of documents in which the feature word appears among a plurality of documents including the target document, and a feature word that represents a characteristic of the target document is determined from the set of feature words based on the calculated second likelihood.

3. The extraction process includes:

3. The information processing program according to claim 2, further comprising: extracting, from among the words contained in each of the portions, a word for which the calculated first likelihood is equal to or greater than a threshold value as a characteristic word representing a characteristic of the portion.

4. calculating a first likelihood for each word included in each of the acquired plurality of parts as a characteristic word representing a characteristic of the part, based on an evaluation value based on a frequency at which the word appears in the part and an evaluation value based on a number of parts in which the word appears among the plurality of parts; calculating a second likelihood for each term contained in the target document as a characteristic word representing a characteristic of the target document based on an evaluation value based on a frequency at which the term appears in the target document and an evaluation value based on a number of documents in which the term appears among a plurality of documents including the target document; determining, based on the calculated first likelihood and the calculated second likelihood, a feature word representing a feature of the target document from among words and phrases contained in the target document; 4. The information processing program according to claim 1, which causes the computer to execute a process.

5. Obtaining multiple parts by dividing the target document according to specific conditions; extracting, from each of the acquired plurality of parts, a feature word that represents a feature of the part, based on a first likelihood of each word contained in each of the acquired plurality of parts being a feature word that represents a feature of the part; determining, from the feature word set, a feature word that represents a feature of the target document, based on a second likelihood, for each feature word included in a feature word set that summarizes the extracted feature words, as a feature word that represents a feature of the target document; An information processing method characterized in that the processing is executed by a computer.

6. Obtaining multiple parts by dividing the target document according to specific conditions; extracting, from each of the acquired plurality of parts, a feature word that represents a feature of the part, based on a first likelihood of each word contained in each of the acquired plurality of parts being a feature word that represents a feature of the part; determining, from the feature word set, a feature word that represents a feature of the target document, based on a second likelihood, for each feature word included in a feature word set that summarizes the extracted feature words, as a feature word that represents a feature of the target document; An information processing device comprising a control unit.

Images