Information processing system, information processing device, information processing method, and recording medium

Abstract

An information processing system (10) is provided with: a first text data acquisition means (110) for acquiring first text data; an audio data generation means (120) for generating first audio data corresponding to the first text data; a context symbol acquisition means (130) for acquiring context symbols corresponding to words included in the first text data; a text data generation means (140) for inserting the context symbols into the first text data and generating second text data; and a training means (150) for training an audio recognition means for generating text data corresponding to audio data from the audio data, having the first audio data and the second audio data as inputs.

Description

[Technical Field]

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing device, an information processing method, and a recording medium. [Background technology]

[0002] One known system of this type is one that trains a speech recognizer. For example, Patent Document 1 discloses a technique in which speech patterns are sequentially input into an initially trained neural network to obtain speech recognition results, and any misrecognitions that occur during this process are selected as input patterns for additional training. Patent Document 2 also discloses a technique in which training is performed using a training data set consisting of speech signals and text and attribute information corresponding to the speech signals.

[0003] As another related technique, Patent Document 3 discloses generating a speech waveform based on attribute symbols that indicate attributes of text such as titles and summaries. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 08-146996 [Patent Document 2] Japanese Patent Publication No. 2020-154076 [Patent Document 3] JP Patent Publication No. 06-044247 Summary of the Invention [Problem to be solved by the invention]

[0005] This disclosure aims to improve upon the techniques disclosed in the prior art documents. [Means for solving the problem]

[0006] One aspect of the information processing system disclosed herein comprises a first text data acquisition means for acquiring first text data, a voice data generation means for generating first voice data corresponding to the first text data, a context symbol acquisition means for acquiring context symbols corresponding to words included in the first text data, a text data generation means for inserting the context symbols into the first text data to generate second text data, and a training means for training a voice recognition means for using the first voice data and the second text data as inputs to generate text data corresponding to the voice data from the voice data.

[0007] One aspect of the information processing device disclosed herein includes a first text data acquisition means for acquiring first text data, a voice data generation means for generating first voice data corresponding to the first text data, a context symbol acquisition means for acquiring context symbols corresponding to words included in the first text data, a text data generation means for inserting the context symbols into the first text data to generate second text data, and a learning means for training a voice recognition means for using the first voice data and the second text data as inputs to generate text data corresponding to the voice data from the voice data.

[0008] One aspect of the information processing method of this disclosure is an information processing method executed by at least one computer, which acquires first text data, generates first speech data corresponding to the first text data, acquires context symbols corresponding to words included in the first text data, inserts the context symbols into the first text data to generate second text data, and trains a speech recognition means that uses the first speech data and the second text data as inputs and generates text data corresponding to the speech data from the speech data.

[0009] One aspect of the recording medium of this disclosure has recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes acquiring first text data, generating first audio data corresponding to the first text data, acquiring context symbols corresponding to words included in the first text data, inserting the context symbols into the first text data to generate second text data, and training a speech recognition means that uses the first audio data and the second text data as inputs to generate text data corresponding to the audio data from the audio data. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a hardware configuration of an information processing system according to a first embodiment. [Figure 2] 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment. [Figure 3] 1 is a table showing an example of first text data, context symbols, and second text data. [Figure 4] 4 is a flowchart showing the flow of operations performed by the information processing system according to the first embodiment. [Figure 5] FIG. 10 is a block diagram showing the functional configuration of an information processing system according to a second embodiment. [Figure 6] 1 is a table showing an example of words and context symbols stored in a dictionary database. [Figure 7] FIG. 10 is a block diagram showing the functional configuration of an information processing system according to a third embodiment. [Figure 8] 11 is a flowchart showing the flow of an update operation by the information processing system according to the third embodiment. [Figure 9] FIG. 10 is a block diagram showing the functional configuration of an information processing system according to a fourth embodiment. [Figure 10] 13 is a flowchart showing the flow of a word adding operation by the information processing system according to the fourth embodiment. [Figure 11]FIG. 11 is a block diagram showing the functional configuration of an information processing system according to a fifth embodiment. [Figure 12] 13 is a flowchart showing the flow of a word adding operation by the information processing system according to the fifth embodiment. [Figure 13] FIG. 13 is a block diagram showing the functional configuration of an information processing system according to a sixth embodiment. [Figure 14] 1 is a table showing an example of words, context symbols, and context examples stored in a dictionary database. [Figure 15] 13 is a flowchart showing the flow of a word adding operation by the information processing system according to the sixth embodiment. [Figure 16] FIG. 13 is a block diagram showing the functional configuration of an information processing system according to a seventh embodiment. [Figure 17] 13 is a flowchart showing the flow of operations performed by the information processing system according to the seventh embodiment.

[0011] Hereinafter, embodiments of an information processing system, an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0012] First Embodiment An information processing system according to a first embodiment will be described with reference to FIGS.

[0013] (Hardware configuration) First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment.

[0014] 1, an information processing system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing system 10 may further include an input device 15 and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected via a data bus 17.

[0015] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, a functional block that performs training of a speech recognizer is realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control of the information processing system 10.

[0016] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a demand-side platform (DSP), or an application-specific integrated circuit (ASIC). The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0017] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that is temporarily used by the processor 11 while the processor 11 is executing the computer programs. The RAM 12 may be, for example, a D-RAM (Dynamic RAM).

[0018] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable ROM (P-ROM).

[0019] The storage device 14 stores data that is to be saved long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0020] The input device 15 is a device that receives input instructions from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet.

[0021] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may also be a speaker or the like that can output information related to the information processing system 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet.

[0022] 1 shows an example of information processing system 10 including a plurality of devices, but all or some of the functions may be realized by a single device (information processing device). This information processing device may be configured to include only processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., storage device 14, input device 15, output device 16) may be provided by an external device connected to the information processing device. Furthermore, some of the calculation functions of the information processing device may be realized by an external device (e.g., an external server, a cloud, etc.).

[0023] (Functional configuration) Next, the functional configuration of the information processing system 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.

[0024] As shown in FIG. 2, the information processing system 10 according to the first embodiment is configured to execute training of a speech recognizer 50. The speech recognizer 50 is a device that generates text data from speech data. The training of the speech recognizer 50 is executed, for example, to generate text data with higher accuracy. The training of the speech recognizer 50 may be to train a conversion model used by the speech recognizer 50 (i.e., a model that converts speech data into text data). Note that the information processing system 10 according to the first embodiment does not include the speech recognizer 50 itself as a component, but may be configured as a system that includes the speech recognizer 50.

[0025] The information processing system 10 according to the first embodiment is configured to include, as components for realizing its functions, a first text data acquisition unit 110, a voice data generation unit 120, a context symbol acquisition unit 130, a text data generation unit 140, and a learning unit 150. Each of the first text data acquisition unit 110, the voice data generation unit 120, the context symbol acquisition unit 130, the text data generation unit 140, and the learning unit 150 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0026] The first text data acquisition unit 110 is configured to be able to acquire first text data. The first text data is text data acquired for training a speech recognizer. The first text data may be, for example, data consisting of words only, or text data in sentence format. The first text data acquisition unit 110 may acquire multiple pieces of first text data. Note that the first text data acquisition unit 110 may acquire the first text data by voice input. That is, voice data may be converted into text data and acquired as the first text data.

[0027] The voice data generation unit 120 is configured to be able to generate first voice data from the first text data acquired by the first text data acquisition unit 110. That is, the voice data generation unit 120 has a function of converting text data into voice data. Note that, as a method for converting text data into voice data can be appropriately adopted from existing technologies, a detailed description thereof will be omitted here.

[0028] The context symbol acquisition unit 130 is configured to acquire context symbols corresponding to words included in the first text data acquired by the first text data acquisition unit 110. The context symbol is information indicating how the word is used in the context. The context symbol may indicate a word category, such as a "person's name," a "place name," an "organization name," or a "product name," or may indicate a word part of speech, such as a "noun" or a "verb." When the first text data includes multiple words, the context symbol acquisition unit 130 may acquire a context symbol for each of the multiple words. In this case, the context symbol acquisition unit 130 may acquire context symbols for all words included in the first text data, or may acquire context symbols for only some of the words. A method for acquiring context symbols will be described in detail in another embodiment described later.

[0029] The text data generation unit 140 is configured to be able to generate the second text data. Specifically, the text data generation unit 140 generates the second text data by inserting the context symbol acquired by the context symbol acquisition unit 130 into the first text data acquired by the first text data. That is, the second text data is data consisting of the first text data and the context symbol. The method for generating the second text data will be described in detail later.

[0030] The learning unit 150 is configured to be able to perform learning of the speech recognizer 50 using the first speech data generated by the speech data generation unit 120 and the second text data generated by the text data generation unit 140. That is, the learning unit 150 is configured to perform learning using a set of the first speech data and the second text data that correspond to each other. Here, in particular, since the context symbol is inserted into the second text data, not only the text but also the context symbol is considered during the learning by the learning unit 150.

[0031] (Example of generating the second text data) Next, a specific example of the generation example of the second text data will be described with reference to FIG. 3. FIG. 3 is a table showing an example of the first text data, the context symbol, and the second text data.

[0032] As shown in FIG. 3, assume that the first text data acquisition unit 110 acquires the first text data of "〇〇 Taro". In this case, the context symbol acquisition unit 130 acquires the context symbol of "person's name". Then, the text data generation unit 140 generates the second text data by inserting the context symbol of "person's name" into the text data of "〇〇 Taro". Specifically, the text data generation unit 140 generates the second text data of "<person's name>〇〇 Taro< / person's name>".

[0033] Next, assume that the first text data acquisition unit 110 has acquired first text data of "〇〇 Tower". In this case, the context symbol acquisition unit 130 acquires a context symbol of "place name". Then, the text data generation unit 140 generates second text data by inserting the context symbol of "place name" into the text data of "〇〇 Tower". Specifically, the text data generation unit 140 generates second text data of "<place name>〇〇 Tower< / place name>".

[0034] In the example described above, an example of inserting context symbols before and after a word is given, but the insertion position of the context symbols is not particularly limited. For example, the context symbol may be inserted only before the word. Specifically, second text data such as "<person name>〇〇 Taro" or "<place name>〇〇 Tower" may be generated. Also, the context symbol may be inserted only after the word. Specifically, second text data such as "〇〇 Taro< / person name>" or "〇〇 Tower< / place name>" may be generated.

[0035] Note that when the first text data is in the form of a sentence, the context symbol may be inserted at the position of each word. For example, when first text data of "I have set a meeting with Mr. D today." is acquired, the text data generation unit 140 may set second text data of "<time>I< / time> have set a meeting with <person name>Mr. D< / person name> today."

[0036] (Flow of operations) Next, referring to FIG. 4, the flow of operations (i.e., the operations when training the speech recognizer 50) by the information processing system 10 according to the first embodiment will be described. FIG. 4 is a flowchart showing the flow of operations by the information processing system according to the first embodiment.

[0037] 4, when the information processing system 10 according to the first embodiment operates, the first text data acquisition unit 110 first acquires first text data (step S101). The first text data acquired by the first text data acquisition unit 110 is output to each of the voice data generation unit 120, the context symbol acquisition unit 130, and the text data generation unit 140.

[0038] Next, the voice data generating unit 120 generates first voice data from the first text data (step S102). The first voice data generated by the voice data generating unit 120 is output to the learning unit 150.

[0039] On the other hand, the context symbol acquisition unit 130 acquires context symbols corresponding to words included in the first text data (step S103). The context symbols acquired by the context symbol acquisition unit 130 are output to the text data generation unit 140. The text data generation unit 140 generates second text data by inserting the context symbols acquired by the context symbol acquisition unit 130 into the first text data acquired by the first text data acquisition unit 110 (step S104). The second text data generated by the text data generation unit 140 is output to the learning unit 150.

[0040] Next, the training unit 150 trains the speech recognizer 50 using the first speech data generated by the speech data generation unit 120 and the second text data generated by the text data generation unit 140 (step S106). Note that the above-described series of processes may be repeatedly executed every time the first text data is acquired.

[0041] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the first embodiment will be described.

[0042] As described with reference to FIGS. 1 to 4, in the information processing system 10 according to the first embodiment, the speech recognizer 50 is trained using second text data that includes context symbols. In this way, the context symbols are taken into consideration when training the speech recognizer 50. As a result, training can be performed taking into consideration how words included in the first text data are used in context. This makes it possible to train the speech recognizer more appropriately.

[0043] Second Embodiment An information processing system 10 according to the second embodiment will be described with reference to Figures 5 and 6. The second embodiment differs from the first embodiment described above only in some configurations and operations, and other parts may be the same as the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit explanations of other overlapping parts as appropriate.

[0044] (Functional configuration) First, the functional configuration of the information processing system 10 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the functional configuration of the information processing system according to the second embodiment. Note that in Fig. 5, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0045] As shown in Fig. 5, the information processing system 10 according to the second embodiment is configured to include, as components for realizing its functions, a first text data acquisition unit 110, a voice data generation unit 120, a context symbol acquisition unit 130, a text data generation unit 140, a learning unit 150, and a dictionary database (DB) 200. That is, the information processing system 10 according to the second embodiment further includes the dictionary database 200 in addition to the configuration of the first embodiment already described (see Fig. 2). The dictionary database 200 may be realized by, for example, the storage device 14 (see Fig. 1) described above.

[0046] The dictionary database 200 is configured to be able to store words and contexts in association with each other. The dictionary database 200 may store a plurality of pairs, for example, each pair consisting of one word and one context. Information relating to words and contexts stored in the dictionary database 200 (hereinafter referred to as "dictionary data") is configured to be able to be read out as appropriate by the context symbol acquisition unit 130. The dictionary data may be input in advance by a user or the like. The dictionary data may also be configured to be able to be updated (e.g., changed, added, deleted, etc.) manually or automatically. Updating of dictionary data will be described in detail in another embodiment below.

[0047] The context symbol acquisition unit 130 according to the second embodiment is configured to be able to acquire context symbols using the above-described dictionary database 200. The context symbol acquisition unit 130 checks whether or not a word included in the first text data is registered in the dictionary database 200, and if so, acquires a context symbol stored in association with the word. Note that for words not registered in the dictionary database 200, it is possible not to acquire a context symbol, or it is possible to acquire a context symbol using a means other than the dictionary database 200.

[0048] (Example of dictionary data) Next, the dictionary data stored in the dictionary database 200 will be specifically described with reference to Fig. 6. Fig. 6 is a table showing an example of words and context symbols stored in the dictionary database.

[0049] As shown in Fig. 6, the dictionary database 200 stores a plurality of words and context symbols linked to one another. In the example shown in the figure, the word "____ Taro" and the context symbol "person's name" are linked and stored. The word "____ Hanako" and the context symbol "person's name" are linked and stored. The word "____ Tower" and the context symbol "place name" are linked and stored. The word "FT-____" and the context symbol "product name" are linked and stored. The word "____ Department" and the context symbol "organization" are linked and stored.

[0050] Although an example is given here in which one word and one context symbol are paired and stored, the dictionary database 200 may store a single word associated with multiple context symbols. For example, the dictionary database 200 may store the word "XXXX Taro" associated with the context symbol "person's name" and the context symbol "noun."

[0051] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the second embodiment will be described.

[0052] 5 and 6, in the information processing system 10 according to the second embodiment, the context symbol is acquired using the dictionary database 200. In this way, it is possible to acquire an appropriate context symbol more easily.

[0053] Third Embodiment An information processing system 10 according to the third embodiment will be described with reference to Figures 7 and 8. The third embodiment differs from the second embodiment described above only in some configurations and operations, and other parts may be the same as the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0054] (Functional configuration) First, the functional configuration of the information processing system 10 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a block diagram showing the functional configuration of the information processing system according to the third embodiment. Note that in Fig. 7, the same elements as those shown in Fig. 5 are denoted by the same reference numerals.

[0055] As shown in FIG. 7, the information processing system 10 according to the third embodiment includes, as components for realizing its functions, a first text data acquisition unit 110, a voice data generation unit 120, a context symbol acquisition unit 130, a text data generation unit 140, a learning unit 150, a dictionary database 200, a dictionary data presentation unit 210, and a dictionary data update unit 220. That is, the information processing system 10 according to the third embodiment further includes the dictionary data presentation unit 210 and the dictionary data update unit 220 in addition to the configuration of the second embodiment already described (see FIG. 5). The dictionary data presentation unit 210 may be realized, for example, by using the output device 16 (see FIG. 1) described above. The dictionary data update unit 220 may be a processing block realized, for example, by the processor 11 (see FIG. 1) described above.

[0056] The dictionary data presentation unit 210 is configured to be able to present the dictionary data stored in the dictionary database 200 to the user. The method of presenting the dictionary data by the dictionary data presentation unit 210 is not particularly limited. For example, the dictionary data presentation unit 210 may display the dictionary data to the user via a display. Alternatively, the dictionary data presentation unit 210 may output the dictionary data aloud via a speaker.

[0057] The dictionary data update unit 220 is configured to be able to update the dictionary data in the dictionary database 200 in response to an operation by a user who has received the dictionary data. For example, when a user performs an operation to input new words and context symbols, the dictionary data update unit 220 may perform a process of adding the words and context symbols to the dictionary database 200. When a user performs an operation to change (modify) a context symbol associated with an already registered word, the dictionary data update unit 220 may perform a process of rewriting the dictionary database 200 with the changed data. When a user performs an operation to delete words and context symbols that have already been registered, the dictionary data update unit 220 may perform a process of deleting the words and context symbols from the dictionary database 200.

[0058] (Update operation) Next, a flow of an operation for updating the dictionary database 200 in the information processing system 10 according to the third embodiment (hereinafter referred to as "update operation") will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the flow of the update operation by the information processing system according to the third embodiment.

[0059] 8, when the update operation of the information processing system 10 according to the third embodiment is started, the dictionary data presenting unit 210 first presents the dictionary data stored in the dictionary database 200 to the user (step S301). The dictionary data presenting unit 210 may present all of the stored dictionary data (for example, displaying it in a list format), or may present only a part of the stored dictionary data.

[0060] Next, the dictionary data update unit 220 accepts an input from the user who has received the dictionary data (step S302). Then, the dictionary data update unit 220 updates the dictionary data stored in the dictionary database 200 in accordance with the user's input (step S303). Note that the dictionary data update operation described above may be executed separately from (for example, before starting) the operation of training the speech recognizer 50 (see FIG. 4) described in the first embodiment. However, the dictionary data update operation may also be executed in parallel with and simultaneously with the operation of training the speech recognizer 50.

[0061] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the third embodiment will be described.

[0062] 7 and 8, in the information processing system 10 according to the third embodiment, dictionary data is updated in response to user input. This allows new dictionary data to be added, and inappropriate dictionary data to be corrected or deleted. As a result, the context symbol acquisition unit 130 can acquire more appropriate context symbols.

[0063] <Fourth embodiment> An information processing system 10 according to the fourth embodiment will be described with reference to Figures 9 and 10. The fourth embodiment differs from the second and third embodiments described above only in some configurations and operations, and other parts may be the same as the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0064] (Functional configuration) First, the functional configuration of the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 9. Fig. 9 is a block diagram showing the functional configuration of the information processing system according to the fourth embodiment. Note that in Fig. 9, the same elements as those shown in Fig. 5 are denoted by the same reference numerals.

[0065] 9, the information processing system 10 according to the fourth embodiment is configured to include, as components for realizing its functions, a first text data acquisition unit 110, a voice data generation unit 120, a context symbol acquisition unit 130, a text data generation unit 140, a learning unit 150, a dictionary database 200, a second text data acquisition unit 230, and a word addition unit 240. That is, the information processing system 10 according to the fourth embodiment further includes, in addition to the configuration of the second embodiment already described (see FIG. 5), the second text data acquisition unit 230 and the word addition unit 240. Each of the second text data acquisition unit 230 and the word addition unit 240 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).

[0066] The second text data acquisition unit 230 is configured to be able to acquire training text data for training the dictionary database 200 (i.e., adding new dictionary data). The training text data may be text data that does not include context symbols (e.g., text data consisting only of words and sentences), or may be text data that includes context symbols (e.g., text data in the same format as the second text data). The second text data acquisition unit 230 may acquire multiple pieces of training text data. Note that the second text data acquisition unit 230 may acquire training text data by voice input. That is, voice data may be converted into text data and acquired as training text data.

[0067] The word adding unit 240 is configured to be able to add words included in the training text data to the dictionary database 200. The word adding unit 240 may have a function of analyzing the training text data and extracting the words included therein. When the second text data includes multiple words, the word adding unit 240 may add all of the words to the dictionary database 200, or may add only some of the words. The word adding unit 240 may automatically select words to be added to the dictionary database 200, or may select words according to input by a user or the like. Specific methods for adding words by the word adding unit 240 will be described in detail in other embodiments described later.

[0068] (word addition action) Next, a flow of an operation of adding a new word to the dictionary database 200 in the information processing system 10 according to the fourth embodiment (hereinafter referred to as a "word adding operation") will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of the word adding operation by the information processing system according to the fourth embodiment.

[0069] 10, when the word adding operation of the information processing system 10 according to the fourth embodiment starts, first, the second text data acquiring unit 230 acquires learning text data (step S401). The learning text data acquired by the second text data acquiring unit 230 is output to the word adding unit 240.

[0070] Next, the word adding unit 240 analyzes the training text data (step S402). For example, the word adding unit 240 analyzes the training text data and extracts words contained therein. Thereafter, the word adding unit 240 adds the words contained in the training text data to the dictionary database 200 (step S403).

[0071] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the fourth embodiment will be described.

[0072] 9 and 10, in the information processing system 10 according to the fourth embodiment, new words are added to the dictionary database 200 using the learning text data. In this way, it is possible to easily increase the number of words registered in the dictionary database 200. As a result, it becomes possible for the context symbol acquisition unit 130 to acquire more appropriate context symbols.

[0073] Fifth Embodiment An information processing system 10 according to the fifth embodiment will be described with reference to Figures 11 and 12. The fifth embodiment differs from the fourth embodiment described above only in some configurations and operations, and other parts may be the same as the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0074] (Functional configuration) First, the functional configuration of the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 11. Fig. 11 is a block diagram showing the functional configuration of the information processing system according to the fifth embodiment. In Fig. 11, the same elements as those shown in Fig. 9 are denoted by the same reference numerals.

[0075] As shown in FIG. 11 , the information processing system 10 according to the fifth embodiment includes, as components for realizing its functions, a first text data acquisition unit 110, a voice data generation unit 120, a context symbol acquisition unit 130, a text data generation unit 140, a learning unit 150, a dictionary database 200, a second text data acquisition unit 230, a word addition unit 240, a word extraction unit 250, and an extracted word presentation unit 260. That is, the information processing system 10 according to the fifth embodiment further includes the word extraction unit 250 and the extracted word presentation unit 260 in addition to the configuration of the fourth embodiment already described (see FIG. 9 ). The word extraction unit 250 may be a processing block realized by, for example, the processor 11 (see FIG. 1 ). The extracted word presentation unit 260 may be realized by, for example, the output device 16 (see FIG. 1 ).

[0076] The word extraction unit 250 is configured to be able to extract words from the training text data acquired by the second text data acquisition unit. The word extraction unit 250 may extract all of the words included in the training text data, or may extract only a portion of them. For example, the word extraction unit 250 may extract only words that are not registered in the dictionary database 200 from among the words included in the training text data.

[0077] The extracted word presentation unit 260 is configured to be able to present the words extracted by the word extraction unit 250 to the user. The method of presenting the extracted words by the extracted word presentation unit 260 is not particularly limited. For example, the extracted word presentation unit 260 may display the extracted words to the user via a display. Alternatively, the extracted word presentation unit 260 may output the extracted words aloud via a speaker.

[0078] The word adding unit 240 according to this embodiment is configured to be able to add words to the dictionary data of the dictionary database 200 in response to an operation by a user who has received presentation of extracted words. For example, when a user selects at least one of the extracted words, the word adding unit 240 may perform a process of newly adding the word selected by the user to the dictionary database 200. Furthermore, when a user performs an operation of linking a context symbol to an extracted word (for example, an operation of inputting a context symbol linked to the word), the word adding unit 240 may perform a process of newly adding the word and the context symbol to the dictionary database 200.

[0079] (word addition action) Next, the flow of a word adding operation in the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the flow of a word adding operation by the information processing system according to the fifth embodiment.

[0080] 12, when the word adding operation of the information processing system 10 according to the fifth embodiment is started, first, the second text data acquiring unit 230 acquires learning text data (step S501). The learning text data acquired by the second text data acquiring unit 230 is output to the word extracting unit 250.

[0081] Next, the word extraction unit 250 extracts words from the learning text data (step S502). Information about the words extracted by the word extraction unit 250 is output to the extracted word presentation unit 260. Then, the extracted word presentation unit 260 presents the words extracted by the word extraction unit 250 to the user (step S503).

[0082] Next, the word adding unit 240 receives input from the user who has received the extracted words (step S504). Then, the word adding unit 240 adds the words extracted by the word extracting unit 250 to the dictionary database 200 in response to the user's input (step S505).

[0083] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the fifth embodiment will be described.

[0084] As described with reference to FIGS. 11 and 12 , in the information processing system 10 according to the fifth embodiment, new words are added to the dictionary database 200 in response to a user input. In this way, the number of words registered in the dictionary database 200 can be increased. Furthermore, a more appropriate context symbol is associated with the word in response to the user input. As a result, the context symbol acquisition unit 130 can acquire a more appropriate context symbol.

[0085] Sixth Embodiment An information processing system 10 according to the sixth embodiment will be described with reference to Figures 13 to 15. The sixth embodiment differs from the fourth and fifth embodiments described above only in some configurations and operations, and other parts may be the same as the first to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0086] (Functional configuration) First, the functional configuration of the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 13. Fig. 13 is a block diagram showing the functional configuration of the information processing system according to the sixth embodiment. In Fig. 13, the same elements as those shown in Fig. 9 are denoted by the same reference numerals.

[0087] 13, the information processing system 10 according to the sixth embodiment is configured to include, as components for realizing its functions, a first text data acquisition unit 110, a voice data generation unit 120, a context symbol acquisition unit 130, a text data generation unit 140, a learning unit 150, a dictionary database 200, a second text data acquisition unit 230, and a word addition unit 240. The word addition unit 240 according to the sixth embodiment particularly includes a context similarity determination unit 245.

[0088] The dictionary database 200 according to the sixth embodiment is configured to be able to store context examples in addition to words and context symbols. The dictionary database 200 stores, for example, pairs of words, context symbols, and context examples as dictionary data. The dictionary database 200 may be configured to store multiple context examples for one word or one context symbol. The context examples may be, for example, input by a user in advance, or may be acquired when updating the dictionary database 200 (for example, those included in previous training text data).

[0089] The context similarity determination unit 245 determines whether or not the first context included in the training text data acquired by the second text data acquisition unit 230 is similar to the example contexts stored in the dictionary database 200. For example, the context similarity determination unit 245 may calculate the degree of match between the first context included in the training text data and the example contexts stored in the dictionary database 200, and determine that the first context and the example context are similar when the degree of match is equal to or greater than a predetermined value.

[0090] The word adding unit 240 according to this embodiment is configured to be able to add new words to the dictionary database 200 in accordance with the determination result of the context similarity determination unit 245. A method of adding words in accordance with the determination result of the context similarity determination unit 245 will be described in detail later. Note that the word adding unit 240 may be configured to be able to add words in other ways in addition to adding words in accordance with the determination result of the context similarity determination unit 245. For example, the word adding unit 240 may be configured to be able to add words in accordance with a user input, as described in the fifth embodiment (see FIGS. 11 and 12).

[0091] (Example of dictionary data) Next, the dictionary data stored in the dictionary database 200 according to the sixth embodiment will be specifically described with reference to Fig. 14. Fig. 14 is a table showing an example of words, context symbols, and context examples stored in the dictionary database.

[0092] As shown in FIG. 14, the dictionary database 200 stores words, context symbols, and context examples in association with each other. The context examples may be stored mainly in association with the context symbols. In the example shown in the figure, the context symbol "person's name" is associated with the context example "Your name is Mr. / Ms. XX" and is stored. The context symbol "place name" is associated with the context example "I went to XX" and is stored. The context symbol "product name" is associated with the context example "We are developing XX" and is stored. The context symbol "organization name" is associated with the context example "People who belong to XX, ..." and is stored.

[0093] Note that multiple context examples may be associated with one context example and stored. Also, context examples may be associated with each word and stored. For example, even if words share a common context symbol, they may be associated with different context examples and stored.

[0094] (word addition action) Next, the flow of a word adding operation in the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the flow of a word adding operation by the information processing system according to the sixth embodiment.

[0095] 15, when the word adding operation of the information processing system 10 according to the sixth embodiment is started, first, the second text data acquiring unit 230 acquires learning text data (step S601). The learning text data acquired by the second text data acquiring unit 230 is output to the context similarity determining unit 245 of the word adding unit 240.

[0096] Next, the context similarity determination unit 245 determines whether the first context included in the learning text data acquired by the second text data acquisition unit 230 is similar to the context examples stored in the dictionary database 200 (step S602).

[0097] If it is determined that the first context is similar to the example context (step S602: YES), the word adding unit 240 stores the words included in the first context in the dictionary database 200 as words linked to the context symbol that was stored in association with the example context determined to be similar (step S603). For example, if the context symbol "person's name" is stored in association with the example context "Your name is Mr. / Ms. XX," and the training text data includes the contexts "Your name is Mr. / Ms. A," "Your name is Mr. / Ms. B," and "Your name is Mr. / Ms. C," the words "Mr. / Ms. A," "Mr. / Ms. B," and "Mr. / Ms. C" are all stored as words linked to the context symbol "person's name."

[0098] On the other hand, if it is determined that the first context is not similar to the example context (step S602: NO), the word adding unit 240 adds words using a method that does not use the example context (step S604). For example, the word adding unit 240 may add words in response to a user input, as described in the fifth embodiment. Alternatively, the word adding unit 240 may not add words.

[0099] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the sixth embodiment will be described.

[0100] As described with reference to FIGS. 13 to 15 , in the information processing system 10 according to the sixth embodiment, whether or not the contexts are similar is determined and a new word is added to the dictionary database 200. In this way, the number of words registered in the dictionary database 200 can be easily increased. Furthermore, by using the context examples, a more appropriate context symbol can be associated with a word. As a result, the context symbol acquisition unit 130 can acquire a more appropriate context symbol.

[0101] Seventh Embodiment An information processing system 10 according to the seventh embodiment will be described with reference to Figures 16 and 17. The seventh embodiment differs only in part of the configuration and operation from the second to sixth embodiments described above, and other parts may be the same as the first to sixth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0102] (Functional configuration) First, the functional configuration of the information processing system 10 according to the seventh embodiment will be described with reference to Fig. 16. Fig. 16 is a block diagram showing the functional configuration of the information processing system according to the seventh embodiment. In Fig. 16, the same elements as those shown in Fig. 5 are denoted by the same reference numerals.

[0103] 16, the information processing system 10 according to the seventh embodiment is configured to include, as components for realizing its functions, a first text data acquisition unit 110, a voice data generation unit 120, a context symbol acquisition unit 130, a text data generation unit 140, a learning unit 150, a dictionary database 200, and an unregistered word addition unit 270. That is, the information processing system 10 according to the seventh embodiment further includes the unregistered word addition unit 270 in addition to the configuration of the second embodiment already described (see FIG. 5). The unregistered word addition unit 270 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0104] When the context symbol acquiring unit 130 acquires a context symbol corresponding to an unregistered word that is not stored in the dictionary database 200, the unregistered word adding unit 270 is configured to be able to store the unregistered word and the context symbol acquired for the unregistered word in the dictionary database 200. For example, when the context symbol acquiring unit 130 acquires a context symbol from a route different from the dictionary database 200 (i.e., without using dictionary data), the unregistered word adding unit 270 may determine that a context symbol corresponding to an unregistered word has been acquired. Note that the context symbol acquiring unit 130 may acquire a context symbol from a route different from the dictionary database 200, for example, by using named entity extraction.

[0105] The context symbol acquiring unit 130 according to the seventh embodiment may be configured to acquire context symbols from a database other than the dictionary database 200. Alternatively, the context symbol acquiring unit 130 may be configured to acquire context symbols in response to a user's input. Alternatively, the context symbol acquiring unit 130 may be configured to automatically determine and acquire a context symbol suitable for a word.

[0106] (Operation flow) Next, the flow of operations performed by the information processing system 10 according to the seventh embodiment will be described with reference to Fig. 17. Fig. 17 is a flowchart showing the flow of operations performed by the information processing system according to the seventh embodiment. In Fig. 17, the same processes as those shown in Fig. 4 are denoted by the same reference numerals.

[0107] 17, when the information processing system 10 according to the seventh embodiment operates, first, the first text data acquisition unit 110 acquires first text data (step S101). The first text data acquired by the first text data acquisition unit 110 is output to each of the voice data generation unit 120, the context symbol acquisition unit 130, and the text data generation unit 140.

[0108] Next, the voice data generating unit 120 generates first voice data from the first text data (step S102). The first voice data generated by the voice data generating unit 120 is output to the learning unit 150.

[0109] On the other hand, the context symbol acquiring unit 130 acquires context symbols corresponding to words included in the first text data (step S103). The context symbols acquired by the context symbol acquiring unit 130 are output to the text data generating unit 140 and the unregistered word adding unit 270.

[0110] Particularly in the seventh embodiment, the unregistered word adding unit 270 determines whether the context symbol acquiring unit 130 has acquired a context symbol for the unregistered word (step S701). If a context symbol has been acquired for the unregistered word (step S701: YES), the unregistered word adding unit 270 newly adds the unregistered word and the acquired context symbol for the unregistered word to the dictionary database 200 (step S702). Note that if a context symbol has not been acquired for the unregistered word (step S701: NO), the unregistered word adding unit 270 omits the processing of step S702 described above.

[0111] Next, the text data generation unit 140 generates second text data by inserting the context symbols acquired by the context symbol acquisition unit 130 into the first text data acquired by the first text data acquisition unit 110 (step S104). The second text data generated by the text data generation unit 140 is output to the learning unit 150.

[0112] Next, the training unit 150 performs training of the speech recognizer 50 using the first speech data generated by the speech data generation unit 120 and the second text data generated by the text data generation unit 140 (step S106).

[0113] In the above example, the unregistered word adding unit 270 adds new words and context symbols immediately after acquiring the context symbols (i.e., immediately after step S103), but the unregistered word adding unit 270 may add new words and context symbols at a different timing. For example, the unregistered word adding unit 270 may add new words and context symbols after the learning of the speech recognizer 50 is completed (i.e., after step S106).

[0114] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the seventh embodiment will be described.

[0115] 16 and 17, in the information processing system 10 according to the seventh embodiment, when a context symbol is acquired for an unregistered word, a new word is added to the dictionary database 200. In this way, it is possible to increase the dictionary data while operating the system (i.e., while executing the process of training the speech recognizer 50).

[0116] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0117] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processing by themselves, but also includes programs that execute processing by operating on an OS in cooperation with other software or functions of an expansion board. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal.

[0118] <Additional Notes> The above-described embodiment may be further described as follows, but is not limited to the following.

[0119] (Appendix 1) The information processing system described in Appendix 1 is an information processing system including: first text data acquisition means for acquiring first text data; audio data generation means for generating first audio data corresponding to the first text data; context symbol acquisition means for acquiring context symbols corresponding to words included in the first text data; text data generation means for inserting the context symbols into the first text data to generate second text data; and training means for training speech recognition means for using the first audio data and the second text data as inputs and generating text data corresponding to the audio data from the audio data. is.

[0120] (Appendix 2) The information processing system described in Appendix 2 is the information processing system described in Appendix 1, further comprising a storage means for linking and storing the words and the context symbols, and the context symbol acquisition means uses the storage means to acquire the context symbols corresponding to the words included in the first text data.

[0121] (Appendix 3) The information processing system described in Appendix 3 is the information processing system described in Appendix 2, further comprising a first presentation means for presenting the words and the context symbols stored in the storage means to a user, and an update means for updating at least one of the words and the context symbols stored in the storage means in accordance with the operation of the user who has received the presentation by the first presentation means.

[0122] (Appendix 4) The information processing system described in Appendix 4 is the information processing system described in Appendix 2 or 3, further comprising a second text data acquisition means for acquiring third text data, and a word addition means for newly storing the words included in the third text data in the storage means.

[0123] (Appendix 5) The information processing system described in Appendix 5 is the information processing system described in Appendix 4, further comprising an extraction means for extracting the words contained in the third text data and a second presentation means for presenting the words extracted by the extraction means to a user, and the word addition means stores the words extracted by the extraction means in the storage means in accordance with the operation of the user who has received the presentation by the second presentation means.

[0124] (Appendix 6) The information processing system described in Appendix 6 is the information processing system described in Appendix 4 or 5, wherein the storage means stores, in addition to the word and the context symbol, context examples corresponding to the word and the context symbol, and when a first context included in the third text data is similar to the context example stored in the storage means, the word adding means stores the word included in the first context in the storage means as being linked to the context symbol corresponding to the similar context example.

[0125] (Appendix 7) The information processing system described in Appendix 7 is the information processing system described in any one of Appendices 2 to 6, wherein the context symbol acquisition means is configured to be able to acquire the context symbol even from a route different from the storage means, and further includes an unregistered word adding means that, when the context symbol acquisition means acquires the context symbol corresponding to an unregistered word that is the word not stored in the storage means, stores the unregistered word and the context symbol corresponding to the unregistered word in the storage means.

[0126] (Appendix 8) The information processing device described in Appendix 8 is an information processing device including: first text data acquisition means for acquiring first text data; audio data generation means for generating first audio data corresponding to the first text data; context symbol acquisition means for acquiring context symbols corresponding to words included in the first text data; text data generation means for inserting the context symbols into the first text data to generate second text data; and learning means for training speech recognition means that receives the first audio data and the second text data as input and generates text data corresponding to the audio data from the audio data.

[0127] (Appendix 9) The information processing method described in Supplementary Note 9 is an information processing method executed by at least one computer, which acquires first text data, generates first speech data corresponding to the first text data, acquires context symbols corresponding to words included in the first text data, inserts the context symbols into the first text data to generate second text data, and trains a speech recognition means that uses the first speech data and the second text data as inputs and generates text data corresponding to the speech data from the speech data.

[0128] (Appendix 10) The recording medium described in Appendix 10 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method of acquiring first text data, generating first speech data corresponding to the first text data, acquiring context symbols corresponding to words included in the first text data, inserting the context symbols into the first text data to generate second text data, and training a speech recognition means that uses the first speech data and the second text data as inputs to generate text data corresponding to the speech data from the speech data.

[0129] (Appendix 11) The computer program described in Appendix 11 is a computer program that causes at least one computer to execute an information processing method of acquiring first text data, generating first speech data corresponding to the first text data, acquiring context symbols corresponding to words included in the first text data, inserting the context symbols into the first text data to generate second text data, and training a speech recognition means that uses the first speech data and the second text data as inputs to generate text data corresponding to the speech data from the speech data.

[0130] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure. [Explanation of symbols]

[0131] 10 Information Processing Systems 11 processors 14 Storage device 50 Speech Recognizer 110 First text data acquisition unit 120 Audio data generation unit 130 Context symbol acquisition unit 140 Text data generation unit 150 Learning Department 200 dictionary databases 210 Dictionary data presentation unit 220 Dictionary Data Update Unit 230 Second text data acquisition unit 240 Word Addition Section 245 Context similarity determination unit 250 Word Extraction Unit 260 Extracted Word Presentation Unit 270 Adding Unregistered Words

Claims

1. a first text data acquisition means for acquiring first text data; a voice data generating means for generating first voice data corresponding to the first text data; a context symbol acquiring means for acquiring a context symbol which is information indicating a contextual use of a word included in the first text data; a text data generating means for generating second text data by inserting the context symbol into the first text data; a learning means for learning a speech recognition means that receives the first speech data and the second text data as input and generates text data corresponding to the speech data from the speech data; An information processing system comprising:

2. further comprising a storage means for storing the words and the context symbols in association with each other; the context symbol acquisition means acquires the context symbols corresponding to the words included in the first text data using the storage means; The information processing system according to claim 1 .

3. a first presentation means for presenting the words and the context symbols stored in the storage means to a user; an update means for updating at least one of the words and the context symbols stored in the storage means in response to an operation by the user that has been presented by the first presentation means; The information processing system according to claim 2 , further comprising:

4. second text data acquisition means for acquiring third text data; a word adding means for newly storing the words included in the third text data in the storage means; The information processing system according to claim 2 or 3, further comprising:

5. extraction means for extracting the words included in the third text data; a second presentation means for presenting the words extracted by the extraction means to a user; Further provided with the word adding means stores the word extracted by the extracting means in the storage means in response to an operation of the user who has received the presentation by the second presentation means; The information processing system according to claim 4 .

6. the storage means stores, in addition to the words and the context symbols, context examples corresponding to the words and the context symbols; the word adding means, when a first context included in the third text data is similar to the context example stored in the storage means, stores the word included in the first context in the storage means as being associated with the context symbol corresponding to the similar context example; 6. The information processing system according to claim 4 or 5.

7. the context symbol acquisition means is configured to be able to acquire the context symbol from a path different from that of the storage means, The apparatus further comprises an unregistered word adding means for storing, in the storage means, the unregistered word and the context symbol corresponding to the unregistered word when the context symbol acquiring means acquires the context symbol corresponding to the unregistered word, which is the word not stored in the storage means. The information processing system according to any one of claims 2 to 6.

8. a first text data acquisition means for acquiring first text data; a voice data generating means for generating first voice data corresponding to the first text data; a context symbol acquiring means for acquiring a context symbol which is information indicating a contextual use of a word included in the first text data; a text data generating means for generating second text data by inserting the context symbol into the first text data; a learning means for learning a speech recognition means that receives the first speech data and the second text data as input and generates text data corresponding to the speech data from the speech data; An information processing device comprising:

9. 1. An information processing method executed by at least one computer, comprising: Obtaining first text data; generating first audio data corresponding to the first text data; acquiring a context symbol that is information indicating a contextual use of a word included in the first text data; inserting the context symbols into the first text data to generate second text data; training a speech recognition means that receives the first speech data and the second text data as input and generates text data corresponding to the speech data from the speech data; Information processing methods.

10. At least one computer Obtaining first text data; generating first audio data corresponding to the first text data; acquiring a context symbol that is information indicating a contextual use of a word included in the first text data; inserting the context symbols into the first text data to generate second text data; training a speech recognition means that receives the first speech data and the second text data as input and generates text data corresponding to the speech data from the speech data; A computer program that executes an information processing method.

Images