Voice recognition program and voice recognition device
By organizing speech recognition dictionaries based on features like character count and initial character, the system addresses inefficiencies in existing systems, improving response times and accuracy through targeted searches.
Patent Information
- Application Number
- JP2021060947
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-01-29
- Filing Date
- 2021-03-31
- Publication Date
- 2025-01-17
- Estimated Expiration
- 2041-03-31
AI Technical Summary
Existing speech recognition systems face inefficiencies due to the need to search through various pronunciation character strings of different lengths, leading to prolonged processing times and potential deterioration in response times.
The system employs conversion dictionary data divided into features such as character count and initial character, allowing for rapid word identification by matching input strings to predefined features, thereby reducing unnecessary searches and improving response time.
This approach enhances speech recognition speed and accuracy by quickly identifying words and phrases through efficient dictionary searches based on predefined features, minimizing unnecessary comparisons and reducing user effort in dictionary updates.
Smart Images

Figure 0007615841000001 
Figure 0007615841000002 
Figure 0007615841000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a voice recognition program and a voice recognition device. [Background technology]
[0002] Patent Document 1 discloses a technology for performing speech recognition by providing a recognition dictionary for each type of word (address, facility name, telephone number, etc.) and searching an input voice in the recognition dictionary corresponding to the type of word selected in advance by the user. Specifically, the recognition dictionary stores character strings (hereinafter referred to as "pronunciation character strings") that represent pronunciations using kana characters, alphabets, etc., and words corresponding to the pronunciation character strings. The input character string, which is obtained by converting the input voice into a character string, is searched for the pronunciation character strings in the recognition dictionary to obtain the corresponding word or phrase. By providing a recognition dictionary for each type of vocabulary, the number of pronunciation character strings and words can be reduced compared to storing the pronunciation character strings and words of all types of vocabulary in a single recognition dictionary, and therefore the time required for search can be shortened. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2006-162782 A (for example, paragraphs 0012-0015, 0033-0037, Figures 1, 4, 5) Summary of the Invention [Problem to be solved by the invention]
[0004] However, while the recognition dictionary is configured for each type of word, the recognition dictionary stores various pronunciation character strings corresponding to the word. For example, for an input string of five characters, the recognition dictionary stores pronunciation character strings of various numbers of characters, such as two characters and three characters, corresponding to the word. Therefore, in a search, in addition to referring to pronunciation character strings with the same number of characters as the input string, it is also necessary to refer to pronunciation character strings with a different number of characters from the input string. This causes problems in that the search takes time and there is a risk of a decrease in the response of the voice recognition.
[0005] The present invention has been made to solve the above-mentioned problems, and has an object to provide a voice recognition program and a voice recognition device that can improve the response of voice recognition. [Means for solving the problem]
[0006] In order to achieve this object, a speech recognition program of the present invention is a program for causing a computer having a storage unit to execute speech recognition processing, the storage unit being made to function as conversion dictionary storage means for storing a plurality of conversion dictionary data, which are dictionary data consisting of a combination of a pronunciation string and a word corresponding to the pronunciation string, the plurality of conversion dictionary data being divided by feature amount of the pronunciation string, and the program includes a speech conversion step of converting an input speech into an input string representing the pronunciation, a feature amount acquisition step of acquiring a feature amount of the input string converted in the speech conversion step, a dictionary acquisition step of acquiring conversion dictionary data corresponding to the feature amount acquired in the feature amount acquisition step from the conversion dictionary storage means, a search step of searching for a word corresponding to the input string converted in the speech conversion step from the conversion dictionary data acquired in the dictionary acquisition step, and an output step of outputting the searched word if the word is searched in the search step, and outputting the input string converted in the speech conversion step if the word is not searched in the search step. And Preparation The conversion dictionary data is created from all dictionary data in which combinations of all pronunciation character strings included in a plurality of the conversion dictionary data and words corresponding to the pronunciation character strings are stored. When the all dictionary data is updated, the combinations of the pronunciation character strings and words corresponding to the pronunciation character strings included in the all dictionary data after the update are rearranged based on the feature amounts of the pronunciation character strings, and conversion dictionary data for each feature amount of the pronunciation character strings is created from the rearranged combinations of the pronunciation character strings and words corresponding to the pronunciation character strings. do.
[0007] The speech recognition device of the present invention further comprises: conversion dictionary storage means for storing a plurality of conversion dictionary data consisting of a combination of a pronunciation character string and a word corresponding to the pronunciation character string, the conversion dictionary data being divided into a plurality of conversion dictionary data for each feature of the pronunciation character string; speech input means for inputting speech; speech conversion means for converting the speech input by the speech input means into an input string representing the pronunciation; feature acquisition means for acquiring a feature of the input string converted by the speech conversion means; dictionary acquisition means for acquiring conversion dictionary data corresponding to the feature acquired by the feature acquisition means from among the conversion dictionary data stored in the conversion dictionary storage means; search means for searching for a word corresponding to the input string converted by the speech conversion means from the conversion dictionary data acquired by the dictionary acquisition means; and output means for outputting the searched word if the search means is able to search for a word, and for outputting the input string converted by the speech conversion means if the search means is unable to search for a word. And Preparation The conversion dictionary data is created from all dictionary data in which combinations of all pronunciation character strings included in a plurality of the conversion dictionary data and words corresponding to the pronunciation character strings are stored. When the all dictionary data is updated, the combinations of the pronunciation character strings and words corresponding to the pronunciation character strings included in the all dictionary data after the update are rearranged based on the feature amounts of the pronunciation character strings, and conversion dictionary data for each feature amount of the pronunciation character strings is created from the rearranged combinations of the pronunciation character strings and words corresponding to the pronunciation character strings. do. Effect of the Invention
[0008] According to the speech recognition program of claim 1, a plurality of conversion dictionary data are stored, which are dictionary data consisting of a combination of a pronunciation character string and a phrase corresponding to the pronunciation character string, and are divided into a plurality of conversion dictionary data divided into a plurality of feature quantities for each pronunciation character string. Then, the feature quantity is acquired from an input character string that represents the pronunciation of an input voice, and conversion dictionary data corresponding to the acquired feature quantity is acquired. Then, a phrase corresponding to the input character string is searched for from the acquired conversion dictionary data, and if the phrase is found, the phrase is output, and if the phrase is not found, the input character string is output.
[0009] That is, the conversion dictionary data used for searching for words and phrases stores pronunciation character strings of features common to the input string and the words and phrases, so that the conversion dictionary data stores only pronunciation character strings similar to the input string. This allows the conversion dictionary data to be quickly searched for words and phrases with pronunciation character strings that match the input string, thereby improving the response of speech recognition. In addition, the conversion dictionary data is created from all dictionary data in which combinations of all pronunciation strings included in multiple conversion dictionary data and words corresponding to those pronunciation strings are stored, and when the all dictionary data is updated, the combinations of pronunciation strings and words corresponding to those pronunciation strings included in the updated all dictionary data are rearranged based on the features of the pronunciation strings, and conversion dictionary data for each feature of the pronunciation string is created from the rearranged combinations of pronunciation strings and words corresponding to those pronunciation strings. The conversion dictionary data created in this way has the effect of being able to appropriately include combinations of pronunciation character strings updated in the entire dictionary data and phrases corresponding to the pronunciation character strings, and combinations of pronunciation character strings of features corresponding to the conversion dictionary data and phrases corresponding to the pronunciation character strings. In addition, since the conversion dictionary data is automatically created by updating the entire dictionary data, it is also possible to reduce the user's effort in updating the conversion dictionary data.
[0010] According to the speech recognition program of claim 2, in addition to the effects of the speech recognition program of claim 1, the following effects are achieved. An input speech is converted into an input character string broken down into words, and a feature amount of each of the input character strings broken down into words is acquired. Then, conversion dictionary data corresponding to each feature amount of the acquired input character string broken down into words is acquired, and a phrase corresponding to each of the input character strings broken down into words is searched for from each of the acquired conversion dictionary data.
[0011] In other words, the features of the input string broken down into words are obtained, and phrases are searched for in the conversion dictionary data corresponding to each of the obtained features. This has the effect of enabling more detailed and accurate phrase output compared to the case where an input string containing multiple words is directly searched for in the conversion dictionary data.
[0012] According to the speech recognition program of claim 3, in addition to the effects of the speech recognition program of claim 1 or 2, the following effects are achieved. The feature value is the number of characters of the pronunciation string or the input string. As a result, the conversion dictionary data is stored according to the number of characters of the pronunciation string. Then, the number of characters of the input string is obtained, and the conversion dictionary data corresponding to the obtained number of characters is obtained and used for searching for a phrase.
[0013] This makes it possible to omit searching for words using conversion dictionary data of pronunciation strings that do not match the number of characters in the input string, thereby enabling quick search for words that match the input string. Also, since the number of characters in the input string or pronunciation string can be easily obtained without complex analysis, conversion dictionary data that matches the feature amount (number of characters) of the input string can be quickly obtained. These have the effect of improving the response of speech recognition.
[0014] According to the speech recognition program of claim 4, in addition to the effects of the speech recognition program of claim 1 or 2, the following effects are achieved. The feature is set to the first character of the pronunciation string or the input string. As a result, conversion dictionary data is stored according to the first character of the pronunciation string. Then, the first character of the input string is obtained, and conversion dictionary data corresponding to the obtained first character is obtained and used for searching for a phrase.
[0015] This makes it possible to omit searching for words in conversion dictionary data for pronunciation strings that do not match the first character of the input string, thereby enabling quick searches for words that match the input string. Also, since the first character of an input string or pronunciation string can be easily obtained without complex analysis, conversion dictionary data that matches the feature (first character) of the input string can be quickly obtained. These have the effect of improving the response of speech recognition.
[0016] According to the speech recognition program of claim 5, in addition to the effects of the speech recognition program of claim 1 or 2, the following effects are achieved. The feature is a combination of the number of characters and the first character of a pronunciation string or an input string. As a result, conversion dictionary data is stored according to the combination of the number of characters and the first character of the pronunciation string. Then, the combination of the number of characters and the first character of the input string is obtained, and conversion dictionary data corresponding to the obtained combination of the number of characters and the first character is obtained and used for searching for a phrase.
[0017] This makes it possible to omit searching for words and phrases in the conversion dictionary data for pronunciation strings that do not match the number of characters and the first character of the input string, thereby enabling a quick search for words and phrases that match the input string. Furthermore, by using a combination of the number of characters and the first character as the feature, the number of pronunciation strings and their words and phrases stored in the conversion dictionary data can be reduced compared to when the feature is only the number of characters or only the first character. This also makes it possible to quickly search for words and phrases that match the input string.
[0018] In addition, since the number of characters and the first character of the input string or the pronunciation string can be easily obtained without complex analysis, conversion dictionary data corresponding to the feature of the input string (combination of the number of characters and the first character) can be quickly obtained. This has the effect of improving the response of the voice recognition.
[0019] According to the voice recognition device of claim 6, the same effect as that of the voice recognition program of claim 1 is achieved. [Brief description of the drawings]
[0020] [Figure 1] FIG. 2 is an external view of a mobile terminal. [Diagram 2] FIG. 1A is a diagram showing a schematic representation of the creation of conversion dictionary data from all dictionary data, and FIG. 1B is a diagram showing a schematic representation of the replacement of an input character string using the conversion dictionary data. [Diagram 3] FIG. 2 is a block diagram showing the electrical configuration of the mobile terminal. [Figure 4] 13A is a flowchart of speech processing, and FIG. 13B is a flowchart of conversion dictionary data creation processing. [Diagram 5] 13 is a flowchart of a dictionary application process. [Figure 6] (a) is a diagram showing a schematic representation of the creation of conversion dictionary data from all dictionary data in the second embodiment, and (b) is a diagram showing a schematic representation of the replacement of an input character string using conversion dictionary data in the second embodiment. [Figure 7] FIG. 11 is a block diagram showing the electrical configuration of a mobile terminal according to a second embodiment. [Figure 8] 13A is a flowchart of a conversion dictionary data creation process according to the second embodiment, and FIG. 13B is a flowchart of a dictionary application process according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0021] A preferred embodiment of the present invention will be described below with reference to the accompanying drawings. First, the configuration of a mobile terminal 1 in this embodiment will be described with reference to FIG. 1. FIG. 1 is an external view of the mobile terminal 1. The mobile terminal 1 is an information processing device (computer) that performs voice recognition of an utterance made by a user H. The mobile terminal 1 is configured to be able to input a voice V, and converts the input voice V into an input string Ti, which is a string of characters representing the pronunciation. The converted input string Ti is replaced with an appropriate word or phrase W by referring to conversion dictionary data Sd described later in FIG. 2, and is displayed on the LCD 16 (see FIG. 3).
[0022] Next, the conversion dictionary data Sd and the replacement of an input character string Ti using the conversion dictionary data Sd will be described with reference to Fig. 2. Fig. 2(a) is a diagram showing a schematic representation of the creation of the conversion dictionary data Sd from all dictionary data Ad, and Fig. 2(b) is a diagram showing a schematic representation of the replacement of an input character string Ti using the conversion dictionary data Sd.
[0023] The mobile terminal 1 is provided with two types of dictionary data: total dictionary data Ad and conversion dictionary data Sd. The total dictionary data Ad stores a plurality of combinations of a pronunciation string Tp, which is a string of phonograms such as hiragana or katakana, and a word or phrase W, which is a string of characters such as kanji or the alphabet that corresponds to the pronunciation string Tp. The total dictionary data Ad stores a word or phrase W and a pronunciation string Tp corresponding to the word or phrase W, and stores all combinations of the word or phrase W and the pronunciation string Tp used to replace the input string Ti.
[0024] The conversion dictionary data Sd is dictionary data created from the entire dictionary data Ad, and is dictionary data constructed by dividing the combinations of pronunciation strings Tp and words W corresponding to the pronunciation strings Tp (hereinafter abbreviated as "combinations of pronunciation strings Tp and words W") stored in the entire dictionary data Ad into groups based on the number of characters in the pronunciation strings Tp.
[0025] That is, the conversion dictionary data Sd includes one-character dictionary data Sd1 that stores a combination of a pronunciation string Tp consisting of one character and a word or phrase W corresponding to the pronunciation string Tp, and two-character dictionary data Sd2 that stores a combination of a pronunciation string Tp consisting of two characters and a word or phrase W corresponding to the pronunciation string Tp, and similarly, three- to ten-character dictionary data Sd3 to Sd10 that store a combination of a pronunciation string Tp consisting of three to ten characters and a word or phrase W corresponding to the pronunciation string Tp are also provided. Hereinafter, the one- to ten-character dictionary data Sd3 to Sd10 are collectively referred to as "M-character dictionary data SdM."
[0026] The input character string Ti is replaced using the conversion dictionary data Sd configured in this manner. Specifically, as shown in FIG. 2(b), the input character string Ti is first decomposed into word-based input character strings TiN (N is a natural number) by morphological analysis. In the example of FIG. 2(b), the input character string Ti is "honjitsu ga arigatou shimasu." Therefore, by morphological analysis of this input character string Ti, the input character string Ti is decomposed into four words: an input character string Ti1 consisting of "honjitsu," an input character string Ti2 consisting of "wa," an input character string Ti3 consisting of "arigatou shimasu," and an input character string Ti4 consisting of "gozaimasu."
[0027] Then, by referring to each of the input character strings TiN divided into words in the conversion dictionary data Sd, the corresponding words W are obtained. Specifically, the number of characters is obtained for each input character string TiN, and conversion dictionary data Sd having a pronunciation character string Tp whose number of characters matches the obtained number of characters is obtained. Then, a search is performed between the input character string TiN and the pronunciation character string Tp in the obtained conversion dictionary data Sd, and the words W corresponding to the pronunciation character string Tp that matches the input character string TiN are obtained.
[0028] In the example of FIG. 2(b), since the number of characters in the input string Ti1 is "4", four-character dictionary data Sd4 is obtained from the conversion dictionary data Sd, and a word or phrase W of the pronunciation string Tp that matches the input string Ti1 is obtained from the four-character dictionary data Sd4. Also, since the number of characters in the input string Ti2 is "1", one-character dictionary data Sd1 is obtained, and a word or phrase W of the pronunciation string Tp that matches the input string Ti2 is obtained from the one-character dictionary data Sd1. Similarly, since the number of characters in the input string Ti3 and the input string Ti4 are "5", five-character dictionary data Sd5 is obtained, and a word or phrase W of the pronunciation string Tp that matches the input string Ti3 and the input string Ti4 is obtained from the five-character dictionary data Sd5.
[0029] In this way, M-character dictionary data SdM is provided for each number of characters in the pronunciation string Tp, and each word or phrase W is searched for in the M-character dictionary data SdM that matches the number of characters in the input string TiN. By searching for the word or phrase W in the M-character dictionary data SdM that matches the number of characters in the input string TiN, it is possible to omit a comparison with the pronunciation string Tp, which has a number of characters that does not match the number of characters in the input string TiN, and therefore it is possible to quickly search for the word or phrase W.
[0030] In addition, since the number of characters of the pronunciation string Tp and the input string TiN can be easily obtained without complex analysis, the conversion dictionary data Sd can be created and the M-character dictionary data SdM that matches the number of characters of the input string TiN can be obtained quickly. This allows for a good response from when the user H inputs the voice V to when the word W corresponding to the voice V is displayed.
[0031] Furthermore, by decomposing the input character string Ti from the user H into word-by-word input character strings TiN and searching the conversion dictionary data Sd for each input character string TiN, it is possible to obtain a more detailed and accurate word-by-word term W compared to searching the conversion dictionary data Sd for an input character string Ti containing multiple words.
[0032] Next, the electrical configuration of the mobile terminal 1 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the electrical configuration of the mobile terminal 1. As shown in Fig. 3, the mobile terminal 1 has a CPU 10, a flash ROM 11, and a RAM 12, which are each connected to an input / output port 14 via a bus line 13. The input / output port 14 is further connected to a microphone 15 for inputting a voice V, an LCD 16 for displaying a word or phrase W or the like resulting from voice recognition, and a touch panel 17 for inputting instructions from a user H.
[0033] The CPU 10 is a calculation device that controls each part connected by a bus line 13. The flash ROM 11 is a rewritable non-volatile memory, and stores a voice recognition program 11a, all dictionary data 11b in which all dictionary data Ad is stored, and conversion dictionary data 11c in which conversion dictionary data Sd is stored. When the voice recognition program 11a is executed by the CPU 10, the voice processing of FIG. 4 is executed.
[0034] The conversion dictionary data 11c includes one-character dictionary data 11c1 in which the one-character dictionary data Sd1 is stored, two-character dictionary data 11c2 in which the two-character dictionary data Sd2 is stored, and similarly, three- to ten-character dictionary data 11c3-11c10 in which the three- to ten-character dictionary data Sd3-10 are stored, respectively. Hereinafter, the one- to ten-character dictionary data 11c1-11c10 are collectively referred to as "M-character dictionary data 11cM."
[0035] The RAM 12 is a memory for rewritably storing various work data, flags, etc. when the CPU 10 is executing the voice recognition program 11a, and is provided with an output character string memory 12a in which a word W obtained from the input character string TiN is stored.
[0036] Next, the process executed by the CPU 10 of the mobile terminal 1 will be described with reference to Fig. 4 and Fig. 5. Fig. 4(a) is a flowchart of the voice process. The voice process is a process executed when an instruction to execute the voice recognition program 11a is input from the user H via the touch panel 17 or the like.
[0037] The speech processing first checks whether the all dictionary data Ad of the all dictionary data 11b has been updated (S1). Specifically, the combination of the pronunciation character string Tp and the word / phrase W of the all dictionary data Ad of the all dictionary data 11b can be updated by adding or deleting, or correcting the pronunciation character string Tp or the word / phrase W, and it is checked whether an instruction to update the all dictionary data Ad of the all dictionary data 11b has been given by the user H via the touch panel 17.
[0038] In the process of S1, if the all dictionary data Ad of the all dictionary data 11b is updated (S1: Yes), there is a possibility that the combination of the pronunciation character string Tp and the word W included in the all dictionary data Ad may differ from the combination of the pronunciation character string Tp and the word W stored in the conversion dictionary data 11c due to the update of the all dictionary data Ad, so a conversion dictionary data creation process (S2) is executed. The conversion dictionary data creation process will be described with reference to Fig. 4(b).
[0039] 4(b) is a flowchart of the conversion dictionary data creation process. The conversion dictionary data creation process first acquires the updated all dictionary data Ad from the all dictionary data 11b (S20). After the process of S20, the combinations of the pronunciation character string Tp and the words and phrases W in the acquired all dictionary data Ad are rearranged in order of the number of characters of the pronunciation character string Tp (S21).
[0040] After the process of S21, the combination of the pronunciation character string Tp and the word W is obtained for each number of characters of the pronunciation character string Tp from the entire dictionary data Ad rearranged in the order of the number of characters of the pronunciation character string Tp to create dictionary data, and the dictionary data is stored in the M-character dictionary data 11cM of the corresponding number of characters of the conversion dictionary data 11c (S22). As a result, the M-character dictionary data 11cM of the conversion dictionary data 11c stores the same combination of the pronunciation character string Tp and the word W as the entire dictionary data Ad of the updated entire dictionary data 11b.
[0041] After the process of S22, the conversion dictionary data creation process ends.
[0042] Return to FIG. 4(a). If the entire dictionary data Ad of the entire dictionary data 11b has not been updated in the process of S1 (S1: No), the process of S2 is skipped. After the processes of S1 and S2, the output character string memory 12a is cleared (S3). After the process of S3, the voice V input from the microphone 15 is converted into a character string to obtain the input character string Ti (S4). Note that a known method is used to convert the voice V into a character string, and therefore a detailed description thereof will be omitted.
[0043] After the process of S4, the acquired input character string Ti is subjected to morphological analysis to acquire an input character string TiN for each word (S5). Note that a known method is used for the morphological analysis, and therefore a detailed description thereof will be omitted. After the process of S5, a dictionary application process (S6) is executed. The dictionary application process will be described with reference to FIG. 5.
[0044] Fig. 5 is a flowchart of the dictionary application process. In the dictionary application process, first, the number of characters in each of the input character strings TiN obtained in the process of S5 in Fig. 4(a) is obtained (S30). After the process of S30, a counter variable N indicating the order of the input character string TiN obtained from the input character string Ti is set to 1 (S31). For example, when the counter variable N is "1", it is regarded as the above-mentioned "input character string Ti1", and when the counter variable N is "2", it is regarded as the above-mentioned "input character string Ti2". Hereinafter, the input character string TiN at the Nth counter variable of the input character string Ti is referred to as the "Nth input character string TiN".
[0045] After the process of S31, M-character dictionary data 11cM corresponding to the number of characters of the N-th input character string TiN is obtained from the conversion dictionary data 11c (S32). After the process of S32, the N-th input character string TiN is searched for in the M-character dictionary data 11cM obtained in the process of S32, thereby obtaining a word W corresponding to the N-th input character string TiN (S33).
[0046] Specifically, the M-character dictionary data 11cM acquired in the process of S32 is searched for a pronunciation character string Tp that matches the N-th input character string TiN, and if a matching pronunciation character string Tp is found, a corresponding word or phrase W is acquired. On the other hand, if a pronunciation character string Tp that matches the N-th input character string TiN is not found in the M-character dictionary data 11cM, the N-th input character string TiN is acquired as it is as the word or phrase W.
[0047] After the process of S33, the obtained word W is added to the output character string memory 12a (S34). After the process of S34, 1 is added to the counter variable N (S35), and it is confirmed whether the counter variable N is greater than the number of input character strings TiN decomposed from the input character string Ti (S36). In the process of S36, if the counter variable N is equal to or less than the number of input character strings TiN (S36: No), the processes from S32 onwards are repeated. On the other hand, if the counter variable N is greater than the number of input character strings TiN (S36: Yes), the dictionary application process is terminated.
[0048] Returning to Fig. 4(a), after the dictionary application process in S6, the character string stored in the output character string memory 12a is displayed on the LCD 16 (S7). As a result, the voice V input by the user H is converted into an input character string Ti, and among the input character string Ti, a character string that corresponds to a pronunciation character string Tp stored in the conversion dictionary data 11c is replaced with a corresponding word or phrase W and displayed on the LCD 16.
[0049] After the process of S7, it is confirmed whether an instruction to end the voice processing has been obtained from the user H via the touch panel 17 (S8). If an instruction to end the voice processing has not been obtained in the process of S8 (S8: No), the process of S1 and thereafter is repeated, and if an instruction to end the voice processing has been obtained (S8: Yes), the voice processing is ended.
[0050] Next, a mobile terminal 100 according to a second embodiment will be described with reference to Figs. 6 to 8. In the first embodiment described above, the conversion dictionary data Sd is created by dividing it into groups according to the number of characters in the pronunciation string Tp, and dictionary data (i.e., M-character dictionary data SdM) that matches the number of characters in the input string TiN is obtained from the conversion dictionary data Sd, and the word W is obtained using the dictionary data.
[0051] In contrast, in the second embodiment, the conversion dictionary data Sd is created for each first character of the pronunciation string Tp, and dictionary data that matches the first character of the input string TiN is obtained from the conversion dictionary data Sd, and the word W is obtained using the dictionary data. The same parts as in the first embodiment described above are given the same reference numerals, and the description thereof will be omitted.
[0052] Fig. 6(a) is a diagram showing a schematic representation of the creation of conversion dictionary data Sd from all dictionary data Ad in the second embodiment, and Fig. 6(b) is a diagram showing a schematic representation of the replacement of an input character string Ti using the conversion dictionary data Sd in the second embodiment. In the second embodiment, conversion dictionary data Sd is created for each first character of a pronunciation character string Tp from a combination of a pronunciation character string Tp and a word W in the all dictionary data Ad.
[0053] Specifically, the conversion dictionary data Sd of the second embodiment is constructed by dividing the combination of the pronunciation character string Tp and the word / phrase W stored in the entire dictionary data Ad into the first characters of the pronunciation character string Tp. In the second embodiment, "hiragana" is used as the first character. That is, the conversion dictionary data Sd includes "a" dictionary data Sd20 in which a combination of a pronunciation character string Tp whose first character is "a" and a word / phrase W corresponding to the pronunciation character string Tp is stored, and "i" dictionary data Sd21 in which a combination of a pronunciation character string Tp whose first character is "i" and a word / phrase W corresponding to the pronunciation character string Tp is stored, and similarly, "u" to "n" dictionary data Sd22 to 65 in which a combination of a pronunciation character string Tp whose first character is "u" to "n" and a word / phrase W corresponding to the pronunciation character string Tp is stored are also provided. Hereinafter, the "a" to "n" dictionary data Sd20 to 65 are collectively referred to as "P dictionary data SdP".
[0054] In the second embodiment, for a combination of a pronunciation string Tp with a voiced consonant such as "ga" or a semi-voiced consonant such as "pi" as the first character, and a word or phrase W, a character without such a voiced consonant or semi-voiced consonant (for example, "ka" for "ga" and "hi" for "pi") is stored in the dictionary data for P SdP for the first character of the pronunciation string Tp. Note that this is not limited to this, and dictionary data for P SdP for combinations of a pronunciation string Tp with a voiced consonant or semi-voiced consonant as the first character and a word or phrase W may be individually provided in the conversion dictionary data Sd.
[0055] The input character string Ti is replaced using the conversion dictionary data Sd configured in this way. In the example of Fig. 6(b), since the input character string Ti is "ASAHAKUUKIGASUTERU", by morphological analysis of the input character string Ti, the input character string Ti is decomposed into five words, namely, an input character string Ti1 with the first character "A" based on "ASA", an input character string Ti2 with the first character "HA" based on "HA", an input character string Ti3 with the first character "KU" based on "KUUKI", an input character string Ti4 with the first character "GA" based on "GA", and an input character string Ti5 with the first character "SU" based on "SUTERU".
[0056] Then, for each decomposed input character string TiN, the conversion dictionary data Sd is referenced to obtain the word W. Specifically, for each input character string TiN, the first character is obtained, and dictionary data SdP for P having a pronunciation character string Tp whose first character matches the obtained first character is obtained.
[0057] In the example of FIG. 2(b), since the first character of the input character string Ti1 is "a", dictionary data Sd20 for "a" is obtained from the conversion dictionary data Sd, and a word or phrase W of the pronunciation character string Tp that matches the input character string Ti1 is obtained from the dictionary data. Similarly, since the first character of the input character string Ti2 is "wa", dictionary data Sd45 for "wa" is obtained, and a word or phrase W is obtained from the dictionary data. Since the first character of the input character string Ti3 is "ku", dictionary data Sd27 for "ku" is obtained, and a word or phrase W is obtained from the dictionary data. Since the first character of the input character string Ti4 is "ga", dictionary data Sd25 for "ka" is obtained, and a word or phrase W is obtained from the dictionary data. Since the first character of the input character string Ti5 is "su", dictionary data Sd32 for "su" is obtained, and a word or phrase W is obtained from the dictionary data.
[0058] In this way, dictionary data for P SdP is provided for each first character of the pronunciation string Tp, and each word or phrase W is searched for in the dictionary data for P SdP that matches the first character of the input string TiN. By searching for the word or phrase W in the dictionary data for P SdP that matches the first character of the input string TiN, it is possible to omit a comparison with the pronunciation string Tp having a number of characters that does not match the first character of the input string TiN in the first place, and therefore it is possible to quickly search for the word or phrase W.
[0059] In addition, since the first character of the pronunciation string Tp or the input string TiN can be easily obtained without complex analysis of the string, the conversion dictionary data Sd can be created and the dictionary data SdP for P that matches the first character of the input string TiN can be obtained quickly. This allows the process from when the user H inputs the voice V to when the word W corresponding to the voice V is displayed quickly.
[0060] Next, the electrical configuration of the mobile terminal 100 of the second embodiment will be described with reference to Fig. 7. Fig. 7 is a block diagram showing the electrical configuration of the mobile terminal 100 of the second embodiment. In the conversion dictionary data 11c of the mobile terminal 100 of the second embodiment, dictionary data 11c20-11c65 for "a" to "n" in which dictionary data Sd20-65 for "a" to "n" are respectively stored, instead of M-character dictionary data 11cM. Hereinafter, the dictionary data 11c20-11c65 for "a" to "n" will be referred to as "P dictionary data 11cP".
[0061] Next, the process executed by the CPU 10 of the mobile terminal 100 of the second embodiment will be described with reference to Fig. 8. Fig. 8(a) is a flowchart of the conversion dictionary data creation process of the second embodiment. In the conversion dictionary data creation process of the second embodiment, after the process of S20, the combinations of the pronunciation character string Tp and the words and phrases W in all the acquired dictionary data Ad are rearranged in the order of the first characters of the pronunciation character string Tp (S100).
[0062] After the process of S100, the combination of the pronunciation string Tp and the word W is obtained for each first character of the pronunciation string Tp from all dictionary data Ad rearranged in the order of the first characters of the pronunciation string Tp to create dictionary data, and the dictionary data is stored in dictionary data 11cP for the corresponding first character P in the conversion dictionary data 11c (S101). After the process of S101, the conversion dictionary data creation process is terminated.
[0063] Next, the dictionary application process of the second embodiment will be described. Fig. 8(b) is a flowchart of the dictionary application process of the second embodiment. In the dictionary application process of the second embodiment, first, the first character of each input character string TiN obtained in the process of S5 described above in Fig. 4(a) is obtained (S110). After the process of S110, the process of S31 described above is performed, and after the process of S31, the dictionary data 11cP for P corresponding to the first character of the Nth input character string TiN is obtained from the conversion dictionary data 11c (S111).
[0064] After the process of S111, the Nth input character string TiN is searched for in the dictionary data for P 11cP obtained in the process of S111 to obtain a word or phrase W corresponding to the Nth input character string TiN (S112). The method of obtaining the word or phrase W corresponding to the input character string TiN from the dictionary data for P 11cP is the same as the process of S33 in Fig. 5 described above, and therefore a detailed description thereof will be omitted. After the process of S112, the processes from S34 onwards are executed.
[0065] The present invention has been described above based on an embodiment, but the present invention is not limited to the above-described embodiment, and it can be easily inferred that various improvements and modifications are possible within the scope of the present invention.
[0066] In the first embodiment, the conversion dictionary data Sd is created for each number of characters in the pronunciation string Tp, and in the second embodiment, the conversion dictionary data Sd is created for each first character of the pronunciation string Tp, but this is not limited to the above. For example, the conversion dictionary data Sd may be created for each combination of the number of characters and the first character of the pronunciation string Tp. In this case, the combination of the number of characters and the first character of the input string TiN is obtained, and the dictionary data of the combination of the number of characters and the first character corresponding to the combination is obtained from the conversion dictionary data Sd, and the word W is searched for using the obtained dictionary data.
[0067] This makes it possible to omit a comparison with a pronunciation string Tp that does not match the number of characters and the first character of the input string TiN, and therefore to more quickly search for a word or phrase W that corresponds to the input string TiN. Furthermore, by creating conversion dictionary data Sd for each combination of the number of characters and the first character of the pronunciation string Tp, it is possible to reduce the number of pronunciation strings Tp and words or phrases W stored in one dictionary data, compared to the conversion dictionary data Sd for each number of characters in the first embodiment and the conversion dictionary data Sd for each first character in the second embodiment. This also makes it possible to quickly search for a word or phrase W that corresponds to the input string TiN.
[0068] Furthermore, the conversion dictionary data Sd is not limited to being created according to the number of characters or the first character, and may be created according to other features of the pronunciation string Tp or the input string TiN. For example, the conversion dictionary data Sd may be created according to the sum of the character code values of the characters that make up the pronunciation string Tp or the input string TiN. In this case, the sum of the character code values of the characters that make up the input string TiN is obtained, dictionary data corresponding to the sum of the character code values is obtained from the conversion dictionary data Sd, and the word W is searched for using the obtained dictionary data.
[0069] In the above embodiment, the entire dictionary data Ad is provided, and the conversion dictionary data Sd is created from the entire dictionary data Ad, but this is not limited to this. For example, the entire dictionary data Ad may be omitted, and the conversion dictionary data Sd may be configured only. In this case, instead of the processes of S1 and S2 in the voice processing of FIG. 4, the conversion dictionary data Sd may be updated according to an instruction from the user H.
[0070] In the above embodiment, the pronunciation character string Tp and the input character string TiN are configured in hiragana, but this is not limited thereto, and other phonetic characters such as katakana, the alphabet, Chinese pinyin, etc. may be used. Also, the conversion dictionary data Sd in the second embodiment is created according to the first character in hiragana, but this is not limited thereto, and the conversion dictionary data Sd may be created according to the first character in other phonetic characters such as katakana, the alphabet, Chinese pinyin, etc.
[0071] In the first embodiment, the conversion dictionary data Sd includes the 1-10 character dictionary data Sd3-10, which are dictionary data of up to 10 characters, but is not limited to this, and dictionary data of 10 characters or more may be provided.
[0072] In the above embodiment, the input character string Ti is decomposed into word-by-word input character strings TiN, and each of the input character strings TiN is searched in the conversion dictionary data Sd, but this is not limited to the above, and the conversion dictionary data Sd may be searched for an input character string Ti containing multiple words.
[0073] In the above embodiment, the input character string Ti is decomposed into input character strings TiN for each word by morphological analysis, but this is not limited to this, and the input character string Ti may be decomposed into input character strings TiN for each word by other methods such as AI.
[0074] 5 and 8(b), the character string in the output character string memory 12a is displayed on the LCD 16. However, this is not limiting. For example, the character string in the output character string memory 12a may be transmitted to an information processing device such as another mobile terminal 1 via a communication device (not shown), or a printer (not shown) may be connected to print the character string in the output character string memory 12a on paper.
[0075] In the above embodiment, the mobile terminal 1 in which the voice recognition program 11a is embedded is exemplified, but the present invention is not limited to this, and the voice recognition program 11a may be executed by other information processing devices (computers) such as a personal computer or a tablet terminal. Also, the voice recognition program 11a may be stored in a ROM or an IC chip, and the present invention may be applied to a dedicated device that executes only the voice recognition program 11a. [Explanation of symbols]
[0076] 1,100 Mobile devices (computers) 11 Flash ROM (storage section) 11a Voice Recognition Program V Audio Tp pronunciation string W-phrase Sd conversion dictionary data 11c Conversion dictionary data (conversion dictionary storage means) Ti,TiN Input string S4 Voice conversion step, voice conversion means S30, S110: Feature acquisition step, feature acquisition means S32, S111 Dictionary acquisition step, feature acquisition means S33, S112 Search step, search means S7 Output step, output means
Claims
1. A speech recognition program for causing a computer having a storage unit to execute a speech recognition process, The storage unit functions as a conversion dictionary storage means for storing a plurality of conversion dictionary data, which are dictionary data consisting of a combination of a pronunciation character string and a word corresponding to the pronunciation character string, and which are divided by feature amount of the pronunciation character string; a speech conversion step for converting the input speech into an input string representing the pronunciation of the input speech; a feature acquisition step of acquiring features of the input character string converted in the speech conversion step; a dictionary acquisition step of acquiring conversion dictionary data corresponding to the feature amount acquired in the feature amount acquisition step from the conversion dictionary storage means; a search step of searching for a phrase corresponding to the input character string converted in the speech conversion step from the conversion dictionary data acquired in the dictionary acquisition step; an output step of outputting the searched word or phrase when the word or phrase is found in the search step, and outputting the input character string converted in the speech conversion step when the word or phrase is not found in the search step, the conversion dictionary data is created from all dictionary data in which combinations of all pronunciation character strings included in a plurality of the conversion dictionary data and words corresponding to the pronunciation character strings are stored; A speech recognition program characterized in that, when the entire dictionary data is updated, combinations of pronunciation strings and words corresponding to those pronunciation strings contained in the updated entire dictionary data are rearranged based on features of the pronunciation strings, and conversion dictionary data for each feature of the pronunciation strings is created from the rearranged combinations of pronunciation strings and words corresponding to those pronunciation strings.
2. The speech conversion step converts the input speech into a character string representing the pronunciation, and breaks the character string into words to obtain an input character string; The feature amount acquiring step acquires feature amounts of each of the input character strings converted and decomposed into words in the speech conversion step, The dictionary acquisition step acquires, from the conversion dictionary storage means, conversion dictionary data corresponding to each feature of the input character string decomposed into words acquired in the feature acquisition step, 2. The speech recognition program according to claim 1, wherein the search step searches for a phrase corresponding to each of the input character strings decomposed into words converted in the speech conversion step from each conversion dictionary data acquired in the dictionary acquisition step.
3. 3. The speech recognition program according to claim 1, wherein the feature amount is the number of characters in the pronunciation character string or the input character string.
4. 3. The speech recognition program according to claim 1, wherein the feature is a first character of the pronunciation character string or the input character string.
5. 3. The speech recognition program according to claim 1, wherein the feature amount is a combination of the number of characters and the first character of the pronunciation character string or the input character string.
6. A conversion dictionary storage means for storing a plurality of conversion dictionary data, which are dictionary data consisting of a combination of a pronunciation character string and a word or phrase corresponding to the pronunciation character string, and which are divided according to features of the pronunciation character string; A voice input means for inputting voice; a speech conversion means for converting the speech inputted by the speech input means into an input character string representing the pronunciation of the speech; A feature acquisition means for acquiring a feature of an input character string converted by the speech conversion means; a dictionary acquisition means for acquiring conversion dictionary data corresponding to the feature acquired by the feature acquisition means from among the conversion dictionary data stored in the conversion dictionary storage means; a search means for searching conversion dictionary data acquired by the dictionary acquisition means for a word or phrase corresponding to the input character string converted by the speech conversion means; an output means for outputting the searched word or phrase when the search means is able to search for the word or phrase, and for outputting the input character string converted by the speech conversion means when the search means is unable to search for the word or phrase, the conversion dictionary data is created from all dictionary data in which combinations of all pronunciation character strings included in a plurality of the conversion dictionary data and words corresponding to the pronunciation character strings are stored; A speech recognition device characterized in that, when the entire dictionary data is updated, combinations of pronunciation strings and words corresponding to the pronunciation strings contained in the updated entire dictionary data are rearranged based on features of the pronunciation strings, and conversion dictionary data for each feature of the pronunciation strings is created from the rearranged combinations of pronunciation strings and words corresponding to the pronunciation strings.
Citation Information
Patent Citations
Converting method of voice input japanese type writer
JP1983052738A
Japanese syllabary to chinese character conversion japanese input device
JP1985063669A
Japanese word input device
JP1990042566A
Word processor
JP1995078152A
Voice recognition device
JP1998049194A