Sound processing device, toy, and computer program

Abstract

To provide a technology for establishing a pseudo conversation even when input words which can be processed are limited.SOLUTION: A voice processing apparatus comprising a voice acquisition unit configured to acquire a voice uttered by a user, a processing unit configured to process the acquired voice, a voice output unit configured to perform voice output according to a result of processing in the processing unit, and a storage unit configured to store voice information of a plurality of predetermined input words and output voice information by the voice output unit associated with each of the plurality of predetermined input words, in the processing, the processing means performs a first determination for determining whether or not the voice acquired by the voice acquisition means corresponds to any of the voice information of the plurality of predetermined input words, and in response to a determination that the voice acquired by the voice acquisition means corresponds to first voice information of the voice information of the plurality of predetermined input words, the processing means causes the voice output means to output first output voice information stored in the storage means in association with the first voice information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a voice processing device, a toy, and a computer program. [Background technology]

[0002] Patent Document 1 discloses an invention of a simulated conversation system, in which a question to start a conversation is output from a speaker 30, and when a voice in response to the output question is input, the voice (input word) is recognized and a registered word corresponding to the voice is determined. In accordance with the determined registered word, a backchannel and the next question are determined from a group of backchannels and a group of next questions, and the voice is synthesized and output from the speaker, continuing the conversation. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-169591 Summary of the Invention [Problem to be solved by the invention]

[0004] In simulated conversation systems such as those described above, the user is not particularly aware of an upper limit on the number of input words that can be spoken. However, if there are constraints on the processing of input words, such as when the processor used has low performance, the number of input words that can be processed is limited. Therefore, there is a need for technology that can establish a simulated conversation even when the number of input words that can be processed is limited.

[0005] Therefore, a technology is provided that makes it possible to establish a pseudo-conversation even when the input words that can be processed are limited. [Means for solving the problem]

[0006] One form for solving the above problem is a voice processing device comprising: a voice acquisition means for acquiring voice uttered by a user; a processing means for processing the acquired voice; a voice output means for outputting voice in accordance with the result of processing by the processing means; and a storage means for storing voice information of a plurality of predetermined input words and output voice information by the voice output means associated with each of the plurality of predetermined input words, wherein the processing means starts the processing in accordance with the acquisition of the voice by the voice acquisition means, and in the processing, makes a first determination to determine whether the voice acquired by the voice acquisition means corresponds to any of the voice information of the plurality of predetermined input words, and in accordance with determining in the first determination that the voice corresponds to first voice information among the voice information of the plurality of predetermined input words, outputs first output voice information stored in the storage means in association with the first voice information from the voice output means. [Effects of the Invention]

[0007] To enable a pseudo conversation to be established even when processable input words are limited. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram showing an example of the configuration of a speech processing system 10 according to an embodiment. [Figure 2] 10 is a flowchart illustrating an example of processing according to the embodiment. [Figure 3A] 10 is a flowchart illustrating an example of a voice registration process according to the embodiment. [Figure 3B] FIG. 4 is a diagram showing an example of the data configuration of a registration voice according to the embodiment. [Figure 4A] 6 is a flowchart showing an example of a first mode process according to the embodiment. [Figure 4B] 5A to 5C are diagrams for explaining a first mode process according to the embodiment. [Figure 4C] FIG. 4 is a diagram showing an example of the configuration of a data table corresponding to a first mode according to the embodiment. [Figure 5A]10 is a flowchart showing an example of a second mode process according to the embodiment. [Figure 5B] FIG. 10 is a diagram showing an example of the configuration of a data table corresponding to a second mode according to the embodiment. [Figure 6A] 10 is a flowchart showing an example of a third mode process according to the embodiment. [Figure 6B] FIG. 10 is a diagram showing an example of the configuration of a data table corresponding to a third mode according to the embodiment. [Figure 6C] 10A to 10C are diagrams for explaining a third mode process according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention as claimed, and not all combinations of features described in the embodiments are necessarily essential to the invention. Two or more of the features described in the embodiments may be arbitrarily combined. Furthermore, the same reference numerals are used for the same or similar components, and redundant explanations will be omitted.

[0010] First, the configuration of a voice processing system corresponding to this embodiment will be described. Fig. 1 is a diagram showing an example of the configuration of a voice processing system 10 corresponding to this embodiment. The voice processing system 10 is composed of a voice processing device 100 and a controller 110. The voice processing device 100 is composed of a processing unit 101, a microphone 102, a speaker 103, a notification unit 104, an infrared receiving unit 105, an operation unit 106, and a storage unit 107. The controller 110 transmits commands via infrared rays in response to operations by a user of the voice processing system 10.

[0011] The system configuration is not limited to that shown in FIG. 1, and the audio processing device 100 may be further connected to an external device such as an external server or a cloud server via a wired or wireless connection, and configured to be able to obtain update data for updating output audio data, etc. from the external device.

[0012] The processing unit 101 of the audio processing device 100 controls the operation of the entire device. The processing unit 101 can be configured with a CPU or the like. The microphone 102 is an audio input device for acquiring audio utterances from the user. Audio information acquired by the microphone 102 is output to the processing unit 101 and processed. The speaker 103 is an audio output device that outputs audio such as messages, alarm sounds, and notification sounds to the user under the control of the processing unit 101. The notification unit 104 is a notification device that provides non-audio notifications to the user under the control of the processing unit 101, and can output, for example, light, video, vibration, etc. The notification unit 104 may perform notification by, for example, controlling the lighting of an LED, or by displaying a video on a display such as an LCD. Alternatively, a vibrator may perform notification by vibration. Any combination of these may also be used.

[0013] The infrared receiving unit 105 receives command information transmitted via infrared rays from the controller 110 and outputs it to the processing unit 101. The operation unit 106 is an operation mechanism for user operation, and includes, for example, a power button, operation buttons, switches, and the like.

[0014] The memory unit 107 is a storage device for managing and storing information and programs required for processing by the processing unit 101, and includes RAM, ROM, EEPROM, etc. The memory unit 107 stores a processing program for the processing unit 101 to execute processing corresponding to this embodiment. When the processing unit 101 is realized by a CPU, for example, it can control each unit of the voice processing device 100 using RAM as a work memory in accordance with a program stored in ROM. The memory unit 107 also stores user voice data (voice information, hereinafter the same) acquired by the microphone 102, output voice data (output voice information, hereinafter the same) output from the speaker 103, alarm sound data, notification sound data, etc. In this embodiment, the voice recognition process is simplified, thereby making it possible to reduce the storage capacity of the memory unit 107.

[0015] The controller 110 is configured to have buttons, switches, a touch panel, etc., and when any button, etc. is operated, it transmits a corresponding command signal via infrared rays. The infrared signal is received and processed by the infrared receiving unit 105 of the audio processing device 100.

[0016] The voice processing device 100 can be configured to have, for example, the external shape of a toy. The toy can be, for example, a model with a doll-like (robot or human) appearance. The model can be, for example, a plastic model that has been assembled and painted. Alternatively, it can be a completed model such as a figurine (action figure) with movable joints. The shape of the model is not limited to a doll-like appearance, but can also be a model of any shape, such as a general vehicle, racing vehicle, military vehicle, aircraft, ship, animal, or virtual life form.

[0017] <Overall processing in the voice processing device 100> Next, an example of processing executed by the voice processing device 100 according to this embodiment will be described with reference to Fig. 2. At least a part of the processing corresponding to the flowchart is realized by the CPU of the processing unit 101 of the voice processing device 100 executing a program stored in the storage unit 107.

[0018] First, in S201, the processing unit 101 executes a voice registration process. This process involves having the user speak a predetermined input word (such as a line, a message, or a sentence) and registering the user's spoken voice as voice data (e.g., voice waveform data) in the storage unit 107. In the voice recognition process of this embodiment, the user's spoken voice is not converted into text, but is instead saved as voice data in the voice registration process. The saved voice data is then compared with the input voice data to determine which of the predetermined input words the user uttered. The predetermined input words are prepared in advance, and the user can register them by reading them out loud in order. The voice registration process can be executed in response to the operation of a button on the controller to instruct the start of the voice registration process, or can be executed when the voice processing system 10 is first started up. Details of S201 will be described with reference to FIG. 3A.

[0019] In the following S202, the infrared receiving unit 105 of the audio processing device 100 receives a command from the controller. The received command information is provided to the processing unit 101 and processed. Specifically, in S203, the processing unit 101 determines the type of the received command information and determines which of a plurality of modes has been instructed to execute. Here, three modes, a first mode, a second mode, and a third mode, will be described, but it is also possible to determine two or four or more modes.

[0020] If it is determined in S203 that the first mode has been requested, the process proceeds to S204, where first mode processing is executed. Details of the first mode processing will be described with reference to FIG. 4A. Furthermore, if it is determined in S203 that the second mode has been requested, the process proceeds to S205, where second mode processing is executed. Details of the second mode processing will be described with reference to FIG. 5. Furthermore, if it is determined in S203 that the third mode has been requested, the process proceeds to S206, where third mode processing is executed. Details of the third mode processing will be described with reference to FIG. 6A. Processing in the audio processing device 100 is carried out in the manner described above.

[0021] <Voice registration process> Next, the voice registration process in S201 will be described in detail. Fig. 3A is a flowchart showing an example of the voice registration process.

[0022] In the speech registration process, in S301, the processing unit 101 resets the value of a parameter n indicating the number of an input word to be registered to 1. Subsequently, in S302, the processing unit 101 acquires, via the microphone 102, the speech of a user reading out a predetermined input word n. Subsequently, in S303, the processing unit 101 divides the speech data acquired from the microphone 102 into syllables and stores them in the storage unit 107. For example, if the predetermined input is "chocolate," the processing unit 101 divides the speech data into "cho," "ko," "ree," and "to," and stores them in the storage unit 107. Note that the syllable division shown here is merely an example, and syllable division can be performed in any manner as long as it is possible to compare the registered speech data with newly input speech data and determine whether they match or mismatch.

[0023] In the next S304, the processing unit 101 determines whether the number of the registered input word has reached a predetermined number N. If N has not yet been reached ("NO" in S304), the processing proceeds to S305, where the input word number n is incremented by 1, and the processing returns to S302 to continue the above-mentioned processing. On the other hand, if N has been reached ("YES" in S304), this processing ends.

[0024] By the above voice registration process, it is possible to register the user's voice data for a predetermined number N of predetermined input words. By using the registered voice data in subsequent processing, when the user utters one of the predetermined input words, it becomes possible to reliably determine which word has been uttered.

[0025] An example of the input words registered at this time is shown in FIG. 3B. FIG. 3B shows an example in which 10 input words (e.g., input word 1 to input word 10) are divided into syllables and registered in storage unit 107. In FIG. 3B, syllable information for the registered input words is shown row by row, and the information for each row is alternatively displayed as a combination of the input word number and the syllable numbers that make up the word. For example, 1_1 represents information about the first (first) syllable of input word 1, and 8_4 represents information about the fourth syllable of input word 8. Here, input word 1 registered at the top of the table in FIG. 3B has the input sound divided into four syllables, 1_1 to 1_4. Specifically, if the word "partner" is spoken and registered by the user, "partner" is pronounced as "aibou" and divided into the syllables "a," "i," "bo," and "u." Therefore, the syllable information of "a" as 1_1, "i" as 1_2, "bo" as 1_3, and "u" as 1_4 is registered. Similarly, if the word "switch to manual" is pronounced as "manyuarunikirikaero," it is divided into the syllables "ma," "nyu," "a," "ru," "ni," "ki," "ri," "ka," "e," and "ro" and registered. By using the voice data divided into these syllables, input voice data uttered by the user and acquired by microphone 102 is compared from the beginning with the registered voice data similarly divided into syllables and stored in storage unit 107, and it is possible to determine which input word matches.

[0026] <First mode processing> Next, the processing content of the first mode in which the above determination is made and audio output is performed will be described with reference to Figures 4A and 4B. Figure 4A is a flowchart corresponding to an example of the processing in the first mode, and Figure 4B is a diagram for explaining the round-robin determination processing corresponding to the first mode.

[0027] In FIG. 4A, in S401, voice uttered by the user is acquired via the microphone 102. The voice data from the microphone 102 is transmitted to the processing unit 101 and processed in the processing unit 101. Specifically, in S402, it is determined whether the voice intensity is greater than a predetermined threshold Th1. The processing unit 101 determines whether the amplitude value of the voice data acquired from the microphone 102 is greater than the threshold Th1, and if it is greater than the threshold Th1 ("YES" in S402), the processing proceeds to S403. On the other hand, if it is equal to or less than the threshold Th1 ("NO" in S402), the processing returns to S401. In the processing of S402, only voices generated at a volume above a certain level are processed to prevent malfunctions due to erroneous input.

[0028] Next, in S403, it is determined whether the length of the input voice is longer than a predetermined threshold value Th2. Th2 can be set to, for example, one second. The processing unit 101 determines whether the length of the voice data acquired from the microphone 102 is longer than the threshold value Th2, and if it is longer than the threshold value Th2 ("YES" in S403), the process proceeds to S404. On the other hand, if it is equal to or less than the threshold value Th2 ("NO" in S403), the process returns to S401. In order to prevent malfunctions due to erroneous input, the process of S403 also processes only voices generated with a certain length or longer.

[0029] In S403, if a certain amount of audio is acquired, the process proceeds to S404. Here, the length of the audio to be processed may be limited. For example, the audio data may be limited to a length not exceeding a threshold value Th3. Here, Th3 may be set to, for example, 3 seconds.

[0030] In the next S404, the processing unit 101 performs a process of dividing the acquired voice data into syllables, and in S405, the input voice data divided into syllables is subjected to a brute force test (first test) on the registered voices of the user registered in the storage unit 107. A specific example of this brute force test process will be described with reference to FIG. 4B. The process in S404 can be performed when the user has finished speaking. The end of the user's speaking can be determined in the same manner as described later in relation to S505 in FIG. 5A.

[0031] In Figure 4B, the input speech data is divided into syllables and numbered from 1 to 5, but there may be other syllables after these. The input speech data is compared starting with the first syllable numbered 1. The registered speech data to be compared is the same as that shown in Figure 3B. The registered speech data is compared sequentially with the registered speech data of the syllable at position 1 of the registered speech data, and if there is a match, a value of 1 is assigned, and if there is a mismatch, a value of 0 is assigned. This is performed for each syllable in the input speech data.

[0032] In the subsequent process of S406, the processing unit 101 selects the registered voice data with the highest determination score in the determination process of S405. Here, the registered voice data for which all syllables in the registered voice data are determined to be 1, or the registered voice data with the most 1 values ​​and containing 1 at a certain rate or more, can be determined to have the highest score. At this time, registered voice data whose number of syllables highly differs from that of the input voice data may be excluded in advance from the selection candidates. For example, if the number of syllables in the input voice data is four and the number of syllables in the registered voice data is five or more, at least one zero will be added, but data containing a certain number of zeros or more may be excluded.

[0033] In the following S407, the processing unit 101 selects the voice data of the first line stored in association with the input word corresponding to the registered voice selected in S406, and outputs the voice from the speaker 103. The first line stored in association with the input word can be identified by referring to a data table registered in the storage unit 107. FIG. 4C shows an example of the data structure of a data table for registering output voice data according to this embodiment. In the data table 400 shown in FIG. 4C, voice data of a first line 402 and a second line 403 (first output voice information) are registered in association with a predetermined input word 401. The predetermined input word 401 corresponds to the registered voice data that was the target of determination in S406. In FIG. 4C, two types of lines are registered in association with each of the input words registered in the input word 401, but the number of lines to be registered may be three or more. In this case, the additional lines may be lines different from the associated registered first and second lines. These voice data may be updated as needed by connecting to an external device.

[0034] In S407, when the output of the audio data of the first line is completed, the process proceeds to S408. In S408, the audio spoken by the user is acquired via the microphone 102. The audio data from the microphone 102 is transmitted to the processing unit 101, which then performs a second determination process. As the second determination, first in S409, the processing unit 101 determines whether the audio intensity is greater than a predetermined threshold Th1. If the amplitude value of the audio data acquired from the microphone 102 is greater than the threshold Th1 ("YES" in S409), the process proceeds to S410. On the other hand, if the amplitude value is equal to or less than the threshold Th1 ("NO" in S409), the process returns to S408. In the process of S409, only audio generated at a volume above a certain level is processed to prevent malfunction due to erroneous input.

[0035] Next, in S410, it is determined whether the length of the input voice is longer than a predetermined threshold value Th2. Th2 can be set to, for example, one second. If the length of the voice data acquired from the microphone 102 is longer than the threshold value Th2 ("YES" in S410), the process proceeds to S411. On the other hand, if the length is equal to or less than the threshold value Th2 ("NO" in S410), the process returns to S408. In order to prevent malfunctions due to erroneous input, the process of S410 also processes only voices generated with a certain length or longer.

[0036] If it is determined in the second determinations of S409 and S410 above that there has been a voice input from the user (or that a voice has been detected or acquired), in S411 the processing unit 101 selects the voice data of the second line registered in association with the input word selected in S406, outputs the voice from the speaker 103, and ends this processing. Note that the processing in S411 can be performed when the user's utterance has ended. The end of the user's utterance can be determined in the same manner as described below in relation to S505 in FIG. 5A.

[0037] The above describes the process of outputting up to the second line, but even after the audio data of the second line has been output, the same process as from S408 to S411 may be repeated to output audio data of additional lines registered in data table 400 in association with the input word selected in S406.

[0038] In the above example, the voice output is performed using the voice data of the lines registered in association with the predetermined words, but the voice output may be performed by selecting one of the lines not associated with the predetermined words. The selection method may be selection according to a predetermined order or random selection. In this case, the same line may be repeatedly output.

[0039] In the processing of the first mode described above, after determining in the first determination whether the voice initially uttered by the user corresponds to one of the predetermined input words, in the second determination, the second line and subsequent lines can be output without determining (or specifying) the content of the user's utterance in response to the acquisition (or detection) of the voice, thereby reducing the processing load and reducing the power consumption of the voice processing device 100. When the voice processing device 100 is battery-powered, reducing the processing power is very important because it also has a significant impact on the battery life.

[0040] <Second mode processing> In the first mode described above, the voice processing device 100 responds to speech from the user, whereas in the second mode, the voice processing device 100 starts outputting voice and the user responds. The processing content of the second mode will be described below with reference to Figures 5A and 5B. Figure 5A is a flowchart corresponding to an example of processing in the second mode, and Figure 5B shows an example of the data configuration of a data table 500 corresponding to the second mode.

[0041] In S501 of FIG. 5A, the processing unit 101 selects one of the voice data of the third lines stored in the storage unit 107 and outputs the voice from the speaker 103. Here, FIG. 5B shows an example of the data configuration of a data table that registers voice data corresponding to the second mode. In the data table 500 of FIG. 5B, voice data of the third line 501 and voice data of the fourth line 502 (second output voice information) are registered in association with each other. In the data table 500, a plurality of combinations of the third line and the fourth line are registered, and in S501, one of these combinations may be selected randomly or in the order of registration. These voice data may be updated as appropriate by connecting to an external device.

[0042] After the audio output in S501 is completed, in the next step S502, the processing unit 101 acquires the audio uttered by the user via the microphone 102. The audio data from the microphone 102 is transmitted to the processing unit 101, where it is processed. In the next step S503, the processing unit 101 determines whether the audio intensity is greater than a predetermined threshold value Th1. If the amplitude value of the audio data acquired from the microphone 102 is greater than the threshold value Th1 ("YES" in S503), the process proceeds to S504. On the other hand, if the amplitude value is equal to or less than the threshold value Th1 ("NO" in S503), the process returns to S502. In the process of S503, only audio generated at a volume above a certain level is processed to prevent malfunction due to erroneous input.

[0043] Next, in S504, the processing unit 101 determines whether the length of the input voice is longer than a predetermined threshold value Th2. Th2 can be set to, for example, one second. If the length of the voice data acquired from the microphone 102 is longer than the threshold value Th2 ("YES" in S504), the process proceeds to S505. On the other hand, if the length is equal to or less than the threshold value Th2 ("NO" in S504), the process returns to S502. In order to prevent malfunctions due to erroneous input, the process of S504 also processes only voices generated with a certain length or longer.

[0044] In the next step S505, the processing unit 101 determines whether the user's speech has ended. For example, if the amplitude value of the voice data acquired from the microphone 102 reaches the noise level and it is determined that the speech has ended ("YES" in S505), the processing proceeds to S506. On the other hand, if the amplitude value is higher than the noise level and it is determined that speech is still occurring ("NO" in S505), the processing returns to S502. This determination is made in order to output the next line after the user's speech has ended. If the next line is output in the middle of the user's speech, the user may not be able to hear it or the conversation may sound unnatural, so the processing unit waits until the user's speech has ended before proceeding to the next step.

[0045] In the following S506, the processing unit 101 selects the voice data of the fourth line registered in the data table 500 in association with the third line output in S501, outputs the voice from the speaker 103, and ends this processing.

[0046] The above describes the processing up to the fourth line, but even after the audio data of the fourth line has been output, the same processing as that from S502 to S506 may be repeated to output the audio data of lines that are associated with the third line selected in S501 and registered in data table 500. Also, the above describes the case where lines that are associated with each other and registered in data table 500 are output in sequence, but lines that are not associated with each other may be randomly selected from a plurality of lines and output in sequence. In this case, the same line may be output repeatedly.

[0047] <Third mode processing> In the first and second modes described above, voice data registered in association with each other are output in sequence. In contrast, in the third mode, multiple voice data are registered in association with a given input word, and one of the data is selected and output each time, enabling different responses to the same voice input. The processing content of the third mode will be described below with reference to Figures 6A, 6B, and 6C. Figure 6A is a flowchart corresponding to an example of processing in the third mode, Figure 6B shows an example of the data configuration of a data table 600 corresponding to the third mode, and Figure 6C is a conceptual diagram of processing corresponding to the third mode.

[0048] In S601 of FIG. 6A, the processing unit 101 acquires the voice uttered by the user via the microphone 102. The voice data from the microphone 102 is transmitted to the processing unit 101, where it is processed. In the following S602, the processing unit 101 determines whether the voice intensity is greater than a predetermined threshold Th1. If the amplitude value of the voice data acquired from the microphone 102 is greater than the threshold Th1 ("YES" in S602), the process proceeds to S603. On the other hand, if the amplitude value is equal to or less than the threshold Th1 ("NO" in S602), the process returns to S601. In the process of S602, only voices generated at a volume above a certain level are processed to prevent malfunctions due to erroneous input.

[0049] Next, in S603, the processing unit 101 determines whether the length of the input voice is longer than a predetermined threshold value Th2. Th2 can be set to, for example, one second. If the length of the voice data acquired from the microphone 102 is longer than the threshold value Th2 ("YES" in S603), the process proceeds to S604. On the other hand, if the length is equal to or less than the threshold value Th2 ("NO" in S603), the process returns to S601. In order to prevent malfunctions due to erroneous input, the process of S603 also processes only voices generated with a certain length or longer.

[0050] In the following S604, the processing unit 101 determines whether the input voice corresponds to a predetermined input word or line. This determination can be made in the same manner as the processes from S404 to S406 in Fig. 4. In the following S605, the processing unit 101 selects a fifth line stored in the storage unit 107 in association with the predetermined line determined in S604, outputs the voice from the speaker 103, and ends this process. At this time, since multiple fifth lines are registered in association with the predetermined line, any one of them is selected.

[0051] 6B shows an example of the data configuration of a data table 600 that registers the voice data of the fifth line. In the data table 600, an input word 601 and a fifth line 602 are registered. The input word 601 may be the same as the input word 401 in FIG. 4C, or an additional input word may be used with some commonality. Looking at input word 1 in FIG. 6B, for example, voice data of multiple lines is registered, such as fifth line 11, fifth line 12, fifth line 13, and fifth line 14. Therefore, when input word 1 is identified as the line uttered by the user in S604, there will be multiple output candidates.

[0052] More specifically, Figure 6C shows an example of a response to a voice input of "partner." "Partner" is a line registered as an input word 601 in Figure 6B, and "Yes, what's wrong?", "What's wrong?", "Where are you now?", etc. are registered as fifth lines 602. When it is determined in S604 that the input voice is "partner," in S605, the fifth lines registered as output voices are output in order from top to bottom, and when the last registered line, "Am I that noisy?", is output, the process returns to the top and "Yes, what's wrong?" is selected. The selection may be in the order of registration or random.

[0053] In this way, in the third mode, the voice data registered as the fifth line is output in sequence or randomly, so that a different response is returned each time the user tweets a specific line, thereby improving preference and interest.

[0054] In Fig. 6A, this process ends after the fifth line is output, but the embodiment is not limited to this, and the process from S408 onwards in Fig. 4A may be combined. This makes it possible to randomize the response to a predetermined input word and to carry out a subsequent dialogue, thereby further improving the user's preference and interest.

[0055] As described above, the present embodiment can provide a technology that enables a dialogue with a user while reducing power consumption by reducing the number of words that require speech recognition (identifying the content of a user's utterance based on a comparison with registered speech data) in the speech processing device 100 and thereby reducing the processing load. A dialogue with a user may be performed by a speech from the user or by a speech from the speech processing device 100. In particular, when a dialogue is started by a speech from the speech processing device 100, speech recognition is not required, and therefore a dialogue with a particularly reduced processing load is possible. Even when a dialogue is started by a speech from the user, it is only necessary to perform speech recognition on the initial utterance, and the dialogue can be continued thereafter without speech recognition, thereby reducing the processing load.

[0056] <Summary of the embodiment> The above-described embodiments disclose at least the following voice processing device, toy, and computer program. (1) a voice acquisition means for acquiring a voice uttered by a user; a processing means for processing the acquired voice; an audio output means for outputting audio in accordance with the result of the processing by the processing means; a storage means for storing speech information of a plurality of predetermined input words and speech information output by the speech output means associated with each of the plurality of predetermined input words; Equipped with The processing means The processing is started in response to the voice acquisition means acquiring the voice, In the process, a first determination is made to determine whether the speech acquired by the speech acquisition means corresponds to any of speech information of the plurality of predetermined input words; A speech processing device that, in the first judgment, determines that the input word corresponds to first speech information among the speech information of the plurality of specified input words, outputs first output speech information stored in the storage means in association with the first speech information from the speech output means. (2) The storage means stores a plurality of pieces of the first output voice information in association with the first voice information; The processing means outputs one of the plurality of first output audio information from the audio output means in response to determining in the first determination that the first output audio information corresponds to the first audio information. (3) the first output voice information includes voice information of a plurality of lines; The processing means When the first output voice information is output from the voice output means, voice information of a first line among the plurality of lines is output; After the audio information of the first line is output, a second determination is made to determine whether or not audio has been acquired by the audio acquisition means; A voice processing device as described in (1) or (2), wherein when it is determined in the second determination that the voice has been acquired, voice information of a second line among the plurality of lines, which is different from the first line, is output from the voice output means. (4) The audio processing device described in (3), wherein the audio information of the multiple lines included in the first output audio information further includes audio information of at least one additional line different from the first line and the second line, which is output after the audio information of the second line is output. (5) the first output voice information includes voice information of a first line; The processing means When the first output voice information is output from the voice output means, voice information of the first line is output; After the audio information of the first line is output, a second determination is made to determine whether or not audio has been acquired by the audio acquisition means; The voice processing device described in (1) above, wherein when it is determined in the second determination that the voice has been acquired, the voice information of any one of the multiple lines stored in the storage means is output from the voice output means. (6) The processing means The voice processing device according to any one of (3) to (5), wherein in the second determination, it is determined that the voice has been acquired in response to the voice being detected by the voice acquisition means. (7) The processing means The audio processing device according to any one of (3) to (6), wherein the second determination determines whether the audio has been acquired, and does not determine the content of the acquired audio. (8) the second determination includes determining an end of the voice acquired by the voice acquisition means; the processing means, in response to the second determination that the audio has ended, causes the audio output means to output audio. A voice processing device according to any one of (3) to (7). (9) The storage means further stores a plurality of pieces of second output speech information without associating them with the speech information of the predetermined input word, and the second output speech information includes speech information of a plurality of lines; The processing means selecting one of the plurality of second output audio information; outputting, from the audio output means, audio information of a third line among the plurality of lines included in the selected second output audio information; After the audio information of the third line is output, the second determination is made; when it is determined in the second determination that the voice has been acquired, outputting voice information of a fourth line, which is different from the third line, among the plurality of lines from the voice output means; A voice processing device according to any one of (3) to (8). (10) The speech processing device according to any one of (1) to (9), wherein the plurality of predetermined input words are different input words. (11) The storage means stores the speech information of the plurality of predetermined input words in units of syllables of each input word spoken, The speech processing device according to any one of (1) to (10), wherein in the first determination, the processing means determines whether the speech acquired by the speech acquisition means matches the speech information of each of the syllable units of the plurality of specified input words. (12) The speech processing device according to (11), wherein the processing means performs the determination of whether the speech matches the speech information of each of the syllable units of the plurality of predetermined input words, starting with the speech information of the first syllable of each input word. (13) The speech processing device according to (12), wherein the processing means performs the determination of whether the speech matches the syllable-based speech information of each of the plurality of predetermined input words in a brute-force manner for the plurality of predetermined input words. (14) The audio processing device according to any one of (1) to (13), wherein the processing means starts the processing in response to the audio acquisition means acquiring audio having a length equal to or longer than a predetermined time. (15) The audio processing device according to (14), wherein the predetermined time is one second. (16) The audio processing device according to (14) or (15), wherein the processing means starts the processing in response to the audio acquisition means acquiring audio with a predetermined sound pressure or higher. (17) A speech processing device described in any one of (1) to 16, wherein the speech information of the plurality of predetermined input words is acquired by the speech acquisition means from the speech uttered by the user for each of the plurality of predetermined input words and stored in the storage means. (18) A toy equipped with a voice processing device according to any one of (1) to (17). (19) A computer program for causing a computer to function as a processing means of the voice processing device according to any one of (1) to (17).

[0057] The invention is not limited to the above-described embodiment, and various modifications and variations are possible within the scope of the gist of the invention.

Claims

1. A voice acquisition means for acquiring a voice uttered by a user; a processing means for processing the acquired voice; an audio output means for outputting audio in accordance with the result of the processing by the processing means; a storage means for storing speech information of a plurality of predetermined input words and speech information output by the speech output means associated with each of the plurality of predetermined input words; Equipped with The processing means The processing is started in response to the voice acquisition means acquiring the voice, In the process, a first determination is made to determine whether the speech acquired by the speech acquisition means corresponds to any of the speech information of the plurality of predetermined input words; in response to determining in the first determination that the input word corresponds to first speech information among the speech information of the plurality of predetermined input words, outputting first output speech information stored in the storage means in association with the first speech information from the speech output means; Audio processing device.

2. the storage means stores a plurality of pieces of first output voice information in association with the first voice information; 2. The audio processing device according to claim 1, wherein the processing means causes the audio output means to output one of the plurality of first output audio information in response to determining in the first determination that the first output audio information corresponds to the first audio information.

3. the first output voice information includes voice information of a plurality of lines; The processing means When the first output voice information is output from the voice output means, voice information of a first line among the plurality of lines is output; After the audio information of the first line is output, a second determination is made to determine whether or not audio has been acquired by the audio acquisition means; When it is determined in the second determination that the voice has been acquired, voice information of a second line of the plurality of lines, which is different from the first line, is output from the voice output means. The audio processing device according to claim 2 .

4. The voice processing device according to claim 3, wherein the voice information of the plurality of lines included in the first output voice information further includes voice information of at least one additional line different from the first line and the second line, which is output after the voice information of the second line is output.

5. the first output voice information includes voice information of a first line; The processing means When the first output voice information is output from the voice output means, voice information of the first line is output; After the audio information of the first line is output, a second determination is made to determine whether or not audio has been acquired by the audio acquisition means; When it is determined in the second determination that the voice has been acquired, voice information of any one of the plurality of lines stored in the storage means is output from the voice output means. The audio processing device according to claim 1 .

6. The processing means The audio processing device according to claim 3 , wherein in the second determination, it is determined that the audio has been acquired in response to the audio being detected by the audio acquisition means.

7. The processing means The audio processing device according to claim 6 , wherein the second determination determines whether the audio has been acquired, but does not determine the content of the acquired audio.

8. the second determination includes determining an end of the voice acquired by the voice acquisition means; the processing means, in response to the second determination that the speech has ended, causes the speech output means to output speech. The audio processing device according to claim 7 .

9. the storage means further stores a plurality of pieces of second output speech information without association with the speech information of the predetermined input word, the second output speech information including speech information of a plurality of lines; The processing means selecting one of the plurality of second output audio information; outputting, from the audio output means, audio information of a third line among the plurality of lines included in the selected second output audio information; After the voice information of the third line is output, the second determination is made; when it is determined in the second determination that the voice has been acquired, outputting voice information of a fourth line, which is different from the third line, among the plurality of lines from the voice output means; The audio processing device according to claim 8 .

10. The speech processing device according to claim 9 , wherein the plurality of predetermined input words are different input words.

11. the storage means stores the speech information of the plurality of predetermined input words in units of syllables of each input word spoken; The speech processing device according to claim 10 , wherein the processing means determines, in the first determination, whether the speech acquired by the speech acquisition means matches the speech information in syllable units of each of the plurality of predetermined input words.

12. 12. The speech processing device according to claim 11, wherein the processing means performs the determination of whether the speech matches the speech information of each of the syllable units of the plurality of predetermined input words, starting from the speech information of the first syllable of each input word.

13. 13. The speech processing device according to claim 12, wherein the processing means performs the determination of whether the speech matches the syllable-by-syllable speech information of each of the plurality of predetermined input words in a round-robin manner for the plurality of predetermined input words.

14. The audio processing device according to claim 13 , wherein the processing means starts the processing in response to the audio acquisition means acquiring audio having a length equal to or longer than a predetermined time.

15. The audio processing device according to claim 14, wherein the predetermined time is one second.

16. The audio processing device according to claim 14 , wherein the processing means starts the processing in response to the audio acquisition means acquiring audio with a predetermined sound pressure or higher.

17. 17. The speech processing device according to claim 16, wherein the speech information of the plurality of predetermined input words is stored in the storage means by the speech acquisition means acquiring speech uttered by the user for each of the plurality of predetermined input words.

18. A toy comprising the sound processing device according to any one of claims 1 to 17.

19. A computer program for causing a computer to function as a processing means of the speech processing device according to any one of claims 1 to 17.

Images