Voice synthesis adjustment device

Abstract

To adjust speech synthesis based on more appropriate prosody information, without requiring special knowledge, while shortening an adjusting work time of the speech synthesis.SOLUTION: A speech synthesis regulator 10 comprises: a domain setting unit 11 which sets domains; a text data acquisition unit 12 which acquires text data including prosody information, corresponding to input data; a determination unit (sentence structure determination unit 13) which determines whether or not the prosody information obtained from the text data is new prosody information; a correction information acquisition unit (pose correction information acquisition unit 14) which transfers the text data to a speech synthesizer 20 when it is the new prosody information, and acquires correction information of the prosody information about a synthetic speech output by the speech synthesizer 20; and a correction control unit (pose correction control unit 15) which registers the new prosody information about the corresponding domain, based on the correction information of the prosody information, and re-creates and outputs the speech corrected based on the correction information of the prosody information by the speech synthesizer 20.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a voice synthesis adjustment device that adjusts (tunes) a voice synthesis process performed by a voice synthesizer. [Background technology]

[0002] A speech synthesis device is known that performs natural language processing on an input sentence to obtain prosodic information of the input sentence and generates a synthetic speech corresponding to the input sentence based on the obtained prosodic information. For example, a technology is known that generates a synthetic speech according to predetermined prosodic information generation rules in order to make the synthetic speech closer to human speech. Note that the "prosodic information" here means information that indicates the phonetic properties of human speech, such as pauses between phrases and accents of words. Conventional speech synthesis devices aim to output a speech that is optimal for everyone, but the optimal speech varies depending on the domain in which the speech is used (meaning, in this case, "a classification determined by the usage scene and purpose"). Therefore, it is essential to adjust (tune) the prosodic information generation rules as appropriate. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 9-62286 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in conventional speech synthesis devices, there are problems in that the above-mentioned adjustment work requires a lot of time and specialized knowledge.

[0005] Furthermore, although Patent Document 1 suggests that speech synthesis is performed by setting pauses among prosodic information according to the purpose, it does not disclose details for aiming at adjustment work based on more appropriate prosodic information, such as using pauses according to the sentence structure obtained by analyzing the input sentence, and so there is room for improvement.

[0006] Therefore, an object of the present disclosure is to adjust speech synthesis based on more appropriate prosodic information while shortening the time required for adjustment work in speech synthesis without requiring specialized knowledge. [Means for solving the problem]

[0007] A voice synthesis adjustment device according to an embodiment of the present disclosure is a voice synthesis adjustment device that causes a voice synthesis device to create and output a voice corresponding to a domain defined by a usage scene and application of the voice, and includes: a domain setting unit that sets the domain based on domain information from an external source; a text data acquisition unit that acquires text data including prosodic information corresponding to input data from an external source; a determination unit that determines whether the prosodic information obtained from the text data acquired by the text data acquisition unit is new prosodic information that is not stored in a prosodic information dictionary that pre-stores prosodic information for each domain; a correction information acquisition unit that, when the determination unit determines that the prosodic information is new prosodic information, transfers the text data acquired by the text data acquisition unit to the voice synthesis device and acquires correction information for the prosodic information for the synthetic voice to be output by the voice synthesis device; and a correction control unit that registers the new prosodic information for the corresponding domain in the prosodic information dictionary based on the correction information for the prosodic information acquired by the correction information acquisition unit, and causes the voice synthesis device to recreate and output a voice corrected based on the correction information for the prosodic information.

[0008] In the above voice synthesis adjustment device, the domain setting unit sets a domain based on domain information from outside, the text data acquisition unit acquires text data including prosodic information corresponding to the input data from outside, and the judgment unit judges whether the prosodic information acquired from the acquired text data is new prosodic information not stored in the prosodic information dictionary that stores prosodic information for each domain in advance. Here, if the prosodic information acquired from the text data is judged to be new prosodic information, the correction information acquisition unit transfers the acquired text data to the voice synthesis device and acquires correction information of the prosodic information for the synthetic voice output by the voice synthesis device. Here, the "correction information of the prosodic information" is, for example, input by the user after the voice synthesis device outputs the synthetic voice to the user, and transferred to the voice synthesis adjustment device via the voice synthesis device, and is acquired by the correction information acquisition unit. Then, the correction control unit registers the new prosodic information related to the corresponding domain in the prosodic information dictionary based on the acquired correction information of the prosodic information, and causes the voice synthesis device to recreate and output a voice corrected based on the correction information of the prosodic information. This allows the user to listen to speech that has been corrected based on the prosodic information correction information. As described above, when the prosodic information obtained from the acquired text data is new prosodic information not stored in the prosodic information dictionary, the new prosodic information for the corresponding domain is registered in the prosodic information dictionary based on the correction information of the acquired prosodic information, so that the conventional process can be partially automated and simplified the next time the same prosodic information is obtained from the acquired text data. This makes it possible to adjust speech synthesis based on more appropriate prosodic information while shortening the time required for adjustment work in speech synthesis without requiring specialized knowledge. Effect of the Invention

[0009] According to the present disclosure, it is possible to adjust speech synthesis based on more appropriate prosodic information while reducing the time required for adjustment work in speech synthesis, without requiring specialized knowledge. [Brief description of the drawings]

[0010] [Figure 1] 1 is a configuration diagram of a voice synthesis adjustment device and related devices in a first embodiment. [Diagram 2] FIG. 2 illustrates examples of different domains. [Diagram 3] FIG. 1A is a diagram showing an example of a pause rule for each sentence structure for domain A, and FIG. 1B is a diagram showing an example of a pause rule for each sentence structure for domain B. [Figure 4] 3 is a flow diagram showing processing executed by the voice synthesis adjustment device and related devices in the first embodiment. FIG. [Diagram 5] FIG. 11 is a configuration diagram of a voice synthesis adjustment device and related devices in a second embodiment. [Figure 6] FIG. 1 illustrates examples of per-word accent types for various domains. [Figure 7] FIG. 11 is a flow diagram showing the processing executed by the voice synthesis adjustment device and related devices in the second embodiment. [Figure 8] FIG. 13 is a diagram for explaining a process of extracting a fundamental frequency by voice analysis. [Figure 9] FIG. 2 is a diagram illustrating an example of a hardware configuration of a voice synthesis adjustment device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Various embodiments according to the present disclosure will be described below in order with reference to the accompanying drawings. In the description of the drawings, the same elements are given the same reference numerals and duplicated description will be omitted.

[0012] [First embodiment] Hereinafter, as a first embodiment, an embodiment will be described in which a pause rule (pause insertion pattern) for the sentence structure of the input text according to a set domain (audio usage scene and purpose) is newly registered or selected, and speech synthesis is adjusted based on the pause rule.

[0013] Fig. 1 shows an example of the configuration of a voice synthesis adjustment device 10 and related devices in the first embodiment, including a voice synthesis device 20, a control device 30, and other related devices 40. Of these, the control device 30 is a device that controls the entire system consisting of the multiple devices shown in Fig. 1, and has a user interface function that receives text input and domain information from a user during normal operation and voice input and domain information during correction, and outputs synthetic voice to the user. The other related devices 40 have a function of converting user input into text data including prosodic information by performing processes such as voice recognition and natural language processing as necessary.

[0014] The speech synthesis device 20 has a function of performing speech synthesis processing based on appropriate prosodic information on the above text data (for example, in the first embodiment, processing for creating synthetic speech with pauses added in accordance with appropriate pause rules) while being adjusted by the speech synthesis adjustment device 10 described later, and has a built-in pause dictionary 21 that stores pause rules corresponding to sentence structures for various domains.

[0015] The voice synthesis adjustment device 10 has a function of adjusting (tuning) the voice synthesis process by the above-mentioned voice synthesis device 20 so that more appropriate prosodic information (for example, pause rules in the first embodiment) is used.

[0016] In order to realize the above functions, the voice synthesis adjustment device 10 includes a domain setting unit 11, a text data acquisition unit 12, a sentence structure determination unit 13, a pause correction information acquisition unit 14, a pause correction control unit 15, and a first creation control unit 16.

[0017] Among these, the domain setting unit 11 is a functional unit that sets a domain based on external domain information, the text data acquisition unit 12 is a functional unit that acquires text data including prosodic information corresponding to external input data, and the sentence structure determination unit 13 is a functional unit that analyzes the sentence structure of the text data acquired by the text data acquisition unit 12 and determines whether the sentence structure obtained by the analysis is a new sentence structure in the above-mentioned pause dictionary 21. The analysis of the sentence structure of the text data by the sentence structure determination unit 13 is performed, for example, by dividing the sentence of the text data into phrases and classifying it from the viewpoint of how many phrases it is divided into, where the break in the sentence is (for example, the position where a comma "," would be inserted if it were written in text), etc. For example, as shown in the example sentence of sentence structure id1 in FIG. 3(a) showing the pause rules for each sentence structure, the sentence structure is divided into the first to sixth phrases separated by " / " such as "It was quite cold last night, but did you sleep well?", and it is analyzed that there is a break in the sentence after the fourth phrase "It was cold, but...". Also, as shown in the example sentence of sentence structure id3, the sentence structure is divided into the first to sixth phrases separated by " / " such as "I walked 3000 steps yesterday, so I'll rest my body today!", and it is analyzed that there is a break in the sentence after the third phrase "Since I walked...". Although these sentence structures id1 and id3 have in common the point of being divided into a total of six phrases, they are considered to be different sentence structures because the locations of the breaks in the sentence are different. Note that the above sentence structure analysis method is just an example, and an analysis method other than the above may be used.

[0018] The pause correction information acquisition unit 14 is a functional unit that, when the sentence structure determination unit 13 determines that the sentence structure is new, transfers the analyzed text data to the speech synthesis device 20, and then acquires text data including pause correction information for the synthesized speech corresponding to the corrected speech from the user via the speech synthesis device 20. The pause correction control unit 15 is a functional unit that registers pause rules for the relevant sentence structure for the relevant domain in the pause dictionary 21 based on the pause correction information acquired by the pause correction information acquisition unit 14, and causes the speech synthesis device 20 to recreate and output speech with pauses corrected based on the pause correction information.

[0019] The first creation control unit 16 is a functional unit that, when the sentence structure determination unit 13 determines that the sentence structure is not a new one, transfers the pause rules and text data of the relevant sentence structure for the relevant domain to the speech synthesis device 20, and causes the speech synthesis device 20 to create and output speech with pauses added in accordance with the pause rules.

[0020] A series of processes executed by the voice synthesis control device 10 having the above-mentioned functional units and related devices will be described later.

[0021] FIG. 2 shows examples of various domains determined by combinations of voice usage scenarios and applications. As shown in FIG. 2, examples of usage scenarios include "nursing care," "childcare," and "reading the news," and the same usage scenario can have multiple applications, with each combination of usage scenarios and applications being treated as one domain. For example, for the usage scenario "nursing care," examples of applications include "healthy people in their 70s" and "people with slow cognitive judgment." The usage scenario "nursing care" and application "healthy people in their 70s" are treated as one domain (Domain A in FIG. 3(a)), and the usage scenario "nursing care" and application "people with slow cognitive judgment" are treated as one domain (Domain B in FIG. 3(b)).

[0022] 3(a) and (b) show various pause rules stored in the pause dictionary 21. As shown in FIG. 3(a), the pause dictionary 21 stores pause rules for each sentence structure for the domain A of the usage scene "care" and the purpose "healthy people in their 70s" in association with the sentence structure ID, and similarly, as shown in FIG. 3(b), the pause dictionary 21 stores pause rules for each sentence structure for the domain B of the usage scene "care" and the purpose "for people with slow cognitive judgment" in association with the sentence structure ID. As is clear from a comparison of FIG. 3(a) and (b) for the same sentence structure, the pause rule in FIG. 3(b) is a rule that generally provides a longer pause than the pause rule in FIG. 3(a), taking into account the difference between the purposes "for people with slow cognitive judgment" and "for healthy people in their 70s". For example, if we focus on the pauses in a sentence (for example, the positions where a comma "," would be placed if the sentence were written in text), i.e., the fourth segment of sentence structure id1, the fourth segment of sentence structure id2, and the third segment of sentence structure id3, the pause rules for domain A define all of the above locations as "medium pauses," whereas the pause rules for domain B define all of the above locations as "long pauses."

[0023] A series of processes executed by the voice synthesis adjustment device 10 and related devices will be described below with reference to the flow chart of FIG.

[0024] First, the voice synthesis adjustment device 10 receives domain information input by the user via the control device 30, and sets the domain indicated in the domain information by the domain setting unit 11 (step S1). Specifically, the domain setting unit 11 selects a domain if the domain indicated in the domain information is an existing domain in the pause dictionary 21, and registers the domain if the domain indicated in the domain information is a new domain not registered in the pause dictionary 21.

[0025] In addition, the input from the user is subjected to processing such as voice recognition and natural language processing by other related devices 40 and converted into text data including prosodic information, and the converted text data is output to the voice synthesis adjustment device 10 via the control device 30 and the voice synthesis device 20 (step S2).

[0026] The voice synthesis adjustment device 10 acquires the text data output in step S2 by the text data acquisition unit 12 (step S3), analyzes the sentence structure of the acquired text data by the sentence structure determination unit 13 (step S4), and determines whether the sentence structure obtained by the analysis is a new sentence structure in the pause dictionary 21 (step S5).

[0027] Here, if it is determined that the sentence structure obtained by the analysis is a new sentence structure (YES in step S5), the speech synthesis adjustment device 10 transfers the analyzed text data (including prosodic information) as is to the speech synthesis device 20 by the pause correction information acquisition unit 14, and waits for pause correction information to arrive via the speech synthesis device 20 (step S6). After that, the speech synthesis device 20 creates a voice in which pauses are inserted according to the prosodic information (here, the pause rule) included in the transferred text data, and outputs the created synthetic voice to the user via the control device 30 (step S7). When the user who listened to the output synthetic voice inputs the corrected voice to the control device 30, the other related device 40 performs processing such as speech recognition and natural language processing on the corrected voice, and converts it into text data including the corrected prosodic information (here, the corrected pause rule), and the converted text data (including the corrected pause rule) is output to the speech synthesis adjustment device 10 via the control device 30 and the speech synthesis device 20 (step S8).

[0028] The voice synthesis adjustment device 10 acquires the converted text data (including the corrected pause rule) by the pause correction information acquisition unit 14, and registers the pause rule (corrected pause rule) of the corresponding sentence structure related to the corresponding domain obtained from the converted text data in the pause dictionary 21 by the pause correction control unit 15, and instructs the voice synthesis device 20 to correct the pause based on the corrected pause rule, recreate the synthetic voice with the corrected pause added, and output it (step S9). The voice synthesis device 20 that has received the instruction in step S9 corrects the pause based on the corrected pause rule, recreates the synthetic voice with the corrected pause added, and outputs it to the user via the control device 30 (step S10). This allows the user to listen to the voice corrected based on the corrected pause rule.

[0029] If the speech synthesis device 20 does not receive the converted text data (including the corrected pause rule) from the control device 30 within a predetermined time after outputting the synthetic speech to the user via the control device 30 in step S7, it considers that there is no pause correction for the speech output in step S7 and notifies the speech synthesis adjustment device 10 of that effect (the dashed line portion from S7 to S9 in FIG. 4). In this case, in step S9, the speech synthesis adjustment device 10 registers the pause rule included in the text data acquired in step S3 for the new sentence structure obtained by analysis by the pause correction control unit 15 in the pause dictionary 21 as the pause rule for the corresponding sentence structure for the corresponding domain. In this case, the speech re-creation and output process in step S10 is not necessary.

[0030] On the other hand, if it is determined in step S5 that the sentence structure obtained by the analysis is not a new sentence structure (NO in step S5), the voice synthesis adjustment device 10 transfers the pause rules of the sentence structure related to the domain and the analyzed text data to the voice synthesis device 20 by the first creation control unit 16, and instructs the voice synthesis device 20 to recreate and output a synthetic voice with pauses added according to the pause rules (step S11). The voice synthesis device 20 that has received the instruction in step S11 recreates a synthetic voice with pauses added according to the pause rules, and outputs it to the user via the control device 30 (step S12). This allows the user to listen to a voice with appropriate pauses added based on the pause rules registered in the pause dictionary 21.

[0031] According to the first embodiment described above, when the sentence structure obtained from the acquired text data is new, that is, when the pause information of the sentence structure for the set domain is new information in the pause dictionary 21, the pause information for the corresponding domain corrected based on the pause correction information obtained from the corrected voice is registered in the pause dictionary 21, so that the conventional process can be partially automated and simplified when the same sentence structure is input from the acquired text data from the next time onwards. This makes it possible to shorten the time required for adjustment work in voice synthesis without requiring specialized knowledge, and adjust the voice synthesis based on more appropriate pause information. In addition, the user can listen to the voice in which the pauses have been appropriately corrected based on the corrected voice.

[0032] Furthermore, if the sentence structure obtained from the acquired text data is not new, the first creation control unit 16 transfers the pause rules and text data of the sentence structure for the domain to the speech synthesizer 20, and the speech synthesizer 20 creates and outputs speech with pauses added according to the pause rules. Therefore, the user can listen to speech with appropriate pauses added based on the pause rules registered in the pause dictionary 21.

[0033] [Second embodiment] Next, as a second embodiment, we will explain an embodiment in which a rule regarding the accent of words in the input text (hereinafter referred to as "accent type") according to a set domain (speech usage scene and purpose) is newly registered or selected, and speech synthesis is adjusted based on the accent type.

[0034] 5 shows an example of the configuration of the voice synthesis control device 10 and related devices in the second embodiment, including a voice synthesis device 20, a control device 30, and other related devices 40. Of these, the control device 30 and other related devices 40 have the same functions as those in the first embodiment, so a duplicated description will be omitted.

[0035] The speech synthesis device 20 has the function of performing speech synthesis processing based on appropriate prosodic information for the speech text (for example, in the second embodiment, processing for creating synthetic speech with word accents according to appropriate accent types) while being adjusted by the speech synthesis adjustment device 10 described later, and has a built-in accent dictionary 22 that stores accent types for each word for various domains.

[0036] The voice synthesis adjustment device 10 has a function of performing adjustment (tuning) in the voice synthesis process by the above-mentioned voice synthesis device 20 so that more appropriate prosodic information (for example, accent type in the second embodiment) is used.

[0037] In order to realize the above functions, the voice synthesis adjustment device 10 includes a domain setting unit 11, a text data acquisition unit 12, a word determination unit 13S, an accent correction information acquisition unit 14S, an accent correction control unit 15S, and a second creation control unit 16S. Of these, the domain setting unit 11 and the text data acquisition unit 12 have the same functions as in the first embodiment, so a duplicated description will be omitted.

[0038] The word determination unit 13S is a functional unit that determines whether the text data acquired by the text data acquisition unit 12 includes a new word in the accent dictionary 22 or not.

[0039] The accent correction information acquisition unit 14S is a functional unit that, when the word determination unit 13S determines that the text data contains a new word, transfers the text data acquired by the text data acquisition unit 12 as is to the speech synthesis device 20, and then acquires text data including accent correction information for the synthetic speech corresponding to the corrected speech from the user (in this case, speech including the speech of the corrected word whose accent type is to be corrected) via the speech synthesis device 20.The accent correction control unit 15S is a functional unit that registers the accent type of the relevant word for the relevant domain in the accent dictionary 22 based on the accent correction information acquired by the accent correction information acquisition unit 14S, and causes the speech synthesis device 20 to recreate and output speech in which the accent of the word has been corrected based on the accent correction information.

[0040] The second creation control unit 16S is a functional unit that, when the word determination unit 13S determines that the text data does not contain a new word, transfers the accent type and text data of the word related to the domain to the voice synthesis device 20, and causes the voice synthesis device 20 to create and output a voice with an accent according to the accent type of the word.

[0041] Fig. 6 illustrates examples of accent types for each word in various domains in the second embodiment, which are stored in the accent dictionary 22. As explained with reference to Fig. 2, a domain corresponds to a combination of a "usage scene" and an "application," but in Fig. 6, for ease of understanding, the domains are illustrated in simple terms such as "for standard language," "for business situations," and "for the elderly."

[0042] As can be seen from Figure 6, for example, in the word "horensa" (spinach), the position of "re" is the accent nucleus (i.e., the position where the accent is placed) in domain A (standard Japanese), whereas there is no accent nucleus in domain B (Kansai dialect). Also, in the word "maji?" (serious?), the position of "ma" is the accent nucleus in domain A (standard Japanese), whereas the position of "ji" is the accent nucleus in domain B (Kansai dialect). In this way, even for the same word, different accent types are set in which the accent nucleus is in a different position depending on the domain.

[0043] A series of processes executed by the voice synthesis control device 10 and related devices will be described below with reference to the flow chart of FIG.

[0044] In steps S1 to S3, similarly to the first embodiment, the domain indicated in the domain information from the user is set, the input data from the user is converted into text and output, and the converted voice text data is obtained.

[0045] Thereafter, the voice synthesis adjustment device 10 causes the word determination unit 13S to determine whether or not the text data acquired by the text data acquisition unit 12 includes a new word in the accent dictionary 22 (step S21).

[0046] Here, if it is determined that the text data includes a new word in the accent dictionary 22 (YES in step S21), the speech synthesis adjustment device 10 transfers the text data (including prosodic information) to the speech synthesis device 20 as is by the accent correction information acquisition unit 14S, and waits for the corrected speech (speech including the speech of the accent correction word) that arrives via the speech synthesis device 20 (step S22). After that, the speech synthesis device 20 creates a speech to which a word accent is added according to the prosodic information (here, the accent type) included in the transferred text data, and outputs the created synthetic speech to the user via the control device 30 (step S23). When the user who listens to the output synthetic speech inputs the corrected speech to the control device 30 and transfers it to the speech synthesis adjustment device 10 via the speech synthesis device 20, the speech synthesis adjustment device 10 extracts the fundamental frequency (pitch) from the corrected speech by speech analysis by the accent correction information acquisition unit 14S (step S24). That is, as shown in Figure 8, the change in frequency along the time axis in the corrected speech is detected, and how the fundamental frequency (pitch) has changed is identified. Then, the position where the fundamental frequency (pitch) is high is detected as the accent nucleus of the word.

[0047] Then, the speech synthesis adjustment device 10 estimates a corrected word accent type according to the position of the accent kernel of the word from the processing result of step S24 by the accent correction control unit 15S, registers the estimated result in the accent dictionary 22 as the accent type of the relevant word related to the relevant domain, and instructs the speech synthesis device 20 to correct the accent of the word based on the accent correction information (here, information on the corrected word accent type obtained by the estimation) and recreate and output the synthetic speech with the corrected accent (step S25). The speech synthesis device 20 that has received the instruction in step S25 corrects the accent of the word based on the accent correction information, recreates the synthetic speech with the corrected accent, and outputs it to the user via the control device 30 (step S26). This allows the user to listen to the speech corrected based on the accent correction information.

[0048] If the voice synthesis adjustment device 10 does not receive a corrected voice from the user within a predetermined time after transferring the text data to the voice synthesis device 20 in step S22, it assumes that there has been no correction to the accent, avoids execution of steps S24 and S25, and ends the process. That is, only if there has been a correction to the accent is registered in the accent dictionary 22 in step S25.

[0049] On the other hand, if it is determined in step S21 that the text data does not include a new word in the accent dictionary 22 (NO in step S21), the voice synthesis adjustment device 10 transfers the accent type and text data of the relevant word related to the relevant domain to the voice synthesis device 20 by the second creation control unit 16S, and instructs the voice synthesis device 20 to recreate and output a synthetic voice with an accent according to the accent type (step S27). The voice synthesis device 20 that has received the instruction in step S27 recreates a synthetic voice with an accent according to the accent type, and outputs it to the user via the control device 30 (step S28). This allows the user to listen to a voice with an appropriate accent based on the accent type registered in the accent dictionary 22.

[0050] According to the second embodiment described above, when a word obtained from the acquired text data is new, that is, when the accent type of the word for the set domain is new information in the accent dictionary 22, the accent type of the word for the corresponding domain is registered in the accent dictionary 22 based on the accent correction information of the word obtained from the corrected voice, so that the conventional process can be partially automated and simplified when the accent type of the same word is obtained from the acquired text data from the next time onwards. This makes it possible to adjust the voice synthesis based on more appropriate accent correction information while shortening the time required for the adjustment work in the voice synthesis without requiring specialized knowledge. In addition, the user can listen to the voice in which the accent of the word has been appropriately corrected based on the corrected voice.

[0051] Furthermore, if the word obtained from the acquired text data is not new, the second creation control unit 16S transfers the accent type and text data of the word related to the domain to the voice synthesizer 20, and the voice synthesizer 20 creates and outputs a voice with an accent according to the accent type. Therefore, the user can listen to a voice with an accent based on the accent type of an appropriate word registered in the accent dictionary 22.

[0052] The voice synthesis adjustment device 10 may have both the pause correction function described in the first embodiment and the accent correction function described in the second embodiment.

[0053] Furthermore, as a modified example of the processing of FIG. 4 in the first embodiment, in a first stage (learning stage), a learned pause dictionary may be created by repeatedly registering pause rules for various sentence structures for various domains in a pause dictionary, and then in a second stage (rule application stage), individual cases are applied to the learned pause dictionary to adjust the speech synthesis regarding the pauses of the individual cases, that is, an embodiment in which the processing is performed in two stages roughly divided in terms of time may be adopted.

[0054] Similarly, as a modified example of the processing of FIG. 7 in the second embodiment, in a first stage (learning stage), a learned accent dictionary may be created by repeatedly registering accent types of various words for various domains in an accent dictionary, and then in a second stage (rule application stage), individual cases are applied to the learned accent dictionary to adjust the speech synthesis for the accent of each individual case, i.e., an embodiment in which processing is performed in two stages roughly divided in terms of time may be adopted.

[0055] [Terminology, transformations, etc.] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of at least one of hardware and software. The method of realizing each functional block is not particularly limited. That is, each functional block may be realized by using one device that is physically or logically combined, or may be realized by using two or more devices that are physically or logically separated and directly or indirectly connected (for example, by wire, wireless, etc.). The functional block may be realized by combining the one device or the multiple devices with software.

[0056] Functions include, but are not limited to, judgment, determination, judgement, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment. For example, a functional block (component) that performs the function of transmission is called a transmitting unit or a transmitter. As described above, there is no particular limitation on the method of realization of either of these.

[0057] For example, the voice synthesis adjustment device 10 in the first and second embodiments of the present disclosure may function as a computer that performs the processing of the present disclosure. As shown in Fig. 9, the above-mentioned voice synthesis adjustment device 10 may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, and a bus 1007. This point is similar to devices other than the voice synthesis adjustment device 10, but here it will be described as an example of the configuration of the voice synthesis adjustment device 10.

[0058] In the following description, the term "apparatus" may be replaced with a circuit, a device, a unit, etc. The hardware configuration of the voice synthesis adjustment device 10 may be configured to include one or more of the devices shown in the figure, or may be configured to exclude some of the devices.

[0059] Each function in the voice synthesis adjustment device 10 is realized by loading a specified software (program) onto hardware such as the processor 1001 and the memory 1002, causing the processor 1001 to perform calculations, control communications via the communication device 1004, and control at least one of the reading and writing of data in the memory 1002 and the storage 1003.

[0060] The processor 1001, for example, operates an operating system to control the entire computer. The processor 1001 may be configured with a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, and a register. For example, each function of the above-mentioned voice synthesis adjustment device 10 may be realized by the processor 1001.

[0061] The processor 1001 reads out a program (program code), a software module, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002, and executes various processes according to the read out programs. As the program, a program that causes a computer to execute at least a part of the operations described in the above-mentioned embodiment is used. For example, each function of the voice synthesis adjustment device 10 may be realized by a control program stored in the memory 1002 and operated in the processor 1001. Although the above-mentioned various processes have been described as being executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The program may be transmitted from a network via a telecommunication line.

[0062] The memory 1002 is a computer-readable recording medium, and may be configured by at least one of, for example, a Read Only Memory (ROM), an Erasable Programmable ROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), and a Random Access Memory (RAM). The memory 1002 may be called a register, a cache, a main memory (primary storage device), or the like. The memory 1002 can store a program (program code), a software module, or the like that is executable to implement an information providing method according to an embodiment of the present disclosure.

[0063] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, and a magnetic strip. Storage 1003 may be called an auxiliary storage device. The above-mentioned storage medium may be, for example, a database, a server, or other suitable medium including at least one of memory 1002 and storage 1003.

[0064] The communication device 1004 is hardware (transmission / reception device) for performing communication between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, or a communication module. The communication device 1004 may be configured to include a high-frequency switch, a duplexer, a filter, a frequency synthesizer, etc., in order to realize, for example, at least one of Frequency Division Duplex (FDD) and Time Division Duplex (TDD).

[0065] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that accepts input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that performs output to the outside. The input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).

[0066] Each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.

[0067] The voice synthesis adjustment device 10 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), etc., and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented using at least one of these pieces of hardware.

[0068] Notification of information is not limited to the aspects / embodiments described in this disclosure and may be performed using other methods.

[0069] The order of the processing steps, sequences, flow charts, etc. of each aspect / embodiment described in this disclosure may be changed unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0070] Information, etc. may be output from a higher layer to a lower layer, or from a lower layer to a higher layer. Information, etc. may be input / output via multiple network nodes.

[0071] The input and output information, etc. may be stored in a specific location (e.g., memory) or may be managed using a management table. The input and output information, etc. may be overwritten, updated, or added. The output information, etc. may be deleted. The input information, etc. may be transmitted to another device.

[0072] The determination may be based on a value represented by a single bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0073] Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched according to execution. Notification of predetermined information (e.g., notification of "X") is not limited to explicit notification, and may be performed implicitly (e.g., by not notifying the predetermined information).

[0074] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure can be implemented as modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is for illustrative purposes only and does not have any limiting meaning on the present disclosure.

[0075] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0076] Software, instructions, information, and the like may be transmitted and received over a transmission medium. For example, if the software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave, etc.), then these wired and / or wireless technologies are included within the definition of transmission media.

[0077] The information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0078] In addition, terms explained in this disclosure and terms necessary for understanding this disclosure may be replaced with terms having the same or similar meanings.

[0079] As used in this disclosure, the terms "system" and "network" are used interchangeably.

[0080] The information, parameters, etc. described in this disclosure may be expressed using absolute values, may be expressed using relative values ​​from a predetermined value, or may be expressed using corresponding other information.

[0081] The names used for the above parameters are not limiting in any way, and the formulas etc. using these parameters may differ from the formulas etc. explicitly disclosed in this disclosure.

[0082] The terms "determining" and "determining" as used in this disclosure may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, inquiry (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in a memory), and the like. "Judgment" and "decision" may include the deeming of resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" may include the deeming of some action as having been "judged" or "decided." "Judgment" may be read as "assuming," "expecting," or "considering," etc.

[0083] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0084] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0085] Any reference to an element using designations such as "first" and "second" used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient way to distinguish between two or more elements. Thus, a reference to a first and a second element does not mean that only two elements may be employed, nor that the first element must precede the second element in any way.

[0086] The "parts" in the configuration of each of the above devices may be replaced with "circuits" or "devices", etc.

[0087] When "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Further, when used in this disclosure, the term "or" is not intended to be an exclusive or.

[0088] In this disclosure, where articles are added by translation, such as "a," "an," and "the" in English, the disclosure may include that the nouns following these articles are in the plural form.

[0089] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." In addition, the term may mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different." [Explanation of symbols]

[0090] 10...speech synthesis adjustment device, 11...domain setting unit, 12...text data acquisition unit, 13...sentence structure determination unit, 13S...word determination unit, 14...pause correction information acquisition unit, 14S...accent correction information acquisition unit, 15...pause correction control unit, 15S...accent correction control unit, 16...first creation control unit, 16S...second creation control unit, 20...speech synthesis device, 21...pause dictionary, 22...accent dictionary, 30...control device, 40...other related devices, 1001...processor, 1002...memory, 1003...storage, 1004...communication device, 1005...input device, 1006...output device, 1007...bus.

Claims

1. A voice synthesis adjustment device that creates and outputs a voice according to a domain determined by a usage scene and a use of the voice, using a voice synthesis device, a domain setting unit that sets the domain based on domain information from an external source; a text data acquisition unit for acquiring text data including prosodic information corresponding to input data from an external source; a determination unit that determines whether or not the prosodic information obtained from the text data acquired by the text data acquisition unit is new prosodic information that is not stored in a prosodic information dictionary that stores prosodic information for each domain in advance; a correction information acquisition unit that transfers the text data acquired by the text data acquisition unit to the speech synthesizer when the prosodic information is determined to be new by the determination unit, and acquires correction information for the prosodic information for the synthetic speech output by the speech synthesizer; a modification control unit that registers the new prosodic information for a corresponding domain in the prosodic information dictionary based on the modification information for the prosodic information acquired by the modification information acquisition unit, and causes the speech synthesis device to regenerate and output a speech modified based on the modification information for the prosodic information; Equipped with the determination unit includes a sentence structure determination unit that analyzes a sentence structure of the text data acquired by the text data acquisition unit, and determines whether or not the sentence structure obtained by the analysis is a new sentence structure in a pause dictionary that stores pause rules corresponding to the sentence structure in advance for each domain; the correction information acquisition unit includes a pause correction information acquisition unit that, when the sentence structure determination unit determines that the sentence structure is a new sentence structure, transfers the text data analyzed by the sentence structure determination unit to the speech synthesizer and acquires pause correction information for the synthetic speech output by the speech synthesizer; the correction control unit includes a pause correction control unit that registers a pause rule of a corresponding sentence structure related to a corresponding domain in the pause dictionary based on the pause correction information acquired by the pause correction information acquisition unit, and causes the speech synthesis device to recreate and output a speech in which a pause is corrected based on the pause correction information; Speech synthesis adjustment device.

2. a creation control unit that transfers the prosodic information related to the corresponding domain and the text data to the speech synthesizer when the determination unit determines that the prosodic information is not new, and causes the speech synthesizer to create and output a speech to which prosody corresponding to the prosodic information has been added; The voice synthesis adjustment device of claim 1 further comprising:

3. a first creation control unit that, when it is determined by the sentence structure determination unit that the sentence structure is not a new sentence structure, transfers a pause rule of the sentence structure for the corresponding domain and the text data to the speech synthesizer, and causes the speech synthesizer to create and output a speech to which pauses are added in accordance with the pause rule; The voice synthesis adjustment device of claim 1 further comprising:

4. the determination unit includes a word determination unit that determines whether the text data acquired by the text data acquisition unit includes a new word in an accent dictionary that stores in advance accent types of words for each of the domains; the correction information acquisition unit includes an accent correction information acquisition unit that, when it is determined by the word determination unit that the text data includes a new word, transfers the text data acquired by the text data acquisition unit to the speech synthesis device and acquires accent correction information for the synthetic speech output by the speech synthesis device; The correction control unit includes an accent correction control unit that registers the accent type of the corresponding word related to the corresponding domain in the accent dictionary based on the accent correction information acquired by the accent correction information acquisition unit, and causes the speech synthesis device to recreate and output a speech in which the accent of the word is corrected based on the accent correction information.

2. The voice synthesis adjustment device according to claim 1.

5. a second creation control unit that transfers the accent type of the word in question and the text data for the domain to the speech synthesizer when the word determination unit determines that the word does not contain a new word, and causes the speech synthesizer to create and output a voice with an accent according to the accent type of the word; The voice synthesis adjustment device of claim 4 further comprising:

Images