Method, server, speech device, and program for controlling speech device
The method for controlling speech devices in home appliances adjusts sound source characteristics to match the appliance's status and user context, improving user comfort and convenience by ensuring clear and appropriate speech output.
Patent Information
- Application Number
- JP2023060786
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-04-09
- Filing Date
- 2023-04-04
- Publication Date
- 2024-11-11
- Estimated Expiration
- 2041-08-20
AI Technical Summary
Existing home appliances with speech functionality use the same sound source regardless of the appliance's status or user situation, leading to discomfort and reduced convenience.
A method and system for controlling speech devices that set sound source characteristics based on the type, identifier, speech performance, operating status, installation location, distance from the user, and user information to provide a suitable sound source for each appliance.
Enhances user comfort and convenience by ensuring the speech from appliances is easily heard and tailored to the specific context and user needs.
Smart Images

Figure 0007580074000001 
Figure 0007580074000002 
Figure 0007580074000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a speech device, and more particularly to a method for controlling a speech device, a server, a speech device, and a program. [Background technology]
[0002] Home appliances are an abbreviation for household electrical appliances, such as televisions, refrigerators, air conditioners, washing machines, vacuum robots, audio equipment, lighting, water heaters, and intercoms used at home. Conventionally, beeps and buzzers are used to inform users of the operating status of home appliances. For example, when a washing machine finishes washing, when an air conditioner is started, or when a refrigerator door is not completely closed for a certain period of time, these home appliances emit beeps to attract the user's attention.
[0003] Currently, home appliances have been developed as speaking devices that can speak using voices including human languages in order to convey more information to users of the home appliances instead of beeps, etc. Such home appliances are called talking appliances, and instead of beeps, they can notify users of information about the home appliances by speaking, for example, "The laundry is done" or "The refrigerator door is not closed." [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 6640266 specification Summary of the Invention [Problem to be solved by the invention]
[0005] Patent Document 1 discloses a message notification control system that causes a home appliance (controlled electronic device) having a speech function to speak. Specifically, a user registers conditions under which the home appliance is to be made to speak via a user intention registration application on a terminal device. The message notification control system detects the state of the home appliance, and when the detected state satisfies the registered condition (for example, the refrigerator is open), causes the home appliance to speak a message.
[0006] However, the message notification control system of the cited document 1 uses the same sound source to make different home appliances speak if the same conditions are met, regardless of the state of the home appliance or the state of the user. It can be said that there is room for improvement in providing a sound source suitable for the home appliance to speak.
[0007] An object of the present invention is to provide a technology that can provide a sound source suitable for a speech device so that speech can be easily heard. [Means for solving the problem]
[0008] In order to solve the above-mentioned problems, the present invention provides a method for controlling a speech device, a server, a speech device, and a program.
[0009] A method for controlling a speech device according to one aspect of the present invention includes the steps of receiving speech source information from an information source device, setting the speech device based on the speech source information, providing the speech device with a speech sound source having sound source characteristics corresponding to the speech device, and causing the speech device to speak using the speech sound source.
[0010] According to another aspect of the present invention, a server for controlling a speech device includes a server storage unit and a server control unit. The server storage unit stores a sound source that can be provided to the speech device. The server control unit is configured to receive speech source information from an information source device, set the speech device based on the speech source information, provide the speech device with a speech sound source having sound source characteristics according to the speech device, and cause the speech device to speak using the speech sound source.
[0011] A speech device according to another aspect of the present invention is a speech device capable of speech, and includes a device storage unit and a device control unit. The device storage unit stores at least one of the type, identifier, speech performance, operating state, installation location, and distance from the user, user information of the user of the speech device, and speaker arrangement of the speech device. The device control unit is configured to set sound source characteristics suitable for the speech device based on at least one of the type, identifier, speech performance, operating state, installation location, and distance from the user, user information of the user of the speech device, and speaker arrangement of the speech device, to inquire of a server using the set sound source characteristics, to obtain a speech sound source having the sound source characteristics from the server, and to speak using the speech sound source.
[0012] A program according to another aspect of the present invention is a program used in a terminal or a speech device that communicates with a server that controls the speech device. Effect of the Invention
[0013] According to the present invention, the method for controlling a speech device, the server, and the speech device can reduce the discomfort felt by the user due to speech from the speech device, and can improve the convenience of the speech device. [Brief description of the drawings]
[0014] [Figure 1] FIG. 1 is a block diagram showing a schematic configuration of a speech device and a server that controls the speech device according to a first embodiment. [Diagram 2] 1 is a flowchart of an example of a method for controlling a speech device according to the first embodiment. [Diagram 3] FIG. 1 is a sequence diagram of an example of a method for controlling a speech device according to the first embodiment; [Figure 4] 11 is a flowchart illustrating an example of step S130 according to the second embodiment. [Diagram 5] FIG. 11 is a sequence diagram of an example of a method for controlling a speech device according to the second embodiment; [Figure 6]FIG. 13 is a block diagram showing a schematic configuration of a speech device and a server that controls the speech device according to a third embodiment. [Figure 7] FIG. 13 is a sequence diagram of an example of a method for controlling a speech device according to the third embodiment. [Figure 8] 13 is a flowchart illustrating an example of step S130 in the fourth embodiment. [Figure 9] FIG. 13 is a sequence diagram of an example of a method for controlling a speech device according to the fourth embodiment. [Figure 10] 11 is a flowchart of an example of a method for controlling a speech device according to the fourth embodiment. [Figure 11] 13 is a flowchart illustrating an example of step S130 according to the fifth embodiment. [Figure 12] FIG. 13 is a sequence diagram of an example of a method for controlling a speech device according to the fifth embodiment. [Figure 13] FIG. 23 is a sequence diagram of an example of a method for controlling a speech device according to the sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] Firstly, various aspects of the method for controlling a speech device, the server and the speech device are described.
[0016] A method for controlling a speech device of a first aspect of the present invention includes the steps of receiving speech source information from an information source device, setting the speech device based on the speech source information, providing the speech device with a speech sound source having sound source characteristics corresponding to the speech device, and causing the speech device to speak using the speech sound source.
[0017] In a method for controlling a speech device of the second aspect of the present invention, in a first aspect, the sound source characteristics can be set based on at least one of the type, identifier, speech performance, operating status, installation location, and distance from the user of the speech device, user information of the user of the speech device, and the placement of the speakers of the speech device.
[0018] In the method for controlling a speech device of the third aspect of the present invention, in the first or second aspect, the sound source characteristics may include at least one of the format of the audio data, timbre characteristics, sound quality characteristics, volume, and speech content.
[0019] In the method for controlling a speech device according to a fourth aspect of the present invention, in any one of the first to third aspects, the sound source characteristics may include a sampling frequency, and the sampling frequency may be set according to the speech performance of the speech device.
[0020] A fifth aspect of the present invention relates to a method for controlling a speech device, and in any one of the first to fourth aspects, the sound source characteristics may include a sampling frequency. The sampling frequency may be set according to a frequency component that is blocked and attenuated by the speech device due to the placement of a speaker of the speech device.
[0021] In the method for controlling a speech device according to a sixth aspect of the present invention, in any one of the first to fifth aspects, the sound source characteristics may include a volume. The volume may be set according to a distance between the speech device and the user. Alternatively, when it is determined that the speech device is in an operating state, the volume may be set to be larger than when it is determined that the speech device is not in an operating state.
[0022] In the method for controlling a speech device according to a seventh aspect of the present invention, in any one of the first to sixth aspects, the sound source characteristics may include at least one of a volume, a speaking rate, and a frequency component. When it is determined that the age of the user to whom the speech device is to speak is equal to or greater than a predetermined age, the volume may be set to be louder, the speaking rate may be set to be slower, and / or the speech rate may be set to include more high frequency components, compared to when it is determined that the age is less than the predetermined age.
[0023] A method for controlling a speech device according to an eighth aspect of the present invention, in any one of the first to seventh aspects, may include the step of providing a speech sound source to the speech device, including the steps of setting sound source characteristics according to the speech device, selecting a sound source having the set sound source characteristics from a plurality of sound sources as the speech sound source, and transmitting an access destination corresponding to the speech sound source to the speech device so as to cause the speech device to download the speech sound source.
[0024] A method for controlling a speech device of a ninth aspect according to the present invention, in any one of the first to seventh aspects, may include the step of providing a speech sound source to the speech device, comprising the steps of receiving a query using set sound source characteristics from the speech device, selecting a sound source having the sound source characteristics in the query from a plurality of sound sources as the speech sound source, and transmitting an access destination corresponding to the speech sound source to the speech device so as to cause the speech device to download the speech sound source.
[0025] A method for controlling a speech device according to a tenth aspect of the present invention, in any one of the first to seventh aspects, may include the steps of selecting a plurality of candidate sound sources from a plurality of sound sources according to sound source characteristics, transmitting access destinations corresponding to the plurality of candidate sound sources to the speech device, and providing the speech source to the speech device via the access destination corresponding to the speech source selected from the plurality of candidate sound sources.
[0026] A server for controlling a speech device according to an eleventh aspect of the present invention includes a server storage unit and a server control unit. The server storage unit stores a sound source that can be provided to the speech device. The server control unit is configured to receive speech source information from an information source device, set the speech device based on the speech source information, provide the speech device with a speech sound source having sound source characteristics according to the speech device, and cause the speech device to speak using the speech sound source.
[0027] In the server controlling the speech device of the twelfth aspect of the present invention, in the eleventh aspect, the sound source characteristics can be set based on at least one of the type, identifier, speech performance, operating status, installation location, and distance from the user of the speech device, user information of the user of the speech device, and the placement of the speakers of the speech device.
[0028] In the server controlling the speech device of the thirteenth aspect of the present invention, in the eleventh or twelfth aspect, the sound source characteristics may include at least one of the format of the audio data, the tone characteristics, the sound quality characteristics, the volume, and the speech content.
[0029] In the server for controlling a speech device according to a fourteenth aspect of the present invention, in any one of the eleventh to thirteenth aspects, the sound source characteristics may include a sampling frequency. The sampling frequency may be set according to the speech performance of the speech device.
[0030] In the server for controlling the speech device according to a fifteenth aspect of the present invention, in any one of the eleventh to fourteenth aspects, the sound source characteristics may include a sampling frequency. The sampling frequency may be set according to a frequency component that is blocked by the speech device and attenuated due to the placement of a speaker of the speech device.
[0031] In the server for controlling a speech device according to a sixteenth aspect of the present invention, in any one of the eleventh to fifteenth aspects, the sound source characteristics may include a volume. The volume may be set according to the distance between the speech device and the user. Alternatively, when it is determined that the speech device is in an operating state, the volume may be set to be larger than when it is determined that the speech device is not in an operating state.
[0032] In the server for controlling the speech device according to the seventeenth aspect of the present invention, in any one of the eleventh to sixteenth aspects, the sound source characteristics may include at least one of a volume, a speaking speed, and a frequency component. When it is determined that the age of the user to whom the speech device is to speak is equal to or greater than a predetermined age, the volume may be set to be louder, the speaking speed may be set to be slower, and / or the speech may be set to include more high frequency components, compared to when it is determined that the age is less than the predetermined age.
[0033] A server controlling a speech device of an 18th aspect of the present invention, in any one of the 11th to 17th aspects, may be further configured so that, when providing a speech sound source to the speech device, the server control unit sets sound source characteristics according to the speech device, selects a sound source having the set sound source characteristics from a plurality of sound sources as the speech sound source, and transmits an access destination corresponding to the speech sound source to the speech device so as to cause the speech device to download the speech sound source.
[0034] A server controlling a speech device of a 19th aspect of the present invention, in any one of the 11th to 17th aspects, may be further configured so that, when providing a speech sound source to the speech device, the server control unit receives a query using set sound source characteristics from the speech device, selects a sound source having the sound source characteristics in the query as the speech sound source from the multiple sound sources, and transmits an access destination corresponding to the speech sound source to the speech device so as to cause the speech device to download the speech sound source.
[0035] A server controlling a speech device of a twentieth aspect according to the present invention, in any one of the eleventh to seventeenth aspects, may be further configured such that, when providing a speech sound source to the speech device, the server control unit selects a plurality of candidate sound sources from the plurality of sound sources according to sound source characteristics, transmits access destinations corresponding to the plurality of candidate sound sources to the speech device, and provides the speech sound source to the speech device via the access destination corresponding to the speech sound source selected from the plurality of candidate sound sources.
[0036] A speech device according to a twenty-first aspect of the present invention is a speech device capable of speech, and includes a device storage unit and a device control unit. The device storage unit stores at least one of the type, identifier, speech performance, operating state, installation location, and distance from the user, user information of the user of the speech device, and speaker arrangement of the speech device. The device control unit is configured to set sound source characteristics suitable for the speech device based on at least one of the type, identifier, speech performance, operating state, installation location, and distance from the user, user information of the user of the speech device, and speaker arrangement of the speech device, to inquire of a server using the set sound source characteristics, to obtain a speech sound source having the sound source characteristics from the server, and to speak using the speech sound source.
[0037] A program according to a 22nd aspect of the present invention is a program used in a terminal that communicates with a server that controls the speech device according to any one of the 11th to 20th aspects, or in the speech device according to the 21st aspect.
[0038] First Embodiment DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A method for controlling a speech device, a server, a speech device, and a program according to a first embodiment of the present invention will be described in detail below with reference to the drawings as needed.
[0039] The following embodiment 1 shows an example of the present invention. The numerical values, shapes, configurations, steps, and order of steps shown in the following embodiment 1 show an example and do not limit the present invention. Among the components in the following embodiment 1, components that are not described in an independent claim showing a top concept are described as optional components.
[0040] In the first embodiment described below, there may be cases where modified examples are shown for specific elements, and other elements include appropriate combinations of any configuration, and the combined configurations provide the respective effects. In the first embodiment, by combining the configurations of the respective modified examples, the effects of the respective modified examples are provided.
[0041] In the following detailed description, the terms "first", "second", etc. are used for descriptive purposes only and should not be understood as expressing or implying the relative importance or ranking of technical features. Features qualified as "first" and "second" expressly or imply the inclusion of one or more of that feature.
[0042] FIG. 1 is a block diagram showing a schematic configuration of a speech device and a server that controls the speech device in the first embodiment. A server 10 (which may be abbreviated as "server 10") that controls the speech device is capable of communicating with at least one speech device 20 capable of speech. The server 10 is also capable of communicating with a terminal device 30, and may receive an instruction for the speech device 20 from a user via the terminal device 30 and control the speech device 20 based on the instruction. The server 10 may receive information from at least one information source device 40 or at least one external information source 50, and cause the speech device 20 to speak based on the received information. Below, an overview of each component will be described.
[0043] <Speech Device 20> The speech device 20 is a device having a speech function. The speech device 20 of the first embodiment includes a home appliance having a speech function (a speech home appliance). The term "home appliance" is an abbreviation for a household electrical appliance. The speech device 20 may be any type of electronic device used at home, and includes, for example, electrical appliances used at home, such as a television, a refrigerator, an air conditioner, a washing machine, a cleaning robot, an audio device, a lighting device, a water heater, an intercom, a pet camera, and a smart speaker. The speech device 20 may be called a "consumer speech device" or a "speech home appliance." The speech function is a function of emitting a voice including a human language using a speaker. The speech function is different from a function of emitting only sounds such as a beep, a buzzer, and an alarm that do not include a human language, and can convey more information to a user using human language. The speech device 20 as a speech home appliance is configured to perform each home appliance function. For example, the speech device 20, which is an air conditioner, includes a compressor, a heat exchanger, and an indoor temperature sensor, and is configured to perform cooling, heating, and dehumidification functions in a controlled space. Also, for example, the speech device 20, which is a cleaning robot, includes a battery, a dust collection mechanism, a movement mechanism, and an object detection sensor, and is configured to clean while moving within a movable range.
[0044] In the embodiment of FIG. 1, the speech device 20 includes a device storage unit 21 (home appliance storage unit) that stores information for performing functions, a device control unit 22 (home appliance control unit) that controls the entire speech device 20, a device communication unit 23 (home appliance communication unit) that can communicate with the server 10 or the terminal device 30, and a speaker 24 for speaking. The speech device 20 may include at least one of various sensors 25 for performing functions. The speech device 20 may include a display for displaying visual information to a user. Note that, although this exemplary speech device 20 will be described in the present disclosure, other speech devices 20 may have a similar configuration.
[0045] The device storage unit 21 is a recording medium for recording various information and control programs, and may be a memory that functions as a working area for the device control unit 22. The device storage unit 21 is realized, for example, by a flash memory, a RAM, or other storage device, or by an appropriate combination of these. The device storage unit 21 may store voice data or video data for speech. The voice data or video data for speech may be stored before the speech device 20 is shipped, may be read from another storage medium based on an instruction from the seller or a user at home, or may be downloaded via the Internet based on an instruction from the seller or user. In the following description, voice data may be abbreviated to "sound source."
[0046] The device control unit 22 is a controller that controls the entire speech device 20. The device control unit 22 includes a general-purpose processor such as a CPU, MPU, FPGA, DSP, or ASIC that executes a program to realize a predetermined function. The device control unit 22 can realize various controls in the speech device 20 by calling and executing a control program stored in the device storage unit 21. The device control unit 22 can also read / write data stored in the device storage unit 21 in cooperation with the device storage unit 21. The device control unit 22 is not limited to a device that realizes a predetermined function by cooperation between hardware and software, and may be a hardware circuit designed specifically to realize a predetermined function.
[0047] The device control unit 22 can receive various settings (e.g., temperature setting of an air conditioner, a channel displayed on a television, and cleaning time of a cleaning robot) set by a user via a setting user interface. Based on these settings and detection values (e.g., room temperature, presence or absence of an object) received from various sensors 25, the device control unit 22 controls each component of the speech device 20 so as to exercise the home appliance functions of the speech device 20. The device control unit 22 may receive a command from the server 10 or the terminal device 30 and control the speech device 20 in accordance with the command. The device control unit 22 also performs speech in accordance with a command from the server 10, based on a method for controlling a speech device, which will be described later.
[0048] The device communication unit 23 can also communicate with the server 10, the user's terminal device 30, etc., and can, for example, send and receive Internet packets. When the device control unit 22 cooperates with the server 10 via the device communication unit 23, it can receive parameter values or commands related to speech from the server 10 via the Internet.
[0049] The speaker 24 converts an electric signal into an acoustic signal using voice data designated by the device control unit 22, and radiates the signal as a sound wave into space. The speaker 24 may communicate with the device control unit 22 via a voice interface. The speaker 24 may be provided appropriately based on the type of the speech device 20. For example, in a speech device 20 that is a television, the speaker 24 may be provided on both sides of the front of the television. In a speech device 20 that is a cleaning robot, the speaker 24 may be provided inside the housing of the cleaning robot. The speaker 24 of each speech device 20 may have different specifications and speech capabilities. For example, the speaker 24 of a television may have a relatively high speech capability, while the speaker 24 of a washing machine may have a relatively low speech capability. The present disclosure does not limit the speech capability of the speaker 24.
[0050] The speech device 20 may include a display. The display is for displaying visual information to a user. The display may be, for example, a high-resolution display for displaying clear images like a television screen, or may be a low-resolution panel display for displaying a user interface (UI) for settings in a washing machine or microwave oven. The present disclosure does not limit the display capabilities of the display. The display may also be a touch panel with a display function.
[0051] The sensor 25 is for acquiring various information from outside the speech device 20 in order to exercise the functions of the speech device 20. For example, the sensor 25 may be an indoor temperature sensor for detecting the temperature inside a room in which an air conditioner is installed, an outdoor temperature sensor for detecting the temperature outside the room in which an air conditioner is installed, an object sensor for detecting the presence or absence of an object in front of the cleaning robot, an open / close sensor for detecting whether the door of a refrigerator is completely closed, etc. Information detected by the sensor 25 is input and stored in the device storage unit 21, and is later used by the device control unit 22 or transmitted to the terminal device 30 or the server 10.
[0052] <Terminal Device 30> The terminal device 30 is a device related to the speech device 20. The terminal device 30 may be, for example, a controller of the speech device 20, or a controller capable of simultaneously managing and controlling a plurality of types of home appliances. The terminal device 30 may also be an information terminal capable of performing data communication with the speech device 20, such as a smartphone, a mobile phone, a mobile phone, a tablet, a wearable device, a computer, or the like, incorporating a dedicated related application 32. The server 10 or the device control unit 22 can acquire settings or commands input by a user via the terminal device 30. In general, the terminal device 30 includes a display for displaying a graphical user interface (GUI). However, in the case of interacting with a user via a voice user interface (VUI), the terminal device 30 may include a speaker and a microphone instead of or in addition to the display. It should be noted that the server 10 can execute the method for controlling the speech device without going through the terminal device 30.
[0053] <Information source device 40> The information source device 40 is an information source related to the contents uttered by the speech device 20. The information source device 40 may be another device (home appliance) in the home where the speech device 20 is installed. When the information source device 40 is another home appliance, in this disclosure, the information source device 40 is also referred to as an information source device. The information source device may be the speech device 20, or may be a home appliance without a speech function. The information source device may transmit speech source information including device information such as its operating state to the server 10, and the server 10 may set the speech contents based on the received speech source information. Examples of the speech source information include, for example, the startup state of the information source device, the operating mode, abnormality information, the current location, the user to be spoken to, and the nearest user.
[0054] <External information sources 50> The external information source 50 is an information source that provides information on services that are not directly related to the speech device, such as weather information and information on the delivery status of a parcel delivery. The server 10 may set the speech content based on the information acquired from the external information source 50.
[0055] <Server 10> The server 10 is a server that controls at least one speech device 20. More specifically, the server 10 controls the at least one speech device 20 to make speech using audio data or video data including human language. In one embodiment, the server 10 can connect to at least one speech device 20 via the Internet and control speech. For multiple speech devices 20 installed in the same home, the server 10 can control these multiple speech devices at once.
[0056] The server 10 may be used for purposes other than executing the method for controlling a speech device described below. For example, the server 10 may be a management server of a manufacturer of the speech device 20 for managing at least one speech device 20 or for collecting data. Alternatively, the server 10 may be an application server. In the first embodiment, the server 10 includes a server storage unit 12 and a server control unit 14. The server 10 may further include a server communication unit 16 for communicating with the speech device 20, the terminal device 30, the information source device 40, or the external information source 50.
[0057] <Server storage unit 12> The server storage unit 12 is a recording medium for recording various information and control programs, and may be a memory that functions as a working area for the server control unit 14. The server storage unit 12 is realized, for example, by a flash memory, an SSD (Solid State Device), a hard disk, a RAM, or other storage device, or an appropriate combination of these. The server storage unit 12 may be a memory inside the server 10, or may be a storage device connected to the server 10 by wireless communication or wired communication.
[0058] The server storage unit 12 stores voice data or video data for speech. Various voice data or video data for speech may be generated according to the type of speech device 20 to be controlled, speech source information including home appliance information of the speech device 20, the type of information source device 40, the type of external information source 50, information acquired from the information source device 40 or the external information source 50, and the like. In one embodiment, the server 10 generates voice data or video data for speech in advance and stores it in the server storage unit 12 before making the speech device 20 speak. In another embodiment, the server 10 dynamically (at run time) generates voice data or video data for speech immediately before making the speech and stores it in the server storage unit 12. The server storage unit 12 may store material data for generating these voice data or video data, or intermediate data.
[0059] <Server control unit 14> The server control unit 14 of the server 10 is a controller that controls the entire server 10. The server control unit 14 includes a general-purpose processor such as a CPU, MPU, GPU, FPGA, DSP, or ASIC that executes a program to realize a predetermined function. The server control unit 14 can realize various controls in the server 10 by calling and executing a control program stored in the server storage unit 12. The server control unit 14 can also read / write data stored in the server storage unit 12 in cooperation with the server storage unit 12. The server control unit 14 is not limited to a unit that realizes a predetermined function through cooperation between hardware and software, and may be a hardware circuit designed specifically to realize the predetermined function.
[0060] <Server communication section 16> The server communication unit 16 cooperates with the server control unit 14 to transmit and receive Internet packets, i.e., communicate with the speech device 20, the terminal device 30, the information source device 40, the external information source 50, and the like. For example, the server 10 may receive a command from the terminal device 30 via the server communication unit 16, may transmit an instruction to the speech device 20, and may receive information from the information source device 40 or the external information source 50. The server communication unit 16 or the device communication unit 23 may communicate and transmit data between the server 10, the speech device 20, the terminal device 30, the information source device 40, and the external information source 50 according to standards such as Wi-Fi (registered trademark), IEEE802.2, IEEE802.3, 3G, and LTE. In addition to the Internet, communication may be performed with an intranet, an extranet, a LAN, ISDN, a VAN, a CATV communication network, a virtual private network, a telephone line network, a mobile communication network, a satellite communication network, infrared rays, and Bluetooth (registered trademark).
[0061] <How to control your speaking device> The server 10 executes a method for controlling the speech device 20 using the server storage unit 12 and the server control unit 14. The method causes the speech device 20 to speak using a speech sound source having sound source characteristics suited to the speech device 20 so that the speech is easy for the user to hear. Fig. 2 is a flowchart of the method for controlling the speech device in the first embodiment, and the method for controlling the speech device includes the following steps S110 to S140. Fig. 3 is a sequence diagram of an example of the method for controlling the speech device in the first embodiment.
[0062] The server control unit 14 of the server 10 receives the utterance source information from the information source device 40 (step S110). For example, the server control unit 14 may receive the utterance source information such as the activation state, driving mode, abnormality information, current location, target user, nearest user, etc. of the information source device 40. Then, the server control unit 14 sets the utterance device 20 based on the utterance source information (step S120).
[0063] In one embodiment, the server storage unit 12 stores a comparison table including speech conditions that may cause the speech function to be activated and scenarios to which the speech conditions correspond. Each scenario may include a scenario identifier, a scenario type, a scenario name, speech content, a speech device 20 to be spoken, and the like. Each scenario may also include a speech priority, whether or not to retry, a retry interval, and an upper limit on the number of retries. The server control unit 14 compares the received speech source information with each speech condition and determines whether the speech condition is satisfied. The server control unit 14 can obtain the conditions and scenarios corresponding to the speech source information through such comparison.
[0064] Based on a user input, the server control unit 14 may link a specific scenario with a specific speech device 20. If a speech condition of a certain scenario is satisfied, the server control unit 14 may cause the speech device 20 linked to the scenario to speak. The server control unit 14 may also link a specific information source device 40 with a specific speech device 20. If the server control unit 14 determines that speech should be made based on speech source information from a certain information source device 40, it may cause the speech device 20 linked to the information source device 40 to speak.
[0065] For example, the information source device 40 of the "washing machine" may be linked to the speech device 20 of the "pet camera" based on a user input. When the server control unit 14 receives information from the "washing machine" that the washing is finished, the server control unit 14 may cause the target device of the "pet camera" to speak the speech content "The washing is finished."
[0066] In one embodiment, the server control unit 14 receives external information from the external information source 50 in step S110. In step S120, the speech device is set based on the external information or based on both the speech source information and the external information. For example, when the server control unit 14 receives information that the washing is finished from the information source device 40 of the "washing machine" and further receives information that rain is forecast from the external information source 50, the server control unit 14 may cause the target device of the "pet camera" to speak the speech content "The washing is finished. The weather is forecast to deteriorate later."
[0067] Next, the server control unit 14 provides the speech device 20 with a speech sound source having sound source characteristics corresponding to the speech device 20, as described below (step S130). Then, the server control unit 14 causes the speech device 20 to speak using the speech sound source (step S140). In one embodiment, the server control unit 14 provides the speech sound source to the speech device 20 by causing the speech device 20 to download the speech sound source stored in the server storage unit 12 from the server storage unit 12.
[0068] More specifically, the server control unit 14 may set the sound source characteristics based on at least one of the type of the speech device 20, the identifier of the speech device 20, the speech performance of the speech device 20, the operating state of the speech device 20, the installation location of the speech device 20, and the distance between the speech device 20 and the user. Also, the server 10 may set the sound source characteristics based on at least one of the user information of the user of the speech device 20 and the arrangement of the speaker 24 of the speech device 20.
[0069] The audio source characteristics may include at least one of the format of the audio data (eg, WAV, MP3, AAC, MPEG-4, FLAC), timbre characteristics, sound quality characteristics, volume, and speech content.
[0070] The timbre characteristics may include at least one of the gender, age, voice type (e.g., high, low, clear voice, husky voice), speaking rate (e.g., slow, normal), and frequency components (e.g., normal, more high frequency components, more low frequency components) of the voice character. In one embodiment, the voice character refers to a character that speaks in voice synthesis (also called Text-To-Speech (TTS)). When the voice data employs the voice of a natural person, the voice character refers to the natural person that speaks. Note that the frequency components in this disclosure particularly refer to frequency components within the audible range.
[0071] The sound quality characteristics may include at least one of a sampling frequency (e.g., 8 kHz, 16 kHz, 32 kHz, 48 kHz, high sampling frequency, medium sampling frequency, low sampling frequency) and a sampling bit rate (e.g., 8 bits, 16 bits, 24 bits, also known as quantization bit rate).
[0072] The spoken content may include at least one of text, language (eg, Japanese, English), and scenario type.
[0073] Hereinafter, how the server control unit 14 sets the sound source characteristics according to the speech device 20 will be described using various examples.
[0074] <Case Study 1> In the first example, the sound source characteristics include a sampling frequency. The server control unit 14 sets the sampling frequency according to the speech performance of the speech device 20. For example, if the speech performance of the speech device 20 of the "smart speaker" can only handle a sampling frequency of 8 kHz, the server control unit 14 sets the sampling frequency to "8 kHz" or "low". On the other hand, if the speech performance of the speech device 20 of the "cleaning robot" can handle a sampling frequency of up to 16 kHz, the server control unit 14 sets the sampling frequency to a higher frequency than the sampling frequency set for the "smart speaker" so that the speech is easy to hear. In this case, the server control unit 14 sets the sampling frequency to "16 kHz" or "medium". Note that, if the speech performance can be identified from the type or identifier of the speech device 20, the server control unit 14 may set the sampling frequency according to the type or identifier of the speech device 20.
[0075] <Case Study 2> In the second example, the sound source characteristics include a sampling frequency. The server control unit 14 can perform detailed corrections to the sampling frequency depending on the arrangement of the speaker 24 of the speech device 20. In the case where the speaker 24 of the speech device 20 is arranged to be included inside the housing of the speech device 20, a specific frequency component may be blocked by the housing and attenuated. The server control unit 14 may determine the arrangement of the speaker 24 of the speech device 20 based on the type, identifier (product number), or name of the speech device 20. When the server control unit 14 determines that the speaker 24 is arranged to be blocked, the server control unit 14 sets the sampling frequency according to the frequency component that is blocked by the speech device 20 and attenuated due to the arrangement of the speaker 24 of the speech device 20. More specifically, the sampling frequency may be set to compensate for the frequency component that is blocked by the housing of the speech device 20 and attenuated, for example, to include a large amount of the frequency component.
[0076] The server control unit 14 may set other sound source characteristics depending on the arrangement of the speaker 24. For example, the speaker 24 of the speech device 20 of the "refrigerator" or the "washing machine" is generally installed outside the speech device 20, whereas the speaker 24 of the speech device 20 of the "cleaning robot" is preferably installed inside the housing since the outside of the speech device 20 is more likely to come into contact with obstacles or dirt. When the speaker 24 is installed inside the speech device, the voice may be partially blocked by the housing and may be difficult to hear, compared to when the speaker 24 is installed outside, so it is preferable to increase the volume. In order to make the voice easier to hear, the server control unit 14 may set a sampling frequency for the speech device 20 of the "cleaning robot" that has the built-in speaker 24 that is relatively higher than the sampling frequency set for the speech device 20 of the "refrigerator" or the "washing machine", for example, setting the sampling frequency to "16 kHz" or "medium".
[0077] <Case Study 3> In case 3, the sound source characteristics include a volume. The speech device 20 acquires the distance to the user by a human sensor, a Bluetooth connection, a GPS technology, or the like, and transmits the acquired distance to the server 10. The server control unit 14 sets the volume according to the distance between the speech device 20 and the user. The server control unit 14 may set the volume to be larger as the distance between the speech device 20 and the user increases, so that the user can easily hear the speech. For example, two distance thresholds, 1 meter and 3 meters, are provided, and the server control unit 14 sets the volume to "low", "medium", and "high" when the distance between the speech device 20 and the user is less than 1 meter, 1 meter or more and less than 3 meters, and 3 meters or more, respectively.
[0078] Alternatively, the speech device 20 may transmit to the server 10 whether the speech device 20 itself is in an operating state, and the server control unit 14 may set the volume depending on whether the speech device 20 is in operation or not. Specifically, the speech device 20 periodically notifies the server 10 that it is in an operating state while it is in operation. When the server control unit 14 determines that the speech device 20 is in an operating state based on the notification, it sets the volume higher than when it is determined that the speech device 20 is not in an operating state. In general, since the speech device 20 emits operating sounds while in operation, it is preferable to set the volume relatively high. For example, when the server control unit 14 determines that the speech device 20 is in standby or charging, it sets the volume to "medium," and when it determines that the speech device 20 is in an operating state, it sets the volume to "high."
[0079] <Case 4> In the fourth example, the sound source characteristics include at least one of volume, speaking speed, and frequency components. The server control unit 14 may set these sound source characteristics according to a target user of the speech device 20. In one embodiment, the server control unit 14 determines whether the speech device 20 is associated with a specific user (i.e., whether a specific user is registered for the speech device 20) by a lookup table stored in the server storage unit 12. If the server control unit 14 determines that there is a linked user, it sets the user as a target user of the speech device. In another embodiment, the speech device 20 identifies the nearest user by a human sensor, Bluetooth connection, GPS technology, or the like, and transmits information about the user to the server 10. The server control unit 14 sets the nearest user as a target user of the speech device.
[0080] The server control unit 14 sets the volume, speaking speed, and / or frequency components according to the age of the user to whom the speech device 20 is to be spoken. Specifically, when the server control unit 14 determines that the age of the user to whom the speech device 20 is to be spoken is equal to or greater than a predetermined age, the server control unit 14 sets the volume higher, the speaking speed slower, and / or the frequency components to include more high frequency components, compared to when the server control unit 14 determines that the age of the user to whom the speech device 20 is to be spoken is less than the predetermined age. In general, it is easier for older users to hear the speech by increasing the volume, slowing the speaking speed, and increasing the frequency. For example, when the server control unit 14 determines that the user is less than a predetermined age, for example, less than 70 years old, the server control unit 14 sets the volume to "medium" and the speaking speed and frequency components to "normal". On the other hand, when the server control unit 14 determines that the specified user to be spoken to is equal to or greater than a predetermined age, for example, 70 years old or older, the server control unit 14 sets the volume to "medium", the speaking speed to "slow", and the frequency components to "higher frequency components" so that the speech can be easily heard even by users over the predetermined age.
[0081] <Case Study 5> The server control unit 14 may set the sound source characteristics based on the installation location of the speech device 20. For example, when the speech device 20 is installed in a place where the user spends relatively little time there, such as a bathroom or a dressing room, the distance from the user is often large, so that the volume may be set to be large or high frequency components may be set to be large so that the speech device 20 is easy to hear.
[0082] <Program used in a terminal communicating with the server 10 that controls the speech device> A terminal in communication with the server 10, for example a speech device 20, comprises a program used to implement the control method as described above.
[0083] When a program for executing speech control is used in the speech device 20, the program is stored in the device storage unit 21. The device control unit 22 executes the program to realize the functions of speech control and speech generation using a speech sound source provided by the server 10.
[0084] This completes the speech control process of the server control unit 14. The server control unit 14 sets sound source characteristics appropriate for the speech device 20 based on various information related to the speech device 20 and the user. For example, by setting the timbre characteristics or sound quality characteristics higher than normal, the speech of the speech device 20 can be made easier to hear. Alternatively, the speech of the speech device 20 can be made easier to hear by setting speech content that is easier for the user to hear.
[0085] Second Embodiment <When the server 10 sets the sound source characteristics> In the second embodiment, the server 10 sets sound source characteristics according to the utterance device 20, and downloads a speech sound source having the set sound source characteristics to the utterance device 20, thereby providing the speech sound source.
[0086] Fig. 4 is a flow chart of an example of step S130 in the second embodiment. Fig. 5 is a sequence diagram of an example of a method for controlling a speech device in the second embodiment. The server control unit 14 sets sound source characteristics according to the speech device 20 set in step S120 (Fig. 2) (step S210). The server control unit 14 may set the sound source characteristics based on at least one of the type, identifier, speech performance, operating state, installation location, and distance from the user of the speech device 20, user information, and arrangement of the speaker 24, as in the first embodiment.
[0087] The server control unit 14 selects a sound source having the set sound source characteristics as a speech sound source from among the multiple sound sources (step S220). In one embodiment, the server control unit 14 selects a speech sound source from among the multiple sound sources already stored in the server storage unit 12. In another embodiment, the server control unit 14 dynamically generates a sound source according to the set sound source characteristics, and selects the generated sound source as a speech sound source.
[0088] Next, the server control unit 14 transmits an access destination corresponding to the speech sound source, for example, a URL (uniform resource locator) corresponding to the speech sound source, to the speech device 20 so that the speech device 20 downloads the speech sound source (step S230). The speech device 20 downloads the speech sound source using the received access destination and speaks it.
[0089] Hereinafter, the provision of a speech sound source will be described using an example in which a URL is used as an access destination. In one embodiment, the server control unit 14 may set the URL based on the type of information source device 40, which is the speech condition, the scenario, the speech character, the sound quality (sampling frequency, etc.), the format of the sound source, the storage location of the sound source in the server storage unit 12, the version of the sound source, and the like. As an example, the URL may be set according to the format of "https: / / serverURL / v1 / deviceType / scenarioId / scenarioId_characterName_voiceQuality.extension". For example, the URL corresponding to the sound source, which is used in a scenario related to the information source device 40 of "washing machine", has a speech character of "Mizuki" and is created with a low sampling frequency, is set as "https: / / serverURL / v1 / washerDryer / washerDryer.dryingFinished / washerDryer.dryingFinished_Mizuki_low.wav".
[0090] By storing various sound sources that can be set as the speech sound source in the server 10 and causing the speech device 20 to download the speech sound source immediately before speaking, the sound source can be easily updated in the server 10. In other words, the server 10 can update the stored sound source and dynamically generate the speech sound source, and can flexibly provide the speech sound source.
[0091] In another embodiment, the server control unit 14 provides the speech sound source by transmitting the speech sound source itself to the speech device 20. In yet another embodiment, voice data corresponding to various sound source characteristics are already stored in the device storage unit 21, and the server control unit 14 transmits the set sound source characteristics to the speech device 20. The speech device 20 selects the corresponding voice data based on the received sound source characteristics and produces the speech.
[0092] According to the method, server, speech device, and program for controlling a speech device of embodiment 2, it is possible to set sound source characteristics that are easy for a user to hear according to the speech device, and to provide a speech sound source easily and flexibly.
[0093] Third Embodiment <If Server 10 is composed of multiple servers> In the third embodiment, the server 10 is made up of a plurality of servers having different roles.
[0094] 6 is a block diagram showing a schematic configuration of a speech device and a server controlling the speech device in the third embodiment. In the third embodiment, the server 10 includes a speech instruction server 10a and a sound source server 10b. The speech instruction server 10a includes a server storage unit 12a, a server control unit 14a, and a server communication unit 16a.
[0095] The sound source server 10b includes a server storage unit 12b, a server control unit 14b, and a server communication unit 16b. The sound source server 10b performs operations related to the generation, storage, and download of voice data (sound source) for speech in a method for controlling a speech device. On the other hand, the speech instruction server 10a performs the remaining operations, such as communication between the speech device 20 and the terminal device 30.
[0096] Fig. 7 is a sequence diagram of an example of a method for controlling a speech device in the third embodiment, which is executed by the configuration shown in Fig. 6. The speech instruction server 10a receives speech source information from the information source home appliance 40, sets the speech device 20 and sound source characteristics, selects a speech sound source, and transmits a speech instruction to the speech device 20. In the example of Fig. 7, the speech sound source is stored in the server storage unit 12b of the sound source server 10b, and the speech instruction includes a URL ("DL URL") for downloading the sound source. When the speech device 20 receives the speech instruction, it downloads the speech sound source from the sound source server 10b based on the DL URL, and speaks with the speech sound source.
[0097] This reduces the processing load of each server in the server 10. Each server in the server 10 only needs to have a configuration for performing the operation for which it is responsible, and for example, the speech instruction server 10a does not need to include hardware for generating a sound source. This configuration makes it easier to maintain and service the entire server 10.
[0098] Note that the functions of the server 10 may be shared among multiple servers from a different perspective than those in Fig. 6 and Fig. 7. For example, the server 10 may include a speech instruction server, a sound source generation server, and a sound source distribution server. In this case, the speech sound source generated by the sound source generation server is stored in the server storage unit of the sound source distribution server and downloaded by the speech device 20.
[0099] Fourth Embodiment <When the speech device 20 sets the sound source characteristics> In the fourth embodiment, the utterance device 20 sets sound source characteristics and inquires (requests) the server 10 about a sound source having the set sound source characteristics. The server control unit 14 selects a speech sound source having sound source characteristics based on the inquiry from the utterance device 20, and provides the selected speech sound source to the utterance device 20.
[0100] Fig. 8 is a flow chart of an example of step S130 performed by the server 10 in the fourth embodiment. Steps S310 to S330 in Fig. 8 are a specific example of step S130. Fig. 9 is a sequence diagram of an example of a method for controlling the speech device in the fourth embodiment. The server control unit 14 provides a speech sound source to the speech device 20 in the flow shown in Figs. 8 and 9, as will be described later.
[0101] 10 is a flowchart of an example of a method performed by the speech device 20 in the fourth embodiment. The device storage unit 21 of the speech device 20 stores at least one of the above-mentioned type, identifier, speech performance, operating state, installation location, and distance from the user of the speech device 20, user information of the user of the speech device 20, and arrangement of the speaker 24 of the speech device 20. The device control unit 22 of the speech device 20 is configured to execute the flowchart of FIG.
[0102] In the method for controlling the speech device, the server control unit 14 first receives the speech source information and sets the speech device 20 (steps S110 and S120 in FIG. 2). After setting the speech device 20, the server control unit 14 transmits a speech instruction to the speech device 20 so as to notify the speech device 20 that the speech device 20 should make a speech. The speech instruction in this embodiment includes information required for the device control unit 22 to set the sound source characteristics, and may include, for example, the speech source information, or a speech condition or a corresponding scenario based on the speech source information. The device control unit 22 uses the information included in the speech instruction to set the sound source characteristics suitable for the speech device 20 based on at least one of the type, identifier, speech performance, operating state, installation location, and distance from the user, user information, and arrangement of the speaker 24 of the speech device 20, as in the above-mentioned first embodiment (step S410).
[0103] The device control unit 22 uses the set sound source characteristics to inquire the server 10 to acquire a sound source (speech sound source) having the sound source characteristics (step S420). More specifically, the device control unit 22 inquires about the URL of the sound source having the sound source characteristics. In response to this, the server control unit 14 receives an inquiry using the sound source characteristics set by the device control unit 22 from the speech device (step S310).
[0104] The server control unit 14 selects a sound source having the sound source characteristics in the query as a speech sound source from among the multiple sound sources stored in the server storage unit 12 (step S320). Then, the server control unit 14 transmits a URL ("DL URL") corresponding to the speech sound source to the speech device so as to cause the speech device to download the speech sound source (step S330). In response to this, the device control unit 22 acquires a speech sound source having the sound source characteristics from the server 10 (step S430). Specifically, the device control unit 22 downloads the speech sound source using the notified URL ("DL URL"). After that, the device control unit 22 speaks using the speaker 24 and the speech sound source (step S440).
[0105] When a program for performing speech control is used in the speech device 20, the program is stored in the device storage unit 21. The device control unit 22 executes the program to realize the function of speech control. In one embodiment, the device control unit 22 executes the program to control the speech device 20 as shown in FIG.
[0106] According to the method, server, speech device, and program for controlling the speech device of the fourth embodiment, the speech device 20 can set sound source characteristics suitable for itself. That is, the speech device 20 can be controlled so as to make the speech easier to hear.
[0107] Fifth Embodiment <When the server 10 provides a plurality of candidate sound sources to the speech device 20> In the fifth embodiment, the server 10 provides a plurality of candidate sound sources, and the speech device 20 selects a speech sound source from the candidate sound sources and produces speech.
[0108] Fig. 11 is a flowchart of an example of step S130 in the fifth embodiment. Fig. 12 is a sequence diagram of an example of a method for controlling the speech device in the fifth embodiment.
[0109] In the method for controlling a speaking device, the server control unit 14 first receives speech source information and sets the speaking device 20 (steps S110 and S120 in FIG. 2). After setting the speaking device 20, the server control unit 14 selects a plurality of candidate sound sources according to the sound source characteristics from a plurality of sound sources stored in the server storage unit 12 (step S510). In one embodiment, there are a plurality of sound sources having the set sound source characteristics, and the server control unit 14 selects these sound sources as candidate sound sources.
[0110] In one embodiment, the server control unit 14 selects, as candidate sound sources, sound sources having the set sound source characteristics and sound source characteristics similar to the set sound source characteristics. The similar sound source characteristics are, for example, sound source characteristics having a value within a predetermined range from the set value of the sound source characteristics such as volume. For example, for the set sound source characteristic of "volume: 50 dB", a sound source having a sound source characteristic of "volume: 40 dB" to "volume: 60 dB" within a predetermined range of 10 dB can be selected as a candidate sound source. For example, for the set sound source characteristic of "sampling frequency: large", a sound source having a sound source characteristic of "sampling frequency: large" and "sampling frequency: medium" can be selected as a candidate sound source. Also, for example, for the set sound source characteristic of "voice character: male, young man", a sound source having a sound source characteristic of "voice character: male, young man" and "voice character: female, young man" can be selected as a candidate sound source.
[0111] The server control unit 14 transmits URLs corresponding to the plurality of candidate sound sources to the speech device 20 (step S520). The server control unit 14 provides the speech sound source to the speech device 20 via the URL corresponding to the speech sound source selected from the plurality of candidate sound sources (step S530).
[0112] In one embodiment, the server control unit 14 transmits a speech instruction including URLs corresponding to multiple candidate sound sources to the speech device. When the device control unit 22 receives the speech instruction including multiple URLs ("DL URLs"), it downloads the candidate sound sources using these URLs. Then, the device control unit 22 selects a speech sound source based on the sound source characteristics of the downloaded candidate sound sources, and speaks with the speech sound source.
[0113] In another embodiment, the server control unit 14 transmits a speech instruction to the speech device, and the speech instruction includes URLs corresponding to a plurality of candidate sound sources and information on the sound source characteristics corresponding to these URLs. When the device control unit 22 receives the speech instruction including the plurality of URLs, the device control unit 22 selects sound source characteristics to be possessed as the speech sound source based on the sound source characteristics corresponding to these URLs. Then, the device control unit 22 downloads the speech sound source using the URL corresponding to the selected sound source characteristics, and speaks with the speech sound source.
[0114] When the device control unit 22 selects a speech sound source or sound source characteristics that the speech sound source should have, as in embodiment 1, the selection may be based on at least one of the type, identifier, speech performance, operating status, installation location, and distance from the user of the speech device 20 itself, user information, and the arrangement of the speaker 24.
[0115] According to the method, server, speech device, and program for controlling a speech device of the fifth embodiment, the speech device 20 can select a speech sound source from a plurality of provided candidate sound sources. Therefore, the server 10 can provide a speech sound source more easily and flexibly. In addition, since the speech device 20 selects a speech sound source based on the state immediately before utterance, it can select a speech sound source that is easy to hear more accurately.
[0116] Sixth Embodiment <When the user is asked to set / select a speech source from multiple candidate sources> In the sixth embodiment, the server 10 or the speech device 20 provides a plurality of candidate sound sources to allow the user to set / select a speech sound source.
[0117] 13 is a sequence diagram of an example of a method for controlling a speech device in embodiment 6. In embodiment 6, an example will be described in which the server 10 sets the sound source characteristics and allows the user to select a sound source, but the speech device 20 may set the sound source characteristics and allow the user to select a sound source.
[0118] In the example of Fig. 13, first, the utterance source information is received and the utterance device 20 is set (steps S110 and S120 in Fig. 2). After setting the utterance device 20, the server control unit 14 sets sound source characteristics according to the utterance device 20 as in the above-mentioned embodiments 1 to 3, and selects sound sources having the set sound source characteristics from the plurality of sound sources as a plurality of candidate sound sources.
[0119] Next, the server control unit 14 presents information about the multiple candidate sound sources to the user via the associated application 32 of the terminal device 30. The information about the multiple candidate sound sources may include the set sound source characteristics, or may include information extracted from the set sound source characteristics to make it easier for the user to understand. In addition, the server control unit 14 may cause the terminal device 30 to download the candidate sound sources so that the user can select a speech sound source after listening to the candidate sound sources.
[0120] When the user selects a speech sound source based on the information presented or previewed by the terminal device 30, the terminal device 30 transmits a selection instruction including the selection result to the server 10. Based on the selection instruction, the server control unit 14 provides the speech sound source to the speech device 20 as in the above-mentioned embodiments 1 to 3, and causes the speech device 20 to speak using the speech sound source (steps S130 and S140 in FIG. 2).
[0121] In one embodiment, the server control unit 14 sets a plurality of sound source characteristics corresponding to the speech device 20 as candidate characteristics, presents information on the candidate characteristics to the user via the terminal device 30, and allows the user to select the sound source characteristic to be adopted. Upon receiving a selection instruction including the selection result from the terminal device 30, the server control unit 14 provides the speech device with an utterance sound source having the selected sound source characteristic, and allows the speech device 20 to speak using the speech sound source.
[0122] In one embodiment, the server control unit 14 sets a plurality of sound source characteristics corresponding to the speech device 20 as candidate characteristics, and selects a plurality of candidate sound sources having these candidate characteristics from the plurality of sound sources. The server control unit 14 presents information about the candidate sound sources to the user via the terminal device 30, or allows the user to preview the candidate sound sources, and allows the user to select a speech sound source. When the server control unit 14 receives a selection instruction including the selection result from the terminal device 30, it provides the selected speech sound source to the speech device, and allows the speech device 20 to speak using the speech sound source.
[0123] This allows the user to select the speech sound source or sound source characteristics, making it possible to provide a speech service that is more in line with the user's needs.
[0124] <Program used in a terminal communicating with the server 10 that controls the speech device> A terminal communicating with the server 10, for example, the speech device 20 or the terminal device 30, has a program used to execute the control method as described above. When a program for executing speech control is used in the speech device 20, the program is stored in the device storage unit 21. The device control unit 22 realizes the function of speech control by executing the program.
[0125] In one embodiment, the device control unit 22 executes the program to obtain a speech sound source corresponding to the speech device 20 from the server 10 and output the speech sound source, as in any one of the first to third, fifth and sixth embodiments.
[0126] In another embodiment, the device control unit 22 executes the program to perform the control method of the speech device as in the fourth and sixth embodiments.
[0127] As described above, the program for functioning as the server 10 or the speech device 20 may be stored in a computer-readable storage medium that can be read by a computer. When the computer-readable storage medium storing the program is supplied to the speech test server 10 or the speech device 20, the control unit (e.g., CPU or MPU) of the speech test server 10 or the speech device 20 can perform its function by reading and executing the program stored in the computer-readable storage medium. Examples of the computer-readable storage medium that can be used include ROM, floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, and non-volatile memory card.
[0128] The above are merely specific embodiments of the present invention, and the scope of protection of the present invention is not limited thereto. The present invention includes the contents described above in the drawings and the specific embodiments described above, but the present invention is not limited thereto. Various disclosed embodiments or examples can be combined without departing from the scope or spirit of the present invention. Modifications that do not depart from the functional and structural principles of the present invention are within the scope of the claims. [Explanation of symbols]
[0129] 10 Server that controls the speech device (server) 10a Speech instruction server 10a 10b Sound source server 12, 12a, 12b Server storage unit 14, 14a, 14b Server control unit 16, 16a, 16b Server communication section 20 Speaking Devices 21 Device storage section 22 Equipment control section 23 Device Communication Department 24 Speakers 25 Sensors 30 Terminal Equipment 32 Related Applications 40 Information source device 50 External information sources
Claims
1. 1. A method of controlling a speech device, comprising: receiving utterance source information from an information source device; setting a speech device based on the speech source information; providing said speech device with a speech source having sound source characteristics according to said speech device; causing the speech device to speak using the speech sound source; Including, The sound source characteristics include a volume, and the volume is set based on a placement of a speaker of the speech device. A method for controlling a speech device.
2. When the speaker of the speech device is installed inside the speech device, the volume is set to be larger than when the speaker is installed outside the speech device. A method for controlling a speech device according to claim 1.
3. The sound source characteristics further include a sampling frequency; A sampling frequency is set according to the speech performance of the speech device. A method for controlling a speech device according to claim 1.
4. When it is determined that the speech device is in an operating state, the volume is set to be higher than when it is determined that the speech device is not in an operating state. A method for controlling a speech device according to claim 1.
5. Providing a speech source to the speech device comprises: setting a sound source characteristic according to the speaking device; selecting a sound source having the set sound source characteristics as the speech sound source from among a plurality of sound sources; transmitting an access destination corresponding to the speech sound source to the speech device so as to cause the speech device to download the speech sound source; Including, A method for controlling a speech device according to claim 3.
6. A server for controlling a speech device, a server storage unit that stores a sound source that can be provided to the speech device; A server control unit, receiving utterance source information from an information source device; Setting a speech device based on the speech source information; providing a speech sound source having sound source characteristics corresponding to the speech device to the speech device; The speech device is caused to speak using the speech sound source. The server control unit configured as above; Including, The sound source characteristics include a volume, and the volume is set based on a placement of a speaker of the speech device. A server that controls speech devices.
7. When the speaker of the speech device is installed inside the speech device, the volume is set to be larger than when the speaker is installed outside the speech device. A server that controls the speech device according to claim 6.
8. The sound source characteristics further include a sampling frequency; A sampling frequency is set according to the speech performance of the speech device. A server that controls the speech device according to claim 6.
9. When it is determined that the speech device is in an operating state, the volume is set to be larger than when it is determined that the speech device is not in an operating state. A server that controls the speech device according to claim 6.
10. When providing a speech sound source to the speech device, the server control unit Setting a sound source characteristic according to the speech device; selecting a sound source having the set sound source characteristics as the speech sound source from among a plurality of sound sources; Transmitting an access destination corresponding to the speech sound source to the speech device so as to cause the speech device to download the speech sound source. [0023] A server that controls the speech device according to claim 6.
11. A speech device capable of producing speech, a device storage unit configured to store at least one of an operating state of the speech device, an installation location of the speech device, and an arrangement of speakers of the speech device; An equipment control unit, setting a volume appropriate for the speech device based on the arrangement of the speakers of the speech device; Query the server using the volume you set, Acquire a speech sound source having a set volume from the server; Speak using the speech source The device control unit configured as above, Including, Speaking equipment.
12. When the speaker of the speech device is installed inside the speech device, the volume is set to be larger than when the speaker is installed outside the speech device. A speech device according to claim 11.
13. A program for causing a speech device according to claim 11 to set a volume appropriate for the speech device based on the arrangement of speakers of the speech device, query a server using the set volume, obtain from the server a speech sound source having the set volume, and speak using the speech sound source.
14. When the speaker of the speech device is installed inside the speech device, the volume is set to be larger than when the speaker is installed outside the speech device. The program according to claim 13.
Citation Information
Patent Citations
Speech output system and onboard device
JP2010048959A
Interactive device, interactive system, interactive program, server, control method for server, and server control program
JP2016062077A
Voice output control device, electronic apparatus, and method for controlling voice output control device
JP2017203967A
Control device, control method, and control program
JP6640266B2
Audio server
WO2015129523A1
