Equipment Control System

Abstract

Provides comfort to the user. [Solution] The home system (6090) includes an input unit (6064), a clock unit (6015), a recording unit (6016), a control unit (6014), and a pattern extraction unit (6017). The input unit (6064) receives a user's command. The clock unit (6015) obtains the time. The recording unit (6016) records a log associating the time and the command. The control unit (6014) controls multiple devices in accordance with the command. The pattern extraction unit (6017) analyzes the log to extract a sequential command pattern including multiple commands issued to the multiple devices within a predetermined time interval.

Description

[Technical field]

[0001] The present invention relates to a device control system. [Background technology]

[0002] A variety of devices have been developed to make the environment surrounding the user more comfortable, and some of these devices can recognize the user's voice.

[0003] Patent Document 1 (JP Patent Publication 2006-308848 A) discloses a technique for controlling a device based on a voice uttered by a user.

[0004] Patent Document 2 (Japanese Patent No. 2552744) discloses a system that allows a bathroom environment to be set for each user.

[0005] Patent Document 3 (JP Patent Publication 2006-320621 A) discloses an air conditioner that emits a scent that reduces stress.

[0006] Patent Document 4 (Japanese Patent Laid-Open Publication No. 2001-324202) discloses an air conditioner equipped with a voice input / output means.

[0007] The configuration disclosed in Patent Document 5 (WO 2012 / 176690) estimates the user's tolerance for "energy saving automatic control" and aims to achieve both reduced power consumption and comfort.

[0008] Patent Document 6 (JP Patent Publication No. 2009-290967) discloses a system that encourages reduction in power consumption in a home.

[0009] Patent Document 7 (JP 2010-181064 A) discloses an air conditioner that can be operated by voice. Summary of the Invention [Problem to be solved by the invention]

[0010] When controlling multiple devices by voice input, it may be cumbersome to control each device each time. Furthermore, it is difficult to reproduce an environment that a user feels comfortable in one place in another place. Furthermore, in the conventional system, it may not be possible to calm a person who is angry. Furthermore, the same user may have different feelings about the comfort of the environment. Furthermore, making the user input his / her intention as to whether or not to allow a reduction in power consumption impairs usability. Furthermore, in the conventional system, information about the sequential operation of multiple devices is not utilized. Furthermore, in the conventional system, the case where a user owns multiple voice-operable devices is not often assumed. The first problem is to provide a setting support device and a program for improving user convenience in a control system that controls devices by voice input.

[0011] The second challenge is to allow a user to easily reproduce his / her preferred environment in a different location.

[0012] A third object is to provide an air conditioning system capable of keeping a speaker calm.

[0013] The fourth challenge is to more faithfully realize users' wishes regarding indoor environmental control.

[0014] The fifth challenge is to estimate the user's tolerance for power consumption reduction of air conditioners and other devices without depending on the user's operation, and to maintain comfort.

[0015] The sixth challenge is to provide comfort to users by utilizing information about the sequential operation of multiple devices installed in a home.

[0016] A seventh object is to provide a device control system capable of stopping voice recognition processing for multiple voice-operable devices with a simple operation, a device controlled by the device control system, and a method for controlling the device. [Means for solving the problem]

[0017] [First configuration] The setting support device according to the first aspect is a device for use in a control system including a voice input receiving unit that receives voice input from a user, a voice input analysis unit that analyzes the voice, a control unit that controls a control device based on an analysis result by the voice input analysis unit, and a specific control storage unit that associates the voice input corresponding to a predetermined keyword with the predetermined control of the control device and stores it as a specific control, and supports the setting of the specific control. Here, the setting support device includes a keyword input receiving unit, a control command selection unit, and a specific control registration unit. Here, the keyword input receiving unit receives input of information corresponding to the keyword. The control command selection unit displays the predetermined control command for the device on an editing screen and accepts the selection of the control command. The specific control registration unit associates the keyword input by the keyword input receiving unit with the control command selected by the control command selection unit and registers them in the specific control storage unit.

[0018] In the setting assistance device according to the first aspect, since a keyword corresponding to a voice input can be associated with a control command for a device on an editing screen, a user can easily set a control command in a control system that controls a device by voice input. As a result, it is possible to improve user convenience in a control system that controls a device by voice input.

[0019] A setting assistance device according to a second aspect is the setting assistance device according to the first aspect, wherein the control command selection unit displays a plurality of the control commands in a pull-down format on an editing screen.

[0020] In the setting assistance device according to the second aspect, the control command selection unit displays the control commands in a pull-down format on the editing screen, so that the user can intuitively operate to set the control commands.

[0021] A setting assistance device according to a third aspect is the setting assistance device according to the first or second aspect, wherein the specific control registration unit associates a plurality of control commands with one keyword.

[0022] In the setting assistance device according to the third aspect, the specific control registration unit associates a plurality of control commands with one keyword, so that the user can intuitively set the control commands.

[0023] A setting support device according to a fourth aspect is a setting support device according to any one of the first to third aspects, in which a keyword input receiving unit displays a keyword image into which a keyword can be input on an editing screen, a control command selecting unit displays a control command image corresponding to a control command on the editing screen, and a specific control registering unit associates the keyword and the control command by specifying and moving the keyword image and the control command image on the editing screen to associate them.

[0024] The setting assistance device according to the fourth aspect has the above-described configuration, and therefore allows a user to intuitively operate to set a control command.

[0025] A setting assistance device according to a fifth aspect is the setting assistance device according to any one of the first to fourth aspects, wherein a specific control registration unit registers the specific control in the specific control storage unit in association with user information that identifies a user.

[0026] In the setting assistance device according to the fifth aspect, the specific control registration unit registers the specific control in association with the user information, so that it is possible to set the specific control in accordance with the preferences of each user.

[0027] A setting support device according to a sixth aspect is a setting support device according to any one of the first to fifth aspects, in which a specific control registration unit registers a specific control in a specific control memory unit in association with a voiceprint when a user reads out a keyword.

[0028] In the setting assistance device relating to the sixth aspect, the specific control registration unit associates the specific control with the voiceprint when the user reads out the keyword and registers it in the specific action memory unit, so that it is possible to set a specific control that can only be controlled by the user whose voiceprint is registered.

[0029] The program according to the seventh aspect is used in a control system including a voice input detection unit that receives voice input from a user, a voice input analysis unit that analyzes the voice, a control unit that controls a control device based on an analysis result by the voice input analysis unit, and a specific control storage unit that associates a voice input corresponding to a predetermined keyword with a predetermined control of the control device and stores the associated control as a specific control, and is a program for realizing a setting assistance device for assisting in setting the specific control. Specifically, the program according to the seventh aspect causes a computer to function as a keyword input acceptance unit, a control command selection unit, and a specific control registration unit. Here, the keyword input acceptance unit accepts input of information corresponding to a keyword. The control command selection unit displays a predetermined control command for the control device on an editing screen and accepts selection of a control command. The specific control registration unit associates the keyword input by the keyword input acceptance unit with the control command selected by the control command selection unit and registers the associated keyword in the specific control storage unit.

[0030] In the program according to the seventh aspect, when used in a computer, a keyword corresponding to a voice input can be associated with a control command for a control device on an editing screen, so that a user can easily set a control command in a control system that controls a control device by voice input. As a result, it is possible to improve user convenience in a control system that controls a device by voice input.

[0031] [Second configuration] An environmental conditioning system according to an eighth aspect adjusts the environment using a target environmental conditioning device installed in a target space. The environmental conditioning system includes a device information acquisition unit, a storage unit, a calculation unit, and a control unit. The device information acquisition unit acquires information on the target environmental conditioning device. The storage unit stores an environmental state to be realized. The calculation unit calculates control parameters of the target environmental conditioning device for realizing the environmental state. The control unit controls the target environmental conditioning device based on the control parameters.

[0032] According to this configuration, the environmental state stored in the storage unit is reproduced as the environment of the target space by control based on the control parameters, so that an environment preferred by the user can be reproduced.

[0033] An environmental conditioning system according to a ninth aspect is an environmental conditioning system according to the eighth aspect, in which the environmental state is calculated by a calculation unit based on information acquired by an equipment information acquisition unit from a reference environmental conditioning device or a reference environmental sensor installed in a reference space separate from the target space.

[0034] According to this configuration, an environmental state is created based on the environment of the reference space, and the environmental state is reproduced in the target space. Therefore, the environment of the reference space can be reproduced in the target space.

[0035] An environmental conditioning system according to a tenth aspect is the environmental conditioning system according to the ninth aspect, further comprising an input unit that receives input from a user, and a command extraction unit that extracts a command from the input. When the command extraction unit extracts the command to reproduce the environmental state, the control unit controls the target environmental conditioning device based on the control parameters calculated to realize the environmental state.

[0036] According to this configuration, when a command to reproduce the environmental condition is received, the control unit controls the target environmental adjustment device in accordance with the environmental condition, so that the user's preferred environment is reproduced in response to the command issued by the user.

[0037] An environmental control system according to an eleventh aspect is the environmental control system according to the tenth aspect, further comprising an authentication unit that authenticates a user based on an input. When the authentication unit authenticates the user as an authorized person, the control unit can control the target environmental control device.

[0038] According to this configuration, a user can control the environmental conditioning device if he or she is authenticated as an authorized user. Therefore, unauthorized persons cannot control the environmental conditioning device, which makes it easier to ensure security.

[0039] An environmental control system according to a twelfth aspect is the environmental control system according to any one of the ninth aspect to the eleventh aspect, in which the target environmental control device and the reference environmental control device both include an air conditioner.

[0040] According to this configuration, the environmental conditioning devices in both the reference space and the target space include air conditioners, so that air conditioning that affects the comfort of the user is reproduced in the target space.

[0041] An environmental conditioning system according to a thirteenth aspect is an environmental conditioning system according to any one of the ninth to twelfth aspects, in which the memory unit is configured to update the environmental state to a value calculated by the calculation unit based on information acquired by the equipment information acquisition unit from a target environmental conditioning device or a target environmental sensor installed in the target space.

[0042] According to this configuration, the environmental state stored in the storage unit can be updated using the environment of the target space, so that if the user likes the environment of the target space, the settings related to that environment can be saved.

[0043] An environmental conditioning system according to a fourteenth aspect is the environmental conditioning system according to any one of the eighth aspect to the thirteenth aspect, in which the environmental conditions include temperature.

[0044] According to this configuration, the environmental conditions include temperature, so that the temperature preferred by the user is reproduced in the target space.

[0045] An environmental conditioning system according to a fifteenth aspect is the environmental conditioning system according to any one of the eighth aspect to the fourteenth aspect, in which the environmental conditions include air volume.

[0046] According to this configuration, the environmental condition includes the air volume, so that the air volume preferred by the user can be reproduced in the target space.

[0047] An environmental conditioning system according to a sixteenth aspect is the environmental conditioning system according to any one of the eighth aspect to the fifteenth aspect, in which the environmental conditions include humidity.

[0048] According to this configuration, the environmental condition includes humidity, so that the humidity preferred by the user is reproduced in the target space.

[0049] An environmental conditioning system according to a seventeenth aspect is the environmental conditioning system according to any one of the eighth to sixteenth aspects, in which the environmental condition includes illuminance, and the target environmental conditioning device includes a lighting fixture.

[0050] According to this configuration, the environmental state includes illuminance, so that the illuminance preferred by the user can be reproduced in the target space.

[0051] An environment conditioning system according to an eighteenth aspect is the environment conditioning system according to any one of the eighth to seventeenth aspects, in which the environmental condition includes an odor, and the target environment conditioning device includes an aroma emitting device.

[0052] According to this configuration, the environmental state includes an odor, and therefore the odor preferred by the user is reproduced in the target space.

[0053] [Third configuration] An air conditioning system according to a nineteenth aspect includes a conditioned air delivery unit, a voice detection unit, a voice input analysis unit, a determination unit, and a control unit. The conditioned air delivery unit delivers conditioned air to a target space. The voice detection unit detects voice emitted by a speaker present in the target space. The voice analysis unit analyzes the voice input and converts it into linguistic information. The determination unit determines whether or not a predetermined anger term is included in the linguistic information analyzed by the voice input analysis unit. The control unit controls the state of the conditioned air when the determination unit determines that an anger term is included.

[0054] In the air conditioning system of the 19th aspect, if the linguistic information analyzed by the voice input analysis unit contains a specified angry term, the state of the conditioned air is controlled, making it possible to keep the speaker calm.

[0055] The air conditioning system of the 20th aspect is the air conditioning system of the 19th aspect, in which, when the control unit determines that an angry term is included, it controls the state of the conditioned air based on the angry term and the volume of the voice spoken by the speaker.

[0056] In the air conditioning system according to the twentieth aspect, the state of the conditioned air is controlled taking into consideration not only anger terms but also the volume of the speaker's voice, thereby enabling more accurate control according to the speaker's anger.

[0057] An air conditioning system according to a twenty-first aspect is the air conditioning system according to the twentieth aspect, further comprising an anger classification storage unit that stores an anger term and a volume, and an anger classification in association with each other. With such a configuration, it is possible to realize an air conditioning system that can be controlled according to the anger classification.

[0058] An air conditioning system according to a twenty-second aspect is the air conditioning system according to any one of the nineteenth to twenty-first aspects, further comprising a position identification unit that identifies the position of the speaker. When it is determined that an anger term is included, the control unit controls the state of the conditioned air according to the position of the speaker.

[0059] In the air conditioning system according to the twenty-second aspect, the conditioned air can be accurately controlled according to the position of the speaker. For example, an air conditioning system capable of fine control can be provided by mood classification.

[0060] The air conditioning system of the 23rd aspect is an air conditioning system of any of the 19th to 22nd aspects, further comprising an audio output unit that outputs a voice of a sentence to reduce anger when it is determined that anger terms are included.

[0061] In the air conditioning system according to the twenty-third aspect, a sentence for reducing anger is output by voice in addition to controlling the conditioned air, so that the effect of calming the speaker can be enhanced.

[0062] An air conditioning system according to a twenty-fourth aspect is an air conditioning system according to any one of the nineteenth to twenty-third aspects, comprising an air conditioning apparatus and an information processing device capable of communicating with the air conditioning apparatus via a network. The air conditioning apparatus has the conditioned air delivery unit, the voice detection unit, and the control unit. The information processing device has the voice input analysis unit and the determination unit.

[0063] In the air conditioning system according to the twenty-fourth aspect, the above-mentioned configuration allows the system to be constructed using an information processing device on a network. Specifically, by using an information processing device that realizes a neural network or the like constructed on a network, voice analysis can be performed with high accuracy. As a result, the analysis accuracy of voice input can be improved, and the reliability of the system can be improved.

[0064] [Fourth configuration] An indoor environment conditioning system according to a twenty-fifth aspect includes a memory unit, a detection unit, an indoor environment conditioner, an output unit, and an input unit. The memory unit stores a set value of the indoor environment. The detection unit detects a state value of the indoor environment. The indoor environment conditioner adjusts the indoor environment according to the set value. When the state value detected by the detection unit reaches the set value, the output unit issues a message asking a user whether or not to accept the state value. The input unit acquires the user's response to the message.

[0065] According to this configuration, the user can feed back his / her preference to the indoor environment control system via the input unit as to whether to accept the environment in which the set temperature is realized or to further change the indoor temperature, thereby improving the user's satisfaction with the indoor environment control.

[0066] An indoor environment control system according to a 26th aspect is the indoor environment control system according to the 25th aspect, further comprising a control unit. The control unit repeats the steps of changing the set value, controlling the indoor environment control device so that the state value detected by the detection unit reaches the set value, and causing the output unit to issue a message asking the user whether or not to accept the state value detected by the detection unit, until the latest state value is accepted by the user.

[0067] According to this configuration, the indoor environment control system repeats adjusting the indoor environment and asking the user questions until consent is obtained from the user, thereby further improving the user's satisfaction with the indoor environment control.

[0068] An indoor environment control system according to a twenty-seventh aspect is the indoor environment control system according to the twenty-fifth or twenty-sixth aspect, in which the indoor environment control device is an air conditioner, the set value is a set temperature, and the state value is an indoor temperature.

[0069] According to this configuration, the indoor environment regulator is an air conditioner, which improves the user's satisfaction with the indoor temperature.

[0070] An indoor environment control system according to a twenty-eighth aspect is the indoor environment control system according to the twenty-fifth or twenty-sixth aspect, in which the indoor environment control device is a humidifier, the set value is a set humidity, and the state value is indoor humidity.

[0071] According to this configuration, the indoor environment conditioner is a humidifier, which improves the user's satisfaction with the indoor humidity.

[0072] An indoor environment control system according to a twenty-ninth aspect is the indoor environment control system according to the twenty-fifth or twenty-sixth aspect, in which the indoor environment controller is a lighting fixture, the set value is a set illuminance, and the state value is indoor illuminance.

[0073] According to this configuration, the indoor environment controller is a lighting fixture, which improves the user's satisfaction with the indoor illuminance.

[0074] An indoor environment control system according to a 30th aspect is the indoor environment control system according to any one of the 25th to 29th aspects, wherein the input unit is a voice input unit that acquires voice data from a user's voice. The indoor environment control system further comprises a text extraction unit that extracts text from the voice data, and an interpretation unit that interprets the text to extract a user command.

[0075] According to this configuration, the input unit receives the user's voice, so the user can issue commands to the indoor environment control system by voice, making operation simple.

[0076] An indoor environment control system according to a thirty-first aspect is the indoor environment control system according to the thirtieth aspect, in which at least one of the text extraction unit and the interpretation unit is connected to the indoor environment control device via a network.

[0077] According to this configuration, at least one of the text extraction unit and the interpretation unit is installed at a location remote from the indoor environment control device, so that the indoor environment control device does not need to bear a high processing capacity.

[0078] An indoor environment control system according to a thirty-second aspect is the indoor environment control system according to the thirtieth or thirty-first aspect, further comprising a user identification unit that extracts a voiceprint from the voice data and identifies a plurality of users based on the voiceprint. The storage unit stores each user in association with a setting value record for each user. The indoor environment control system treats the setting value record corresponding to the user identified by the user identification unit as a setting value.

[0079] According to this configuration, the user identification unit identifies the user from the voiceprint, and therefore the optimal setting value for each user can be reflected in the indoor environment.

[0080] An indoor environment control system according to a thirty-third aspect is an indoor environment control system according to a thirty-second aspect, in which the setting value record stored in the memory unit is updated based on consent from a user identified by the user identification unit.

[0081] According to this configuration, each of the multiple users can update the setting values ​​to suit himself / herself, thereby further improving the satisfaction of each user.

[0082] [Fifth configuration] An air conditioning management system according to a thirty-fourth aspect includes an air conditioner, a voice input unit, a state extraction unit, a determination unit, and a control unit. The voice input unit acquires voice uttered by a user. The state extraction unit extracts the user's state from the voice. The determination unit determines whether or not to perform energy-saving operation based on the user's state. The control unit performs energy-saving operation in accordance with the decision of the determination unit.

[0083] According to this configuration, the determination unit automatically determines whether or not to perform energy saving operation, thereby reducing the burden of decision-making on the user.

[0084] An air conditioning management system according to a thirty-fifth aspect includes an air conditioner, an image input unit, a state extraction unit, a determination unit, and a control unit. The image input unit acquires an image or video of a user. The state extraction unit extracts the user's state from the image or video. The determination unit determines whether or not to perform energy saving operation based on the user's state. The control unit performs energy saving operation in accordance with the decision of the determination unit.

[0085] According to this configuration, the determination unit automatically determines whether or not to perform energy saving operation, thereby reducing the burden of decision-making on the user.

[0086] An air conditioning control system according to a thirty-sixth aspect is the air conditioning control system according to the thirty-fourth aspect, wherein the state is an emotion of the user derived from voice. A determination unit determines to perform an energy saving operation when the emotion is positive, and not to perform the energy saving operation when the emotion is negative.

[0087] According to this configuration, the energy saving operation is not performed when a user who has negative emotions is present, and therefore the operation is performed with consideration given to the user who has negative emotions.

[0088] An air conditioning control system according to a 37th aspect is the air conditioning control system according to the 35th aspect, wherein the state is an emotion of the user derived from an image or a video, and the determination unit determines to perform an energy saving operation when the emotion is positive, and not to perform the energy saving operation when the emotion is negative.

[0089] According to this configuration, the energy saving operation is not performed when a user who has negative emotions is present, and therefore the operation is performed with consideration given to the user who has negative emotions.

[0090] An air conditioning management system according to a thirty-eighth aspect is the air conditioning management system according to the thirty-fourth aspect to the thirty-seventh aspect, in which the energy saving operation includes reducing the capacity of the air conditioner.

[0091] According to this configuration, the capacity of the air conditioner is reduced during energy saving operation, and therefore the power consumption of the air conditioner is reduced.

[0092] An air conditioning control system according to a thirty-ninth aspect is the air conditioning control system according to the thirty-fourth to thirty-seventh aspects, wherein the energy saving operation includes responding with approval to a request for reduction from an electric power company.

[0093] According to this configuration, the energy saving operation includes a consent response to a suppression request from the power company. Therefore, consent or refusal is automatically determined based on the user's state, reducing the burden on the user.

[0094] [6th configuration] A home system according to a fortieth aspect includes an input unit, a clock unit, a recording unit, a control unit, and a pattern extraction unit. The input unit receives a user's command. The clock unit obtains the time. The recording unit records a log associating the time and the command. The control unit controls a plurality of devices according to the command. The pattern extraction unit analyzes the log to extract a sequential command pattern including a plurality of commands issued to a plurality of devices within a predetermined time difference.

[0095] This configuration provides a characteristic sequential command pattern, allowing the home system to grasp a control pattern that is likely to be comfortable for the user.

[0096] A home system according to a forty-first aspect is the home system according to the fortieth aspect, further comprising a prediction unit that predicts a command that the user is likely to issue, based on the extracted sequential command pattern.

[0097] According to this configuration, the prediction unit predicts the next device control that the user is likely to perform based on the sequential command pattern, and the home system can therefore ascertain the next control that is likely to be comfortable for the user.

[0098] A home system according to a forty-second aspect is the home system according to the forty-first aspect, further comprising an output unit that outputs a message. The control unit causes the output unit to issue a message notifying the user of a command that the user is likely to issue based on the prediction.

[0099] According to this configuration, the message output unit notifies the user of the device control that the user is likely to prefer to perform next, thereby preventing the user from forgetting to perform a device operation that will bring comfort to the user.

[0100] A home system according to a forty-third aspect is the home system according to the forty-first aspect, wherein the control unit causes at least one of the plurality of appliances to execute a command that the user is likely to issue based on a prediction.

[0101] According to this configuration, the message output unit notifies the user of the device control that the user is likely to prefer to perform next, thereby preventing the user from forgetting to perform a device operation that will bring comfort to the user.

[0102] A home system according to a 44th aspect is a home system according to any one of the 40th to 43rd aspects, wherein the input unit is a voice input unit that acquires voice data from a user's voice. The home system further includes a text extraction unit that extracts text from the voice data, and an interpretation unit that interprets the text to extract a user command.

[0103] This configuration allows the user to issue commands by voice, making it easier for the user to operate the home system.

[0104] A home system according to a forty-fifth aspect is a home system according to any one of the fortieth aspect to the forty-fourth aspect, in which the plurality of devices includes an air conditioner.

[0105] According to this configuration, the home system controls the air conditioner, and therefore the home system can achieve a temperature and the like that the user finds comfortable.

[0106] [Seventh configuration] A device control system according to a forty-sixth aspect controls a first device and a second device. The first device has a first voice input unit and transmits voice data of a voice received by the first voice input unit. The second device has a second voice input unit and transmits voice data of a voice received by the second voice input unit. The device control system includes a first voice data receiving unit, a second voice data receiving unit, a first voice analysis unit, a second voice analysis unit, a detection unit, and a stop determination unit. The first voice data receiving unit receives the voice data transmitted by the first device. The second voice data receiving unit receives the voice data transmitted by the second device. The first voice analysis unit analyzes the voice data received by the first voice data receiving unit. The second voice analysis unit analyzes the voice data received by the second voice data receiving unit. The detection unit detects that the first device has received an instruction to stop a first function which is at least a part of functions related to voice recognition processing, in which a first voice input unit receives voice, transmits voice data of the received voice, a first voice data receiving unit receives the transmitted voice data, and has a first voice analysis unit analyze the received voice data. When the detection unit detects that the first device has received the instruction to stop the first function, the stop determination unit decides to stop, for the second device, at least a part of a second function which is at least a part of functions related to voice recognition processing, in which a second voice input unit receives voice, transmits voice data of the received voice, a second voice data receiving unit receives the transmitted voice data, and has a second voice analysis unit analyze the received voice data.

[0107] In this device control system, when a first device receives an instruction to stop a first function, which is at least a part of the functions related to the voice recognition processing, a second function, which is at least a part of the functions related to the voice recognition processing of a second device, is stopped. In other words, in this device control system, when a user stops the voice recognition processing of a first device, the voice recognition processing of a second device is also stopped. Therefore, by using this device control system, it is possible to save the trouble of stopping the execution of the voice recognition processing of each of the multiple devices, and to stop the voice recognition processing of the multiple devices with a simple operation.

[0108] A device control system according to a 47th aspect is the device control system according to the 46th aspect, wherein the second function is a function of receiving voice from a second voice input unit, or a function of transmitting voice data from the second device.

[0109] In this case, since audio data is not transmitted from the second device, it is easy to prevent problems such as privacy issues and interception of audio data that may occur when audio data is transmitted.

[0110] A device control system according to a 48th aspect is the device control system according to the 47th aspect, further comprising a stop request unit. The stop request unit transmits a signal to the second device requesting that the second function be stopped in response to a decision of the stop decision unit.

[0111] Here, since the second device is instructed directly to stop the second function in the second device, the reliability of stopping the voice recognition process for the second device is high.

[0112] A device control system according to a 49th aspect is a device control system according to the 46th aspect, wherein the second function is a function of a second voice data receiving unit receiving voice data transmitted by the second device, a function of a second voice analysis unit analyzing the voice data transmitted by the second device, or a function of storing the voice data transmitted by the second device.

[0113] Here, the voice recognition process for the second device can be stopped only by the process on the device control system side.

[0114] A device control system according to a fiftieth aspect is the device control system according to any one of the forty-sixth to forty-ninth aspects, in which the second function is the same type of function as the first function.

[0115] Here, when a function related to the voice recognition process of the first device is stopped, the same type of function related to the voice recognition process of the second device can be stopped, so that both the first device and the second device can be brought into a state desired by the user with respect to the voice recognition process.

[0116] A device control system according to a fifty-first aspect is the device control system according to any one of the forty-sixth to fifty-first aspects, further comprising an alarm unit for notifying that the second function has been stopped. Preferably, the device control system further comprises a stop information transmission unit. When the stop decision unit decides to stop the second function, the stop information transmission unit transmits function stop information to the second device so that the alarm unit notifies that the second function has been stopped.

[0117] Here, when the user stops the voice recognition process for the first device, the user can confirm that the voice recognition process has also been stopped for the second device.

[0118] A device control system according to a 52nd aspect is a device control system according to any one of the 46th to 51st aspects, further comprising a determination unit that determines devices associated with the first device. The stop determination unit determines to stop the second function of the second device when the detection unit detects that the first device has received an instruction to stop the first function and the devices that the determination unit determines to be associated with the first device include the second device.

[0119] Here, the voice recognition process for the first device can be stopped at the same time as the voice recognition process for the second device related to the first device. In other words, if it is determined that the first device and the second device are not related to each other, the voice recognition process for the second device can remain active even if the voice recognition process for the first device is stopped.

[0120] A device control system according to a 53rd aspect is a device control system according to any one of the 46th aspect to the 52nd aspect, in which the instruction to stop the first function received by the first device includes any one of an instruction to a physical switch, an instruction by a remote controller, or an audio instruction to a first audio input unit.

[0121] A device control system according to a 54th aspect is a device control system according to any one of the 46th to 53rd aspects, wherein the detection unit further detects that the first device has received an instruction to start the first function. Preferably, the device control system further includes a start determination unit. When the detection unit detects that the first device has received an instruction to start the first function, the start determination unit determines that the second device will start the second function.

[0122] Here, when the first device receives an instruction to start (resume) a first function related to the voice recognition processing, the second function related to the voice recognition processing for the second device is also started (resume). In other words, in this device control system, the user can enable the voice recognition processing for the second device by enabling the voice recognition processing for the first device. Therefore, by using this device control system, it is possible to save the trouble of enabling the execution of the voice recognition processing for each of the multiple devices, and to start the voice recognition processing for the multiple devices with a simple operation.

[0123] A device according to a fifty-fifth aspect is a voice-operable device. The device includes a voice input unit, a voice data transmission unit, an instruction receiving unit, and a stop information receiving unit. The voice input unit receives voice. The voice data transmission unit transmits the voice received by the voice input unit as voice data to a device control system having a voice analysis unit. The instruction receiving unit receives an instruction to stop at least a part of functions related to voice recognition processing, in which the voice input unit receives voice, the voice data transmission unit transmits voice data, and the transmitted voice data is analyzed by a voice analysis unit of the device control system. The stop information receiving unit receives function stop information transmitted from the device control system, regarding a decision to stop at least a part of functions related to voice recognition processing of the device in response to the stop of at least a part of functions related to voice recognition processing of another voice-operable device.

[0124] In this device, the voice recognition process can be stopped for the device in response to a user's instruction, and the voice recognition process for the device can be stopped in conjunction with the stopping of the voice recognition process for other devices. Therefore, by using this device, the effort of stopping the voice recognition process for multiple devices individually can be eliminated, and the voice recognition process for multiple devices can be stopped with a simple operation.

[0125] A fifty-sixth aspect of the present invention relates to the device according to the fifty-fifth aspect, wherein the instruction receiving unit is a physical switch.

[0126] In this device, functions related to voice recognition processing are stopped by a physical switch, so that the voice recognition processing can be stopped reliably.

[0127] A control method according to a fifty-seventh aspect is a control method for a first device and a second device. The first device has a first voice input unit and a first voice data transmission unit. The first voice data transmission unit transmits first voice data of a voice accepted by the first voice input unit to a device control system. The device control system has a first voice data reception unit that accepts the first voice data, and a first voice analysis unit that analyzes the first voice data accepted by the first voice data reception unit. The second device has a second voice input unit and a second voice data transmission unit. The second voice data transmission unit transmits second voice data of a voice accepted by the second voice input unit to the device control system. The device control system further has a second voice data reception unit that accepts the second voice data, and a second voice analysis unit that analyzes the second voice data accepted by the second voice data reception unit. The control method includes a detection step and a determination step. In the detection step, it is detected that the first device has received an instruction to stop at least a first function that is a part of functions related to speech recognition processing, in which a first speech input unit receives a first speech, a first speech data transmission unit transmits the first speech data, a first speech data reception unit receives the transmitted first speech data, and a first speech analysis unit analyzes the received first speech data. In the determination step, when it is detected that the first device has received the instruction to stop the first function, it is determined that for the second device, at least a second function that is a part of functions related to speech recognition processing is stopped, in which a second speech input unit receives a second speech, a second speech data transmission unit transmits the second speech data, a second speech data reception unit receives the transmitted second speech data, and a second speech analysis unit analyzes the received second speech data.

[0128] In this control method, when it is detected that the first device has received an instruction to stop at least a first function related to the voice recognition processing, it is determined that the second device also stops at least a second function related to the voice recognition processing. Therefore, by using this control method, it is possible to eliminate the trouble of stopping the execution of the voice recognition processing of each of the multiple devices, and to stop the voice recognition processing of the multiple devices with a simple operation. [Brief description of the drawings]

[0129] [First configuration] [Figure 1] FIG. 2 is a schematic diagram showing the configuration of a device control system 1001 according to a first embodiment of a first configuration. [Diagram 2] FIG. 1 is a schematic diagram showing the configuration of a device control system 1001 according to the embodiment. [Diagram 3] 11 is a schematic diagram showing the configuration of a server 1100 according to the embodiment. [Figure 4A] 10 is a sequence diagram for explaining the operation of the device control system 1001 according to the embodiment. FIG. [Figure 4B] 10 is a sequence diagram for explaining the operation of the device control system 1001 according to the embodiment. FIG. [Diagram 5] FIG. 1 is a schematic diagram showing the configuration of a device control system 1001 according to the embodiment. [Figure 6] 14 is a schematic diagram showing the configuration of a setting assistance device 1400 according to the embodiment. [Figure 7] 13 is a flowchart for explaining the operation of the setting assistance device 1400 according to the embodiment. [Figure 8] 13 is a schematic diagram showing a concept of screen transition in the setting support device 1400 according to the embodiment. FIG. [Figure 9] 13 is a schematic diagram showing a concept of screen transition in the setting support device 1400 according to the embodiment. FIG. [Figure 10] 13 is a schematic diagram showing a concept of screen transition in the setting support device 1400 according to the embodiment. FIG. [Figure 11] 13 is a schematic diagram showing a concept of screen transition in the setting support device 1400 according to the embodiment. FIG. [Figure 12] 13 is a schematic diagram showing a concept of screen transition in the setting support device 1400 according to the embodiment. FIG. [Figure 13] 13 is a schematic diagram showing a concept of screen transition in the setting support device 1400 according to the embodiment. FIG. [Figure 14] 13 is a schematic diagram showing a concept of screen transition in the setting support device 1400 according to the embodiment. FIG. [Figure 15] 13 is a schematic diagram showing a concept of screen transition in the setting support device 1400 according to the embodiment. FIG. [Figure 16] 13 is a schematic diagram for explaining a modified example of the setting assistance device according to the embodiment. FIG.

[0130] [Second configuration] [Figure 17] FIG. 20 is a schematic diagram of an environmental conditioning system 2090 according to one embodiment in a second configuration. [Figure 18] FIG. 20 is a block diagram of the configuration of an environmental conditioning system 2090. [Figure 19] FIG. 20 is a detailed block diagram of the reference environmental control device 2062. [Figure 20] FIG. 20 is a functional block diagram of an environmental conditioning system 2090. [Figure 21] 2 is an example of an environmental state stored in the memory unit 2017. [Figure 22] FIG. 2 is a diagram showing a target space TS in which an environmental state is reproduced. [Diagram 23] FIG. 2 is a schematic diagram of an environmental conditioning system 2090A according to a first modified example. [Figure 24] FIG. 11 is a schematic diagram of an environmental conditioning system 2090B according to a second modified example.

[0131] [Third configuration] [Diagram 25] FIG. 3 is a schematic diagram showing the concept of an air conditioning system 3001 according to an embodiment of a third configuration. [Figure 26] 13 is a schematic diagram showing the configurations of an information processing unit 3020P and a server 100 according to the embodiment. FIG. [Figure 27] 13 is a schematic diagram showing the configuration of an anger classification DB3104D according to the embodiment. FIG. [Figure 28A] FIG. 3 is a sequence diagram for explaining the operation of the air conditioning system 3001 according to the embodiment. [Figure 28B] FIG. 3 is a sequence diagram for explaining the operation of the air conditioning system 3001 according to the embodiment. [Figure 29] 13 is a schematic diagram showing the configuration of an information processing unit 3020P according to Modification A. FIG. [Diagram 30] 13 is a schematic diagram showing a configuration of an information processing unit 3020P according to Modification B. FIG. [Diagram 31] FIG. 13 is a schematic diagram showing the concept of an air conditioning system 3001 according to Modification D. [Diagram 32] FIG. 13 is a schematic diagram showing the concept of an air conditioning system 3001 according to Modification E.

[0132] [Fourth configuration] [Diagram 33] FIG. 4 is a schematic diagram of an indoor environment control system 4090 according to an embodiment of a fourth configuration. [Diagram 34] FIG. 4 is a block diagram of the configuration of an indoor environment control system 4090. [Diagram 35] FIG. 4 is a detailed block diagram of an air conditioner 4062. [Diagram 36] FIG. 40 is a functional block diagram of an indoor environment control system 4090. [Figure 37] 13 is a flowchart showing a fine adjustment routine. [Figure 38] FIG. 4 is a schematic diagram of an indoor environment control system 4090A according to a first modified example. [Figure 39] FIG. 4 is a schematic diagram of an indoor environment control system 4090B according to a second modified example.

[0133] [Fifth configuration] [Diagram 40] FIG. 13 is a schematic diagram of an air conditioning management system 5090 according to a fifth configuration. [Diagram 41] FIG. 13 is a block diagram showing a configuration of an air conditioning management system 5090 according to a fifth configuration. [Diagram 42] FIG. 13 is a functional block diagram of an air conditioning management system 5090 according to a fifth configuration.

[0134] [Sixth configuration] [Diagram 43] FIG. 6 is a schematic diagram of a home system 6090 according to an embodiment of a sixth configuration. [Diagram 44] FIG. 6 is a block diagram of the configuration of a home system 6090. [Diagram 45] FIG. 6 is a functional block diagram of a home system 6090. [Figure 46] 11 is a table illustrating an example of a log. [Figure 47] FIG. 6 is a schematic diagram of a home system 6090A according to a first modified example of the present invention. [Figure 48] FIG. 11 is a functional block diagram of a home system 6090B according to a second modified example of the present invention.

[0135] [Seventh configuration] [Figure 49] FIG. 23 is a schematic block diagram of a device control system and devices controlled by the device control system according to an embodiment of a seventh configuration. [Figure 50] 4 is a sequence diagram for explaining the operation of the first device and the device control system when voice is input to a voice input unit of the first device. FIG. [Figure 51] 10 is a sequence diagram for explaining the operation of the second device and the device control system when voice is input to a voice input unit of the second device. FIG. [Figure 52] FIG. 11 is a sequence diagram illustrating the operation of the device and the device control system when the first device receives an instruction to stop a voice reception function by a voice input unit, which is an example of a first function of voice recognition processing. [Diagram 53] This is a sequence diagram that explains the operation of the device and the device control system when the first device receives an instruction to stop the reception function by the voice data reception unit of the voice data transmitted by the voice data transmission unit of the first device, which is an example of the first function of voice recognition processing. [Figure 54] FIG. 11 is a sequence diagram illustrating the operation of the device and the device control system when the first device receives an instruction to start (resume) a voice reception function by a voice input unit, which is an example of a first function of voice recognition processing. [Figure 55]This is a sequence diagram that explains the operation of the device and the device control system when the first device receives an instruction to start (resume) the reception function by the voice data reception unit of the first device of voice data transmitted by the voice data transmission unit, which is an example of the first function of voice recognition processing. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0136] [First configuration] (1) Overview of Device Control System 1001 (1-1) Configuration of device control system 1001 1 and 2 are schematic diagrams showing the configuration of a device control system 1001 according to one embodiment of the present invention.

[0137] The device control system 1001 includes a voice input device 1060, an infrared output device 1070, and a server 1100. In the device control system 1001, a user 1005 can control a specific control device by inputting a control instruction to the voice input device 1060. Here, there are a "first type device 1010" and a "second type device 1020" as control devices. It is assumed that these control devices are placed in a room R.

[0138] 1 and 2, one voice input device 1060, one infrared output device 1070, and one server 1100 are shown, but the number of each device is not limited to this. The server 1100 can be connected to any number of devices and manage these devices.

[0139] The first type of device 1010 can be controlled by an infrared output signal. For example, the first type of device 1010 includes an electric fan 1010a, a lighting device 1010b, a television 1010c, and an air conditioner 1010d. In addition, a pattern of an infrared output signal is set in advance for each control device, and the control device 1010 can be controlled by using this pattern. Here, the correspondence between the pattern of the infrared output signal and the control content is stored in an infrared pattern DB 1104A described later. In the following description, the reference symbol 1010 is used to indicate any first type device, and a lowercase English subscript is added to indicate an individual first type device.

[0140] The second type devices 1020 can be directly controlled by the server 1100 via the network NW. Like the first type devices 1010, the second type devices 1020 include an electric fan 1020a, a lighting device 1020b, a television 1020c, and an air conditioner 1020d. In the following description, the reference symbol 1020 is used to indicate any second type device, and a lowercase English subscript is added to indicate an individual second type device.

[0141] The voice input device 1060 receives input of control instructions for predetermined control devices 1010, 1020. Here, the voice input device 1060 has a microphone, and receives control instructions for the control devices 1010, 1020 from the user 1005 by voice input via this microphone. Then, the voice input device 1060 transmits voice information corresponding to the received voice input to the server 1100. Note that when the voice input device 1060 detects a voice uttered by the user 1005, it transmits the voice information as it is to the server 1100.

[0142] The infrared output device 1070 outputs infrared rays to the control device (first type device) 1010. The infrared output device 1070 has an attitude control mechanism 1070A, and when relative position information described later is received from the server 1100, the attitude of the infrared output device 1070 is controlled based on the relative position information. The infrared output device 1070 can be attached inside a fixed device 1020F whose position is fixed in a predetermined space (room R). The fixed device 1020F is, for example, an air conditioner, a lighting fixture, a television, etc., and is attached and fixed to the ceiling or wall of the room R. Alternatively, the fixed device 1020F may be embedded and fixed in the ceiling or wall of the room R.

[0143] As shown in FIG. 3, the server 1100 has an input unit 1101, an output unit 1102, a communication unit 1103, a memory unit 1104, and a processing unit 1105, and is connected to an audio input device 1060 and an infrared output device 1070 via a network NW such as the Internet.

[0144] Here, the input unit 1101 is realized by an arbitrary input device and inputs various information to the server 1100. The output unit 1102 is realized by an arbitrary output device and outputs various information from the server 1100. The communication unit 1103 connects to an external network NW and enables information communication.

[0145] The storage unit 1104 is realized by a ROM, a RAM, etc., and stores information input to the server 1100 and information calculated by the server 1100. The storage unit 1104 stores an "infrared pattern database (DB) 1104A," a "relative position database (DB) 1104B," and a "specific control database (DB) 1104T."

[0146] The infrared pattern DB 1104A stores the correspondence between the pattern of an infrared output signal and a predetermined control content for each control device (the first type device 1010).

[0147] The relative position DB 1104B stores "relative position information" indicating the relative positional relationship between the infrared output device 1070 and the control device (first type device 1010) in a predetermined space (room R). When the infrared output device 1070 is fixed to the fixed device 1020F, it is also possible to use information indicating the relative positional relationship between the position of the fixed device 1020F and the position of the first type device 1010 as the relative position information, instead of information indicating the relative positional relationship between the position of the infrared output device 1070 and the position of the first type device 1010.

[0148] The specific control DB 1104T stores "specific controls" in which a voice input corresponding to a specific keyword is associated with a specific control of a control device. The specific controls are set by the setting assistance device 1400, which will be described later.

[0149] The processing unit 1105 is realized by a CPU or the like, and executes information processing in the server 1100. Here, the processing unit 1105 executes a program stored in the storage unit 1104, thereby functioning as a "voice input analysis unit 1110," a "control content identification unit 1120," a "first control unit 1130," and a "second control unit 1135."

[0150] The voice input analysis unit 1110 analyzes the contents of the input received from the voice input device 1060. Specifically, the voice input device 1060 uses a neural network or the like to analyze the meaning corresponding to the voice from the voice information and convert it into text information.

[0151] The control content identification unit 1120 identifies the control content indicating the control device and the control instruction from the analysis result by the voice input analysis unit 1110. For example, when the voice input device 1060 accepts a voice input, the control content identification unit 1120 determines whether or not the text information converted by the voice input analysis unit 1110 contains language information corresponding to the control device and the control instruction, and identifies the control content.

[0152] Here, when the control content identifying unit 1120 identifies the control device as the first type device 1010, it sends the control content corresponding to the control device to the first control unit 1130. On the other hand, when the control content identifying unit 1120 identifies the control device as the second type device 1020, it sends the control content corresponding to the control device to the second control unit 1135.

[0153] When the control content for the first type device 1010 is identified by the control content identification unit 1120, the first control unit 1130 transmits an infrared pattern corresponding to the control content to the infrared output device 1070. More specifically, the first control unit 1130 transmits an infrared output command to the infrared output device 1070 based on the control content identified by the control content identification unit 1120 and the information stored in the infrared pattern DB 1104A. As a result, the first type device 1010 is controlled via the infrared output device 1070. Furthermore, the first control unit 1130 transmits relative position information of the infrared output device 1070 and the target first type device 1010 to the infrared output device 1070 together with the infrared output command. The relative position information is extracted from the relative position DB 1104B.

[0154] When the control content specifying unit 1120 specifies the control content related to the second type device 1020, the second control unit 1135 controls the second type device 1020 via the network NW based on the control content.

[0155] (1-2) Operation of the device control system 1001 4A and 4B are sequence diagrams for explaining the operation of the device control system 1001 according to this embodiment.

[0156] First, the user 1005 uses the voice input device 1060 to input voice to the control devices 1010 and 1020 (S1). Then, the voice input device 1060 transmits input information corresponding to the received voice input to the server 1100 (S2).

[0157] Subsequently, server 1100 receives the input information (S3) and analyzes the contents of the voice input (S4). Next, server 1100 identifies control devices 1010, 1020 and control contents indicating control instructions for control devices 1010, 1020 (S5).

[0158] Here, if the server 1100 determines that the control content is related to the first type device 1010 (S6-Yes), it extracts infrared pattern information from the infrared pattern DB 1104A based on the control content (S7). Furthermore, the server 1100 extracts relative position information between the first type device 1010 and the infrared output device 70 (or the fixed device 1020F) from the relative position DB 1104B (S8). Then, the server 1100 transmits the infrared pattern information and the relative position information to the infrared output device 1070 together with an infrared output command (S9).

[0159] Next, when the infrared output device 1070 receives the infrared pattern information and the relative position information together with the infrared output command (S10), it changes its attitude toward the corresponding control device 1010 based on the relative position information (S11). Then, the infrared output device 1070 outputs infrared rays toward the control device (first type device) 1010 based on the received infrared pattern information (S12).

[0160] On the other hand, in parallel with the above step S6, if the server 1100 determines that the control content is related to a second type device 1020 (S13-Yes), it controls the control device (second type device) 1020 via the network NW based on the control content (S14).

[0161] In the above steps S6 and S13, if the server 1100 cannot identify that the control content is related to the first type device 1010 and the second type device 1020, it ends the process (S6-No, S13-No).

[0162] The processing of steps S6 to S9 and the processing of steps S13 and S14 can be performed in any order, and either one can be performed first.

[0163] (1-3) Features As described above, the device control system 1001 according to this embodiment includes a voice input device 1060, an infrared output device 1070, and a server 1100. Here, the voice input device 1060 accepts a control instruction for the control devices 1010 and 1020 from the user 1005 by voice input. The infrared output device 1070 outputs infrared rays to the control devices 1010 and 1020. The server 1100 includes a voice input analysis unit 1110, a control content identification unit 1120, a first control unit 1130, and a second control unit 1135. The voice input analysis unit 1110 analyzes the content of the input received from the voice input device 1060. The control content identification unit 1120 identifies the control device and the control content indicating the control instruction from the analysis result by the voice input analysis unit 1110. When the control content identifying unit 1120 identifies the control content related to the first type device 1010, the first control unit 1130 transmits an infrared pattern corresponding to the control content to the infrared output device 1070. When the control content identifying unit 1120 identifies the control content related to the second type device 1020, the second control unit 1135 controls the second type device 1020 via the network NW based on the control content.

[0164] Therefore, the device control system 1001 according to this embodiment can control a first type device 1010 that can be controlled by outputting an infrared pattern, and a second type device 1020 that can be controlled via the network NW.

[0165] Furthermore, in the device control system 1001S according to this embodiment, the server 1100 on the network NW can transmit an infrared output command to the infrared output device 1070S based on the analysis result of the voice input. Here, when trying to control a device by voice input, the amount of information processing may become enormous. Even in such a case, the device control system 1001S can perform voice analysis with high accuracy by using the server 1100 that realizes a neural network or the like built on the network NW. This makes it possible to specify the control device 1010 and the control instruction in detail even with voice input. As a result, it is possible to provide a device control system 1001 that can easily control any device.

[0166] In the device control system 1001 according to this embodiment, the server 1100 on the network NW has an infrared pattern DB 1104A, and stores the correspondence between the pattern of the infrared output signal and the predetermined control content for each controlled device. This allows the pattern of the infrared output signal to be changed, updated, added, etc., all at once. However, in the device control system 1001 according to this embodiment, the information of the infrared pattern DB 1104A may be stored in the storage unit of each infrared output device 1070, not in the server 1100.

[0167] (2) Details of the setting support device (2-1) Configuration of the setting support device 5, the setting assistance device 1400 is a device that connects to the above-mentioned device control system 1001 via a network NW and assists in setting to facilitate control of the control devices 1010, 1020. Specifically, the setting assistance device 1400 is a device for assisting in associating a voice input corresponding to a predetermined keyword K with a predetermined control of the control device and setting it as a "specific control." The setting assistance device 1400 is realized by installing a "setting assistance program" described later on a computer.

[0168] Here, as shown in FIG. 6, the setting support device 1400 has an input unit 1401, an output unit 1402, a communication unit 1403, a storage unit 1404, and a processing unit 1405, and is connected to the server 1100 via a network NW such as the Internet. The input unit 1401 is realized by a keyboard, a microphone, etc., and inputs various information to the setting support device 1400. The output unit 1402 is realized by a display, etc., and outputs various information from the setting support device 1400. The communication unit 1403 connects to an external network NW and enables information communication. The storage unit 1404 is realized by a ROM, a RAM, etc., and stores information input to the setting support device 1400 and information calculated by the setting support device 1400. The processing unit 1405 is realized by a CPU, etc., and executes information processing in the setting support device 1400. Here, the processing unit 1405 executes the “setting assistance program P” stored in the memory unit 1404, thereby functioning as a “keyword input receiving unit 1410”, a “control command selecting unit 1420”, and a “specific control registering unit 1430”.

[0169] The keyword input receiving unit 1410 receives a voice input corresponding to a predetermined keyword K. Specifically, the keyword input receiving unit 1410 displays a keyword image GK into which the keyword K can be input on the editing screen G, and receives character information of the keyword K via a keyboard or the like (see FIG. 8, etc., described later). The keyword input receiving unit 1410 may also receive a voice input corresponding to the keyword K via a microphone or the like.

[0170] The control command selection unit 1420 displays predetermined control commands O for the control devices 1010, 1020 on the editing screen G and accepts selection of the control command O (see FIG. 10 etc. described later). Specifically, the control command selection unit 1420 displays a control command image GO corresponding to the control command O on the editing screen G. For example, the control command selection unit 1420 displays a control command image GO displaying a plurality of control commands O1, O2, ... in a pull-down format on the editing screen G. Then, when an arbitrary control command O is designated from the plurality of control commands O1, O2, ... displayed in the pull-down format, the control command selection unit 1420 accepts selection of the designated control command O.

[0171] The specific control registration unit 1430 associates the keyword K input by the keyword input reception unit 1410 with the control command O selected by the control command selection unit 1420, and registers them as "specific controls" in the specific control DB 1104T of the server 1100. Specifically, the specific control registration unit 1430 associates the keyword K with the control command O by specifying and moving the keyword image GK and the control command image GO on the editing screen G. Furthermore, the specific control registration unit 1430 can associate not only one control command O1 with one keyword K, but also multiple control commands O1, O2, .... The specific control registration unit 1430 can associate the specific control with user information identifying the user 5 and register it in the specific control DB 1104T. Furthermore, the specific control registration unit 1430 can also associate the specific control with the voiceprint of the user 5 when the keyword is read out, and register it in the specific control DB 1104T.

[0172] (2-2) Operation of the Setting Support Device 1400 Fig. 7 is a flowchart for explaining the operation of the setting support device 1400 according to this embodiment. Figs. 8 to 15 are schematic diagrams showing the concept of screen transitions in the setting support device 1400 according to the embodiment.

[0173] First, the user 1005 uses the setting support device 1400 to register a keyword K for the control devices 1010, 1020 (T1). Specifically, the user 1005 inputs a display command via the input unit 1401, whereby a keyword image GK as shown in Fig. 8 is displayed on the editing screen G. Then, the keyword K can be input into the blank portion of the keyword image GK. Here, as an example, the words "heat the bath" are input as the keyword K as shown in Fig. 9.

[0174] Next, the user 5 uses the input unit 1401 to select a control command image GO1 displayed on the editing screen G. Here, a plurality of control commands O1, O2, ... are displayed in a pull-down format on the editing screen G. Then, as shown in FIG. 10, the user 1005 operates a pointer P displayed on the editing screen G to select an arbitrary control command O from the plurality of control commands O1, O2, ... (T2). In FIG. 10, it is assumed that O1 (here, corresponding to "fill the tub with hot water") has been selected. As a result, as shown in FIG. 11, a control command image GO1 corresponding to the selected control command is displayed.

[0175] Next, as shown in Fig. 12, the user 1005 operates the pointer P to move the control command image GO1 close to the keyword image GK. This causes a tentative association between the keyword image GK and the selected control command image GO1 (T4). Specifically, as shown in Fig. 13, when the keyword image GK and the control command image GO1 approach each other, a line L connecting the two is displayed to indicate that a tentative association has been made. In the same manner, a tentative association between the keyword image GK and another control command image GO2 is made (T5-No, T6). This causes a transition to a screen as shown in Fig. 14.

[0176] 15, when the user 5 presses a registration button image GT or the like on the editing screen G, the keyword K corresponding to the keyword image GK and the multiple control commands O1, O2, ... corresponding to the control command images GO1, GO2 are associated as a "specific control" (T5-Yes). Then, information on this specific control is registered in the specific control DB 1104T of the server 1100 (T7).

[0177] (2-3) Features (2-3-1) As described above, the setting support device 1400 of this embodiment is a device for supporting the setting of specific controls in a device control system 1001 that includes a voice input device 1060 that accepts voice input uttered by a user, a voice input analysis unit 1110 that analyzes the voice, control units 1130, 1135 that control control devices 1010, 1020 based on the analysis results by the voice input analysis unit 1110, and a specific control DB 1104T that associates voice input corresponding to a specified keyword K with a specified control of the control devices 1010, 1020 and stores it as a specific control.

[0178] Here, the setting support device 1400 includes a keyword input receiving unit 1410, a control command selection unit 1420, and a specific control registration unit 1430. The keyword input receiving unit 1410 receives input of information corresponding to a keyword. The control command selection unit 1420 displays a predetermined control command for the control devices 1010, 1020 on an editing screen G, and receives a selection of a control command. The specific control registration unit 1430 associates the keyword K input by the keyword input receiving unit 1410 with the control command selected by the control command selection unit 1420, and registers them in the specific control DB 1104T.

[0179] Therefore, in the setting support device 1400 according to this embodiment, since the keyword K corresponding to the voice input can be associated with the control command for the control devices 1010, 1020 on the editing screen G, the user 1005 can easily set the control command in the device control system 1001 that controls the control devices 1010, 1020 by voice input. As a result, the convenience for the user 1005 can be improved in the device control system 1001 that controls the control devices 1010, 1020 by voice input.

[0180] (2-3-2) Furthermore, in the setting assistance device 1400 according to this embodiment, the specific control registration unit 1430 can associate a plurality of control commands O1, O2, ... with one keyword K. This makes it possible to execute a series of controls consisting of a plurality of operations by voice input of one keyword K.

[0181] (2-3-3) Furthermore, in the setting support device 1400 according to this embodiment, the control command selection unit 1420 can display a plurality of control commands in a pull-down format on the editing screen G. This makes it possible to provide the setting support device 1400 that allows the user 5 to set a control command by an intuitive operation.

[0182] Furthermore, in the setting support device 1400 according to this embodiment, the keyword input receiving unit 1410 displays a keyword image GK into which a keyword can be input on the editing screen G. Furthermore, the control command selecting unit 1420 displays a control command image GO corresponding to a control command on the editing screen G. Furthermore, the specific control registering unit 1430 associates the keyword K with a control command by specifying and moving the keyword image GK and the control command image GO on the editing screen G. This makes it possible to provide the setting support device 1400 that allows the user 1005 to set a control command by an intuitive operation.

[0183] (2-3-4) Furthermore, in the setting assistance device 1400 according to this embodiment, the specific control registration unit 1430 registers the specific control in association with user information, thereby making it possible to set control commands that match the preferences of each user.

[0184] Furthermore, in the setting assistance device 1400 according to this embodiment, the specific control registration unit 1430 registers the keyword K in association with the voiceprint when the keyword K is read out. This allows the setting of a control command that can be controlled only by the user 1005 whose voiceprint has been registered.

[0185] (2-4) Modifications (2-4-1) In the above description, the setting support device 1400 functions as the "keyword input receiving unit 1410", the "control command selecting unit 1420", and the "specific control registering unit 1430", but these functions may be provided by the server 1100 at appropriate times. That is, as shown in the concept of FIG. 16, the setting support device 1400 may be a so-called thin client. In this case, the setting support device 1400 accesses the server of the setting support function providing device 1200B via the network NW every time the setting support device 1400 performs a process of associating a specific keyword with a specific control and registering it as a "specific control", and uses the functions of the "keyword input receiving unit", "control command selecting unit", and "specific control registering unit" provided by the setting support function providing device 1200B. The setting support function providing device 1200B may be configured as the same device as the server 1100, or the two may be configured to cooperate with each other.

[0186] With this configuration, the user 5 starts the association process (V1) by using the voice input device 1060 (microphone) or the like, and can register a keyword on the editing screen G (V2). When the user 1005 sets the association on the editing screen G (V3), the setting support device 1400 registers the setting contents and ends the process (V4).

[0187] (2-4-2) Note that the server 1100 according to this embodiment can register the control of the control devices 1010, 1020, which is determined for each time, as "schedule information." In this case, at the time, the control corresponding to the schedule information is executed in the control devices 1010, 1020. For example, at the time, a voice is read out based on the schedule information and input to the voice input device 1060. Alternatively, instead of the voice input, text information or the like corresponding to the voice input is input to the voice input device 1060 to control the control devices 1010, 1020.

[0188] <Additional Notes> The present invention is not limited to the above-described embodiments as they are. In the implementation stage, the components of the present invention can be modified without departing from the gist of the present invention. In addition, the present invention can be formed into various inventions by appropriately combining the multiple components disclosed in the above-described embodiments. For example, some components may be deleted from all the components shown in the embodiments. Furthermore, the components may be appropriately combined in different embodiments.

[0189] [Second configuration] (1) Overall structure 17 shows a device control system according to an embodiment. The device control system of this embodiment is configured as an environmental control system 2090. The environmental control system 2090 includes a router 2061, a reference environmental control device 2062, an audio input / output device 2063, and a reference environmental sensor 2069 installed in a building 2060, and a server 2040. The reference environmental control device 2062, the audio input / output device 2063, the reference environmental sensor 2069, and the server 2040 are connected by a network 2050.

[0190] (1-1) Standard environmental control equipment 2062 The reference environment control device 2062 is a device that changes the stimulation of the human five senses through the environment. The reference environment control device 2062 includes, for example, an air conditioner, an electric fan, a humidifier, an electric window, a lighting device, a curtain device, an electric aroma pot, and the like. The reference environment control device 2062 shown in Fig. 17 is configured as an air conditioner. The reference environment control device 2062 is installed in the reference space RS.

[0191] The reference environmental control device 2062 is connected to the network 2050 via a router 2061 having a switching hub. The link between the router 2061 and the reference environmental control device 2062 may be realized by either wired communication or wireless communication.

[0192] (1-2) Audio input / output device 63 The audio input / output device 2063 is installed in the reference space RS, similar to the reference environment control device 2062. The audio input / output device 2063 is connected to the network 2050 via a router 2061. The audio input / output device 2063 is provided with an audio input unit 2064 and an audio output unit 2065. The link between the router 2061 and the audio input / output device 2063 may be realized by either wired communication or wireless communication.

[0193] As an input means to the reference environment control device 2062, in addition to the audio input / output device 2063, a wired remote control, an infrared remote control, a wireless remote control, or the like may also be used.

[0194] (1-3) Reference Environment Sensor 2069 The reference environment sensor 2069 measures a physical quantity related to the environment of the reference space RS. The measured physical quantity is, for example, temperature or humidity. The reference environment sensor 2069 is connected to the network 2050 via the router 2061. The link between the router 2061 and the reference environment sensor 2069 may be realized by either wired communication or wireless communication.

[0195] The reference environment sensor 2069 is not an essential component, and does not necessarily have to be installed in the building 2060 .

[0196] (1-4) Network 2050 The network 2050 is, for example, the Internet constructed using the PSTN (Public Switched Telephone Network) or the like.

[0197] (1-5) Server 2040 The server 2040 is installed in a location remote from the building 2060 and is connected to the network 2050. The server 2040 controls the reference environmental control device 2062 in response to a voice generated by a user of the reference environmental control device 2062. The server 2040 may be configured as a single computer, or may be configured from multiple computers 2040a, 2040b each having different functions. For example, one computer 2040a may be in charge of analyzing the voice and extracting commands, and another computer 2040b may be in charge of controlling the reference environmental control device 2062 and detecting anomalies. In this case, the multiple computers 2040a, 2040b may be installed in locations remote from each other and owned or managed by different companies.

[0198] (2) Detailed configuration FIG. 18 is a block diagram of an environmental control system 2090 configuration.

[0199] (2-1) Standard environmental control equipment 2062 The reference environment control device 2062 configured as an air conditioner has an input / output interface unit 2621, a processor 2622, and a refrigerant circuit 2623. The input / output interface unit 2621 is connected to the network 2050 via the router 2061, and exchanges information with other devices. The refrigerant circuit 2623 includes sensors and actuators, and conditions the air in the room. The processor 2622 controls the actuators of the reference environment control device 2062, reads the outputs of the sensors, and exchanges information with the input / output interface unit 2621.

[0200] 19 is a detailed block diagram of the reference environment control device 2062. The reference environment control device 2062 includes an outdoor unit 2070 and an indoor unit 2080. The input / output interface unit 2621 is mounted on the indoor unit 2080. The processor 2622 includes an outdoor unit control unit 2079 mounted on the outdoor unit 2070, and an indoor unit control unit 2089 mounted on the indoor unit 2080. The refrigerant circuit 2623 includes a compressor 2071, a four-way switching valve 2072, an outdoor heat exchanger 2073, an outdoor expansion valve 2075, a gas stop valve 2077, and a liquid stop valve 2078 mounted on the outdoor unit 2070, and an indoor heat exchanger 2081 mounted on the indoor unit 2080. The outdoor unit control unit 2079 controls the compressor 2071, the four-way switching valve 2072, the fan 2074, and the outdoor expansion valve 2075, and reads detection values ​​of various sensors (not shown) mounted in the outdoor unit 2070. The indoor unit control unit 2089 controls the fan 2082, and reads detection values ​​of various sensors mounted in the indoor unit 2080, including a room temperature sensor 2083 that detects the room temperature.

[0201] (2-2) Audio input / output device 2063 18, the audio input / output device 2063 has an input / output interface unit 2631, an audio input unit 2064, and an audio output unit 2065. The input / output interface unit 2621 is connected to the network 2050 via a router 2061, and exchanges information with other devices.

[0202] The audio input unit 2064 has a microphone 2641, an amplifier 2642, and an AD converter 2643. The microphone 2641 acquires an analog audio signal. The amplifier 2642 amplifies the acquired analog audio signal. The AD converter 2643 performs AD conversion on the amplified analog audio signal, and sends the acquired audio data SD to the input / output interface 2631.

[0203] The audio output unit 2065 has a DA converter 2653, an amplifier 2652, and a speaker 2651. The DA converter 2653 performs DA conversion on the output data OD received from the input / output interface unit 2631, and sends the resulting analog output signal to the amplifier 2652. The amplifier 2652 amplifies the analog output signal. The speaker 2651 produces sound corresponding to the amplified analog output signal.

[0204] (2-3) Reference Environment Sensor 2069 Although not shown in detail in FIG. 18, the reference environment sensor 2069 performs AD conversion on the measured physical quantity relating to the environment and transmits it to the router 2061 as digital data.

[0205] (2-4) Server 2040 The server 2040 includes computers 2040a and 2040b. The server 2040 may include any number of computers. Here, only the configuration of the computer 2040a will be described. The computer 2040a includes an input / output interface unit 2041, a processor 2042, and a memory 2043. The input / output interface unit 2041 is connected to a network 2050. The processor 2042 performs various processes. The processes include sending and receiving information via the input / output interface unit 2041, and various arithmetic operations. The memory 2043 stores information by a write operation of the processor 2042, etc.

[0206] (3) Functional Blocks 20 is a functional block diagram of an environment control system 2090. In addition to a voice input unit 2064 and a voice output unit 2065, the environment control system 2090 has a plurality of functional blocks, namely, a text conversion unit 2011, a voice recognition dictionary 2012, an interpretation unit 2013, a control unit 2014, a device information acquisition unit 2016, a storage unit 2017, a calculation unit 2018, and an authentication unit 2019.

[0207] The functional blocks 2011 to 2019 may be configured as software such as a program stored in memory 2043 of the computers 2040a and 2040b of the server 2040 and executed by the processor 2042. Alternatively, the functional blocks 2011 to 2019 may themselves be configured as hardware such as an integrated circuit or a hard drive. The functional blocks 2011 to 2019 may be physically installed in the computers 2040a and 2040b, the audio input / output device 2063, the reference environment control device 2062, or other locations.

[0208] (4) Basic operation (4-1) Voice Control The reference space RS is, for example, the user's home. The user realizes his / her preferred environment via the voice input unit 2064 of the voice input / output device 2063. For example, the user gives commands such as "Turn down the temperature a little more," "Turn up the airflow," and "Turn down the humidity" to the voice input unit 2064 by voice.

[0209] The user's voice is converted into voice data SD of a digital signal by the AD converter 2643 in Fig. 18. The voice data SD arrives at the server 2040 via, for example, a network 2050. A text conversion unit 2011 in Fig. 20 converts the voice data SD into text by referring to a voice recognition dictionary 2012. An interpretation unit 2013 interprets the text and extracts a command CM intended by the user. That is, the text conversion unit 2011 and the interpretation unit 2013 function as a command extraction unit that extracts a command from voice.

[0210] The control unit 2014 sends the output data OD to the audio output unit 2065, and causes the speaker 2651 to emit an audio message such as "The temperature will be lowered a little." The control unit 2014 sends a control signal to the reference environmental control device 2062 configured as an air conditioner, and controls the reference environmental control device 2062 to lower the current control parameter, i.e., the value of the set temperature, by a predetermined amount.

[0211] Reference environment control devices 2062 other than air conditioners can also be controlled in the same manner. For example, in the case where a reference environment control device 2062 configured as a lighting fixture compatible with the environment control system 2090 is installed in the reference space RS, when the user issues a voice command to the voice input unit 2064 such as "Make it brighter," the control unit 2014 increases the illuminance of the lighting fixture.

[0212] (4-2) User authentication The environmental control system 2090 has a user authentication function so that only authorized users can control the reference environmental control device 2062. Various methods of user authentication can be adopted.

[0213] For example, the authentication unit 2019 may receive voice data SD generated from a voice commanding the operation of the reference environmental control device 2062, and identify the user through voiceprint analysis, thereby allowing the control unit 2014 to execute only the commands of a specific user.

[0214] Alternatively, after the environmental control system 2090 is instructed to operate the reference environmental control device 2062, the control unit 2014 may cause the audio output unit 2065 to emit a message requesting the user to recite a password. When the interpretation unit 2013 detects that the correct password has been recited, the control unit 2014 can control the reference environmental control device 2062 as desired by the user.

[0215] (5) Environment reproduction operation (5-1) Environmental conservation in reference space RS When a user who is a resident of the reference space RS feels that the environment in his or her home is comfortable, the user can have the environmental condition saved in the environmental conditioning system 2090. First, the user issues a command to the voice input unit 2064 saying, "Save the current indoor environment in my favorites."

[0216] In response to a user's command, the device information acquisition unit 2016 acquires device information and control parameters of the reference environment adjustment device 2062. The control parameters include universally understood parameters such as "set temperature 26°C" and parameters that follow a model-specific definition such as "gentle breeze mode." Furthermore, the device information acquisition unit 2016 acquires the detection value of the reference environment sensor 2069.

[0217] Next, the calculation unit 18 calculates the environmental state from the acquired control parameters. Fig. 21 shows an example of the environmental state. In principle, each item of the environmental state is expressed in a universally used physical unit. The calculation unit 2018 converts the model-specific control parameters into amounts expressed in physical units with reference to the device information.

[0218] The environmental state is stored in the storage unit 2017 in association with the authenticated user.

[0219] (5-2) Environmental reproduction in the target space TS 22 shows a target space TS. The target space TS is a place other than the reference space RS, such as a hotel room, where a plurality of target environment control devices 2091-2097 are installed. The target environment control devices 2091-2097 are connected to the server 2040 via the network 2050, similar to the reference environment control device 2062 installed in the reference space RS. An authenticated user can issue commands related to the operation of the target environment control devices 2091-2097 via the audio input / output device 2063. The target environment control devices 2091-2097 are, for example, an air conditioner 2091, an electric fan 2092, a humidifier 2093, an electric window 2094, a lighting device 2095, a curtain device 2096, and an electric aroma pot 2097. Other aroma emitting devices may be used instead of the electric aroma pot 2097. As an input means to the plurality of target environmental control devices 2091 to 2097, in addition to the voice input / output device 2063, a wired remote control, an infrared remote control, a wireless remote control, or the like may be used in combination.

[0220] Furthermore, a target environment sensor 2099 may be installed in the target space TS. The target environment sensor 2099 measures a physical quantity related to the environment of the target space TS. The measured physical quantity is, for example, temperature or humidity. The target environment sensor 2099 is also connected to the server 2040 via the network 2050.

[0221] The user can command the environmental control system 2090 to reproduce an environment in the target space TS that is close to the environment of the reference space RS. First, the user commands the voice input unit, "Reproduce my favorite environment." In response to the user's command, the device information acquisition unit 2016 acquires device information of the target environmental control devices 2091-2097 installed in the target space TS. Next, the control unit 2014 calls up the stored environmental state. Next, the control unit 2014 requests the calculation unit 2018 to calculate control parameters that are closest to the called-up environmental state, using the target environmental control devices 2091-2097 in the target space TS.

[0222] For example, in order to realize the air volume included in the environmental state, the air conditioner 2091 and the electric fan 2092 are available. Therefore, the calculation unit 2018 calculates an appropriate balance of airflow by opening and closing the air conditioner 2091, the electric fan 2092, and the electric window 2094. If the environmental state includes the humidity item but the air conditioner 2091 installed in the target space TS does not have a humidity control function, the calculation unit 2018 attempts to realize the humidity item of the environmental state by appropriately determining the control parameters of the humidifier 2093. For the illuminance item, the calculation unit 2018 attempts to realize it by the control parameters of the lighting fixture 2095 and the curtain fixture 2096. For the odor item, the calculation unit 2018 checks whether the electric aroma pot 2097 is available or not.

[0223] Finally, the control unit 2014 controls the target environment adjustment devices 2091-2097 based on the control parameters calculated by the calculation unit 2018. In this process, the control unit 2014 may perform feedback control using the detection value of the target environment sensor 2099. In this way, an environment close to the environment of the reference space RS is reproduced in the target space TS.

[0224] (5-3) Environmental conservation in the target space TS If the user feels that the environment of the target space TS is comfortable, the user can have the environmental state stored in the storage unit 2017 of the environmental adjustment system 2090. The method for storing the environmental state is similar to that for storing the environment of the reference space RS.

[0225] (6) Features (6-1) The environmental state stored in the storage unit 2017 is reproduced as the environment of the target space TS by control based on the control parameters, so that an environment that suits the user's preferences can be reproduced.

[0226] (6-2) An environmental state is created based on the environment of the reference space RS, and the environmental state is reproduced in the target space TS. Therefore, the environment of the reference space RS can be reproduced in the target space TS.

[0227] (6-3) When a command to reproduce the environmental state is received, the control unit 2014 controls the target environmental adjustment devices 2091 to 2097 in accordance with the environmental state. Therefore, the user's preferred environment is reproduced according to the command issued by the user.

[0228] (6-4) A user can control an environmental control device only if he or she is authenticated as an authorized user. Therefore, unauthorized persons cannot control the environmental control device, which makes it easier to ensure security.

[0229] (6-5) The environmental conditioning devices in both the reference space RS and the target space TS include air conditioners, so that air conditioning that affects the comfort of the user is reproduced in the target space TS.

[0230] (6-6) The environmental state stored in the storage unit 17 can be updated using the environment of the target space TS. Therefore, if the user likes the environment of the target space TS, the settings related to that environment can be saved.

[0231] (6-7) According to this configuration, the environmental conditions can include temperature, airflow, humidity, illuminance, and odor, and thus the user's preferred environment is reproduced in the target space TS.

[0232] (7) Variations (7-1) First Modification 23 shows an environmental control system 2090A according to a first modified example of the above embodiment. The environmental control system 2090A does not have an audio input / output device 2063, and differs from the above embodiment in that an audio input unit 2064 and an audio output unit 2065 are installed in a reference environmental control device 2062.

[0233] In this configuration, the environmental control system 2090 requires less installation space because the audio input / output device 2063 is not present.

[0234] (7-2) Second Modification FIG. 24 shows an environment conditioning system 2090B according to a second modified example of the above embodiment. In the environment conditioning system 2090B, a mobile terminal 2067 is used instead of the voice input / output device 2063 to receive commands from a user and to send messages to the user. The mobile terminal 2067 is, for example, a smartphone equipped with a dedicated application. The reference environment conditioning device 2062 is provided with an antenna 2066 for communication with the mobile terminal 2067. The antenna 2066 may be built into the reference environment conditioning device 2062. Alternatively, the antenna 2066 may be configured as an external adapter and connected to the reference environment conditioning device 2062 by wiring.

[0235] According to this configuration, it is not necessary to install a user interface terminal such as the audio input / output device 2063 in each location such as the reference space RS and the target space TS, so that the cost of the environmental control system 2090B can be reduced.

[0236] (7-3) Third Modification The input means to the reference environmental control device 62 and the target environmental control devices 2091 to 2097 is not limited to the audio input / output device 2063 or the mobile terminal 2067, and may be any mode. For example, the input means may be a wired remote control, an infrared remote control, a wireless remote control, a camera capable of image recognition, a portable BLE beacon tag or RFID tag, various sensors such as a capacitance sensor, and the like.

[0237] [Third configuration] (1) Configuration of Air Conditioning System 3001 25 is a schematic diagram showing the concept of a device control system according to an embodiment. The device control system according to the present embodiment is configured as an air conditioning system 3001.

[0238] The air conditioning system 3001 includes an air conditioner 3020 (air conditioning device) and a server 3100 capable of communicating with the air conditioner 3020 via a network NW. For ease of explanation, Fig. 25 shows a state in which one air conditioner 3020 is connected to the server 3100, but the server 3100 can be connected to any number of air conditioners 3020. In the following explanation, the symbol 3005 is used to indicate any user, and a lowercase English subscript is added to indicate an individual user.

[0239] (1-1) Air conditioner 3020 The air conditioner 3020 uses internal mechanisms such as a compressor, a heat exchanger, an expansion valve, a fan, louvers, etc. to generate and blow out conditioned air of a predetermined condition into a target space. The internal mechanisms of the air conditioner 3020 are controlled by a built-in information processing unit 3020P.

[0240] It should be noted that the "condition of the conditioned air" refers to any one or any combination of the temperature, air volume, and air direction of the conditioned air.

[0241] As shown in FIG. 26, the information processing unit 3020P has an input section 3021, an output section 3022, a communication section 3023, a storage section 3024, and a processing section 3025, and is connected to an external server 3100 via a network NW such as the Internet.

[0242] The input unit 3021 inputs various information to the information processing unit 3020P. For example, the input unit 3021 can be configured with a general remote control, and the user 3005 can input various commands to the air conditioner 3020 via such a remote control. The input unit 3021 may also have various sensors, and values ​​detected by the sensors are sent to the processing unit 3025 as input information. Here, the input unit 3021 includes a microphone, and the voice uttered by the user 3005 is input to the air conditioner 3020 via such a microphone. The input voice is analyzed by the processing unit 3025, which will be described later, and voice information including the frequency and volume of the voice is acquired.

[0243] The output unit 3022 is realized by a speaker or the like, and outputs various information from the information processing unit 3020P. The communication unit 3023 connects to an external network NW to enable information communication. The storage unit 3024 is realized by a RAM, a ROM, or the like, and stores information input to the information processing unit 3020P, information calculated by the information processing unit 3020P, and the like.

[0244] The processing unit 3025 is realized by a CPU or the like, and executes information processing in the information processing unit 3020P. Here, the processing unit 3025 executes a program stored in the storage unit 3024, thereby functioning as a "conditioned air delivery unit 3025A," a "sound detection unit 3025B," and a "specific control unit 3025C."

[0245] The conditioned air delivery unit 3025A controls the internal mechanism of the air conditioner 3020 in order to generate conditioned air in a predetermined state and blow it out in a predetermined direction. Specifically, the conditioned air delivery unit 3025A controls the internal mechanism of the air conditioner 3010 in response to commands from the user 3005 input via the input unit 3021 (such as a remote control).

[0246] The voice detection unit 3025B detects, via the input unit 3021 (microphone), a voice made by the user 3005 present in the space (room R) in which the air conditioner 3020 is placed. In addition, the voice detection unit 3025B acquires voice information including the frequency and volume of the voice of the user 3005. Upon acquiring the voice information, the voice detection unit 3025B transmits the voice information to the server 3100 via the communication unit 3023.

[0247] When the air conditioner 3020 enters a specific state, the specific control unit 3025C controls the internal mechanism of the air conditioner 3020 under the control condition corresponding to the specific state. This changes or maintains the state of the conditioned air. Here, a control condition of "angry mode" is set in advance for the specific state that "there is an angry person" in the surrounding environment of the air conditioner 3020. Then, when the specific control unit 3025C receives a control command corresponding to the "angry mode" from the server 100 described later, it controls the internal mechanism of the air conditioner 3020 under the control condition of the "angry mode."

[0248] (1-2) Server 3100 As shown in FIG. 26, the server 3100 has an input unit 3101, an output unit 3102, a communication unit 3103, a memory unit 3104, and a processing unit 3105, and is connected to an information processing unit 3020P built into the air conditioner 3020 via a network NW such as the Internet.

[0249] Here, the input unit 3101 inputs various information to the server 3100. The output unit 3102 outputs various information from the server 3100. The communication unit 3103 connects to an external network NW and enables information communication.

[0250] The storage unit 3104 is realized by a ROM, a RAM, etc., and stores information input to the server 3100 and information calculated by the server 3100. Here, the storage unit 3104 stores the "anger classification DB104D".

[0251] As shown in FIG. 27, the anger classification DB3104D stores an anger term W, a volume, and an anger classification in association with each other. For example, the anger classification DB3104D stores an anger term W of "Don't mess with me" in association with an anger classification of "violent fight" (anger classification 1) when the volume is "loud". The anger classification DB3104D also stores a control command of a predetermined control content in association with the anger classification of "violent fight" (anger classification 1). Specifically, the anger classification DB3104D stores a control command for executing a control a of "lowering temperature", a control b of "lowering humidity", and a control c of "increasing airflow" for the anger classification of "violent fight". The anger classification DB3104D also stores an anger term W of "idiot" in association with an anger classification of "light fight" (anger classification 3) when the volume is "low". Furthermore, the anger classification DB 3104D stores a control command for executing control c of "increasing the airflow" for the anger classification of "light quarrel" (anger classification 3).

[0252] The processing unit 3105 is realized by a CPU or the like, and executes information processing in the server 3100. Here, the processing unit 3105 executes a program stored in the storage unit 3104, thereby functioning as a "voice input analysis unit 3110" and a "state determination unit (determination unit) 3125."

[0253] The voice input analysis unit 3110 analyzes the voice input and converts it into text information (language information). Here, when voice information corresponding to the voice input is received from the air conditioner 3020, the meaning of the voice is analyzed from the voice information and converted into text information. This converted text information is sent to the state determination unit 3125. The voice input analysis unit 3110 is realized by a neural network or the like.

[0254] The state determination unit 3125 determines whether the air conditioner 3020 is in a specific state. Here, the state determination unit 3125 determines whether or not there is an "angry person" in the surrounding environment of the air conditioner 3020 as the specific state. Specifically, the state determination unit 3125 collates the information stored in the anger classification DB 3104D with the text information analyzed by the voice input analysis unit 3110, and determines whether or not a predetermined "anger term W" is included in the text information. When the state determination unit 3125 determines that the anger term W is included, it determines that there is an "angry person" in the surrounding environment of the air conditioner 3020, and sets the air conditioner 3020 to an "anger mode". Then, the state determination unit 3125 extracts a control command corresponding to the anger mode from the anger classification DB 3104D, and transmits the extracted control command to the information processing unit 3020P of the air conditioner 3020.

[0255] (2) Operation of air conditioning system 3001 28A and 4B are sequence diagrams for explaining the operation of the air conditioning system 3001 according to this embodiment.

[0256] When multiple users 3005a, 3005b start talking in a room R in which an air conditioner 3020 is placed, the air conditioner 3020 detects the voices of the users 3005a, 3005b talking via a microphone or the like (S1). Then, the air conditioner 3020 transmits voice information of the conversation between the users 3005a, 3005b to the server 3100 in a timely manner (S2).

[0257] When the server 3100 receives voice information from the air conditioner 3020, it converts the voice information into text information (S3, S4). Here, when the user 3005a and the user 3005b get into an argument, the conversation may contain an anger term W. The server 3100 compares the analyzed text information with the information stored in the anger classification DB 3104D each time, and determines at any time whether the text information contains an anger term W or not (S5).

[0258] Then, when the server 3100 determines that the conversation between the users 3005a and 3005b contains an anger term W, it sets the air conditioner 3020 to an "anger mode." Specifically, the server 3100 determines an anger classification based on the anger term W contained in the conversation and the volume of the conversation (S5-Yes, S6). Then, the server 3100 transmits a control command based on the determined anger classification to the air conditioner 3020 (S7).

[0259] Next, the air conditioner 3020 receives a control command from the server 3100 and changes the conditioned air control state to the conditioned air mode (S8, S9). After that, the air conditioner 3020 controls the conditioned air in the conditioned air mode until a predetermined time has elapsed (S10).

[0260] The above steps S2 to S10 are then continued until the voices of the users 3005a and 3005b talking are no longer detected (S11-Yes, S2). On the other hand, if the voices of the users 3005a and 3005b talking are no longer detected, the control by the anger mode is released and the control state of the conditioned air is returned to the state before the voices were detected (S11-No, S12).

[0261] (3) Features (3-1) As described above, the air conditioning system 3001 according to this embodiment includes a conditioned air delivery unit 3025A, a voice detection unit 3025B, a voice input analysis unit 3110, a state determination unit (determination unit) 3125, and a specific control unit (control unit) 3025C. The conditioned air delivery unit 3025A delivers conditioned air to the target space (room R). The voice detection unit 3025B acquires voice information corresponding to the voices emitted by the users (speakers) 3005a and 3005b present in the target space (room R). The voice input analysis unit 3110 analyzes the voice input and converts it into language information. The state determination unit 3125 determines whether or not a predetermined anger term W is included in the language information analyzed by the voice input analysis unit 3110. The specific control unit 3025C controls the state of the conditioned air when the state determination unit 3125 determines that the anger term W is included.

[0262] Therefore, in the air conditioning system 3001 of this embodiment, if the language information analyzed by the voice input analysis unit 3110 contains a predetermined anger term W, the state of the conditioned air is controlled, making it possible to keep users 3005a, 3005b calm.

[0263] To add, since anger is judged after analyzing linguistic information from the voice, the anger of users 3005a and 3005b can be judged with high accuracy. Furthermore, by changing the state of the conditioned air, it is possible to provide a distraction to users who have spoken words that are filled with anger (for example, people who are having a marital dispute). As a result, it is possible to provide an air conditioning system that can calm the speaker.

[0264] (3-2) The air conditioning system 3001 according to this embodiment includes an air conditioner 3020 and a server 3100 that can communicate with the air conditioner 3020 via a network NW. The air conditioner 3020 has a conditioned air sending unit 3025A, a voice detection unit 3025B, and a specific control unit 3025C. The server 3100 has a voice input analysis unit 3110 and a state determination unit 3125.

[0265] In short, in the air conditioning system 3001 according to this embodiment, the system is constructed using the server 3100 on the network NW. In this way, by configuring information processing to be executable on the network NW, it is possible to easily construct a neural network or the like. As a result, it is possible to improve the analysis accuracy of voice input, and to increase the reliability of the system.

[0266] (3-3) In addition, in the air conditioning system 3001 according to this embodiment, when the state determination unit 3125 determines that the anger term W is included, the specific control unit 3025C controls the state of the conditioned air based on the anger term W and the volume of the voice uttered by the users 3005a and 3005b (speakers). Supplementally, in the air conditioning system 3001 according to this embodiment, when the state determination unit 3125 determines that the voice information includes the anger term W, it sets the air conditioner 3020 to an anger mode. Then, the state determination unit extracts a control command corresponding to the anger classification from the anger classification DB 3104D based on the anger term W and the volume of the voice uttered by the users 3005a and 3005b, and transmits the control command to the air conditioner 3020. Then, the specific control unit 3025C of the air conditioner 3020 receives the control command and controls the state of the conditioned air based on the control command.

[0267] Therefore, in the air conditioning system 3001 of this embodiment, the state of the conditioned air is controlled taking into consideration not only the anger term W but also the volume of the voices uttered by the users 3005a, 3005b, thereby providing an air conditioning system 3001 that can more accurately control according to the speaker's anger.

[0268] (3-4) In addition, the air conditioning system 3001 according to this embodiment further includes an anger classification DB (anger classification storage unit) 3104D that stores the anger term W, the volume, and the anger classification in association with each other. With this configuration, it is possible to realize the air conditioning system 3001 that can be controlled according to the anger classification.

[0269] Supplementally, depending on the anger classification, a mild stimulus may amplify the anger of the user 3005. In such a case, it is desirable not to give more stimulus than necessary. On the other hand, depending on the anger classification, it may be better to give a positive stimulus to reduce the anger. In the air conditioning system 3001 according to this embodiment, the setting of the anger classification can be optimized at any time according to the situation.

[0270] (4) Variations (4-1) Variation A In the air conditioning system 3001 according to this embodiment, the processing unit 3025 of the air conditioner 3020 may function as a "position identification unit 3025D" that identifies the position of the user 3005 (speaker) as shown in Fig. 29. Specifically, the air conditioner 20 has various sensors as the input unit 3021, and the position identification unit 3025D calculates position information indicating the position of the user 3005 based on the detection values ​​of the sensors.

[0271] Furthermore, when the position of the user 3005 is identified, the specific control unit 3025C may control the state of the conditioned air according to the position of the user 3005. This makes it possible to accurately control the conditioned air according to the user's position.

[0272] Furthermore, the air conditioner 3020 may be configured to transmit position information indicating the position of the user 3005 to the server 3100. Here, the server 3100 stores the control contents reflecting the user's position information in association with the anger classification as the anger classification DB 3104D. Therefore, in such a configuration, the control contents reflecting the user's position information are extracted from the anger classification DB 3104D. Therefore, the specific control unit 3025C of the air conditioner 3020 can control the state of the conditioned air in an anger mode that takes into account the positions of the users 3005a and 3005b. This makes it possible to divert the attention of the users 3005a and 3005b by blowing a strong wind toward their faces. Also, for example, depending on the anger classification, it may be more effective to reduce the anger of a person with anger by blowing a light wind at their feet rather than blowing it on their face. Even in such a case, in the air conditioning system 3001 according to the present modified example A, the information stored in the anger classification DB 3104D can be updated to finely set the control of the conditioned air in the anger mode.

[0273] (4-2) Variation B In addition, in the air conditioning system 3001 according to this embodiment, the processing unit 3025 of the air conditioner 3020 may function as a "sentence output command unit 3025E" as shown in Fig. 30. Specifically, when the air conditioner 3020 is controlled in the anger mode, the sentence output command unit 3025E outputs a predetermined sentence for reducing anger by voice through the speaker of the output unit 3022. The predetermined sentence for reducing anger may be stored in the storage unit 3024 of the air conditioner 3020 or may be stored in the storage unit 3104 of the server 3100.

[0274] In addition, a predetermined sentence for reducing anger may be stored in the anger classification DB 3104D in association with the anger classification. The air conditioner 3020 may be configured to output this sentence by voice when it receives a control command for the anger mode. In such a configuration, the sentence output command unit 3025E outputs a voice corresponding to text information such as, for example, "It seems a little hot. We will temporarily lower the temperature" via the speaker of the output unit 3022. Depending on the level of anger, inoffensive words may be preferable.

[0275] In this way, according to the air conditioning system 3001 of Modification Example B, in addition to controlling the conditioned air, a sentence for reducing anger is output by voice, thereby enhancing the effect of calming the user 3005.

[0276] (4-3) Variation C Furthermore, the air conditioning system 3001 according to this embodiment can be set to notify (announce) the start and / or end of the anger mode in association with the anger classification. Depending on the level of anger, it may be preferable not to announce the start and / or end of the anger mode, since this may irritate the user 3005.

[0277] It is also possible to notify the administrator of the server 3100 that the anger mode has started. This allows the administrator of the server 3100 to identify an air conditioner in which the anger mode has been set among a plurality of air conditioners connected to the server 100. In other words, by being able to identify the location of an air conditioner in the anger mode, it is possible to identify the location where an "angry person" is present. As a result, it is possible to anticipate the location where a conflict will occur.

[0278] (4-4) Variation D Moreover, each function of the server 3100 described above may be distributed and executed in a plurality of servers. For example, the air conditioning system 3001 may be configured to include a first server 3100A and a second server 3200A instead of the server 3100, as shown in FIG. 31. Here, the first server 3100A has the function of the voice input analysis unit described above, and the second server 3200A has the other functions. In addition, when the air conditioner 3020 is controlled by voice input, a large amount of processing may be required to analyze the voice input. Even in such a case, the air conditioning system 3001 can perform voice analysis with high accuracy by using the first server 3100A that realizes a neural network or the like built on the network NW. On the other hand, the usability of the system can be improved by having the second server 3200A execute low-load processing other than the analysis of the voice input.

[0279] (4-5) Variation E In the above explanation, the air conditioner 3020 has a microphone as the input unit 3021, and the processing unit 3025 functions as the voice detection unit 3025B, but the air conditioning system 3001 according to this embodiment is not limited to this configuration.

[0280] 32, the air conditioning system 3001 may be configured such that the air conditioner 3020 does not have the above-mentioned configuration, but instead has a separate voice input device 3060. Here, the voice input device 3060 detects, via a microphone, the voice uttered by a user 3005 present in the space (room R) in which the air conditioner 3020 is placed. Then, when the voice input device 3060 detects the voice, it transmits the voice information to the server 3100.

[0281] (4-6) Variation F The air conditioning system 3001 according to this embodiment can also control the state of the conditioned air based on the amount of change such as an increase or decrease in the number of angry words, an increase or decrease in the volume of the voice, etc. For example, the air conditioning system 3001 may determine a situation in which angry words have decreased, the volume of the speaking voice has calmed down, etc., and return the control of the conditioned air to the original state.

[0282] (4-7) Variation G The air conditioning system 3001 according to this embodiment is not limited to the above, and is capable of controlling various types of conditioned air depending on the setting of the anger classification.

[0283] For example, when users 3005a and 3005b are having a marital dispute, the air conditioning system 3001 can determine which one is dominant (the one that is heating up) based on audio information, and change the airflow direction to face that person.

[0284] For example, if the air conditioning system 3001 recognizes that people are fighting (getting heated up), it can blow out ions or the like from the air conditioner 3020. Depending on the type of ions or the like, it is expected to have the effect of diverting the attention of the user 3005.

[0285] For example, when the air conditioning system 3001 detects an intense exchange of voices (loud volume), it lowers the temperature of the conditioned air. This is expected to have the effect of cooling the user 3005.

[0286] For example, when the air conditioning system 3001 detects that the users 3005a and 3005b are fighting in conjunction with a home network, it temporarily suspends all or some of the electrical appliances in the house. Then, the air conditioning system 3001 blows out hot air from the air conditioner 3020. This is expected to have the effect of raising a sense of danger to life. As a result, it is expected to have the effect of reconciling the fighting users 3005a and 3005b.

[0287] In short, the air conditioning system 3001 can determine the emotion of the user 3005 from the voice information according to the anger classification. In other words, it can read a person's emotion from their voice. The air conditioning system 3001 can divert the attention of the excited user 3005 by blowing cool air on him / her. However, depending on the anger classification, control other than blowing cool air is performed.

[0288] <Additional Notes> The present invention is not limited to the above-described embodiments as they are. In the implementation stage, the components of the present invention can be modified without departing from the gist of the present invention. In addition, the present invention can be formed into various inventions by appropriately combining the multiple components disclosed in the above-described embodiments. For example, some components may be deleted from all the components shown in the embodiments. Furthermore, the components may be appropriately combined in different embodiments.

[0289] [Fourth configuration] (1) Overall structure 33 shows a device control system according to one embodiment. The device control system of this embodiment is configured as an indoor environment control system 4090. The indoor environment control system 4090 includes a router 4061, an air conditioner 4062, and an audio input / output device 4063 installed in a building 4060, and a server 4040. The air conditioner 4062, the audio input / output device 4063, and the server 4040 are connected by a network 4050.

[0290] The router 4061 has a switching hub and is connected to the network 4050. The air conditioner 4062 is connected to the router 4061. The link between the router 4061 and the air conditioner 4062 may be realized by either wired communication or wireless communication.

[0291] The audio input / output device 4063, like the air conditioner 4062, is connected to the network 4050 via the router 4061. The audio input / output device 4063 is provided with an audio input unit 4064 and an audio output unit 4065. The link between the router 4061 and the audio input / output device 4063 may be realized by either wired communication or wireless communication.

[0292] The network 4050 is, for example, the Internet constructed using the PSTN (Public Switched Telephone Network) or the like.

[0293] The server 4040 is installed in a location remote from the building 4060 and is connected to the network 4050. The server 4040 controls the air conditioner 4062 in response to a voice generated by a user of the air conditioner 4062. The server 4040 may be configured as a single computer, or may be configured from multiple computers 4040a, 4040b each having different functions. For example, one computer 4040a may be in charge of analyzing the voice and executing commands, and another computer 4040b may be in charge of controlling the air conditioner 62 and detecting anomalies. In this case, the multiple computers 4040a, 4040b may be installed in locations remote from each other and owned or managed by different companies.

[0294] (2) Detailed configuration FIG. 34 is a block diagram of the configuration of an indoor environment control system 4090.

[0295] (2-1) Air conditioner 4062 The air conditioner 4062 has an input / output interface unit 4621, a processor 4622, and a refrigerant circuit 4623. The input / output interface unit 4621 is connected to the network 4050 via the router 4061, and exchanges information with other devices. The refrigerant circuit 4623 includes sensors and actuators, and conditions the air in the room. The processor 4622 controls the actuators of the air conditioner 4062, reads the outputs of the sensors, and exchanges information with the input / output interface unit 4621.

[0296] 35 is a detailed block diagram of the air conditioner 4062. The air conditioner 4062 includes an outdoor unit 4070 and an indoor unit 4080. The input / output interface unit 4621 is mounted on the indoor unit 4080. The processor 4622 includes an outdoor unit control unit 4079 mounted on the outdoor unit 4070, and an indoor unit control unit 4089 mounted on the indoor unit 4080. The refrigerant circuit 4623 includes a compressor 4071, a four-way switching valve 4072, an outdoor heat exchanger 4073, an outdoor expansion valve 4075, a gas stop valve 4077, and a liquid stop valve 4078 mounted on the outdoor unit 4070, and an indoor heat exchanger 4081 mounted on the indoor unit 4080. The outdoor unit control unit 4079 controls the compressor 4071, the four-way switching valve 4072, the fan 4074, and the outdoor expansion valve 4075, and reads detection values ​​of various sensors (not shown) mounted in the outdoor unit 4070. The indoor unit control unit 4089 controls the fan 4082, and reads detection values ​​of various sensors mounted in the indoor unit 4080, including a room temperature sensor 4083 that detects the room temperature.

[0297] (2-2) Audio I / O device 4063 Returning to FIG. 34, the audio input / output device 4063 has an input / output interface unit 4631, an audio input unit 4064, and an audio output unit 4065. The input / output interface unit 4621 is connected to the network 4050 via the router 4061, and exchanges information with other devices. The audio input unit 4064 has a microphone 4641, an amplifier 4642, and an AD converter 4643. The microphone 4641 acquires an analog audio signal. The amplifier amplifies the acquired analog audio signal. The AD converter 4643 performs AD conversion on the amplified analog audio signal, and sends the obtained audio data SD to the input / output interface 4631. The audio output unit 4065 has a DA converter 4653, an amplifier 4652, and a speaker 4651. The DA converter 4653 performs DA conversion on the output data OD received from the input / output interface unit 4631, and sends the obtained analog output signal to the amplifier 4652. The amplifier 4652 amplifies the analog output signal. The speaker 4651 produces sound in accordance with the amplified analog output signal.

[0298] (2-3) Server 4040 The server 4040 has computers 4040a and 4040b. The server 4040 may include any number of computers. Here, only the configuration of the computer 4040a will be described. The computer 4040a has an input / output interface unit 4041, a processor 4042, and a memory 4043. The input / output interface unit 4041 is connected to a network 4050. The processor 4042 performs various processes. The processes include sending and receiving information via the input / output interface unit 4041, and various arithmetic operations. The memory 4043 stores information by a write operation of the processor 4042, etc.

[0299] (3) Functional Blocks 36 is a functional block diagram of the indoor environment control system 4090. In addition to the voice input unit 4064 and the voice output unit 4065, the indoor environment control system 4090 has a number of functional blocks, namely, a text conversion unit 4011, a voice recognition dictionary 4012, an interpretation unit 4013, a control unit 4014, a storage unit 4017, and a user identification unit 4019.

[0300] The functional blocks 4011 to 4019 may be configured as software such as a program stored in memory 4043 of the computers 4040a and 4040b of the server 4040 and executed by the processor 4042. Alternatively, the functional blocks 4011 to 4019 may themselves be configured as hardware such as an integrated circuit or a hard drive. The functional blocks 4011 to 4019 may be physically mounted on the computers 4040a and 4040b, the audio input / output device 4063, the air conditioner 4062, or other locations. For example, at least a part of the control unit 4014 is configured as the processor 4622 of the air conditioner 4062.

[0301] (4) Basic operation (4-1) Voice Control A user instructs his / her air conditioner 4062 to perform an operation via the voice input unit 4064 of the voice input / output device 4063 in Fig. 34. For example, the user speaks commands such as "Turn on the air conditioner" or "Turn down the temperature a little more" into the voice input unit 4064.

[0302] The user's voice is converted into voice data SD of a digital signal by an AD converter 4643. The voice data SD is delivered to a server 4040 via a network 4050, for example. A text conversion unit 4011 in Fig. 36 converts the voice data SD into text by referring to a voice recognition dictionary 4012. An interpretation unit 4013 interprets the text and extracts the command CM intended by the user.

[0303] The control unit 4014 sends the output data OD to the audio output unit 4065, and causes the speaker 4651 in Fig. 34 to emit an audio message such as "The temperature will be lowered slightly." The control unit 4014 sends a control signal to the refrigerant circuit 4623 of the air conditioner 4062, and controls the air conditioner 4062 to lower the current control parameter, i.e., the set temperature value, by a predetermined temperature.

[0304] (4-2) User Identification The indoor environment control system 4090 has a function of identifying multiple users. For example, the user identification unit 4019 receives voice data SD generated from a voice commanding the operation of the air conditioner 4062, and identifies the user by voiceprint analysis. The storage unit 4017 stores records of preferred setting values ​​related to temperature and the like, which differ for each user, in association with each user. The preferred setting value records stored in the storage unit 4017 are called up as setting values ​​by the control unit 4014 in response to a command from the user corresponding to the setting, and are used to control actual state values ​​such as room temperature.

[0305] (5) Fine-tuning routines for comfort When the room temperature Tr, which is a state value detected by the room temperature sensor 4083, reaches the set temperature Ts, which is a set value determined by the user, as a result of the air conditioning operation, the indoor environment control system 4090 starts a fine adjustment routine. The fine adjustment routine is executed in the manner of the flowchart shown in FIG. 37. In step S0, the fine adjustment routine is started. In step S1, the process branches depending on whether the room temperature Tr has reached the set temperature Ts. If the result is NO in step S1, the temperature control is performed in step S2 to bring the room temperature Tr closer to the set temperature Ts, and then the process returns to step S1 again. If the result is YES in step S1, the process proceeds to step S3. In step S3, the control unit 4014 causes the voice output unit 4065 to issue a message asking whether the user is satisfied with the room temperature Tr. In step S4, the voice input unit 4064 acquires the user's voice, and the interpretation unit 4013 extracts the user's command. In step S5, the process branches depending on the content of the user's command. If the command indicates that the user is satisfied with the room temperature Tr, the process proceeds to step S6, and the fine adjustment routine ends. If the command indicates a request to increase the room temperature Tr a little more in step S5, the process proceeds to step S7, and the set temperature Ts is increased by a predetermined amount ΔT. If the command indicates a request to decrease the room temperature Tr a little more in step S5, the process proceeds to step S8, and the set temperature Ts is decreased by a predetermined amount ΔT. After step S7 or step S8 ends, the process returns to step S1.

[0306] As described above, the indoor environment control system 4090 repeats adjusting the indoor environment (step S2) and asking the user questions (step S3) until the user accepts the latest room temperature Tr.

[0307] (6) Features (6-1) The user can feed back his / her preference to the indoor environment control system 4090 via the voice input unit 4064 regarding whether to accept the environment in which the set temperature Ts is realized or to further change the room temperature Tr. This improves the user's satisfaction with the adjustment of the indoor environment.

[0308] (6-2) The indoor environment control system 4090 repeats adjusting the indoor environment and asking the user questions until consent is obtained from the user, thereby further improving the user's satisfaction with the adjustment of the indoor environment.

[0309] (6-3) The voice input unit 4064 accepts the user's voice. Therefore, the user can issue commands to the indoor environment control system 4090 by voice, which simplifies operation.

[0310] (6-4) For example, at least one of the text extraction unit 4011 and the interpretation unit 4013 can be placed in a server 40 installed at a location away from the air conditioner 4062. Therefore, the air conditioner 4062 does not need to bear the burden of high processing power.

[0311] (6-5) The user identification unit 4019 identifies the user from the voiceprint, so that the optimal setting value for each user can be reflected in the indoor environment.

[0312] (6-6) Each of the multiple users can update the settings to suit their own needs, which increases the satisfaction of each user.

[0313] (7) Variations (7-1) First Modification In the above embodiment, the only device for adjusting the environment that the indoor environment control system 4090 can control is the air conditioner 4062. Alternatively, as shown in FIG. 38, the indoor environment control system 4090A may control other indoor environment control devices. The indoor environment control devices controlled by the indoor environment control system 4090A according to the first modification include the air conditioner 4062, a humidifier 4062A, and a lighting fixture 4062B. Regarding the humidifier 4062A, the memory unit 4017 stores a set humidity as a set value, and the control unit 4014 controls the humidifier 4062A so that the indoor humidity approaches the set humidity. Regarding the lighting fixture 4062B, the memory unit 4017 stores a set illuminance as a set value, and the control unit 4014 controls the lighting fixture 6240B so that the indoor illuminance approaches the set humidity. Naturally, indoor environment control devices other than those described above may be installed and controlled by the indoor environment control system 4090A.

[0314] According to this configuration, stimulation of the user's five senses can be adjusted more comfortably.

[0315] (7-2) Second Modification In the above-described embodiment, the user's input and output to the indoor environment control system 4090 is voice. Alternatively, as shown in Fig. 39, the user may perform input and output to the indoor environment control system 4090B by means other than voice. The indoor environment control system 4090B according to the second modified example is equipped with a remote controller 4063A instead of the voice input / output device 4063. The remote controller 4063A directly communicates with the air conditioner 4062 via wireless or infrared communication. The remote controller 4063A is provided with input keys 4064A and an output display 4065A.

[0316] This configuration allows the user to communicate their wishes to the indoor environment control system 4090 without relying on hearing.

[0317] [Fifth configuration] (1) Overall structure 40 shows an equipment control system according to an embodiment. The equipment control system of this embodiment is configured as an air conditioning management system 5090. The air conditioning management system 5090 includes a plurality of properties 5060A, 5060B, and a server 5040. The air conditioning management system 5090 cooperates with a power company 5030 to form a demand response system. The air conditioning management system 5090 receives power from the power company 5030 and communicates with the power company 5030.

[0318] An electric power company 5030 provides power to the properties 5060A and 5060B using a power line 5032. The electric power company 5030 is provided with a power management device 5031. The power management device 5031 can communicate with controllers 5061 of the properties 5060A and 5060B via a network 5050 using a communication line 5033.

[0319] The power management apparatus 5031 can use the communication line 5033 to transmit a “restriction request” to the properties 5060A and 5060B to urge them to restrict the amount of power usage.

[0320] (2) Detailed configuration (2-1) Properties 60A and 60B The properties 5060A and 5060B are buildings such as houses, office buildings, factories, etc. The properties 5060A and 5060B are provided with a group of electrical devices such as an air conditioner 5062, lighting fixtures 5066, and a ventilation fan 5067. Furthermore, the properties 5060A and 5060B are provided with a controller 5061, a power meter 5068, and an audio input / output device 5063.

[0321] (2-1-1) Air conditioner 5062 The air conditioner 5062 adjusts the temperature in the room in which it is installed, etc. The power consumption of the air conditioner 5062 varies depending on the power ON / OFF, heating mode / cooling mode, set temperature, external environment, etc.

[0322] (2-1-2) Lighting fixture 5066 The power consumption of the lighting fixture 5066 varies depending on whether the power is turned on or off, and on the brightness adjustment.

[0323] (2-1-3) Ventilator 5067 The power consumption of the ventilation fan 5067 varies depending on whether the power is turned on or off.

[0324] (2-1-4) Controller 5061 The controller 5061 can transmit approval or denial of the restriction request to the power management device 5031 of the power company 5030. Furthermore, the controller 5061 controls the electric appliances after taking into consideration the presence or absence of a restriction request.

[0325] (2-1-5) Power Meter 5068 The power meter 5068 measures the amount of power used in the properties 5060A and 5060B. The measurement results are monitored by the controller 5061.

[0326] (2-1-6) Audio input / output device 5063 The audio input / output device 5063 operates as an audio remote controller for the group of electrical devices. The audio input / output device 5063 is installed in the same room as the air conditioner 5062, for example.

[0327] (2-2) Server 5040 The server 5040 is for operating the audio input / output device 5063 as an audio remote controller for a group of electrical devices. The server 5040 may be configured as a single computer, or may be configured from multiple computers each having different functions. For example, one computer may be in charge of analyzing voice and extracting commands, and another computer may be in charge of controlling electrical devices and detecting abnormalities. In this case, the multiple computers may be installed in locations remote from each other and owned or managed by different companies.

[0328] (3) Hardware Configuration Fig. 41 is a block diagram of the hardware configuration of an air conditioning management system 5090. This diagram shows only a group of electrical devices installed in one property.

[0329] (3-1) Air conditioner 5062 The air conditioner 5062 has an input / output interface unit 5621, a processor 5622, and a refrigerant circuit 5623. The input / output interface unit 5621 is connected to the network 50 via the controller 5061, and exchanges information with other devices. The refrigerant circuit 5623 includes sensors and actuators, and conditions the air in the room. The processor 5622 controls the actuators of the air conditioner 5062, reads the outputs of the sensors, and exchanges information with the input / output interface unit 5621.

[0330] (3-2) Audio input / output device 5063 The audio input / output device 5063 includes an input / output interface unit 5631, an audio input unit 5064, and an audio output unit 5065. The input / output interface unit 5621 is connected to the network 5050 via the controller 5061, and exchanges information with other devices.

[0331] The audio input unit 5064 has a microphone 5641, an amplifier 5642, and an AD converter 5643. The microphone 5641 acquires an analog audio signal. The amplifier 5642 amplifies the acquired analog audio signal. The AD converter 5643 performs AD conversion on the amplified analog audio signal, and sends the acquired audio data SD to the input / output interface 5631.

[0332] The audio output unit 5065 has a DA converter 5653, an amplifier 5652, and a speaker 5651. The DA converter 5653 performs DA conversion on the output data OD received from the input / output interface unit 5631, and sends the resulting analog output signal to the amplifier 5652. The amplifier 5652 amplifies the analog output signal. The speaker 5651 produces sound corresponding to the amplified analog output signal.

[0333] (3-3) Server 5040 Server 5040 includes computers 5040a and 5040b. Server 5040 may include any number of computers. Here, only the configuration of computer 5040a will be described. Computer 5040a includes input / output interface unit 5041, processor 5042, and memory 5043. Input / output interface unit 5041 is connected to network 5050. Processor 5042 performs various processes. The processes include sending and receiving information via input / output interface unit 5041, and various arithmetic operations. Memory 5043 stores information by a write operation of processor 5042, etc.

[0334] (3-4) Controller 5061 The controller 5061 has input / output interface units 5611, 5614, 5615, a processor 5612, and a memory 5613. The input / output interface unit 5611 is connected to a network 5050. The input / output interface unit 5614 is connected to an air conditioner 5062. The input / output interface unit 5615 is connected to an audio input / output device 5063. The memory 5613 stores various information. The processor 5612 controls various communications, calculations, recording of information, reading of information, and other general processing. (4) Functional Blocks 42 is a functional block diagram of an air conditioning control system 5090. In addition to a voice input unit 5064 and a voice output unit 5065, the air conditioning control system 5090 has a number of functional blocks, namely, a text conversion unit 5011, a voice recognition dictionary 5012, an interpretation unit 5013, a control unit 5014, a state extraction unit 5015, a state extraction dictionary 5016, a determination unit 5017, and a storage unit 5018.

[0335] The functional blocks 5011 to 5018 may be configured as software such as a program stored in memory 5043 of the computers 5040a and 5040b of the server 5040 and executed by the processor 5042. Alternatively, the functional blocks 5011 to 5018 may themselves be configured as hardware such as an integrated circuit or a hard drive. The functional blocks 5011 to 5018 may be physically mounted in the computers 5040a and 5040b, the audio input / output device 5063, the air conditioner 5062, or other locations.

[0336] (5) Basic operation A user instructs an operation to be performed by the air conditioner 5062 via a voice input unit 5064 of the voice input / output device 5063 in Fig. 41. For example, the user speaks commands such as "Turn on the air conditioner" or "Turn down the temperature a little more" to the voice input unit 5064.

[0337] The user's voice is converted into voice data SD of a digital signal by an AD converter 5643. The voice data SD is delivered to a server 5040 via a network 5050, for example. A text conversion unit 5011 in Fig. 42 converts the voice data SD into text by referring to a voice recognition dictionary 5012. An interpretation unit 5013 interprets the text and extracts the command CM intended by the user.

[0338] The control unit 5014 transmits the output data OD to the audio output unit 5065, and causes a voice message such as "The temperature will be lowered slightly" to be output from the speaker 5651 in Fig. 41. The control unit 5014 transmits a control signal to the refrigerant circuit 5623 of the air conditioner 5062, and controls the air conditioner 5062 to lower the current control parameter, i.e., the set temperature value, by a predetermined temperature.

[0339] It is possible to control electrical appliances other than the air conditioner 5062 in a similar manner. For example, when the user commands the voice input unit 5064 to "make it brighter" by voice, the control unit 5014 increases the illuminance of the lighting device 5066.

[0340] (6) Demand response operation (6-1) State Extraction The state extraction unit 5015 analyzes the voice data SD sent from the voice input unit 5064 while referring to the state extraction dictionary 5016, and grasps the emotion of the user in the room. The emotion can be interpreted in various ways. As one example, the excitement level of the user derived from the strength of the voice or the shape of the voice waveform may be used as the emotion to be grasped.

[0341] (6-2) Mode determination When a request for power usage reduction is made from the power management device, the determination unit 5017 decides whether or not to accept the reduction request, depending on the user's emotion grasped by the state extraction unit 5015. Specifically, when the emotion is positive, the determination unit 5017 determines an "acceptance mode" in which the reduction request is accepted, and when the emotion is negative, the determination unit 5017 determines a "rejection mode" in which the reduction request is rejected.

[0342] (6-3) Notification to the power management device 5031 The processor 5612 of the controller 5061 functioning as part of the control unit 5014 transmits to the power management device 5031 a consent to the suppression request when in the "consent mode" and a refusal to the suppression request when in the "refusal mode".

[0343] (6-4) Record The storage unit 5018 stores a history of the approval or refusal sent to the power management apparatus 5031 .

[0344] (7) Features (7-1) The determining unit 5017 automatically determines whether or not to respond with approval to the restraint request from the power company, thereby reducing the burden of decision-making on the user.

[0345] (7-2) When there is a user who has a negative emotion, the control request is not accepted, and the vehicle is driven in a manner that takes into consideration the user who has a negative emotion.

[0346] (8) Variations (8-1) Image and video input Instead of acquiring voice data by the voice input unit 5064, image or video data may be acquired using an image input unit such as a camera. The state extraction unit 5015 may detect the user's facial expression, posture, or movement, and then grasp the user's emotions from the detected contents.

[0347] (8-2) Energy saving operation The process performed based on the output of the determination unit 5017 may be the execution of an energy saving operation unrelated to demand response, instead of transmitting approval or rejection to the power management device 5031. That is, the energy saving operation may be performed in the "approval mode", and the normal operation may be performed in the "rejection mode". The energy saving operation referred to here may be, for example, reducing the capacity of the air conditioner 5062 by limiting the motor rotation speed of the compressor of the air conditioner 5062.

[0348] [6th configuration] (1) Overall structure 43 shows a device control system according to an embodiment. The device control system of this embodiment is configured as a home system 6090. The home system 6090 includes a building 6060, which is a residence, and a server 6040 provided in a remote location. The building 6060 is provided with a router 6061, an audio input / output device 6063, and a group of devices 6070. The router 6061 and the server 6040 are connected via a network 6050.

[0349] (2) Detailed configuration (2-1) Network 6050 The network 6050 is, for example, the Internet constructed using the PSTN (Public Switched Telephone Network) or the like.

[0350] (2-2) Router 6061 The router 6061 is connected to the network 6050 and has a switching hub. An audio input / output device 6063 and a group of devices 6070 are connected to the router 6061 via wired or wireless communication links.

[0351] (2-3) Equipment group 6070 The group of devices 6070 includes, for example, an air conditioner 6071, a bathroom water heater 6072, a television 6073, lighting equipment 6074, a wearable device 6075, cooking equipment 6076, and a refrigerator 6077.

[0352] (2-4) Audio input / output device 6063 The audio input / output device 6063 is for operating the device group 6070 by audio commands. The audio input / output device 6063 is provided with an audio input unit 6064 and an audio output unit 6065.

[0353] (2-5) Server 6040 The server 6040 controls the group of devices 6070 in response to a voice uttered by the user. The server 6040 may be configured as a single computer, or may be configured from multiple computers 6040a, 6040b each having different functions. For example, one computer 6040a may be in charge of analyzing voice and executing commands, and another computer 6040b may be in charge of controlling the air conditioner 6071 and detecting anomalies. In this case, the multiple computers 6040a, 6040b may be installed in locations separate from each other and owned or managed by different companies.

[0354] (3) Hardware Configuration FIG. 44 is a block diagram of the configuration of a home system 6090.

[0355] (3-1) Equipment group 70 An air conditioner 6071, which is one of the devices belonging to the device group 6070, has an input / output interface unit 6711, a processor 6712, and a refrigerant circuit 6713. The input / output interface unit 6711 is connected to the network 6050 via a router 6061, and exchanges information with other devices. The refrigerant circuit 6713 includes sensors and actuators, and conditions the air in the room. The processor 6712 controls the actuators of the air conditioner 6071, reads the output of the sensors, and exchanges information with the input / output interface unit 6711.

[0356] Other devices belonging to the device group 6070 also usually have a processor, an actuator, a sensor, and an input / output interface, similar to the air conditioner 6071. The processor controls the actuator, reads the output of the sensor, and exchanges information with the input / output interface.

[0357] (3-2) Audio input / output device 6063 The audio input / output device 6063 has an input / output interface unit 6631, an audio input unit 6064, and an audio output unit 6065. The input / output interface unit 6631 is connected to the network 6050 via the router 6061, and exchanges information with other devices.

[0358] The audio input unit 6064 has a microphone 6641, an amplifier 6642, and an AD converter 6643. The microphone 6641 acquires an analog audio signal. The amplifier 6642 amplifies the acquired analog audio signal. The AD converter 6643 performs AD conversion on the amplified analog audio signal, and sends the acquired audio data SD to the input / output interface 6631.

[0359] The audio output unit 6065 has a DA converter 6653, an amplifier 6652, and a speaker 6651. The DA converter 6653 performs DA conversion on the output data OD received from the input / output interface unit 6631, and sends the resulting analog output signal to the amplifier 6652. The amplifier 6652 amplifies the analog output signal. The speaker 6651 emits sound corresponding to the amplified analog output signal.

[0360] (3-3) Server 6040 The server 6040 includes computers 6040a and 6040b. The server 6040 may include any number of computers. Here, only the configuration of the computer 6040a will be described. The computer 6040a includes an input / output interface unit 6041, a processor 6042, and a memory 6043. The input / output interface unit 6041 is connected to a network 6050. The processor 6042 performs various processes. The processes include sending and receiving information via the input / output interface unit 6041, and various arithmetic operations. The memory 6043 stores information by a write operation of the processor 6042, etc.

[0361] (4) Functional blocks 45 is a functional block diagram of a home system 6090. In addition to a voice input unit 6064 and a voice output unit 6065, the home system 6090 has a plurality of functional blocks, namely, a text extraction unit 6011, a voice recognition dictionary 6012, an interpretation unit 6013, a control unit 6014, a clock unit 6015, a recording unit 6016, a pattern extraction unit 6017, and a prediction unit 6018.

[0362] The functional blocks 6011 to 6018 may be configured as software such as a program stored in memory 6043 of the computers 6040a and 6040b of the server 6040 and executed by the processor 6042. Alternatively, the functional blocks 6011 to 6018 may themselves be configured as hardware such as an integrated circuit or a hard drive. The functional blocks 6011 to 6018 may be physically mounted in the computers 6040a and 6040b, the audio input / output device 6063, the air conditioner 6071, or other locations. For example, at least a part of the control unit 6014 is configured as a processor 6712 of the air conditioner 6071.

[0363] (5) Operation (5-1) Voice Control A user instructs the device group 6070 to execute an operation via a voice input unit 6064 of the voice input / output device 6063 in Fig. 44. For example, the user speaks commands such as "Turn on the air conditioner" or "Turn down the temperature a little more" to the voice input unit 6064.

[0364] The user's voice is converted by an AD converter 6643 into voice data SD of a digital signal. The voice data SD arrives at a server 6040 via a network 6050, for example. A text extraction unit 6011 in Fig. 45 converts the voice data SD into text while referring to a voice recognition dictionary 6012. An interpretation unit 6013 interprets the text and extracts a command CM intended by the user. As a result, the interpretation unit 6013 understands that the command CM is related to, for example, an air conditioner 6071.

[0365] The control unit 6014 sends the output data OD to the audio output unit 6065, and causes a voice message such as "The temperature will be lowered slightly" to be output from the speaker 6651 in Fig. 44. The control unit 6014 sends a control signal to the refrigerant circuit 6713 of the air conditioner 6071, and controls the air conditioner 6071 to lower the current control parameter, i.e., the set temperature value, by a predetermined temperature.

[0366] (5-2) Acquisition of device operation The server 6040 acquires the sensor output provided in the device group 6070 and the contents of the command CM to be sent to the device group 6070. The sensor output and the control command CM are associated with the time measured by the clock unit 6015 and stored in the recording unit 6016 as a log shown in FIG.

[0367] (5-3) Extraction of user behavior patterns By analyzing the log, frequently occurring device operation patterns are extracted by the pattern extraction unit 6017. For example, the following are characteristic device operation patterns.

[0368] (5-3-1) Strong correlation between date and time and device operation A record of commands or detections made to a device on a particular calendar day, day of the week, or time of day. Lighting fixture 6074 is turned on around 7pm on a weekday (when the person returns home from work). Around 6pm, the wearable device 6075 detects an increase in heart rate. (Evening jogging) Around 6pm, Cooking Appliance 6076 is used (preparing dinner). (5-3-2) Strong correlation between the operations of multiple devices The recording of multiple sequential commands or detections to separate devices within a specified time interval. After using the bathroom water heater 6072, the temperature setting of the air conditioner 6071 is lowered. (To increase the cooling after taking a bath) After the wearable device 6075 detects an increase in heart rate, the temperature setting of the air conditioner 6071 is increased (reducing the cooling after jogging). While using the cooking appliance 6076, the temperature setting of the air conditioner 6071 is lowered. (The cooling is increased while cooking.) (5-3-3) Strong correlation between date and time and the operation of multiple devices At around 8pm on Friday, TV 6073 is turned on and then the door of Refrigerator 6077 is opened. (Watching TV while having a drink) (5-4) Predicting user behavior The prediction unit 6018 predicts a pattern that is likely to occur in the near future from the device operation patterns extracted by the pattern extraction unit 6017. For example, assume that the current time is 5:55 PM and the set temperature of the air conditioner 6071 is 26° C. Then, the prediction unit 6018 predicts that "there is a high probability that the set temperature of the air conditioner 71 will be changed to 25° C. at around 6:00 PM, five minutes later."

[0369] (5-5) Equipment control The control unit 6014 performs control based on the prediction. As a method of control, for example, the following two modes can be mentioned.

[0370] (5-5-1) Advance Realization Mode Before the user operates any of the devices 6070, the control unit 6014 performs an operation that the user is likely to perform in advance. For example, based on the above-mentioned prediction, the control unit 6014 changes the set temperature of the air conditioner 6071 from 26° C. to 25° C. at 6 p.m.

[0371] (5-5-2) Advice mode The control unit 6014 issues a message to the user informing him of the predicted operation. For example, based on the above prediction, the control unit 6014 controls the voice output unit 6065 at 6 p.m. to issue a message saying, "It is now 6 p.m. You may want to lower the temperature of the air conditioner to 25° C."

[0372] (6) Features (6-1) A characteristic sequential command pattern is obtained. Therefore, the home system 6090 can grasp a control pattern that is likely to be felt by the user as being comfortable.

[0373] (6-2) A prediction unit 6018 predicts the next device control that the user is likely to perform based on the sequential command pattern. Therefore, the home system 6090 can grasp the next control that is likely to be comfortable for the user.

[0374] (6-3) The message output unit notifies the user of the device control that the user is likely to prefer to perform next, thereby preventing the user from forgetting to perform a device operation that brings comfort to the user.

[0375] (6-4) The audio output unit 6065 notifies the user of the device control that the user is likely to prefer to perform next. This prevents the user from forgetting to operate a device that brings comfort to the user.

[0376] (6-5) The user can issue commands by voice, making it easy for the user to operate the home system 6090.

[0377] (6-6) The home system 6090 controls the air conditioner 6071. Therefore, the home system 6090 can realize a temperature etc. that the user feels comfortable.

[0378] (7) Variations (7-1) First Modification Instead of the voice input / output device 6063 of the above-mentioned embodiment, a smartphone 6063A may be used as shown in FIG. 47. The devices are omitted in this figure. The connection of the smartphone 6063A to the network 6050 may be realized by wireless communication with the router 6061, or may be realized by using a 4G line of a mobile phone carrier. A text message may be used instead of a voice message. An image or animation of a character may be displayed on the screen of the smartphone 6063A to make it look like the character is speaking a message.

[0379] Furthermore, the input / output means is not limited to the audio input / output device 6063 and the smartphone 6063A, but may be any type of input / output means such as a touch panel, a keyboard, a camera, an LED indicator, or the like.

[0380] (7-2) Second Modification In a second modified example shown in Fig. 48, a home system 6090B includes a functional block called a context unit 6019. The context unit 6019 creates a message that matches the pattern output from the prediction unit while referring to the context of the lifestyle of people or of each country or region.

[0381] For example, when the lighting fixture 6074 is turned on on a Friday night, the audio output unit 6065 may emit words of appreciation such as "Thank you for your hard work this week. There's cold beer in the fridge."

[0382] This context unit 6019 may be formed, for example, by a neural network.

[0383] (7-3) Third Modification The pattern prediction made by the prediction unit 6018 may be presented to the user by the audio output unit 6065 or other output means. In this case, a determination unit may be further provided that determines an event in which the user operates the device as presented as successful presentation, and determines an event in which the user performs an operation different from the presented as unsuccessful presentation. In addition, a pattern presentation result recording unit may be provided that records a history of such successful and unsuccessful presentations.

[0384] According to this configuration, the history of successes and failures can be analyzed along with the device operation log, so that the predictability of the user's future actions based on the recorded history can be increased and the presentation can be made more likely to be successful.

[0385] (7-4) Fourth Modification When presenting a device operation pattern to the user in the above-described third modified example, the content of the presentation may be determined taking into consideration information about the outside of the building 6060.

[0386] For example, in the summer when the load on the power grid is close to its limit, a system could suggest, "Your usual setting for your air conditioner is 25°C, but how about setting it to 26°C today?"

[0387] [Seventh configuration] Below, with reference to the drawings, we will explain a device control system 7400 according to one embodiment of the device control system of the present disclosure, a first device 7010, a second device 7020, and a third device 7030 according to one embodiment of the devices of the present disclosure controlled by the device control system 7400, and an embodiment of a method for controlling these devices.

[0388] (1) Overall overview An overview of the device control system 7400 and the first device 7010, second device 7020, and third device 7030 controlled by the device control system 7400 will be described with reference to FIG.

[0389] Fig. 49 is a schematic block diagram of a device control system 7400 and a first device 7010, a second device 7020, and a third device 7030 controlled by the device control system 7400. Note that, although illustration is omitted in Fig. 49 to avoid cluttering the drawing, the third device 7030 also has components such as an audio input unit, an audio data transmission unit, a start / stop request receiving unit, a start / stop information receiving unit, an alarm unit, a switch, and a remote control, similar to the first device 7010 and the second device 7020.

[0390] The first device 7010, the second device 7020, and the third device 7030 are connected to the device control system 7400 via a network 7040 (see FIG. 49). The network 7040 is, for example, the Internet, but may also be a WAN or the like.

[0391] The first device 7010, the second device 7020, and the third device 7030 are devices that can be operated by voice. Here, the first device 7010, the second device 7020, and the third device 7030 are devices installed in the same building, for example, a detached house. However, the installation locations are merely examples, and these devices may be devices installed in an office building, a hotel, a factory, or the like. Here, the first device 7010 and the second device 7020 are installed in a first space (for example, the first floor of a house), and the third device 7030 is installed in a second space (for example, the second floor of a house).

[0392] Here, an example will be described in which three devices (first device 7010, second device 7020, and third device 7030) are installed in a building, but the present invention is not limited to this, and two or four or more devices may be installed in a building. Also, here, an example will be described in which the first device 7010, second device 7020, and third device 7030 are installed in one building, but the devices may be installed in multiple buildings, and the devices installed in the multiple buildings may be connected to the device control system 7400 via the network 7040.

[0393] In this embodiment, the first device 7010, the second device 7020, and the third device 7030 are home appliances. The home appliances include, for example, an air conditioner, a television, a recorder, an audio device, a refrigerator, a microwave oven, a washing machine, and a lighting device. The types of devices listed here are examples. The first device 7010, the second device 7020, and the third device 7030 may be home appliances other than those listed, or may be devices other than home appliances. The first device 7010, the second device 7020, and the third device 7030 may all be devices of the same type, or may be devices of different types. Although not limited thereto, in this embodiment, the first device 7010 and the third device 7030 are air conditioners, and the second device 7020 is a television.

[0394] Configurations and functions related to the voice operations of the first device 7010, the second device 7020, and the third device 7030 will be described later. Note that, since home appliances such as air conditioners and televisions are generally well-known devices, descriptions of configurations and functions other than those related to the voice operations of the first device 7010, the second device 7020, and the third device 7030 will be omitted here.

[0395] The device control system 7400 is a system that receives voice data transmitted from the first device 7010, the second device 7020, and the third device 7030, and analyzes the received voice data. The device control system 7400 also transmits signals (instructions or information) based on the analysis results of the voice data to the first device 7010, the second device 7020, and the third device 7030, thereby controlling the first device 7010, the second device 7020, and the third device 7030.

[0396] The device control system 7400 includes a first server 7100, a second server 7200, and a third server 7300 (see FIG. 49). The first server 7100, the second server 7200, and the third server 7300 are connected to each other via a network 7040 so as to be able to communicate with each other.

[0397] The first server 7100, the second server 7200, and the third server 7300 are usually installed in a building separate from the building in which the first device 7010, the second device 7020, and the third device 7030 are installed. The first server 7100, the second server 7200, and the third server 7300 may be installed in the same location, or may be installed in different locations.

[0398] The first server 7100 is a server that receives voice data transmitted from the first device 7010, the second device 7020, and the third device 7030, and analyzes the received voice data. The first server 7100 also executes various processes related to starting / stopping functions related to voice recognition processing for the first device 7010, the second device 7020, and the third device 7030. Details will be described later.

[0399] The voice recognition process for the first device 7010 means a series of processes in which the first device 7010 receives voice, the first device 7010 transmits voice data of the received voice, and the first server 7100 receives the voice data transmitted from the first device 7010 and analyzes the received voice data. More specifically, the voice recognition process for the first device 7010 means a series of processes in which the voice input unit 7012 receives voice, the voice data transmission unit 7014 transmits the voice data of the received voice, the voice data reception unit 7110 receives the voice data transmitted from the first device 7010, and the voice analysis unit 7120 analyzes the received voice data. The voice input unit 7012 and the voice data transmission unit 7014 of the first device 7010 and the voice data reception unit 7110 and the voice analysis unit 7120 of the device control system 7400 will be described later.

[0400] Functions related to voice recognition processing for the first device 7010 include, for example, the following functions. 1) Voice reception function of the voice input unit 7012 2) Function of transmitting voice data by the voice data transmitting unit 7014 3) A function in which the voice data receiving unit 7110 receives voice data transmitted by the first device 7010 4) A function in which the voice analysis unit 7120 analyzes the voice data transmitted by the first device 7010 5) A function of storing voice data transmitted by the first device 7010 in a storage unit 7190 of the first server 7100, which will be described later. The voice recognition processing for the second device 7020 and the third device 7030, and the functions related to the voice recognition processing for the second device 7020 and the third device 7030, are similar to the voice recognition processing for the first device 7010, and the functions related to the voice recognition processing for the first device 7010, respectively, so they will not be described here.

[0401] The second server 7200 is a server that transmits a signal based on the analysis result by the voice analysis unit 7120 of the first server 7100 of the voice data transmitted by the first device 7010 or the third device 7030 (air conditioner) to the first device 7010 or the third device 7030 that is the source of the voice data. For example, specifically, the second server 7200 transmits a command (signal) to start operation to the first device 7010 based on the analysis result of the voice data of the voice "Start operation" transmitted by the first device 7010 (the analysis result that the content of the voice data is an instruction to start operation).

[0402] In this case, the second server 7200 transmits a signal based on the analysis result of the voice data from the first device 7010 or the third device 7030 to the first device 7010 or the third device 7030, which is the source of the voice data. However, the device control system 7400 is not limited to this embodiment. For example, when the first device 7010 and the third device 7030 are air conditioners made by different manufacturers, or when the manufacturer is the same but the types of air conditioners are different, the device control system 7400 may have a fourth server (not shown) in addition to the first to third servers. The second server 7200 may transmit a signal based on the analysis result of the voice data from the first device 7010 to the first device 7010, and the fourth server may transmit a signal based on the analysis result of the voice data from the third device 7030 to the third device 7030. In addition, the second server 7200 may be configured to transmit a signal based on the analysis results of the voice data from the first device 7010 or the third device 7030 to the first device 7010 or the third device 7030, which is the source of the voice data, regardless of the manufacturers or types of the air conditioners of the first device 7010 and the third device 7030.

[0403] The third server 7300 is a server that transmits a signal based on the analysis result by the audio analysis unit 7120 of the first server 7100 of the audio data transmitted by the second device 7020 (a television in this embodiment) to the second device 7020 that is the transmission source of the audio data. For example, specifically, the second server 7200 transmits a power-on command signal to the second device 7020 based on the analysis result (the analysis result that the content of the audio data is an instruction to turn on the power) of the audio data of the voice "power on" transmitted by the second device 7020.

[0404] In this embodiment, the third server 7300 transmits a signal based on the analysis result of the voice data to the second device 7020, but the present invention is not limited to this. For example, the device control system 7400 may not include the third server 7300, and the second server 7200 may function as the third server 7300 of this embodiment.

[0405] (2) Detailed configuration The configurations and functions related to voice operation of the devices (first device 7010, second device 7020, and third device 7030) and the device control system 7400 will be further described below.

[0406] (2-1) First device, second device and third device The first device 7010, the second device 7020, and the third device 7030 are all examples of the first device and examples of the second device.

[0407] The configurations and functions related to the voice operations of the first device 7010, the second device 7020, and the third device 7030 will be described below using the first device 7010 as an example.

[0408] The voice input unit 7022, the voice data transmission unit 7024, the start / stop request reception unit 7026, the start / stop information reception unit 7027, the notification unit 7028, the switch 7021a, and the remote control 7021b of the second device 7020 are similar to the voice input unit 7012, the voice data transmission unit 7014, the start / stop request reception unit 7016, the start / stop information reception unit 7017, the notification unit 7018, the switch 7011a, and the remote control 7011b of the first device 7010. The third device 7030 also has the same configuration as the first device 7010 with respect to voice operation. Therefore, here, the description of the second device 7020 and the third device 7030 will be omitted.

[0409] The first device 7010 mainly includes, as components related to voice operation, a voice input unit 7012 including a microphone, a control board (not shown) equipped with a CPU and a memory in which programs executed by the CPU are stored, a communication interface (not shown) enabling connection to a network 7040, a notification unit 7018 including an LED, a physical switch 7011a provided on the main body (not shown) of the first device, and a remote control 7011b used to transmit various commands to the first device 7010. The remote control 7011b may be connected to the main body of the first device 7010 by wire, or may transmit signals to the main body of the first device 7010 wirelessly (for example, by infrared signal).

[0410] The first device 7010 functions as an audio data transmission unit 7014, a start / stop request reception unit 7016, a start / stop information reception unit 7017, and the like, as a result of the CPU of the control board executing a program.

[0411] The switch 7011a, remote control 7011b, audio input unit 7012, audio data transmission unit 7014, start / stop request reception unit 7016, start / stop information reception unit 7017, and notification unit 7018 of the first device 7010 will be described below.

[0412] (2-1-1) Switches and remote controls The switch 7011a and the remote control 7011b are an example of an instruction receiving unit. The instruction receiving unit is a functional unit that receives an instruction to stop at least a part of the functions related to the voice recognition processing, in which the voice input unit 7012 receives a voice, the voice data transmission unit 7014 transmits the voice data, and the voice analysis unit 7120 of the device control system 7400 analyzes the transmitted voice data. The switch 7011a and the remote control 7011b are also functional units that receive an instruction to start (resume) at least a part of the functions related to the voice recognition processing.

[0413] The switch 7011a is a physical switch (for example, a push button switch).

[0414] The remote control 7011b is a remote control used for operating the first device 7010 as an air conditioner, for example, turning the first device 7010 on / off, setting an operation mode, inputting a set temperature, etc. The remote control 7011b is also provided with a switch for receiving an instruction to start / stop at least a part of a function related to a voice recognition process for the first device 7010.

[0415] When the switch 7011a or the remote control 7011b receives an instruction to start / stop at least a portion of the functions related to voice recognition processing for the first device 7010, it is preferable that the first device 7010 transmits a function start notification signal / function stop notification signal to the device control system 7400.

[0416] The function start notification signal / function stop notification signal is a signal for notifying that an instruction to start / stop at least a part of a function related to the voice recognition processing for the first device 7010 has been received. Note that it is preferable that the function start notification signal / function stop notification signal includes not only information indicating that an instruction to start / stop a function has been received, but also information regarding which function the instruction to start / stop has been received.

[0417] (2-1-2) Audio input section The audio input unit 7012 has a microphone (not shown) for receiving audio, and receives audio input.

[0418] It is preferable that the voice reception function of the voice input unit 7012 is configured so that it is possible to instruct start (execution) / stop.

[0419] It is preferable that the voice reception function of the voice input unit 7012 can be started / stopped by an instruction to the switch 7011a (pressing the switch 7011a) or an instruction from the remote control 7011b (operating the remote control 7011b). When the voice reception function of the voice input unit 7012 is started / stopped by an instruction to the switch 7011a or an instruction from the remote control 7011b, it is preferable that the first device 7010 transmits a signal (function start notification signal / function stop notification signal) notifying the first server 7100 of the start / stop of the voice reception function of the voice input unit 7012 to the first server 7100.

[0420] In addition, it is preferable that when the start / stop request receiving unit 7016 receives a request to start / stop the voice reception function of the voice input unit 7012, the voice reception function of the voice input unit 7012 is instructed to start / stop in response to the request.

[0421] (2-1-3) Audio data transmission unit The voice data transmission unit 7014 transmits the voice received by the voice input unit 7012 as voice data to the device control system 7400 having the voice analysis unit 7120. The voice data transmission unit 7014 transmits, for example, a digital voice signal (voice data) obtained by A / D converting the voice received by the voice input unit 7012 to the device control system 7400.

[0422] It is preferable that the voice data transmission function of the voice data transmission unit 7014 is configured so that it is possible to instruct start (execution) / stop.

[0423] It is preferable that the voice data transmission function of the voice data transmission unit 7014 can be started / stopped by an instruction to the switch 7011a or an instruction from the remote control 7011b. When the voice data transmission function of the voice data transmission unit 7014 is started / stopped by an instruction to the switch 7011a or an instruction from the remote control 7011b, it is preferable that the first device 7010 transmits a signal (function start notification signal / function stop notification signal) notifying the first server 7100 of the start / stop of the voice data transmission function of the voice data transmission unit 7014 to the first server 7100.

[0424] The voice data transmission function of the voice data transmission unit 7014 may be instructed to start / stop by voice input from the voice input unit 7012. For example, the first equipment 7010 has a voice recognition chip that recognizes only a specific voice (for example, a voice instructing the voice data transmission function of the voice data transmission unit 7014 to start / stop) among voices input to the voice input unit 7012. By having such a voice recognition chip, it is possible to instruct the voice data transmission function of the voice data transmission unit 7014 to start / stop in response to a specific voice input to the voice input unit 7012. Note that, even when the voice data transmission function of the voice data transmission unit 7014 is started / stopped by a voice instruction to the voice input unit 7012, it is preferable that the first equipment 7010 transmits a signal (function start notification signal / function stop notification signal) informing the first server 7100 of the start / stop of the voice data transmission function of the voice data transmission unit 7014.

[0425] In addition, it is preferable that when the start / stop request receiving unit 7016 receives a request to start / stop the audio data transmission function of the audio data transmission unit 7014, the start / stop function is instructed to be started / stopped in response to the request.

[0426] (2-1-4) Start / Stop Request Reception Unit The start / stop request receiving unit 7016 receives a request to start / stop a function related to the voice recognition processing for the first device 7010, which is transmitted by a start / stop request unit 7180 of the device control system 7400 described later. The function start / stop request received by the start / stop request receiving unit 7016 is a function that can be started / stopped by the first device 7010 side. For example, the function start / stop request received by the start / stop request receiving unit 7016 is a request to start / stop a voice reception function of the voice input unit 7012, or a request to start / stop a voice data transmission function of the voice data transmission unit 7014. When the start / stop request receiving unit 7016 receives a signal requesting the start / stop of a function related to the voice recognition processing for the first device 7010, the first device 7010 starts / stops the function related to the voice recognition processing for the first device 7010 in response to this signal.

[0427] (2-1-5) Start / Stop Information Reception Section A start / stop information receiving unit 7017 receives function stop information transmitted from a start / stop information transmitting unit 7170 of a device control system 7400, which will be described later.

[0428] The function stop information is information regarding a decision to stop at least a part (second function) of the functions related to voice recognition processing of another voice-operable device (device other than the first device 7010) in response to the stop of at least a part (first function) of the functions related to voice recognition processing of the device. In other words, the function stop information is information transmitted to the first device 7010 to notify the first device 7010 when at least a part of the functions related to voice recognition processing of the other voice-operable device (device other than the first device 7010) is stopped and in response to this, the start / stop decision unit 7160 of the device control system 7400 described later decides to stop at least a part of the functions related to voice recognition processing of the device (first device 7010).

[0429] Furthermore, the start / stop information receiving unit 7017 receives function start information transmitted by a start / stop information transmitting unit 7170 of the device control system 7400, which will be described later.

[0430] The function start information is information regarding a decision to start a function related to voice recognition processing of another voice-operable device (device other than the first device 7010) in response to the start of a function related to voice recognition processing of the device (first device 7010). In other words, the function start information is information transmitted to the first device 7010 to notify the start of a function related to voice recognition processing of the other voice-operable device (device other than the first device 7010) (enabling voice recognition processing of the device (first device 7010)) when the function related to voice recognition processing of the other voice-operable device (device other than the first device 7010) has been started and the voice recognition processing has become enabled.

[0431] (2-1-6) Notification Department The notification unit 7018 is a functional unit that notifies the user of the first device 10 whether the voice recognition process for the first device 7010 is valid or not. The notification unit 7018 includes, for example, an LED.

[0432] The notification unit 7018 notifies that at least a part of the functions related to the voice recognition processing for the first equipment 7010 has been stopped. In other words, the notification unit 7018 notifies that the voice recognition processing for the first equipment 7010 has been stopped. Specifically, the notification unit 7018 lights up an LED of a first color (e.g., a red LED) when the switch 7011a, the remote control 7011b, or the voice input unit 7012, which are examples of an instruction receiving unit, receives an instruction to stop any of the functions related to the voice recognition processing for the first equipment 7010 or when the start / stop information receiving unit 7017 receives function stop information.

[0433] Further, the notification unit 7018 notifies that a function related to the voice recognition processing for the first equipment 7010 has been started. The notification unit 7018 notifies that all of the functions related to the voice recognition processing for the first equipment 7010 have been started (not stopped). In other words, the notification unit 7018 notifies that the voice recognition processing for the first equipment 7010 is valid (in an executable state). Specifically, the notification unit 7018 lights up an LED of a second color (e.g., a blue LED) when the switch 7011a, the remote control 7011b, or the voice input unit 7012, which are examples of an instruction receiving unit, receives an instruction to start a function related to the voice recognition processing for the first equipment 7010 or when the start / stop information receiving unit 7017 receives function start information.

[0434] (2-2) Equipment control system The first server 7100, the second server 7200, and the third server 7300 of the device control system 7400 will be described.

[0435] (2-2-1) First Server The first server 7100 is a computer having a processor, a storage device including a main storage device and an auxiliary storage device, a communication interface, etc. The first server 7100 is connected to a first device 7010, a second device 7020, a third device 7030, a second server 7200, and a third server 7300 via a network 7040 so as to be able to communicate with each other.

[0436] In the first server 7100, a processor executes various processes by executing programs stored in a storage unit 7190 (storage device). The first server 7100 has a voice data receiving unit 7110, a voice analysis unit 7120, an analysis result transmission unit 7130, a detection unit 7140, a judgment unit 7150, a start / stop determination unit 7160, a start / stop information transmission unit 7170, and a start / stop request unit 7180 as functional units that execute various processes.

[0437] The memory unit 7190 also includes a related information memory area 7192 and a voice data memory area 7194 as memory areas for information regarding voice recognition processing for the first device 7010, the second device 7020, and the third device 7030, and starting / stopping at least some of the functions related to the voice recognition processing.

[0438] In addition, the associated information storage area 7192 stores the identification codes of devices controlled by the device control system 7400 in association with the identification codes of related devices.

[0439] Here, a certain device (referred to as device A) is related to another device (referred to as device B) means that they are in a preferable relationship such that when at least a portion of the functions (first function) related to the voice recognition processing of device A is started / stopped, at least a portion of the functions (second function) related to the voice recognition processing of device B is started / stopped. For example, specifically, when device A and device B are located relatively close to each other, device A and device B are often in a preferable relationship such that when at least a portion of the functions related to the voice recognition processing of device A is started / stopped, at least a portion of the functions related to the voice recognition processing of device B is started / stopped.

[0440] The device with which device A is to be stored in association is determined, for example, based on information input to the first server 7100 by the user of device A from an information terminal or the like (not shown).

[0441] As a specific example, when information that device A and device B are installed in the same space is input, device A and device B are stored as related devices in the related information storage area 7192. For example, in the example of Fig. 49, the first device 7010 and the second device 7020 are placed in the same space (first space), so the first device 7010 and the second device 7020 are stored in association with each other. On the other hand, the third device 7030 is placed in a space (second space) different from the first device 7010 and the second device 7020, so the third device 7030 is not stored in association with the first device 7010 and the second device 7020.

[0442] In another example, when information is input that device A and device B are installed in the same building, device A and device B may be stored in related information storage area 7192 as being related devices.

[0443] In another example, when multiple devices are communicating with multiple access points within a building via wireless LAN, devices using the same access point may be stored in the related information storage area 7192 as being related devices.

[0444] In yet another example, device A and device B may be stored in the related information storage area 7192 as related devices upon notification by the users of the devices.

[0445] The voice data receiving unit 7110, voice analysis unit 7120, analysis result transmission unit 7130, detection unit 7140, judgment unit 7150, start / stop determination unit 7160, start / stop information transmission unit 7170, and start / stop request unit 7180 will be described below.

[0446] (2-2-1-1) Voice data reception section The voice data receiving unit 7110 is an example of a first voice data receiving unit and a second voice data receiving unit. The voice data receiving unit 7110 receives voice data transmitted by the voice data transmitting unit 7014 of the first device 7010, the voice data transmitting unit 7024 of the second device 7020, and the voice data transmitting unit (not shown) of the third device 7030. When the voice data receiving unit 7110 receives voice data transmitted by the voice data transmitting unit 7014 of the first device 7010, the voice data transmitting unit 7024 of the second device 7020, and the voice data transmitting unit (not shown) of the third device 7030, it is preferable that the received voice data is temporarily stored in the voice data storage area 7194 before the execution of the voice analysis. However, the timing of storing the voice data is an example, and the voice data may be stored in the voice data storage area 7194 before or during the execution of the voice analysis.

[0447] A function by the voice data receiving unit 7110 to receive voice data transmitted by the first device 7010, which is an example of a function related to voice recognition processing for the first device 7010 (hereinafter, for the sake of simplicity, this will be referred to simply as the voice data receiving function), is preferably configured so that start / stop can be instructed from the first device 7010.

[0448] Specifically, it is preferable that the start / stop of the voice data reception function can be requested to the first server 7100 (using a function start notification signal or a function stop notification signal) by, for example, an instruction to a switch 7011a of the first device 7010 or an instruction from a remote control 7011b of the first device 7010. Then, when the first server 7100 is requested to start / stop the voice data reception function, it is preferable that the first server 7100 instructs the start / stop of the voice data reception function in response to the request.

[0449] Furthermore, the start / stop of the voice data reception function may be instructed by voice input from the voice input unit 7012. For example, when voice instructing the start / stop of the voice data reception function is input to the voice input unit 7012, and the voice data of this voice is received by the voice data reception unit 7110 and recognized by the voice analysis unit 7120 as an instruction to start / stop the voice data reception function, it is preferable that the first server 7100 instructs the execution / stop of the voice data reception function in response to the instruction.

[0450] In addition, when the start / stop decision unit 7160 described later decides to stop at least a portion of the functions related to voice recognition processing for the first device 7010, it is preferable that the first server 7100 is capable of instructing the execution / stop of the voice data reception function.

[0451] Moreover, it is preferable that a function of storing voice data transmitted by the first device 7010 in a voice data storage area 7194 of the storage unit 7190 (hereinafter, for the sake of simplicity, simply referred to as a voice data storage function), which is an example of a function related to voice recognition processing for the first device 7010, can be configured so that start / stop can be instructed from the first device 7010. Specifically, it may be realized in the same way as start / stop of the voice data reception function, and therefore a description thereof will be omitted.

[0452] In addition, when the start / stop decision unit 7160 described later decides to stop at least some of the functions related to voice recognition processing for the first device 7010, it is preferable that the first server 7100 is able to instruct the execution / stop of the voice data storage function.

[0453] Here, the start / stop of the function of the voice data receiving unit 7110 receiving voice data transmitted by the first device 7010 and the function of storing the voice data transmitted by the first device 7010 in the voice data storage area 7194 of the storage unit 7190 has been described. The start / stop of the function of the voice data receiving unit 7110 receiving voice data transmitted by the second device 7020 or the third device 7030 is the same as the above description, and therefore will not be described here.

[0454] (2-2-1-2) Audio Analysis Section The voice analysis unit 7120 is an example of the first voice analysis unit and the second voice analysis unit. The voice analysis unit 7120 analyzes the content of the voice data received by the voice data receiving unit 7110 (the first device 7010, the second device 7020, and the third device). Specifically, the voice analysis unit 7120, for example, analyzes the voice data to obtain its feature amount, and generates text information from the feature amount by using a voice recognition dictionary including an acoustic model, a language model, and a pronunciation dictionary stored in a storage device. The text information generated by the voice analysis unit 7120 is, but is not limited to, text information such as "start operation", "set temperature 25 degrees", and "cooling operation".

[0455] A function in which the voice analysis unit 7120 analyzes voice data transmitted by the first device 7010, which is an example of a function related to voice recognition processing for the first device 7010 (hereinafter, for the sake of simplicity, simply referred to as a voice data analysis function), is preferably configured so that start / stop can be instructed from the first device 7010. Specifically, this may be realized in the same way as the start / stop of the voice data reception function described above, and therefore a description thereof will be omitted.

[0456] In addition, when the start / stop decision unit 7160 described later decides to stop at least some of the functions related to voice recognition processing for the first device 7010, it is preferable that the first server 7100 is capable of instructing the execution / stop of the voice data analysis function.

[0457] Here, the description has been given of starting / stopping the function of the audio analysis unit 7120 analyzing the audio data transmitted by the first device 7010. The description of starting / stopping the function of the audio analysis unit 7120 analyzing the audio data transmitted by the second device 7020 and the third device 7030 is the same as above, and therefore will not be repeated here.

[0458] (2-2-1-3) Analysis result transmission unit The analysis result transmission unit 7130 transmits the voice analysis result of the voice analysis unit 7120 (text information generated by the voice analysis unit 7120) to the second server 7200 or the third server 7300. Note that the voice analysis result preferably includes information regarding the transmission source of the voice data that was the subject of the voice analysis.

[0459] The analysis result transmission unit 7130 may transmit the voice analysis result to a server associated with the transmission source of the voice data that was the subject of the voice analysis. For example, in this case, when the transmission source of the voice data that was the subject of the voice analysis is the first device 7010 or the third device 7030, the analysis result transmission unit 7130 transmits the voice analysis result to the second server 7200. On the other hand, when the transmission source of the voice data that was the subject of the voice analysis is the second device 7020, the analysis result transmission unit 7130 transmits the voice analysis result to the third server 7300.

[0460] In another embodiment, the analysis result sending unit 7130 may select a destination for the voice analysis result based on the content of the voice analysis result (for example, in this case, if the content is for an air conditioner, the second server 7200 is selected, and if the content is for a television, the third server 7300 is selected), and send the analysis result to the selected server.

[0461] (2-2-1-4) Detection unit The detection unit 7140 detects that the first device 7010 has received an instruction to stop at least a part (first function) of the functions related to the voice recognition processing for the first device 7010. Similarly, the detection unit 7140 detects that the second device 7020 has received an instruction to stop at least a part of the functions related to the voice recognition processing for the second device 7020, or that the third device 7030 has received an instruction to stop at least a part of the functions related to the voice recognition processing for the third device 7030.

[0462] The detection unit 7140 also detects that the first device 7010 has received an instruction to start a first function that had been stopped. Similarly, the detection unit 7140 also detects that the second device 7020 has received an instruction to start a function related to speech recognition processing that had been stopped for the second device 7020, and that the third device 7030 has received an instruction to start a function related to speech recognition processing that had been stopped for the third device 7030.

[0463] Specifically, as described above, the detection unit 7140 detects that the first device 7010 has received an instruction to start / stop the first function related to the voice recognition processing for the first device 7010, based on a signal (function start notification signal / function stop notification signal) transmitted from the first device 7010 when the switch 7011a or the remote control 7011b receives an instruction to start / stop at least a part of the function related to the voice recognition processing for the first device 7010. Furthermore, when the voice data analyzed by the voice analysis unit 7120 indicates an instruction to start / stop the first function related to the voice recognition processing for the first device 7010, the detection unit 7140 detects that the first device 7010 has received an instruction to start / stop the first function related to the voice recognition processing for the first device 7010.

[0464] Detection of the second device 20 receiving an instruction to stop at least some of the functions related to the voice recognition processing, or the third device 30 receiving an instruction to stop at least some of the functions related to the voice recognition processing, may be performed in a similar manner.

[0465] The detection unit 7140 does not have to detect that the first device 7010 has received an instruction to start / stop the first function related to the voice recognition processing based on a function start notification signal / function stop notification signal transmitted from the first device 7010. For example, when the first function is a communication function of the first device 7010, the detection unit 7140 may detect that the first device 7010 has received an instruction to start / stop the first function related to the voice recognition processing based on whether the first server 7100 can communicate with the first device 7010.

[0466] (2-2-1-5) Judgment section The determination unit 7150 determines devices related to the first device 7010, the second device 7020, and the third device 7030. The determination unit 7150 determines devices related to the first device 7010, the second device 7020, and the third device 7030 based on information stored in a related information storage area 7192 of the storage unit 7190, for example.

[0467] (2-2-1-6) Start / stop decision section When the detection unit 7140 detects that a certain device (referred to as device A) has received an instruction to stop at least a part of functions (first functions) related to the voice recognition processing for device A, the start / stop determination unit 7160 determines to stop, for another device (referred to as device B), at least a part of functions (second functions) related to the voice recognition processing, in which a voice input unit receives voice, transmits voice data of the received voice, the voice data reception unit 7110 receives the transmitted voice data, and the voice analysis unit 7120 analyzes the received voice data. More specifically, when the detection unit 7140 detects that device A has received an instruction to stop the first function of the voice recognition processing for device A and the devices determined by the determination unit 7150 to be related to device A include device B, the start / stop determination unit 7160 determines to stop the second function related to the voice recognition processing for device B.

[0468] A specific example will be given for explanation.

[0469] For example, it is assumed that the first device 7010 and the second device 7020 are stored in association with each other in the associated information storage area 7192, but the first device 7010 and the third device 7030 are not stored in association with each other. In other words, it is assumed that the devices that the determination unit 7150 determines to be associated with the first device 7010 include the second device 7020, but not the third device 7030. It is also assumed that the detection unit 7140 detects that the first device 7010 has received an instruction to stop the first function of the voice recognition processing for the device. In this case, the start / stop determination unit 7160 determines to stop at least a part of the function (second function) related to the voice recognition processing for the second device 7020. On the other hand, the start / stop determination unit 160 does not determine to stop the function related to the voice recognition processing for the third device 30.

[0470] In addition, it is preferable that the first function to be stopped in the voice recognition processing for device A and the second function of the voice recognition processing for device B that is stopped based on the stopping of the first function are the same type of function.

[0471] In addition, the second function and the first function being the same type of function means, for example, when the first function is a function of receiving voice by the voice input unit 7012, the second function is a function of receiving voice by the voice input unit 7022. In addition, the second function and the first function being the same type of function means, for example, when the first function is a function of transmitting voice data by the first device 7010, the second function is a function of transmitting voice data by the second device 7020. In addition, the second function and the first function being the same type of function means, for example, when the first function is a function in which the voice analysis unit 7120 analyzes voice data transmitted by the first device 7010, the second function is a function in which the voice analysis unit 7120 analyzes voice data transmitted by the second device 7020.

[0472] However, the first function and the second function do not have to be the same type of function. For example, the second function of the voice recognition processing for device B, which is stopped when the first function of the voice recognition processing for device A is stopped, may be determined in advance (regardless of the type of function the first function is).

[0473] When the start / stop determination unit 7160 determines to stop the second function of the voice recognition processing for device B, if the second function is a function that can be stopped on the device control system 7400 side, the first server 7100 performs processing to stop this second function. Note that the functions that can be stopped on the device control system 7400 side include a function in which the voice data receiving unit 7110 receives voice data transmitted by the device, a function in which the voice analysis unit 7120 analyzes voice data transmitted by the device, and a function in which the voice data storage area 7194 of the storage unit 7190 of the first server 7100 accumulates voice data transmitted by the device. On the other hand, if the second function is a function that cannot be stopped on the device control system 7400 side (if it is a function that is stopped on the device B side), a start / stop request unit 7180 described later transmits a stop request to device B.

[0474] Furthermore, when the detection unit 7140 detects that a certain device (referred to as device A) has received an instruction to start (resume) at least a part of the functions (the stopped first function) related to the voice recognition processing for device A, the start / stop determination unit 7160 determines to start (resume) at least a part of the functions (the stopped second function) related to the voice recognition processing for another device (referred to as device B), in which the voice input unit receives voice, transmits voice data of the received voice, the voice data reception unit 7110 receives the transmitted voice data, and the voice analysis unit 7120 analyzes the received voice data. More specifically, when the detection unit 7140 detects that device A has received an instruction to start the first function of the voice recognition processing for device A and the devices determined by the determination unit 7150 to be related to device A include device B, the start / stop determination unit 7160 determines to start the second function related to the voice recognition processing for device B. In other words, when it is detected that voice recognition processing for device A is executable and device B is included among the devices that the judgment unit 7150 judges to be associated with device A, the start / stop determination unit 7160 decides to enable voice recognition processing for device B.

[0475] When the start / stop decision unit 7160 decides to start (resume) the second function of the voice recognition processing for device B, if the second function is a function that can be started on the device control system 7400 side (in other words, if the second function is a function that has been stopped on the device control system 7400 side), the first server 7100 performs processing to start this second function. On the other hand, if the second function is a function that cannot be started on the device control system 7400 side (if it is a function that is to be started on the device B side), the start / stop request unit 7180, which will be described later, sends a start request to device B.

[0476] (2-2-1-7) Start / Stop Information Transmitter When the start / stop decision unit 7160 decides to start / stop a second function related to voice recognition processing for a certain device, the start / stop information sending unit 7170 transmits function start information / function stop information to the second device 7020 so that the notification unit of the device notifies the stop of the second function.

[0477] For example, to explain using a specific example, when the start / stop decision unit 7160 decides to start / stop the second function related to voice recognition processing for the second device 7020, the start / stop information sending unit 7170 transmits function start information / function stop information to the second device 7020 so that the notification unit 7028 of the second device 7020 notifies that the second function has been stopped.

[0478] In addition, if the second function is a function that is started / stopped on the device side (that is, if the second function is a voice reception function of a voice input section of the device or a voice data transmission function of a voice data transmission section), a start / stop request unit 7180 described later transmits a signal requesting the starting / stopping of the second function to the device. Therefore, if the second function is a function that is started / stopped on the device side, a start request / stop request described later may be transmitted instead of function start information / function stop information. In other words, if the second function is a function that is started / stopped on the device side, the start / stop request unit 7180 may also have the function of the start / stop information transmission unit 7170.

[0479] (2-2-1-8) Start / stop request section In response to the decision of the start / stop decision section 7160, the start / stop request section 7180 transmits a signal to the second device 7020 requesting the second function to be stopped.

[0480] Specifically, the start / stop request unit 7180 determines whether to start / stop a second function of voice recognition processing for a device by the start / stop decision unit 7160, and if the second function is a function that cannot be stopped by the device control system 7400 (a function that must be stopped on the device side), it generates and sends a start / stop request to the device.

[0481] (2-2-2) Second and third servers The second server 7200 is a computer having a processor, a storage device including a main storage device and an auxiliary storage device, a communication interface, etc. The second server 7200 is connected to at least the first device 7010, the third device 7030, and the first server 7100 via the network 7040 so as to be able to communicate with each other.

[0482] The third server 7300 is also a computer similar to the second server 7200. The second server 7200 is connected to the second device 7020 and the first server 7100 via the network 7040 so as to be able to communicate with each other.

[0483] The second server 7200 executes various processes by causing the processor to execute programs stored in the storage unit. The second server 7200 has an analysis result receiving unit 7210 and a signal generating and transmitting unit 7220 as functional units that execute various processes.

[0484] The analysis result receiving unit 7210 receives the analysis result (eg, text data) of the voice data transmitted by the first device 7010 or the third device 7030 by the voice analysis unit 7120 of the first server 7100.

[0485] The signal generating and transmitting unit 7220 generates and transmits a signal (command) based on the analysis result (text data) received by the analysis result receiving unit 7210 so that the first device 7010 or the third device 7030 that sent the voice data will be in an operating state corresponding to the analysis result (for example, if the analysis result is text data such as "start air conditioner operation", then the device that sent the voice data will start operating).

[0486] The third server 7300 is similar, and has an analysis result receiving unit 7310 and a signal generating and transmitting unit 7320.

[0487] The analysis result receiving unit 7310 receives the analysis result (eg, text data) of the voice data transmitted by the second equipment 7020 by the voice analysis unit 7120 of the first server 7100.

[0488] The signal generating and transmitting unit 7320 generates and transmits a signal (command) based on the analysis result (text data) received by the analysis result receiving unit 7310 so that the second device 7020, which is the source of the voice data, is put into an operating state corresponding to the analysis result (for example, if the analysis result is text data saying "power on", the power of the device which has sent the voice data is turned on).

[0489] (3) Voice control of devices The voice operation of a device is now described. The voice operation of a device can be performed when the voice recognition process for that device is executable (when the functions required for executing the voice recognition process are not stopped).

[0490] Here, the voice operation of the device will be described with reference to Fig. 50, taking as an example a case where the first device 7010 is voice operated. Note that the process flow when the third device 7030 is voice operated is the same as the process flow when the first device 7010 is voice operated, except for the device, and therefore the description will be omitted.

[0491] First, in step S1, it is assumed that an instruction voice (for example, "Start air conditioner operation") is input to the voice input unit 7012 of the first device. As a result, the voice data of the voice received by the voice input unit 7012 is transmitted from the voice data transmission unit 7014 to the first server 7100 of the device control system 7400.

[0492] Next, in step S2, the voice data receiving unit 7110 of the first server 7100 receives the voice data.

[0493] Next, in step S3, the voice data accepted by the voice data accepting unit 7110 is stored in a voice data storage area 7194 of the storage unit 7190. The voice data stored in the voice data storage area 7194 is used for voice analysis in the next step S4, and is also stored in the voice data storage area 7194 as history data of the voice data.

[0494] Note that here, before voice analysis of the voice data is performed, the voice data is stored in the voice data storage area 7194, but alternatively or in addition, the voice analysis results may be stored as historical data in the storage unit 7190.

[0495] Next, in step S4, the voice analysis unit 7120 performs a voice analysis of the voice data stored in the voice data storage area 7194. The obtained voice analysis result is transmitted to the second server 7200 by the analysis result transmission unit 7130.

[0496] In step S 5 , the analysis result receiving unit 7210 of the second server 7200 receives the analysis result transmitted by the analysis result transmitting unit 7130 .

[0497] Next, in step S6, the signal generating and transmitting unit 7220 generates a signal (command or information) based on the analysis result (the analysis result that the content of the voice data is an instruction to start driving), and transmits it to the first device 7010.

[0498] Next, in step S7, the first device 7010 receives the signal transmitted from the signal generating and transmitting unit 7220, and if the signal is, for example, a command, executes an operation according to the command.

[0499] 51 is a sequence diagram for explaining voice operation of the second device 7020 when the second device 7020 is voice operated. Here, the difference is that the third server 7300 is used instead of the second server 7200, but the contents of the process are the same as when the first device 7010 is voice operated, so the description will be omitted.

[0500] (4) Processing for stopping a second function of a voice recognition process in a device when a first function of a voice recognition process in a device is stopped. Next, a process for stopping a second function of voice recognition processing in a certain device when a first function of voice recognition processing is stopped in another device will be described with reference to sequence diagrams in FIGS. 52 and 53.

[0501] In Figure 52, as an example of the first function of voice recognition processing for the first device 7010, a case where the voice reception function of the voice input unit 7012 is stopped is taken as an example, and the process of stopping the second function of voice recognition processing in another device (a device other than the first device 7010) is explained.

[0502] Note that, here, it is assumed that the devices that the determination unit 7150 determines to be related to the first device 7010 based on the information stored in the related information storage area 7192 of the storage unit 7190 include the second device 7020 but do not include the third device 7030. Also, here, it is assumed that the first function (i.e., the voice reception function of the voice input unit 7012) to be stopped in the voice recognition processing for the first device 7010 and the second function of the voice recognition processing for another device that is stopped based on the stopping of the first function are the same type of function.

[0503] In the sequence diagram of Figure 52, the first and second functions are voice reception functions of the voice input unit, but the processing flow is the same (except for the fact that the functions that are stopped are different) even if the first and second functions are voice data transmission functions of the voice data transmission unit.

[0504] First, in step S21, it is assumed that an instruction to activate the voice reception function of the voice input unit 7012 is given to the physical switch 7011a, which is an example of an instruction reception unit.

[0505] As a result, the voice input unit 7012 of the first device 7010 enters a state in which it cannot accept voice (step S23). For example, in step S23, power is no longer supplied to the electric and electronic circuit that operates the voice input unit 7012. Then, in step S24, the notification unit 7018 turns on the first color LED (e.g., red LED) (and turns off the second color LED (e.g., blue LED)) to notify that the voice recognition process for the first device 7010 has been stopped.

[0506] Furthermore, as a result of the switch 7011a receiving the instruction in step S21, the first device 7010 notifies the first server 7100 that the voice reception function of the voice input unit 7012 has been stopped (function stop notification signal). Note that the notification that the function has been stopped preferably does not merely notify that the function has been stopped, but also transmits information that can identify which function has been stopped. In step S22, the detection unit 7140 of the first server 7100 detects, based on the signal transmitted from the first device 7010, that an instruction to stop the first function related to the voice recognition processing for the first device 7010 has been received.

[0507] Next, in step S25, the determination unit 7150 of the first server 7100 determines devices related to the first device 7010 based on the information stored in the related information storage area 7192 of the storage unit 7190. Here, the devices related to the first device 7010 include the second device 7020, but do not include the third device 7030.

[0508] Next, in step S26, based on the results of steps S22 and S25, the start / stop determination unit 7160 decides to stop at least a part of functions (second functions) related to the voice recognition processing for the second device 7020. In particular, here, the start / stop determination unit 7160 decides to stop the voice reception function of the voice input unit 7022, which is the same type as the first function, as an example of the second function related to the voice recognition processing for the second device 7020. Meanwhile, the start / stop determination unit 7160 does not decide to stop the functions related to the voice recognition processing for the third device 7030.

[0509] Note that the voice reception function of the voice input unit 7022 is a function that cannot be stopped on the device control system 7400 side (it is a function that is stopped on the second device 7020 side). Therefore, in step S27, the start / stop request unit 7180 transmits a stop request for the second function (the voice reception function of the voice input unit 22) to the second device 7020.

[0510] In the second device 7020, when the start / stop request receiving unit 7026 receives the stop request (step S28), in response, an instruction is given to stop the voice reception function of the voice input unit 7022, and the voice reception function of the voice input unit 7022 is stopped (step S29).

[0511] Next, in step S30, since the start / stop decision unit 7160 has decided in step S26 to stop the second function related to voice recognition processing for the second device 7020 (the voice reception function of the voice input unit 7022), the start / stop information sending unit 7170 sends function stop information to the second device 7020 so that the notification unit 7028 of the second device 7020 notifies the stop of the second function.

[0512] In the second device 7020, when the start / stop information receiving unit 7027 receives function stop information (step S31), in response, the notification unit 7018 turns on the first color LED (e.g., a red LED) (and turns off the second color LED (e.g., a blue LED)).

[0513] Here, the first server 7100 transmits the function stop information in addition to the stop request, but the transmission of the function stop information may be omitted. Then, when the second device 7020 receives the stop request, the notification unit 7018 may turn on the first color LED (e.g., red LED) (turning off the second color LED (e.g., blue LED)). In other words, the stop request may also serve as the function stop information.

[0514] If the voice reception function of the voice input unit 7022 is stopped in step S1 as an example of the first function of the voice recognition process for the second device 7020, the process flow is similar except that the process performed in the first device 7010 is performed in the second device 7020 and the process performed in the second device 7020 is performed in the first device 7010, and therefore the description will be omitted. If the voice reception function of the voice input unit is stopped in step S1 as an example of the first function of the voice recognition process for the third device 7030, in this embodiment, since there is no device associated with the third device 7030, only the voice reception function of the voice input unit of the third device 7030 is stopped, and there is no particular effect on the first device 7010 and the second device 7020.

[0515] Next, in Figure 53, as an example of the first function of voice recognition processing for the first device 7010, a process of stopping the second function of voice recognition processing in another device (a device other than the first device 7010) is explained using an example where the function of the voice data receiving unit 7110 to receive voice data transmitted by the first device 7010 (hereinafter, for simplicity of explanation, referred to as the first voice data receiving function) is stopped.

[0516] In addition, here, it is assumed that the devices that the determining unit 7150 determines to be related to the first device 7010 based on the information stored in the related information storage area 7192 of the storage unit 7190 include the second device 7020 and do not include the third device 7030. In addition, here, it is assumed that the first function (i.e., the first voice data receiving function) that is stopped in the voice recognition processing for the first device 7010 and the second function (hereinafter, for the sake of simplicity of explanation, referred to as the second voice data receiving function) of the voice recognition processing for another device that is stopped based on the stopping of the first function are the same type of function.

[0517] In the sequence diagram of Figure 53, the first and second functions are functions in which the voice data receiving unit 7110 receives voice data, but the processing flow is similar (except for the functions that are stopped being different) even if the first and second functions are functions in which the voice analysis unit 7120 analyzes voice data, or functions in which the voice data is stored in the memory unit 7190.

[0518] First, in step S41, it is assumed that an instruction to stop the first voice data receiving function is given to the physical switch 7011a, which is an example of an instruction receiving unit.

[0519] In step S42, the notification unit 7018 notifies that the first function of the voice recognition processing for the first device 7010 has been stopped by turning on a first color LED (e.g., a red LED) (and turning off a second color LED (e.g., a blue LED)).

[0520] As a result of the switch 7011a receiving the instruction in step S41, the first device 7010 transmits to the first server 7100 a notification (function stop notification signal) that the first voice data reception function will be stopped (a request to stop the first voice data reception function). Note that the notification that the function will be stopped preferably does not merely notify that the function has been stopped, but also transmits information that can identify which function has been stopped. In step S43, the detection unit 7140 of the first server 7100 detects, based on the signal transmitted from the first device 7010, that an instruction to stop the first function related to the voice recognition processing for the first device 7010 has been received.

[0521] Furthermore, the first server 7100 instructs the first voice data reception function to be stopped in response to the notification (request) to stop the first voice data reception function (step S44). As a result, the voice data reception unit 7110 is brought into a state in which it does not receive voice data transmitted from the first device 7010.

[0522] Next, in step S45, the determination unit 7150 of the first server 7100 determines devices related to the first device 7010 based on the information stored in the related information storage area 7192 of the storage unit 7190. Here, the devices related to the first device 7010 include the second device 7020, but do not include the third device 7030.

[0523] Next, in step S46, based on the results of steps S43 and S45, the start / stop determination unit 7160 decides to stop at least a part of functions (second functions) related to the voice recognition processing for the second device 7020. In particular, here, the start / stop determination unit 7160 decides to stop a second voice data reception function, which is the same type as the first function, as an example of the second function related to the voice recognition processing for the second device 7020. Meanwhile, the start / stop determination unit 7160 does not decide to stop the functions related to the voice recognition processing for the third device 7030.

[0524] The second voice data reception function can be stopped on the device control system 7400 side. Therefore, in step S47, the first server 7100 instructs the device control system 7400 to stop the second voice data reception function (step S44). As a result, the voice data reception unit 7110 is put into a state in which it does not receive voice data transmitted from the second device 20.

[0525] Next, in step S48, since the start / stop decision unit 7160 has decided in step S47 to stop the second function (second voice data acceptance function) related to voice recognition processing for the second device 7020, the start / stop information sending unit 7170 sends function stop information to the second device 7020 so that the notification unit 7028 of the second device 7020 notifies the stop of the second function.

[0526] In the second device 7020, when the start / stop information receiving unit 7027 receives function stop information (step S51), in response, the notification unit 7018 turns on the first color LED (e.g., a red LED) (and turns off the second color LED (e.g., a blue LED)) (step S52).

[0527] (5) A process for starting (resuming) a second function of a voice recognition process in another device when a first function of a voice recognition process in a certain device is started (resumed) The process of starting a second function of speech recognition processing in a certain device when a first function of speech recognition processing is started in another device is shown in the sequence diagrams of FIGS. 54 and 55. In FIG.

[0528] Figure 54 shows the start processing of the second function of the voice recognition processing in another device (a device other than the first device 7010) by taking the case where the voice reception function of the voice input unit 7012 is started as an example of the first function of the voice recognition processing for the first device 7010.

[0529] It is assumed here that the devices that the determination unit 7150 determines to be related to the first device 7010 based on the information stored in the related information storage area 7192 of the storage unit 7190 include the second device 7020 but do not include the third device 7030. It is also assumed here that a first function (i.e., a voice reception function of the voice input unit 7012) started for the voice recognition processing for the first device 7010 and a second function of the voice recognition processing for another device that is started based on the start of the first function are the same type of function.

[0530] The sequence diagram in Fig. 54 differs from the sequence diagram in Fig. 52 in that the first and second functions are started and stopped, but the flow is generally similar. Therefore, the sequence diagram in Fig. 54 is omitted here.

[0531] Figure 55 shows the start processing of the second function of the voice recognition processing in another device (a device other than the first device 7010) by using as an example the case where the function of the voice data receiving unit 7110 to receive voice data transmitted by the first device 7010 (hereinafter, for the sake of simplicity, referred to as the first voice data receiving function) is started as an example of the first function of the voice recognition processing for the first device 7010.

[0532] It is assumed here that the devices that the determining unit 7150 determines to be related to the first device 7010 based on the information stored in the related information storage area 7192 of the storage unit 7190 include the second device 7020 and exclude the third device 7030. It is also assumed here that a first function (i.e., a first voice data receiving function) that is started for the voice recognition processing for the first device 7010 and a second function (hereinafter, for the sake of simplicity of explanation, referred to as a second voice data receiving function) of the voice recognition processing for another device that is started based on the stop of the first function are the same type of function.

[0533] The sequence diagram in Fig. 55 differs from the sequence diagram in Fig. 53 in that the first and second functions are started, or the first and second functions are started, but the flow is generally similar. Therefore, the sequence diagram in Fig. 55 is omitted here.

[0534] (6) Features (6-1) The device control system 7400 of this embodiment controls a first device 7010 as an example of a first device and a second device 7020 as an example of a second device. The first device 7010 has a voice input unit 7012 as an example of a first voice input unit, and transmits voice data of a voice received by the voice input unit 7012. The second device 7020 has a voice input unit 7022 as an example of a second voice input unit, and transmits voice data of a voice received by the voice input unit 7022. The device control system 7400 includes a voice data receiving unit 7110 as an example of a first voice data receiving unit and a second voice data receiving unit, a voice analysis unit 7120 as an example of a first voice analysis unit and a second voice analysis unit, a detection unit 7140, and a start / stop determination unit 7160. The voice data receiving unit 7110 receives the voice data transmitted by the first device 7010. The voice data receiving unit 7110 receives voice data transmitted by the second device 7020. The voice analysis unit 7120 analyzes the voice data received by the voice data receiving unit 7110. The detection unit 7140 detects that the first device 7010 has received an instruction to stop at least a part of a first function related to voice recognition processing for the first device 7010, in which the voice input unit 7012 receives voice, transmits voice data of the received voice, the voice data receiving unit 7110 receives the transmitted voice data, and the voice analysis unit 7120 analyzes the received voice data. When the detection unit 7140 detects that the first device 7010 has received an instruction to stop the first function, the start / stop decision unit 7160 decides to stop at least a part of the second function related to voice recognition processing for the second device 7020, in which the voice input unit 7022 accepts voice, transmits voice data of the accepted voice, the voice data accepting unit 7110 accepts the transmitted voice data, and the voice analysis unit 7120 analyzes the accepted voice data.

[0535] In this device control system 7400, when the first device 7010 receives an instruction to stop a first function, which is at least a part of the functions related to the voice recognition processing, a second function, which is at least a part of the functions related to the voice recognition processing, is stopped in the second device 7020. In other words, in this device control system 7400, when the user stops the voice recognition processing in the first device 7010, the voice recognition processing in the second device 7020 is also stopped. Therefore, by using this device control system 7400, the effort of stopping the execution of the voice recognition processing in each of the multiple devices can be eliminated, and the voice recognition processing in the multiple devices can be stopped with a simple operation.

[0536] (6-2) In the device control system 7400 of the present embodiment, the second function is a voice reception function of the voice input unit 7022, or a voice data transmission function of the second device 7020.

[0537] Here, since audio data is no longer transmitted from the second device 7020, problems such as privacy issues and interception of audio data, which are associated with the transmission of audio data, can be easily prevented.

[0538] (6-3) The device control system 7400 of the present embodiment includes a start / stop request unit 7180 as an example of a stop request unit. The start / stop request unit 7180 transmits a signal requesting the second device 7020 to stop the second function in response to the decision of the start / stop decision unit 7160.

[0539] Here, since the second device 7020 is instructed directly to stop the second function in the second device 7020, the reliability of stopping the voice recognition process for the second device 7020 is high.

[0540] (6-4) In the device control system 7400 of this embodiment, the second function may be a function in which the voice data receiving unit 7110 receives voice data transmitted by the second device 7020, a function in which the voice analysis unit 7120 analyzes the voice data transmitted by the second device 7020, or a function in which the voice data transmitted by the second device 7020 is stored.

[0541] Here, the voice recognition process for the second device 7020 can be stopped only by the process on the device control system 7400 side.

[0542] (6-5) In the device control system 7400 of this embodiment, the second function is the same type of function as the first function.

[0543] In addition, the second function and the first function being the same type of function means, for example, when the first function is a function of receiving voice by the voice input unit 12, the second function is a function of receiving voice by the voice input unit 7022. In addition, the second function and the first function being the same type of function means, for example, when the first function is a function of transmitting voice data by the first device 7010, the second function is a function of transmitting voice data by the second device 7020. In addition, the second function and the first function being the same type of function means, for example, when the first function is a function in which the voice analysis unit 7120 analyzes voice data transmitted by the first device 7010, the second function is a function in which the voice analysis unit 7120 analyzes voice data transmitted by the second device 7020.

[0544] Here, when a function related to the voice recognition processing for the first device 7010 is stopped, the same type of function related to the voice recognition processing for the second device 7020 can be stopped. Therefore, with regard to the voice recognition processing, both the first device 7010 and the second device 7020 can be shifted to a state desired by the user.

[0545] (6-6) In the device control system 7400 of the present embodiment, the second device 7020 has a notification unit 7028 that notifies that the second function has been stopped. The device control system 7400 includes a start / stop information transmission unit 7170 as an example of a stop information transmission unit. When the start / stop decision unit 7160 decides to stop the second function, the start / stop information transmission unit 7170 transmits function stop information to the second device 7020 so that the notification unit 7028 notifies that the second function has been stopped.

[0546] Here, when the user stops the voice recognition process for the first device 7010, the user can confirm that the voice recognition process for the second device 7020 has also been stopped.

[0547] (6-7) The device control system 7400 of the present embodiment includes a determination unit 7150 that determines devices associated with the first device 7010. When the detection unit 7140 detects that the first device 7010 has received an instruction to stop the first function and the second device 7020 is included in the devices determined by the determination unit 7150 to be associated with the first device 7010, the start / stop determination unit 7160 determines to stop the second function of the second device 7020.

[0548] Here, the voice recognition process for the first device 7010 can be stopped simultaneously with the voice recognition process for the second device 7020 related to the first device 7010. In other words, when it is determined that the first device 7010 and the second device 7020 are not related to each other, even if the voice recognition process for the first device 7010 is stopped, the voice recognition process for the second device 7020 can remain active.

[0549] (6-8) In the device control system 7400 of this embodiment, an instruction to stop the first function received by the first device 7010 includes an instruction to a physical switch 7011a, an instruction from a remote control 7011b, or an audio instruction to an audio input unit 7012.

[0550] (6-9) In the device control system 7400 of this embodiment, the detection unit 7140 detects that the first device 7010 has received an instruction to start the first function. The device control system 7400 includes a start / stop determination unit 7160 as an example of a start determination unit. When the detection unit 7140 detects that the first device 7010 has received an instruction to start the first function, the start / stop determination unit 7160 determines that the second device 7020 will start the second function.

[0551] Here, when the first device 7010 receives an instruction to start (resume) a first function related to the voice recognition processing, the second function related to the voice recognition processing for the second device 7020 is also started (resume). In other words, in this device control system 7400, the user can enable the voice recognition processing for the second device 7020 by enabling the voice recognition processing for the first device 7010. Therefore, by using this device control system 7400, the effort of enabling the execution of the voice recognition processing for each of the multiple devices can be eliminated, and the voice recognition processing for the multiple devices can be started with a simple operation.

[0552] (6-10) The second device 7020 of this embodiment is a device that can be operated by voice. The second device 7020 includes a voice input unit 7022, a voice data transmission unit 7024, an instruction reception unit (for example, a switch 7021a, a remote control 7021b, or the voice input unit 7022), and a start / stop information reception unit 7027 as an example of a stop information reception unit. The voice input unit 7022 receives voice. The voice data transmission unit 7024 transmits the voice received by the voice input unit 7022 as voice data to the device control system 7400 having the voice analysis unit 7120. The instruction reception unit receives an instruction to stop at least a part of the functions related to the voice recognition process, in which the voice input unit 7022 receives voice, the voice data transmission unit 7024 transmits the voice data, and the transmitted voice data is analyzed by the voice analysis unit 7120 of the device control system 7400. The start / stop information receiving unit 7027 receives function stop information transmitted from the device control system 7400 regarding a decision to stop at least a portion of functions related to voice recognition processing of the second device 7020 in response to the stopping of at least a portion of functions related to voice recognition processing of another voice-operable device (e.g., the first device 7010).

[0553] Although the explanation is omitted, the same applies to the first device 7010 and the third device 7030.

[0554] In the second device 7020, the voice recognition process can be stopped for the second device 7020 in response to a user instruction, and the voice recognition process for the second device 7020 can be stopped in conjunction with the stopping of the voice recognition process for another device (for example, the first device 7010). Therefore, by using the second device 7020, the effort of stopping the execution of the voice recognition process for each of the multiple devices can be eliminated, and the voice recognition process for the multiple devices can be stopped with a simple operation.

[0555] Furthermore, if functions related to voice recognition processing are stopped using a physical switch 7021a, the reliability of stopping the voice recognition processing can be improved (the occurrence of a state in which the voice recognition processing is not stopped can be reduced).

[0556] (6-11) The control method of the present embodiment is a method for controlling a first device 7010 and a second device 7020. The first device 7010 has a voice input unit 7012 as an example of a first voice input unit, and a voice data transmission unit 7014 as an example of a first voice data transmission unit. The voice data transmission unit 7014 transmits first voice data of the voice accepted by the voice input unit 7012 to the device control system 7400. The device control system 7400 has a voice data acceptance unit 7110 as an example of a first voice data acceptance unit that accepts the first voice data, and a voice analysis unit 7120 as an example of a first voice analysis unit that analyzes the first voice data accepted by the voice data acceptance unit 7110. The second device 7020 has a voice input unit 7022 as an example of a second voice input unit, and a voice data transmission unit 7024 as an example of a second voice data transmission unit. The voice data transmission unit 7024 transmits the second voice data of the voice accepted by the voice input unit 7022 to the device control system 7400. The device control system 7400 has a voice data acceptance unit 7110 as an example of a second voice data acceptance unit that accepts the second voice data, and a voice analysis unit 7120 as an example of a second voice analysis unit that analyzes the second voice data accepted by the voice data acceptance unit 7110. The control method includes a detection step (steps S22, S42) and a determination step (steps S26, S48). In the detection step, it is detected that the first device 7010 has received an instruction to stop at least a part of the first function related to the voice recognition process, in which the voice input unit 7012 accepts the first voice, the voice data transmission unit 7014 transmits the first voice data, the voice data acceptance unit 7110 accepts the transmitted first voice data, and the voice analysis unit 7120 analyzes the accepted first voice data. In the decision step, when it is detected that the first device 7010 has received an instruction to stop the first function, it is decided that for the second device 7020, at least a part of the second function related to voice recognition processing is to be stopped, in which the voice input unit 7022 receives the second voice, the voice data transmission unit 7024 transmits the second voice data, the voice data receiving unit 7110 receives the transmitted second voice data, and the voice analysis unit 7120 analyzes the received second voice data.

[0557] In this control method, when it is detected that the first device 7010 has received an instruction to stop at least a first function related to the voice recognition processing, it is determined to also stop at least a second function related to the voice recognition processing of the second device 7020. Therefore, by using this control method, it is possible to save the trouble of stopping the execution of the voice recognition processing of each of the multiple devices, and to stop the voice recognition processing of the multiple devices with a simple operation.

[0558] (7) Variations Modifications of the above embodiment are given below. The modifications may be combined with each other as appropriate as long as they are not inconsistent.

[0559] (7-1) Variation A In the above embodiment, the device control system 7400 has three servers (the first server 7100, the second server 7200, and the third server 7300), but is not limited to this.

[0560] For example, the device control system 7400 may have a single server having functions similar to those of the above-described first server 7100, second server 7200, and third server 7300. Also, for example, the device control system 7400 may have two or four or more servers, and these servers may be configured to have functions similar to those of the above-described first server 7100, second server 7200, and third server 7300.

[0561] Furthermore, for example, a function similar to that of the above-described first server 7100 may be realized by a plurality of servers different from the second server 7200 and the third server 7300 working together.

[0562] (7-2) Variation B In the above embodiment, the first device 10, the second device 20, and the third device 30 are home appliances, but are not limited thereto. For example, the first device 10 may be a voice-operated home appliance.

[0563] The voice-operated device has a voice input unit that accepts voice, transmits voice data of the voice received by the voice input unit to the device control system 7400, receives a signal based on the analysis result of the voice data by the device control system 7400, and controls the operation of the home appliance to be operated in response to the signal. As a specific example, the voice-operated device is a voice-operated device (voice remote control) of the first device 7010. The voice-operated device accepts a command voice for the first device 7010 (for example, a voice saying "start operation of the air conditioner") and transmits the voice data of the accepted voice to the device control system 7400. The voice-operated device then receives a signal based on the analysis result of the voice data by the device control system 7400 (a signal indicating the analysis result that the content of the voice data was an instruction to start operation of the air conditioner), and transmits a command signal to start operation to the air conditioner to be operated from an infrared signal transmission unit of the voice-operated device.

[0564] Also, for example, a voice-operated device may have a voice input unit that accepts voice, transmit voice data of the voice received by the voice input unit to the device control system 7400, and control the object to be operated by transmitting a signal based on the analysis result of the voice data from the device control system 7400 to the object to be operated of the device connected via the network 7040.

[0565] (7-3) Variation C In the above embodiment, the voice data receiving unit 7110 functions as a first voice data receiving unit and a second voice data receiving unit, and the voice analysis unit 7120 functions as a first voice analysis unit and a second voice analysis unit, but this is not limited to this.

[0566] For example, instead of providing the first server 7100 with a voice data receiving unit 7110 and a voice analysis unit 7120, the second server may be provided with a first voice data receiving unit that receives voice data transmitted by the first device 7010 and the third device 7030, and a first voice analysis unit that analyzes the voice data received by the first voice data receiving unit, and the third server may be provided with a second voice data receiving unit that receives voice data transmitted by the second device 7020, and a second voice analysis unit that analyzes the voice data received by the second voice data receiving unit.

[0567] Although the embodiment and modifications have been described above, it will be understood that various changes in form and details are possible without departing from the spirit and scope of the claims. [Industrial Applicability]

[0568] The present disclosure is widely applicable and useful to a device control system that controls a plurality of voice-operable devices, voice-operable devices controlled by the device control system, and methods for controlling these devices. [Explanation of symbols]

[0569] [First configuration] 1001 Equipment control systems (control systems) 1005 users 1010 First type of equipment (control equipment) 1020 Second type of equipment (control equipment) 1060 Voice input reception section 1070 Infrared output device 1100 Server 1104T Specific control memory unit 1110 Voice input analysis unit 1120 Control content specification unit 1130 First control section (control section) 1135 Second Control Section (Control Section) 1400 Setting support device 1410 Keyword input reception unit 1420 Control command selection unit 1430 Specific Control Registration Department G Editing screen GK Keyword Image GO control command image K Keywords O Control Command NW Network P Setting Support Program [Second configuration] 2011 Text Extraction 2012 Speech Recognition Dictionary 2013 Interpretation Department 2014 Control Unit 2016 Device information acquisition department 2017 Memory Department 2018 Arithmetic section 2019 Certification Department 2040 Server 2050 Network 2060 Building 2061 Router 2062 Air conditioner 2063 Audio input / output device 2064 Audio input section 2065 Audio output section 2069 Reference Environment Sensor 2090 Environmental Control System 2091 Air conditioner 2092 Electric fan 2093 Humidifier 2094 Electric window 2095 Lighting equipment 2096 Curtain fixtures 2097 Electric aroma pot 2099 Target Environment Sensor RS reference space TS target space [Third configuration] 3001 Air conditioning systems 3005a User (speaker) 3005b User (speaker) 3020 Air conditioners (air conditioning equipment) 3020P Information Processing Unit 3021 Input section 3022 Output section 3023 Communications Department 3024 Storage section 3025 Processing section 3025A Conditioned air delivery section 3025B Voice Detection Unit 3025C Specific control section 3025D Position identification part 3025E Text output command section 3060 Voice input device 30100 Servers (information processing equipment) 3100A First server (first information processing device) 3101 Input section 3102 Output section 3103 Communications Department 3104 Storage section 3104D Anger classification DB (anger classification storage unit) 3110 Voice Input Analysis Unit 3125 Status Judgment Unit 3200A Second server (second information processing device) NW Network [Fourth configuration] 4011 Text Extraction Unit 4012 Speech Recognition Dictionary 4013 Interpretation Department 4014 Control section 4015 User Identification Unit 4016 Storage section 4040 Server 4050 Network 4060 Building 4061 Router 4062 Air conditioner (indoor environment conditioner) 4063 Audio I / O device 4064 Audio input section 4065 Audio output section 4070 Outdoor unit 4080 Indoor unit 4090 Indoor Environmental Control System [Fifth configuration] 5011 Text Extraction Unit 5012 Voice recognition dictionary 5013 Interpretation Department 5014 Control section 5015 State Extraction Unit 5016 State Extraction Dictionary 5017 Judgment section 5018 Storage section 5030 Electric Power Company 5031 Power management device 5040 Server 5050 Network 5060A, 5060B property 5061 Controller 5062 Air conditioner 5063 Audio input / output device 5064 Audio input section 5065 Audio output unit 5066 Lighting equipment 5067 Ventilator 5068 Power Meter 5090 Air Conditioning Management System [Sixth configuration] 6011 Text Extraction Unit 6013 Interpretation Department 6014 Control section 6015 Clock section 6016 Recording Department 6017 Pattern Extraction Unit 6018 Prediction Department 6019 Context section 6040 Server 6050 Network 6060 Building 6061 Router 6063 Audio input / output device 6064 Audio input section 6065 Audio output section 6071 Air conditioner 6072 Bathroom water heater 6073 Television 6074 Lighting equipment 6075 Wearable Device 6076 Cooking utensils 6077 Refrigerator 6090 Home System [Seventh configuration] 7010 First equipment (equipment) 7011a Switch (physical switch, instruction reception unit) 7011b Remote control (remote controller, instruction reception unit) 7012 Voice input unit (first voice input unit, instruction receiving unit) 7014 Audio data transmission unit (first audio data transmission unit) 7016 Start / stop request reception unit (stop information reception unit) 7017 Start / Stop Information Reception Unit (Stop Information Reception Unit) 7018 Information Department 7020 Second equipment (equipment) 7021a Switch (physical switch, instruction reception unit) 7021b Remote control (remote controller, instruction reception unit) 7022 Voice input unit (second voice input unit, instruction receiving unit) 7024 Audio data transmission unit (second audio data transmission unit) 7026 Start / Stop Request Reception Unit (Stop Information Reception Unit) 7027 Start / Stop Information Reception Unit (Stop Information Reception Unit) 7028 Information Department 7110 Voice data reception unit (first voice data reception unit, second voice data reception unit) 7120 Voice Analysis Unit (First Voice Analysis Unit, Second Voice Analysis Unit) 7140 Detection unit 7150 Judgment Department 7160 Start / stop decision section (stop decision section, start decision section) 7170 Start / Stop Information Transmitter (Stop Information Transmitter) 7180 Start / stop request section (stop request section) 7400 Equipment Control System S22, S42 Detection steps S26, S48 Decision step [Prior art documents] [Patent documents]

[0570] [Patent Document 1] JP 2006-308848 A [Patent Document 2] Patent No. 2552744 [Patent Document 3] JP 2006-320621 A [Patent Document 4] JP 2001-324202 A [Patent Document 5] International Publication No. 2012 / 176690 [Patent Document 6] JP 2009-290967 A [Patent Document 7] JP 2010-181064 A

Claims

1. An input unit (6064) for receiving a user's command; A clock unit (6015) for obtaining the time; a recording unit (6016) for recording a log in which the time and the command are associated with each other; A control unit (6014) for controlling a plurality of devices (6071 to 6077) according to the command; a pattern extraction unit (6017) that extracts a sequential command pattern including a plurality of commands issued to the plurality of devices within a predetermined time interval by analyzing the log; a prediction unit (6018) for predicting the command that the user is likely to issue based on the extracted sequential command pattern; an output unit (6065) that outputs a message presenting to the user the command that the user is likely to issue based on the prediction; Equipped with The control unit causes at least one of the plurality of devices to execute the command that the user is likely to issue; The input unit receives an instruction from the user to cause the device to execute according to the content of the message presented by the output unit, or an instruction from the user to cause the device to execute with content different from the message presented by the output unit, Analyzing the log to extract the sequential command pattern includes: - obtaining the frequency of the user's actions, Including, obtaining a correlation between the operation of at least a portion of said plurality of devices and a date, a time of day, or a day of the week; or - obtaining functional correlations between parts of said plurality of devices; Including at least one of Home System (6090).

2. An input unit (6064) for receiving a user's command; An output unit (6065) for outputting a message; A clock unit (6015) for obtaining the time; a recording unit (6016) for recording a log in which the time and the command are associated with each other; A control unit (6014) for controlling a plurality of devices (6071 to 6077) according to the command; a pattern extraction unit (6017) that extracts a sequential command pattern including a plurality of commands issued to the plurality of devices within a predetermined time interval by analyzing the log; a prediction unit (6018) for predicting the command that the user is likely to issue based on the extracted sequential command pattern; a determination unit that determines an event in which the user operates at least one of the plurality of devices as presented by the output unit (6065) as a successful presentation, and determines an event in which the user performs an operation different from that presented by the output unit (6065) as an unsuccessful presentation; a pattern presentation result recording unit that records a history of the success and failure of the presentation; Equipped with The control unit causes the output unit to issue the message notifying the user of the command that the user is likely to issue based on the prediction; The pattern extractor analyzes the log as well as the history of successes and failures, home system (6090).

3. The input unit is a voice input unit (6064) that acquires voice data (SD) from the voice of the user, A text extraction unit (6011) for extracting text from the voice data; an interpretation unit (6013) for interpreting the text and extracting the user's command; Further comprising: The home system according to claim 1 or 2.

4. The plurality of devices includes an air conditioner (6071), A home system according to any one of claims 1 to 3.

Images