Control System and Infrared Output Device

Abstract

The present invention provides a control system and an infrared output device. The operating system (1001) includes an input receiving device (1060), a first information processing device (1100), a second information processing device (1200), and an infrared output device (1070), and operates a first type of device (1010) that can be operated by infrared pattern communication and a second type of device (1020) that can be operated via a network. The first information processing device (1100) is connected to the input receiving device (1060) and analyzes operation information corresponding to an operation input. The second information processing device (1200) controls the second type of device (1020) (control device (B)) via a network based on a control command. The infrared output device (1070) outputs an infrared pattern corresponding to the control command to the first type of device (1010) (control device (A)).

Description

[0001] This application is a divisional application of a patent application for invention with the title of "Operating System, Information Processing Device, Control System, and Infrared Output Device", the application date of July 12, 2018, and the application number of 201880036386.8 (the international application number is PCT / JP2018 / 026410). Technical Field

[0002] The present invention relates to an operating system, an information processing device, a control system, and an infrared output device. Background Art

[0003] Currently, the development of operating devices for centrally operating multiple devices has been studied (for example, refer to Patent Document 1 (Japanese Utility Model Registration No. 3130081)).

[0004] In addition, for example, Patent Document 2 (Japanese Patent Laid-Open No. 6-113365) discloses an infrared remote controller that can operate multiple devices with one unit. Summary of the Invention

[0005] Problems to be Solved by the Invention

[0006] In recent years, methods of operation input and methods of device management have become increasingly diverse. Therefore, the operation of each device owned by a user sometimes becomes complicated. In addition, with the diversification, the requirements for a control system that can normally control devices are also increasing.

[0007] In addition, in the case of operating a device using an infrared remote controller, there are sometimes cases where the state where the device does not operate according to the operation from the infrared remote controller (this state is hereinafter referred to as an operation failure state) cannot be recognized, and the device is left in a state that the user does not expect.

[0008] In this situation, at least the following problems arise.

[0009] The first problem is to provide an operating system and an information processing device that can control any device.

[0010] The second problem is to provide a control system and an infrared output device that can easily control any device.

[0011] The third problem is to provide a highly reliable control system.

[0012] The fourth problem is to provide an operating system in which a state where the operation content of a target device that can be operated with an infrared signal does not match the operation content is less likely to occur.

[0013] Solutions to the Problems

[0014] [First Invention]

[0015] As the first invention for solving the first technical problem, there is the following invention.

[0016] The operating system of the first aspect of the first invention includes an input receiving device, a first information processing device, a control command determination unit, a second information processing device, and an infrared output device, and operates at least a first type of device that can be operated by infrared pattern communication and a second type of device that can be operated via a network. The input receiving device receives operation inputs. The first information processing device is connected to the input receiving device and has an operation information analysis unit that analyzes operation information corresponding to the operation inputs. The control command determination unit determines whether the analysis result of the operation information analysis unit includes a control command for the first type of device or a control command for the second type of device. The second information processing device is connected to the first information processing device and, when it is determined by the control command determination unit that the control command for the second type of device is included, controls the second type of device via the network based on the control command. The infrared output device is connected to the first information processing device and / or the second information processing device, and when it is determined by the control command determination unit that the control command for the first type of device is included, outputs an infrared pattern corresponding to the control command to the first type of device. In addition, the first information processing device or the second information processing device has a control command determination unit.

[0017] In the operating system of the first aspect of the first invention, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the first type of device, an infrared pattern is sent to the first type of device for control. On the other hand, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the second type of device, the operating system controls the second type of device via the network. Therefore, a device that cannot be operated via the network (the first type of device) is operated by the infrared output device, and a device that can be operated via the network (the second type of device) is operated by the second information processing device, so that any device can be controlled.

[0018] The operating system of the second aspect of the first invention is an operating system of the first aspect of the first invention, and includes an operating device that houses the input receiving device and the infrared output device in the same housing. Since the input receiving device and the infrared output device are housed in the same housing as the operating device, any device around the operating device can be controlled regardless of whether it is a device that can be operated via the network (the second type of device).

[0019] The operating system of the third aspect of the first invention is an operating system of the first aspect or the second aspect of the first invention, and the input receiving device determines whether the second type of device is controlled by the second information processing device and sends the determination result to the first information processing device.

[0020] In the operating system of the third aspect of the first invention, the input receiving device (operation device) determines whether the second type of device is controlled by the second information processing device and sends the determination result to the first information processing device. Therefore, even when the administrator of the first information processing device and the administrator of the second information processing device are different, the administrator of the first information processing device can determine whether the second type of device is controlled by the second information processing device. Thus, the operating system can be appropriately managed.

[0021] The operating system of the fourth aspect of the first invention is the operating system of any one of the first to third aspects of the first invention, in which the input receiving device determines whether the first type of device has been controlled by the transmission of an infrared pattern and sends the determination result to the first information processing device and / or the second information processing device.

[0022] In the operating system of the fourth aspect of the first invention, the input receiving device (operation device) determines whether the first type of device has been controlled by the transmission of an infrared pattern and sends the determination result to the first information processing device and / or the second information processing device. Therefore, it can be determined whether the administrator of the first information processing device and / or the administrator of the second information processing device has controlled the first type of device. For example, when the administrator of the first information processing device and / or the second information processing device receives the determination result indicating that the first type of device has not been controlled, a command to transmit an infrared pattern can be sent to the infrared output device again, etc., which can improve the reliability of the operating system.

[0023] The operating system of the fifth aspect of the first invention is the operating system of any one of the first to fourth aspects of the first invention. When the determination result of the control command determination unit in the second information processing device includes a control command for the first type of device, the second information processing device sends an infrared pattern output command corresponding to the control command to the infrared output device.

[0024] In the operating system of the fifth aspect of the first invention, the second information processing device sends an output command to the infrared output device. Therefore, in the second information processing device, it can be determined whether the first type of device has been controlled. As a result, the reliability of the operating system can be improved.

[0025] The operating system of the sixth aspect of the first invention is the operating system of any one of the first to fifth aspects of the first invention, in which the second information processing device or the infrared output device further includes an infrared pattern generation unit that generates an infrared pattern corresponding to the control content of the first type of device.

[0026] In the operating system according to the sixth aspect of the first invention, since there is an infrared pattern generation unit that generates an infrared pattern corresponding to the control content for the first type of device, the desired first type of device can be controlled. As a result, the expandability for the first type of device can be improved.

[0027] The operating system according to the seventh aspect of the first invention is an operating system according to the first to sixth aspects of the first invention, wherein the first type of device includes multiple models, and the infrared pattern corresponding to the control command is different for each model. With this configuration, multiple models of the first type of device can be controlled using different infrared patterns (special commands) for each model.

[0028] The operating system according to the eighth aspect of the first invention is an operating system according to the first to seventh aspects of the first invention, wherein the second type of device includes an input receiving device and / or an infrared output device.

[0029] In the operating system according to the eighth aspect of the first invention, since the operating device is housed inside the second type of device, the system structure can be simplified.

[0030] The operating system according to the ninth aspect of the first invention is an operating system according to the first to eighth aspects of the first invention, wherein the operation input is voice input by sound.

[0031] In the operating system according to the ninth aspect of the first invention, the first type of device and the second type of device can be controlled by voice input.

[0032] The operating system according to the tenth aspect of the first invention is an operating system according to the first to ninth aspects of the first invention, wherein the input receiving device includes a specific operation information recognition unit, a specific operation storage unit, and a specific operation execution unit. The specific operation information recognition unit recognizes the specific operation information for the second type of device in the operation information corresponding to the operation input. The specific operation storage unit stores the specific operation information in association with the specific operation. The specific operation execution unit executes the specific operation on the second type of device when the specific operation information recognition unit recognizes the specific operation information.

[0033] In the operating system according to the tenth aspect of the first invention, when the input receiving device recognizes the specific operation information for the second type of device, the specific operation is executed on the second type of device. Therefore, the second type of device can be controlled without accessing the first information processing device and the second information processing device on the network.

[0034] In the operating system of the eleventh aspect of the first invention, among the operating systems of the first to tenth aspects of the first invention, the second information processing device further includes an environmental information acquisition unit. The environmental information acquisition unit acquires environmental information from an environmental information detection device that detects environmental information indicating the state of the surrounding environment at a specified timing. Moreover, when the determination result of the control command determination unit includes a control command for the first type of device, the second information processing device sends an output command for outputting an infrared pattern based on the control command and the environmental information to the infrared output device. Additionally, when it is determined that the determination result includes a control command for the second type of device, the second information processing device controls the second type of device via a network based on the control command and the environmental information.

[0035] In the operating system of the eleventh aspect of the first invention, when the determination result includes a control command for the first type of device, the second information processing device sends an infrared pattern output command based on the control command and the environmental information to the infrared output device. Therefore, the device can be appropriately controlled according to the user's environment. Additionally, when it is determined that the determination result includes a control command for the second type of device, the second type of device is controlled via a network based on the control command and the environmental information. Therefore, the device can be appropriately controlled according to the user's environment.

[0036] In the operating system of the twelfth aspect of the first invention, among the operating systems of the first to eleventh aspects of the first invention, the second information processing device further includes an environmental information acquisition unit, an associated device storage unit, an associated device extraction unit, and an associated device control unit. The environmental information acquisition unit acquires environmental information from an environmental information detection device that detects environmental information indicating the state of the surrounding environment at a specified timing. The associated device storage unit stores, as associated devices, any one or any combination of other first type devices or second type devices in association with any one of the first type devices or second type devices and the environmental information. When it is determined by the control command determination unit that the determination result includes a control command for the first type of device or a control command for the second type of device, the associated device extraction unit extracts associated devices from the associated device storage unit. When the associated device extraction unit extracts other first type devices as associated devices, the associated device control unit sends an infrared pattern output command corresponding to the control content for the extracted associated devices to the infrared output device, and / or when the associated device extraction unit extracts other second type devices as associated devices, the extracted associated devices are controlled via a network.

[0037] In the operating system of the twelfth aspect of the first invention, the second information processing device stores other devices in association with the first type of device, the second type of device, and environmental information as associated devices. Since not only the first device or the second device is controlled according to the user's environment, but also the associated devices are controlled, the comfort of the user can be improved.

[0038] In addition, the "other devices" referred to in the present invention mean devices different from the devices to be controlled.

[0039] The operating system of the thirteenth aspect of the first invention is the operating system of the first aspect to the twelfth aspect of the first invention, and the second information processing device further includes a specific condition detection unit, a specific condition storage unit, and a specific condition control unit. The specific condition detection unit detects a specific condition. The specific condition storage unit stores the specific condition in association with a prescribed first type of device and the control content for the first type of device. In addition, the specific condition storage unit stores the specific condition in association with a prescribed second type of device and the control content for the second type of device. When the specific condition is detected, the specific condition control unit sends an infrared pattern output command corresponding to the control content associated with the specific condition to the infrared output device regardless of the operation information. In addition, the specific condition control unit controls the second type of device according to the control content associated with the specific condition.

[0040] In the operating system of the thirteenth aspect of the first invention, when the specific condition is detected, the control content for the first type of device associated with the specific condition is sent to the operation device, so that the user can recognize the specific condition. In addition, when the specific condition is detected, the second type of device is controlled according to the control content associated with the specific condition, so that the user can recognize the specific condition.

[0041] The operating system of the fourteenth aspect of the first invention is the operating system of the first aspect to the thirteenth aspect of the first invention, and the first information processing device can communicate with a third information processing device that can operate a third type of device different from the second type of device via a network. In addition, the control command determination unit further determines whether the analysis result of the operation information analysis unit includes a control command for the control command of the third type of device. Moreover, when the control command determination unit determines that the control command for the third type of device is included, the first information processing device sends an operation instruction corresponding to the control command to the third information processing device.

[0042] In the operating system according to the fourteenth aspect of the first invention, when it is determined based on the analysis result of the operation information that the operation information includes a control command for a first type of device, an infrared pattern is sent to the first type of device for control. In addition, when it is determined based on the analysis result of the operation information that the operation information includes a control command for a second type of device, the operating system controls the second type of device via a network. In addition, when it is determined based on the analysis result of the operation information that the operation information includes a control command for a third type of device, the operating system sends an operation instruction for the third type of device to a third information processing device that can operate the third type of device via a network.

[0043] Therefore, an operating system can be provided that can not only operate a first type of device and a second type of device, but also send an operation instruction to a third type of device that cannot be operated by the second information processing device. As a result, an operating system with higher scalability can be provided.

[0044] The operating system according to the fifteenth aspect of the present invention is the operating system according to the fourteenth aspect, in which the second information processing device and the second type of device are connected via a first communication adapter that communicates according to a first communication protocol. In addition, the third information processing device and the third type of device are connected via a second communication adapter that communicates according to a second communication protocol different from the first communication protocol.

[0045] In the operating system according to the fifteenth aspect of the first invention, an operating system can be provided that can also send an operation instruction to a third type of device that communicates according to a communication protocol different from that of the second type of device.

[0046] The operating system according to the sixteenth aspect of the first invention is the operating system according to the fourteenth or fifteenth aspect of the first invention, in which the input receiving device determines whether the third type of device is controlled by the third information processing device and sends the determination result to the first information processing device and / or the second information processing device.

[0047] In the operating system according to the sixteenth aspect of the first invention, the input receiving device (operation device) determines whether the third type of device is controlled and sends the determination result to the first information processing device and / or the second information processing device. Therefore, even when the managers of the first information processing device and / or the second information processing device are different from the manager of the third information processing device, the managers of the first information processing device and / or the second information processing device can determine whether the third type of device is controlled by the third information processing device. Thereby, the operating system can be managed more appropriately.

[0048] In the operating system of the seventeenth aspect of the first invention, in the operating systems of the fourteenth to sixteenth aspects of the first invention, the second information processing device further includes an environmental information acquisition unit, an associated device storage unit, an associated device extraction unit, and an associated device control unit. The environmental information acquisition unit acquires the environmental information from an environmental information detection device that detects environmental information indicating the state of the surrounding environment at a prescribed timing. The associated device storage unit stores, as associated devices, any one or any combination of other first-type devices, other second-type devices, or other third-type devices in association with any one of the first-type devices, second-type devices, or third-type devices and the environmental information. When the control command determination unit determines that a control command for any one of the first-type devices, second-type devices, or third-type devices is included, the associated device extraction unit extracts the associated devices from the associated device storage unit. When the associated device extraction unit extracts other first-type devices as the associated devices, the associated device control unit sends an infrared pattern output command corresponding to the control content for the extracted associated devices to the infrared output device. In addition, when the associated device extraction unit extracts other second-type devices as the associated devices, the associated device control unit controls the extracted associated devices via the network. In addition, when the associated device extraction unit extracts other third-type devices as the associated devices, the associated device control unit sends an operation instruction corresponding to the control command for the associated devices to the third information processing device.

[0049] In the operating system of the seventeenth aspect of the first invention, when a third-type device is extracted as an associated device, the second information processing device sends an operation instruction for the associated device that is a third-type device via the network based on the control command and the environmental information, and thus, the device can be appropriately controlled according to the user's environment.

[0050] The second information processing device of the eighteenth aspect of the first invention is connected to the first information processing device and the infrared output device via the network. Here, the first information processing device has an operation information analysis unit that analyzes operation information corresponding to an operation input, and a control command determination unit that determines whether the analysis result of the operation information analysis unit includes a control command for at least a first-type device that can be operated by infrared pattern communication or a control command for at least a second-type device that can be operated via the network. When the control command determination unit determines that a control command for a first-type device is included, the infrared output device outputs an infrared pattern corresponding to the control command to the first-type device. When the control command determination unit determines that a control command for a second-type device is included, the second information processing device controls the second-type device via the network based on the control command.

[0051] The second information processing device according to the eighteenth aspect of the first invention is connected to the first information processing device and the infrared output device, and controls the second type of device via the network when it is determined based on the analysis result of the operation information that the operation information includes a control command for the second type of device. Therefore, a device that cannot be operated via the network is operated by the infrared output device, and a device that can be operated via the network is operated by the second information processing device, so that an operating system capable of controlling any device can be constructed.

[0052] The second information processing device according to the nineteenth aspect of the first invention is the second information processing device according to the eighteenth aspect of the first invention, and receives the determination result of the control command determination unit from the first information processing device. When the determination result includes a control command for the first type of device, an infrared pattern output command corresponding to the control command is sent to the infrared output device. According to such a structure, since the second information processing device sends an output command to the infrared output device, it is possible to determine in the second information processing device whether the control of the first type of device has been executed.

[0053] The second information processing device according to the twentieth aspect of the first invention is the second information processing device according to the eighteenth or nineteenth aspect of the first invention, and further includes an infrared pattern generation unit that generates an infrared pattern corresponding to the control content for the first type of device.

[0054] In the second information processing device according to the twentieth aspect of the first invention, since there is an infrared pattern generation unit that generates an infrared pattern corresponding to the control content for the first type of device, it is possible to send the infrared pattern corresponding to the control content to the first type of device and control the first type of device.

[0055] The second information processing device according to the twenty - first aspect of the first invention is the second information processing device according to any one of the eighteenth to twentieth aspects of the first invention, and the first type of device includes multiple models, and the infrared pattern corresponding to the control command is different for each model. With this structure, it is possible to control multiple models of the first type of device using different infrared patterns (special commands) for each model.

[0056] The second information processing device according to the twenty - second aspect of the first invention is the second information processing device according to any one of the eighteenth to twenty - first aspects of the first invention, and the operation input is voice input by voice.

[0057] In the second information processing device according to the twenty - second aspect of the first invention, the first type of device and the second type of device can be controlled by voice input.

[0058] The second information processing device according to the twenty-third aspect of the first invention is the second information processing device according to any one of the eighteenth to twenty-second aspects of the first invention, and further includes an environmental information acquisition unit that acquires environmental information from an environmental information detection device that detects environmental information indicating the state of the surrounding environment at a prescribed timing. Moreover, when receiving the determination result of the control command determination unit from the first information processing device and the determination result includes a control command for the first type of device, the second information processing device sends an infrared pattern output command based on the control command and the environmental information to the infrared output device. Additionally, when it is determined that the determination result includes a control command for the second type of device, the second information processing device controls the second type of device via a network based on the control command and the environmental information.

[0059] In the second information processing device according to the twenty-third aspect of the first invention, the second information processing device receives the determination result from the first information processing device. When the determination result includes a control command for the first type of device, it sends an output command for outputting an infrared pattern based on the control command and the environmental information to the first type of device to the infrared output device, and thus can appropriately control the device according to the user's environment. Additionally, when it is determined that the determination result includes a control command for the second type of device, it controls the second type of device via a network based on the control command and the environmental information, and thus can appropriately control the device according to the user's environment.

[0060] The second information processing device according to the twenty-fourth aspect of the first invention is the second information processing device according to any one of the eighteenth to twenty-third aspects of the first invention, and includes an environmental information acquisition unit, an associated device storage unit, an associated device extraction unit, and an associated device control unit. The environmental information acquisition unit acquires environmental information from an environmental information detection device that detects environmental information indicating the state of the surrounding environment at a prescribed timing. The associated device storage unit stores, as associated devices, any one or any combination of other first type devices or second type devices in association with any one of the first type devices or second type devices and the environmental information. When it is determined by the control command determination unit that the determination result includes a control command for the first type of device or a control command for the second type of device, the associated device extraction unit extracts associated devices from the associated device storage unit. When the associated device extraction unit extracts other first type devices as associated devices, the associated device control unit sends an infrared pattern output command corresponding to the control content for the extracted associated devices to the infrared output device. Additionally, when the associated device extraction unit extracts other second type devices as associated devices, the associated device control unit controls the extracted associated devices via a network.

[0061] In the second information processing apparatus according to the twenty-fourth aspect of the first invention, the control apparatus stores other devices in association with a specified device and environment information as associated devices. Thus, not only can the first device or the second device be controlled according to the user's environment, but also the associated devices can be controlled, thereby improving the user's comfort level.

[0062] The second information processing apparatus according to the twenty-fifth aspect of the first invention is the second information processing apparatus according to any one of the eighteenth to twenty-fourth aspects of the first invention, and includes a specific condition detection unit, a specific condition storage unit, and a specific condition control unit. The specific condition detection unit detects a specific condition. The specific condition storage unit stores the specific condition in association with a specified first type of device and control content for the first type of device. Further, the specific condition storage unit stores the specific condition in association with a specified second type of device and control content for the second type of device. In addition, when the specific condition is detected, the specific condition control unit sends an infrared pattern output command corresponding to the control content associated with the specific condition to the infrared output device regardless of the operation information. Further, the specific condition control unit controls the second type of device according to the control content associated with the specific condition.

[0063] In the second information processing apparatus according to the twenty-fifth aspect of the first invention, when the specific condition is detected, the control content for the first type of device associated with the specific condition is sent to the operation device, so that the user can recognize the specific condition. Further, when the specific condition is detected, the second type of device is controlled according to the control content associated with the specific condition, so that the user can recognize the specific condition.

[0064] The second information processing device of the twenty-sixth aspect of the first invention is the second information processing device of any one of the eighteenth aspect to the twenty-fifth aspect of the first invention, and further includes an environmental information acquisition unit, an associated device storage unit, an associated device extraction unit, and an associated device control unit. Here, the first information processing device can communicate with a third information processing device of a third type of device that can be operated via a network and is different from the second type of device, and the control command determination unit further determines whether the analysis result of the operation information analysis unit includes a control command for the third type of device. When the control command determination unit determines that the analysis result includes a control command for the third type of device, an operation instruction corresponding to the control command is sent to the third information processing device. Moreover, the environmental information acquisition unit acquires environmental information from an environmental information detection device that detects environmental information indicating the state of the surrounding environment at a specified timing. The associated device storage unit stores any one or any combination of other first type devices, other second type devices, or other third type devices in association with any one of the first type device, the second type device, or the third type device and the environmental information as associated devices. When the control command determination unit determines that the analysis result includes a control command for any one of the first type device, the second type device, or the third type device, the associated device extraction unit extracts associated devices from the associated device storage unit. When the associated device extraction unit extracts another first type device as an associated device, the associated device control unit sends an infrared pattern output command corresponding to the control content for the extracted associated device to an infrared output device. Additionally, when the associated device extraction unit extracts another second type device as an associated device, the associated device control unit controls the extracted associated device via the network. Additionally, when the associated device extraction unit extracts another third type device as an associated device, the associated device control unit sends an operation instruction corresponding to the control command for the associated device to the third information processing device.

[0065] In the second information processing device of the twenty-sixth aspect of the first invention, when a third type of device is extracted as an associated device, an operation instruction for the associated device as the third type of device is sent via the network based on the control command and the environmental information. Therefore, the device can be appropriately controlled according to the user's environment.

[0066] The second information processing device of the twenty-seventh aspect of the first invention is connected to the first information processing device and the infrared output device via a network. Here, the first information processing device has an operation information analysis unit that analyzes operation information corresponding to an operation input. When it is determined that the analysis result of the operation information analysis unit includes a control command for at least a first type of device that can be operated by infrared pattern communication, the infrared output device outputs an infrared pattern corresponding to the control command to the first type of device. Further, the second information processing device includes a control command determination unit and a second control unit. The control command determination unit determines whether the analysis result of the operation information analysis unit includes a control command for at least a first type of device that can be operated by infrared pattern communication or a control command for at least a second type of device that can be operated via the network. When it is determined by the control command determination unit that the analysis result includes a control command for the second type of device, the second control unit controls the second type of device via the network based on the control command.

[0067] The second information processing device of the twenty-seventh aspect of the first invention is connected to the first information processing device and the infrared output device, and when it is determined based on the analysis result of the operation information that the operation information includes a control command for the second type of device, it controls the second type of device via the network. Therefore, a device that cannot be operated via the network is operated by the infrared output device, and a device that can be operated via the network is operated by the second information processing device, so that an operating system capable of controlling any device can be constructed.

[0068] [Second Invention]

[0069] As the second invention for solving the second technical problem, there is the following invention.

[0070] The control system of the first aspect of the second invention includes an input reception device and an infrared output device. The input reception device receives a control instruction for a control device that can be controlled by infrared rays through voice input. The infrared output device is installed inside a fixed device whose position is fixed in a specified space. Further, when the input reception device receives the control instruction, the infrared output device outputs infrared rays to the control device.

[0071] In the control system of the first aspect of the second invention, since it has the above structure, it is possible to control a control device through voice input and via infrared rays. Further, since the position of the fixed device is fixed in a specified space, it is possible to foresee in advance the reach range of the infrared rays output by the infrared output device installed in the fixed device. Therefore, the infrared output device can easily control any control device as long as the device existing within the reach range can be controlled by infrared rays. Further, since the infrared output device is installed in the fixed device, a setting space for the infrared output device is not required.

[0072] In the control system of the second aspect of the second invention, in the control system of the first aspect of the second invention, the fixed device is installed and fixed on the ceiling or wall of the room. Alternatively, the control system of the second aspect of the second invention is embedded and fixed in the ceiling or wall of the room.

[0073] In the control system of the second aspect of the second invention, the fixed device is installed and fixed on the ceiling or wall of the room. For example, as the fixed device, lighting fixtures, air conditioning devices, etc. can be used. Alternatively, the fixed device is embedded and fixed in the ceiling or wall of the room. For example, as the fixed device, lighting fixtures, air conditioning devices, wall-mounted TVs, etc. can be used. By using such fixed devices, the probability of preventing obstacles from entering the infrared propagation path in the specified space can be increased. In other words, the probability of infrared rays reaching the control device can be increased. As a result, the reliability of the control system can be improved. In addition, although the configuration of the fixed device is generally considered in the space design, if it is the control system of the second aspect, the control device can be appropriately controlled in the space designed considering the configuration of the fixed device.

[0074] The control system of the third aspect of the second invention is such that in the control system of the first or second aspect of the second invention, the fixed device is an air conditioning device. Generally, the air conditioning device is installed at a higher position (near the ceiling of the room, etc.). Therefore, in the control system of the third aspect, it is possible to easily control the control device located at a position lower than the place where the air conditioning device is installed.

[0075] The control system of the fourth aspect of the second invention is such that in the control system of any one of the first to third aspects of the second invention, the infrared output device is installed in the upper half region of the body of the fixed device. Therefore, in the control system of the fourth aspect, infrared rays can be output from a high position. Thereby, the probability of preventing obstacles from entering the infrared propagation path in the specified space can be increased. For example, the infrared output device is installed on the upper part of a floor-standing air conditioning device.

[0076] The control system of the fifth aspect of the second invention is such that in the control system of any one of the first to fourth aspects of the second invention, the input receiving device is arranged inside the fixed device.

[0077] In the control system of the fifth aspect of the second invention, since the input receiving device is arranged inside the fixed device, the system structure can be simplified. In addition, the installation space for the input receiving device can be dispensed with.

[0078] The control system of the sixth aspect of the second invention is such that in the control system of any one of the first to fifth aspects of the second invention, a posture control device for controlling the posture of the infrared output device is installed on the infrared output device.

[0079] In the control system according to the sixth aspect of the second invention, since the output direction of the infrared ray can be changed to a desired direction, the probability of the infrared ray reaching the control device can be increased. As a result, the reliability of the control system can be improved.

[0080] The control system according to the seventh aspect of the second invention is a control system according to any one of the first to sixth aspects of the second invention, and further includes an information processing device capable of communicating with an input receiving device and an infrared ray output device via a network. The information processing device includes a sound analysis unit, a control content specifying unit, and an output command transmission unit. The sound analysis unit analyzes a sound input. The control content specifying unit specifies control content indicating a control device and a control instruction for the control device based on the analysis result of the sound analysis unit. The output command transmission unit transmits an infrared ray output command to the infrared ray output device based on the control content specified by the control content specifying unit.

[0081] In the control system according to the seventh aspect of the second invention, the information processing device on the network transmits an infrared ray output command to the infrared ray output device based on the analysis result of analyzing the sound input. Here, when a device is to be controlled by a sound input, the amount of information processing sometimes increases. Even in such a case, in the control system according to the seventh aspect, by using the information processing device on the network, sound analysis can be performed with high accuracy, and thus, the control device and the control instruction can be accurately specified. As a result, a control system capable of easily controlling any device can be provided.

[0082] The infrared ray output device according to the eighth aspect of the second invention is installed inside a fixed device whose position is fixed in a predetermined space, and outputs infrared rays to a control device when the input receiving device that receives a control instruction for a control device that can be controlled by infrared rays through a sound input receives the control instruction.

[0083] In the infrared ray output device according to the eighth aspect of the second invention, since the position of the fixed device is fixed, the reach range of the infrared ray output can be foreseen in advance. In addition, the infrared ray output device outputs infrared rays based on the sound input input via the sound receiving device to the control device. Therefore, the infrared ray output device can easily control any control device as long as the device existing within the reach range can be controlled by infrared rays. In addition, since the infrared ray output device is installed in the fixed device, a setting space for the infrared ray output device can be dispensed with.

[0084] [Third Invention]

[0085] As the third invention for solving the third technical problem, there is the following invention.

[0086] The control system of the first aspect of the third invention includes an input receiving device, an infrared output device, an environmental information detecting device, and an information processing device. The input receiving device receives the input of a control instruction for a control device that can be controlled by infrared rays. The infrared output device outputs infrared rays to the control device. The environmental information detecting device detects the environmental information around the control device. The information processing device receives the control instruction from the input receiving device and sends an infrared output command to the infrared output device based on the control instruction. Here, the information processing device receives the environmental information from the environmental information detecting device and determines whether the control device is controlled based on the output command and the environmental information.

[0087] In the control system of the first aspect of the third invention, the information processing device receives the environmental information from the environmental information detecting device and determines whether the control device is controlled based on the output command and the environmental information. Therefore, in the case where the control device is not controlled, processing such as controlling the control device can be executed. For example, re-send the output command, or notify the manager of the control device of the fact that the control device is not controlled to prompt the sending of the output command. As a result, a highly reliable control system can be provided.

[0088] The control system of the second aspect of the third invention is the control system of the first aspect of the third invention, and in the case where it is determined that the control device is not controlled, the information processing device re-sends the output command to the infrared output device. As a result, the control device is reliably controlled, and therefore, a highly reliable control system can be provided.

[0089] The control system of the third aspect of the third invention is the control process of the first or second aspect of the third invention, and in the case where it is determined that the control device is not controlled, the information processing device sends a notification of the fact that it is not controlled to the input receiving device. As a result, the user of the input receiving device is prompted to re-enter the control instruction, so the control device is reliably controlled. As a result, a highly reliable control system can be provided.

[0090] The control system of the fourth aspect of the third invention is the control system of any one of the first to third aspects of the third invention, and a posture control device for controlling the posture of the infrared output device is installed on the infrared output device.

[0091] In the control system of the fourth aspect of the third invention, since the output direction of the infrared rays can be changed to a desired direction, the probability of the infrared rays reaching the control device can be increased. As a result, the reliability of the control system can be improved.

[0092] The information processing device of the fifth aspect of the third invention is connected to an input receiving device, an infrared output device, and an environmental information detecting device. Here, the input receiving device receives an input of a control instruction for a control device that can be controlled by infrared rays. The infrared output device outputs infrared rays to the control device. The environmental information detecting device detects environmental information around the control device. Moreover, the information processing device of the fifth aspect includes an output command sending unit and a control determination unit. The output command sending unit receives a control instruction from the input receiving device and sends an infrared output command to the infrared output device based on the control instruction. The control determination unit receives environmental information from the environmental information detecting device and determines whether the control device is controlled based on the infrared output command and the environmental information.

[0093] The information processing device of the fifth aspect of the third invention receives environmental information from the environmental information detecting device and determines whether the control device is controlled based on the output command and the environmental information. Therefore, in the case where the control device is not controlled, processing such as controlling the control device can be executed. For example, re-send the output command, or notify the manager of the control device of the fact that the control device is not controlled, so as to prompt the sending of the output command. As a result, a highly reliable control system can be provided.

[0094] [Fourth Invention]

[0095] As the fourth invention for solving the fourth technical problem, there is the following invention.

[0096] The operating system of the first aspect of the fourth invention includes an air conditioner and an infrared output device. The air conditioner has an indoor unit. The infrared output device is provided on the indoor unit or on the surface of a wall or ceiling near the indoor unit. The infrared output device receives first information related to an instruction for an operation target device and sends an infrared signal corresponding to the first information to the operation target device. The operation target device is a device that can be operated by an infrared signal other than the air conditioner. The air conditioner has a device management device for managing the operation target device. The device management device includes an instruction information receiving unit and a determination unit. The instruction information receiving unit receives second information related to the content of the instruction. The determination unit determines whether there is a deviation between the operation content of the operation target device and the instruction content based on the operation content of the operation target device and the second information.

[0097] Here, through the device management device of the air conditioner, it is determined whether there is a deviation between the actual operation content of the operation target device and the instruction content for the operation target device. Therefore, it is difficult to ignore the state of deviation between the two (operation failure state).

[0098] In addition, here, it is preferable that the operation content determined to deviate includes at least the operation / stop of the operation target device. That is, preferably, when using the infrared output device to operate the operation target device to make it operate / stop, the determination unit determines at least whether the operation target device operates / stops according to the operation.

[0099] In addition, by the air conditioner having a device management device, there are particularly the following advantages.

[0100] Most of the residences, offices, etc. use air conditioners for air conditioning. Therefore, by providing a device management device in the air conditioner, it is possible to manage the operation target device without additionally providing a dedicated device for device management, and it is easy to suppress the device cost.

[0101] In addition, here, by the infrared output device being provided on the indoor unit of the air conditioner or on the surface of the wall or ceiling near the indoor unit, there are particularly the following advantages.

[0102] Since there are furniture, etc. placed in residences, offices, etc., due to the installation position of the infrared output device, the furniture, etc. become obstacles, and the infrared signal may not be able to reach the infrared light receiving part of the operation target device.

[0103] From the perspective of its original functionality, the indoor unit is mostly installed on the ceiling or near the ceiling where the space can be overlooked. Moreover, on the basis of achieving the purpose of air conditioning, the possibility that furniture such as shelves is arranged near the indoor unit and obstructs the air supply is relatively low. That is, the possibility of setting obstacles that will interfere with the transmission of infrared signals near the indoor unit is relatively low.

[0104] Therefore, in the present operating system where the infrared output device is provided on the indoor unit of the air conditioner or on the surface of the wall or ceiling near the indoor unit, the state where the operation content indicated by the infrared output device deviates from the actual device operation content is less likely to occur.

[0105] The operating system of the second aspect of the fourth invention is that in the operating system of the first aspect of the fourth invention, the device management device further includes a first information sending unit. The first information sending unit sends first information to the infrared output device.

[0106] In this operating system, by sending the first information from the device management device to the infrared output device, the infrared signal corresponding to the first information is sent to the operation target device. That is, the sending operation of the infrared output device is controlled by the device management device of the air conditioner. Moreover, since the infrared output device is provided on the indoor unit or near the indoor unit, the operating system can be realized with almost no wiring work for setting the infrared output device.

[0107] In the operating system of the third aspect of the fourth invention, in the operating system of the second aspect of the fourth invention, when the determination unit determines that there is a deviation, the first information transmission unit retransmits the first information to the infrared output device.

[0108] In this operating system, when the actual operation content of the operation target device deviates from the instructed operation content, the first information is retransmitted. As a result, an infrared signal corresponding to the first information is retransmitted from the infrared output device to the operation target device. Therefore, it is difficult to ignore the operation failure state.

[0109] In the operating system of the fourth aspect of the fourth invention, in the operating system of any one of the first to third aspects of the fourth invention, the infrared output device is mounted on the indoor unit.

[0110] Here, since the infrared output device is mounted on the indoor unit, the operation of connecting the infrared output device and the indoor unit on site can be omitted.

[0111] In the operating system of the fifth aspect of the fourth invention, in the operating system of any one of the first to fourth aspects of the fourth invention, it further includes an operation state detection unit. The operation state detection unit detects the operation state of the operation target device. The device management device further includes a judgment unit. The judgment unit judges the operation content of the operation target device based on the operation state detected by the operation state detection unit.

[0112] Most devices operated by infrared do not have an output unit that outputs the operation content to the outside. However, here, the operating system has an operation state detection unit that detects the operation state of the operation target device and judges the operation content of the operation target device based on the detected operation state. Therefore, even for an operation target device that does not have an output unit for outputting the operation content, etc., the device management device can manage it.

[0113] In the operating system of the sixth aspect of the fourth invention, in the operating system of the fifth aspect of the fourth invention, the operation state detection unit includes at least one of a microphone, a camera, a sensor for measuring current or power, an illuminance sensor, a temperature sensor, and a pressure sensor.

[0114] Here, the operation state detection unit obtains the operation sound of the operation target device or the notification sound when receiving an infrared signal through the microphone, or detects the operation of the operation target device through the camera, or measures various state quantities through various sensors. Thus, the operation state of the operation target device can be accurately grasped.

[0115] In the operating system of the seventh aspect of the fourth invention, in the operating system of any one of the first to sixth aspects of the fourth invention, the device management device further includes an output unit. The output unit outputs information related to the determination result of the determination unit.

[0116] In this operating system, since information related to the determination result of the output and determination unit is output, it is difficult to ignore the state (operation failure state) in which the indicated operation content of the operation target device deviates from the actual operation content.

[0117] The operating system of the eighth aspect of the fourth invention is an operating system of any one of the first to seventh aspects of the fourth invention, and further includes an instruction receiver. The instruction receiver receives an instruction to the operation target device as an instruction sound, and transmits a signal related to the instruction sound to an analysis device that analyzes the signal via a network. The first information is information based on the signal analysis result of the analysis device.

[0118] Here, since the operation target device can be operated by voice, the convenience is high.

[0119] Invention Effect

[0120] [First Invention]

[0121] In the operating system of the first aspect of the first invention, any device can be controlled.

[0122] In the operating system of the second aspect of the first invention, any device around the operating device can be controlled.

[0123] In the operating system of the third aspect of the first invention, the system can be appropriately managed.

[0124] In the operating system of the fourth aspect of the first invention, the reliability of the system can be improved.

[0125] In the operating system of the fifth aspect of the first invention, the reliability of the system can be improved.

[0126] In the operating system of the sixth aspect of the first invention, the expandability to the first type of device can be improved.

[0127] In the operating system of the seventh aspect of the first invention, multiple models of the first type of device can be controlled.

[0128] In the operating system of the eighth aspect of the first invention, the system structure can be simplified.

[0129] In the operating system of the ninth aspect of the first invention, the first type of device and the second type of device can be controlled by voice input.

[0130] In the operating system of the tenth aspect of the first invention, a device can be controlled without accessing an information processing device on a network.

[0131] In the operating system of the eleventh aspect of the first invention, a device can be appropriately controlled according to the user's environment.

[0132] In the operating system of the twelfth aspect of the first invention, the user's comfort can be improved.

[0133] In the operating system of the thirteenth aspect of the first invention, the user can identify a specific situation.

[0134] In the operating system of the fourteenth aspect of the first invention, an operating system with high extensibility can be provided.

[0135] In the operating system of the fifteenth aspect of the first invention, an operating system with high extensibility can be provided.

[0136] In the operating system of the sixteenth aspect of the first invention, the operating system can be managed more appropriately.

[0137] In the operating system of the seventeenth aspect of the first invention, the device can be appropriately controlled according to the user's environment.

[0138] In the second information processing device of the eighteenth aspect of the first invention, an operating system capable of controlling any device can be constructed.

[0139] The second information processing device of the nineteenth aspect of the first invention can improve the reliability of the system.

[0140] In the second information processing device of the twentieth aspect of the first invention, the extensibility to the first type of device can be improved.

[0141] In the second information processing device of the twenty-first aspect of the first invention, multiple models of the first type of device can be controlled.

[0142] In the second information processing device of the twenty-second aspect of the first invention, the first type of device and the second type of device can be controlled by voice input.

[0143] In the second information processing device of the twenty-third aspect of the first invention, the device can be appropriately controlled according to the user's environment.

[0144] In the second information processing device of the twenty-fourth aspect of the first invention, the user's comfort can be improved.

[0145] In the second information processing device of the twenty-fifth aspect of the first invention, the user can identify a specific situation.

[0146] In the second information processing device of the twenty-sixth aspect of the first invention, the device can be appropriately controlled according to the user's environment.

[0147] In the second information processing device of the twenty-seventh aspect of the first invention, an operating system capable of controlling any device can be constructed.

[0148] [Second Invention]

[0149] In the control system of the first aspect of the second invention, any control device can be easily controlled by voice input.

[0150] In the control system of the second aspect of the second invention, the probability of infrared rays reaching the control device can be increased.

[0151] In the control system of the third aspect of the second invention, a control device located in a place lower than the place where the air conditioner is installed can be easily controlled.

[0152] In the control system of the fourth aspect of the second invention, infrared rays can be output from a high position.

[0153] In the control system of the fifth aspect of the second invention, the system structure can be simplified.

[0154] In the control system of the sixth aspect of the second invention, the probability of infrared rays reaching the control device can be increased.

[0155] In the control system of the seventh aspect of the second invention, any device can be easily controlled by voice input.

[0156] In the infrared ray output device of the eighth aspect of the second invention, the control device can be easily controlled by voice input.

[0157] [Third Invention]

[0158] In the control system of the first aspect of the third invention, a reliable control system can be provided.

[0159] In the control system of the second aspect of the third invention, the reliability can be further improved.

[0160] In the control system of the third aspect of the third invention, the reliability can be further improved.

[0161] In the control system of the fourth aspect, the probability of infrared rays reaching the control device can be increased.

[0162] According to the information processing device of the fifth aspect of the third invention, a control system with high reliability can be constructed.

[0163] [Fourth Invention]

[0164] In the operating system of the first aspect of the fourth invention, since the device management device of the air conditioner determines whether there is a deviation between the actual operation content of the operation target device and the instruction content for the operation target device, it is difficult to ignore the state where the two have deviated (operation failure state).

[0165] In the operating systems of the second and fourth aspects of the fourth invention, wiring work during setting can be suppressed.

[0166] In the operating systems of the third and seventh aspects of the fourth invention, it is difficult to ignore the state where the actual operation content of the operation target device deviates from the indicated operation content.

[0167] In the operating system of the fifth aspect of the fourth invention, even for an operation target device that does not have an output unit for outputting operation content, etc., the device management apparatus can perform management.

[0168] In the operating system of the sixth aspect of the fourth invention, the operation state of the operation target device can be accurately grasped.

[0169] In the operating system of the seventh aspect of the fourth invention, even when causing the air conditioner to perform a relatively complex action, the air conditioner can be operated using voice.

[0170] In the operating system of the eighth aspect of the fourth invention, since the operation target device can be operated by voice, the convenience is high. BRIEF DESCRIPTION OF THE DRAWINGS

[0171] Figure 1 is a schematic diagram showing the concept of the operating system 1001 of the first embodiment of the first invention;

[0172] Figure 2 is a schematic diagram showing the structure of the operating system 1001 of the same embodiment;

[0173] Figure 3 is a schematic diagram showing the structure of the operation device 1050 of the same embodiment;

[0174] Figure 4 is a schematic diagram showing the structure of the first information processing apparatus 1100 of the same embodiment;

[0175] Figure 5 is a schematic diagram showing the structure of the second information processing apparatus 1200 of the same embodiment;

[0176] Figure 6 is a sequence diagram for explaining the operation of the operating system 1001 of the same embodiment;

[0177] Figure 7 is a sequence diagram for explaining the operation of the operating system 1001 of the same embodiment;

[0178] Figure 8 is a sequence diagram for explaining the operation of the operating system 1001 of the same embodiment;

[0179] Figure 9It is a schematic diagram showing the structure of the operating system of Modification Example 1F;

[0180] Figure 10 It is a schematic diagram showing the structure of the operating device 1050 of Modification Example 1F;

[0181] Figure 11 It is a sequence diagram showing the operations of the operating system 1001 of Modification Example 1F;

[0182] Figure 12 It is a sequence diagram showing the operations of the operating system 1001 of Modification Example 1F;

[0183] Figure 13 It is a schematic diagram showing the structure of the operating system 1001 of Modification Example 1G;

[0184] Figure 14 It is a sequence diagram showing the operations of the operating system 1001 of Modification Example 1G;

[0185] Figure 15 It is a schematic diagram showing the structure of the operating system 1001 of Modification Example 1H;

[0186] Figure 16 It is a schematic diagram showing the structure of the second information processing device 1200 of Modification Example 1H;

[0187] Figure 17 It is a schematic diagram showing the structure of the associated device storage unit 1240 of Modification Example 1H;

[0188] Figure 18 It is a sequence diagram showing the operations of the operating system 1001 of Modification Example 1H;

[0189] Figure 19 It is a sequence diagram showing the operations of the operating system 1001 of Modification Example 1H;

[0190] Figure 20 It is a schematic diagram showing the structure of the operating system 1001 of Modification Example 1I;

[0191] Figure 21 It is a schematic diagram showing the structure of the second information processing device 1200 of Modification Example 1I;

[0192] Figure 22 It is a sequence diagram showing the operations of the operating system 1001 of Modification Example 1I;

[0193] Figure 23 It is a schematic diagram showing the concept of the operating system 1001S of the second embodiment of the first invention;

[0194] Figure 24 It is a schematic diagram showing the concept of the operating system 1001S of the same embodiment;

[0195] Figure 25A is a sequence diagram for explaining the operation of the operating system 1001S of the same embodiment;

[0196] Figure 25B is a sequence diagram for explaining the operation of the operating system 1001S of the same embodiment;

[0197] Figure 26A is a sequence diagram showing the operation of the operating system 1001S of Modification 2A;

[0198] Figure 26B is a sequence diagram showing the operation of the operating system 1001S of Modification 2A;

[0199] Figure 27 is a schematic diagram showing the structure of the operating system 1001S of Modification 2B;

[0200] Figure 28 is a schematic diagram showing the structure of the second information processing device 1200S of Modification 2B;

[0201] Figure 29 is a schematic diagram showing the structure of the associated device storage unit 1240S of Modification 2B;

[0202] Figure 30A is a sequence diagram showing the operation of the operating system 1001S of Modification 2B;

[0203] Figure 30B is a sequence diagram showing the operation of the operating system 1001S of Modification 2B;

[0204] Figure 31A is a sequence diagram showing the operation of the operating system 1001S of Modification 2B;

[0205] Figure 31B is a sequence diagram showing the operation of the operating system 1001S of Modification 2B;

[0206] Figure 32 is a schematic diagram showing the structure of the second information processing device 1200T of the third embodiment of the first invention;

[0207] Figure 33 is a sequence diagram for explaining the operation of the operating system 1001T of the same embodiment;

[0208] Figure 34 is a schematic diagram showing the structure of the fourth information processing device 1200V of the first embodiment of the first invention;

[0209] Figure 35AIt is a sequence diagram for explaining the operation of the operating system 1001V of the same embodiment;

[0210] Figure 35B It is a sequence diagram for explaining the operation of the operating system 1001V of the same embodiment;

[0211] Figure 36 It is a schematic diagram showing the structure of the control system 2001 of the second embodiment of the second invention;

[0212] Figure 37 It is a schematic diagram showing the structure of the control system 2001 of the same embodiment;

[0213] Figure 38 It is a schematic diagram showing the structure of the information processing apparatus 2100 of the same embodiment;

[0214] Figure 39A It is a sequence diagram for explaining the operation of the control system 2001 of the same embodiment;

[0215] Figure 39B It is a sequence diagram for explaining the operation of the control system 2001 of the same embodiment;

[0216] Figure 40 It is a schematic diagram showing an example of the stationary device (air conditioner 2020d) of the same embodiment;

[0217] Figure 41 It is a schematic diagram showing the structure of the control system 2001 of Modification 3A;

[0218] Figure 42 It is a schematic diagram showing the structure of the control system 2001 of Modification 3B;

[0219] Figure 43 It is a schematic diagram showing the structure of the control system 2001S of the second embodiment of the present invention;

[0220] Figure 44 It is a schematic diagram showing the structure of the infrared output device 2070S of the same embodiment;

[0221] Figure 45 It is a schematic diagram showing the structure of a modification of the control system 2001S of the same embodiment;

[0222] Figure 46 It is a schematic diagram showing the structure of a modification of the infrared output device 2070S of the same embodiment;

[0223] Figure 47 It is a schematic diagram showing the structure of the control system 3001 of the first embodiment of the third invention;

[0224] Figure 48 is a schematic diagram showing the structure of the control system 3001 of the same embodiment;

[0225] Figure 49 is a schematic diagram showing the structure of the information processing device 3100 of the same embodiment;

[0226] Figure 50A is a sequence diagram for explaining the operation of the control system 3001 of the same embodiment;

[0227] Figure 50B is a sequence diagram for explaining the operation of the control system 3001 of the same embodiment;

[0228] Figure 51 is a schematic diagram showing the structure of the control system 3001 of the same embodiment;

[0229] Figure 52 is a schematic diagram showing the structure of the information processing device 3100 of the same embodiment;

[0230] Figure 53A is a sequence diagram for explaining the operation of the control system 3001 of the same embodiment;

[0231] Figure 53B is a sequence diagram for explaining the operation of the control system 3001 of the same embodiment;

[0232] Figure 54 is a schematic diagram showing a modified example of the control system 3001 of the same embodiment;

[0233] Figure 55 is a schematic diagram showing a modified example of the control system 3001 of the same embodiment;

[0234] Figure 56 is a schematic block diagram of the equipment system of the first embodiment of the fourth invention;

[0235] Figure 57 is a schematic block diagram of the equipment system of the same embodiment, in Figure 57 which, the drawing of a part of the structure of the equipment system is omitted;

[0236] Figure 58A is a schematic diagram of the installation state of the wall-mounted indoor unit of the air conditioner and the infrared output device included in the operating system of the same embodiment;

[0237] Figure 58B is a schematic diagram of the installation state of the ceiling-embedded indoor unit of the air conditioner and the infrared output device included in the operating system of the same embodiment;

[0238] Figure 59It is a flowchart showing the operation of the device management apparatus when explaining the devices of the first device group in the same embodiment;

[0239] Figure 60 It is an example of a list of instruction contents for devices and operation contents of devices stored in the storage unit of the device management apparatus of the air conditioner in the same embodiment for different devices;

[0240] Figure 61 It is a schematic block diagram of the operating system of Modification 4E. In Figure 61 part of the structure of the operating system is omitted from the drawing. Detailed Embodiments

[0241] [First Invention]

[0242] <First Embodiment>

[0243] (1-1-1) Structure of Operating System 1001

[0244] Figure 1 It is a schematic diagram showing the concept of the operating system 1001 of the first embodiment of the first invention. Figure 2 It is a schematic diagram showing the structure of the operating system 1001 of the same embodiment.

[0245] The operating system 1001 includes an operation device 1050 including an input reception device 1060 and an infrared output device 1070, a first information processing device 1100, and a second information processing device 1200. In the operating system 1001, by a user 1005 performing operation input on the operation device 1050, the devices existing around the operation device 1050 can be operated. Here, as the types of devices, there are "first type devices 1010" and "second type devices 1020". In addition, these devices are arranged in a building 1002.

[0246] In addition, in Figure 1 one operation device 1050, one first information processing device 1100, and one second information processing device are shown, but the number of each device is not limited to this. The first information processing device 1100 and the second information processing device can be connected to any number of operation devices 1050 and manage these operation devices 1050.

[0247] The first type devices 1010 can be operated at least by infrared pattern communication. For example, as the first type devices 1010, a electric fan 1010a, a lighting device 1010b, a television 1010c, an air conditioner 1010d, etc. can be cited. In addition, in the following description, the reference numeral 1010 is used to represent any first type device, and a lowercase letter subscript is attached when representing an individual first type device.

[0248] The second type of device 1020 can operate at least via the network NW. Here, the second type of device 1020 is managed by the second information processing device 1200. Similar to the first type of device 1010, the second type of device 1020 can also include an electric fan 1020a, a lighting device 1020b, a television 1020c, an air conditioner 1020d, etc. In addition, in the following description, the reference numeral 1020 is used to represent any second type of device, and a lowercase letter subscript is added when representing an individual second type of device.

[0249] As Figure 3 shown, the operation device 1050 has an input unit 1051, an output unit 1052, a communication unit 1053, a storage unit 1054, and a processing unit 1055, and functions as an input receiving device 1060 and an infrared output device 1070.

[0250] The input unit 1051 inputs information into the operation device 1050. For example, the input unit 1051 is composed of a microphone, and the user 1005 can input information by voice (voice input). With the help of this input unit 1021, various commands are input into the operation device 1050, and the processing corresponding to the commands is executed in the processing unit 1055. In addition, the input unit 1051 may also have a keyboard, a mouse, and / or a touch screen, etc.

[0251] The output unit 1052 outputs various information from the operation device 1050. For example, the output unit 1022 is composed of a speaker, etc. In addition, the output unit 1052 can output infrared rays, thereby controlling peripheral devices. In addition, the output unit 1052 not only has a speaker, but may also have a display.

[0252] The communication unit 1053 can be connected to the external network NW. Thus, the operation device 1050 can perform information transmission and reception with the first information processing device 1100, the second information processing device 1200, etc. via the network, etc.

[0253] The storage unit 1054 stores the information input into the operation device 1050, the information calculated in the operation device 1050, etc. For example, the storage unit 1054 is composed of a ROM, a RAM, etc. Here, the storage unit 1054 stores an "infrared pattern storage database (DB) 1054a". Information on infrared patterns set for each model of the first type of device 1010 existing around the operation device 1050 is stored in the infrared pattern storage DB. In addition, the first type of device 1010 includes multiple models, and the infrared patterns corresponding to the control commands are different for each model. In addition, the storage unit 1054 stores various programs for implementing the various functions of the processing unit 1055.

[0254] The processing unit 1055 performs information processing in the operation device 1050. Specifically, the processing unit 1055 is composed of a CPU, a cache memory, etc. The processing unit 1055 executes the program incorporated in the storage unit 1054, whereby the operation device 1050 functions as an "input receiving device 1060" and an "infrared output device 1070".

[0255] When an operation input is received from the input unit 1051, the input receiving device 1060 sends operation information corresponding to the operation input to the first information processing device 1100 via the communication unit 1053. For the input receiving device 1060, the operation input can be input by voice. In addition, after a predetermined time has elapsed since the operation input, the input receiving device 1060 determines whether the second type of device 1020 is controlled by the second information processing device 1200 and sends the determination result to the first information processing device 1100. In addition, the input receiving device 1060 determines whether the first type of device 1010 is controlled by sending an infrared pattern through the infrared output device 1070, and sends the determination result to the first information processing device 1100 or the second information processing device 1200.

[0256] When the infrared output device 1070 receives an output command from the second information processing device 1200, which will be described later, it reads out the infrared pattern corresponding to the output command from the storage unit 1054 and outputs it to the first type of device 1010 existing around the operation device 1050. Thereby, the first type of device 1010 is controlled.

[0257] As Figure 4 shown, the first information processing device 1100 has an input unit 1101, an output unit 1102, a communication unit 1103, a storage unit 1104, and a processing unit 1105, and is connected to the operation device 1050 and the second information processing device 1200 via the network NW. Here, the input unit 1101 inputs various information to the first information processing device 1100. The output unit 1102 outputs various information from the first information processing device 1100. The communication unit 1103 can be connected to the external network NW. The storage unit 1104 stores the information input to the first information processing device 1100, the information calculated by the first information processing device 1100, etc. The processing unit 1105 performs information processing in the first information processing device 1100. Here, the processing unit 1105 functions as an "operation information analysis unit 1110", a "control command determination unit 1120", and a "control confirmation unit 1130" by executing the program incorporated in the storage unit 1104.

[0258] The operation information analysis unit 1110 analyzes operation information corresponding to an operation input received from the operation device 1050. Here, when a voice input is received from the operation device 1050, the voice information corresponding to the voice input is analyzed. Specifically, the meaning corresponding to the voice is analyzed from the voice information using a neural network or the like and converted into text information. The converted text information is sent to the control command determination unit 1120.

[0259] The control command determination unit 1120 determines whether the analysis result of the operation information analysis unit 1110 includes a control command for the first type of device 1010 or a control command for the second type of device 1020. The analysis result is sent to the second information processing device 1200.

[0260] The control confirmation unit 1130 receives from the input receiving device 1060 the determination result as to whether the second type of device 1020 is controlled by the second information processing device 1200. Moreover, when the control confirmation unit 1130 receives a determination result to the effect that the second type of device 1020 is not controlled, the control confirmation unit 1130 sends again the analysis result of the operation information analysis unit 1110 to the second information processing device 1200.

[0261] As Figure 5 shown, the second information processing device 1200 has an input unit 1201, an output unit 1202, a communication unit 1203, a storage unit 1204, and a processing unit 1205, and is connected to the operation device 1050 and the first information processing device 1100 via the network NW. Here, the input unit 1201 inputs various information to the second information processing device 1200. The output unit 1202 outputs various information from the second information processing device 1200. The communication unit 1203 can be connected to the external network NW. The storage unit 1204 stores information input to the second information processing device 1200, information calculated by the second information processing device 1200, and the like. The processing unit 1205 executes information processing in the second information processing device 1200. Here, by executing a program incorporated in the storage unit 1204, the processing unit 1205 functions as a "first control unit 1210", a "second control unit 1220", and a "control confirmation unit 1230".

[0262] When the first control unit 1210 receives the determination result of the control command determination unit 1120 from the first information processing device 1100, and when the determination result includes a control command for the first type of device 1010, the first control unit 1210 sends, via the communication unit 1203, an output command for outputting an infrared pattern corresponding to the control command to the first type of device 1010 to the operation device 1050 (infrared output device 1070).

[0263] When the second control unit 1220 receives the determination result of the control command determination unit 1120 from the first information processing device 1100, and when the determination result includes a control command for the second type of device 1020, the second control unit 1220 controls the second type of device 1020 via the network NW based on the control command.

[0264] The control confirmation unit 1230 receives the determination result of whether the first type of device 1010 is controlled by the first information processing device 1100 from the input receiving device 1060. Moreover, when the control confirmation unit 1230 receives the determination result indicating that the first type of device 1010 is not controlled, the control confirmation unit 1230 sends the analysis result of the operation information analysis unit 1110 to the infrared output device 1070 again.

[0265] (1-1-2) Operation of the operating system 1001

[0266] Figure 6 is a sequence diagram for explaining the operation of the operating system 1001 of the present embodiment. In the following description, for convenience, it is assumed that there is a control device A as the first type of device 1010 and a control device B as the second type of device 1020 around the user 1005.

[0267] First, the user 1005 makes an operation input to the devices existing around. Here, the user 1005 gives an operation instruction for the control device A or the control device B by voice input (S1). For example, the user 1005 gives commands such as "Turn on the power of the control device A" and "Turn off the control device B" by voice input.

[0268] Next, the input receiving device 1060 receives the voice input of the user 1005 and converts the voice input into voice information and sends it to the first information processing device 1100 and the second information processing device 1200 (S2).

[0269] In the second information processing device 1200, the received voice information is stored at any time (S3).

[0270] In the first information processing device 1100, the operation information analysis unit 1110 analyzes the voice information received from the operation device 1050 (S4). For example, the operation information analysis unit 1110 of the first information processing device 1100 analyzes the voice information using a neural network or the like. Here, the operation information analysis unit 1110 of the first information processing device 1100 analyzes the meaning corresponding to the voice information from the voice information and converts it into text information.

[0271] Next, the control command determination unit 1120 of the first information processing device 1100 determines whether the analysis result of the operation information analysis unit 1110 includes a control command for the first type of device 1010 or a control command for the second type of device 1020 (S5). When it is determined that the analysis result includes a control command for the first type of device 1010 (S5 - Yes), the first information processing device 1100 sends the determination result to the second information processing device 1200. Here, the analysis result includes a control command for the control device A as the first type of device.

[0272] Next, the second information processing device 1200 receives the determination result from the first information processing device 1100 (S6), and determines the control content for the first type of device 1010 (control device A) (S7). Then, the first control unit 1210 of the second information processing device 1200 sends an infrared pattern output command corresponding to the control command to the operation device 1050 (infrared output device 1070) via the communication unit 1203.

[0273] Next, the infrared output device 1070 receives the output command from the second information processing device 1200, and outputs an infrared pattern based on this (S8), and controls the control device A as the first type of device 1010 (S9).

[0274] On the other hand, in step S5 above, when the first information processing device 1100 determines that the analysis result does not include a control command for the first type of device 1010 (S5 - No), the first information processing device 1100 determines whether it includes a control command for the second type of device 1020 (S10). When it is determined that the analysis result includes a control command for the second type of device 1020 (S10 - Yes), the first information processing device 1100 sends the determination result to the second information processing device 1200. Here, the analysis result includes a control command for the control device B as the second type of device 1020.

[0275] Next, the second information processing device 1200 receives the determination result from the first information processing device 1100 (S11), and determines the control content for the second type of device 1020 (control device B) (S12). Then, the second control unit 1220 of the second information processing device 1200 controls the control device B as the second type of device 1020 via the network NW based on the control command (S13).

[0276] In step S10 above, when the first information processing device 1100 determines that the analysis result does not include a control command for the second type of device 1020 (control device B) (S10 - No), the operating system 1001 ends the process.

[0277] In addition, the processing order of the above steps S5 to S9 and steps S10 to S13 is different, and either one can be processed first.

[0278] (1-1-3) Feature

[0279] (1-1-3-1)

[0280] As described above, the operating system 1001 of the present embodiment includes an input receiving device 1060, a first information processing device 1100, a second information processing device 1200, and an infrared output device 1070, and operates at least a first type of device 1010 that can be operated by infrared pattern communication and a second type of device 1020 that can be operated via the network NW. The input receiving device 1060 receives operation inputs. The first information processing device 1100 is connected to the input receiving device 1060 and has an operation information analysis unit 1110 that analyzes operation information corresponding to the operation inputs. In addition, the first information processing device 1100 has a control command determination unit 1120 that determines whether the analysis result of the operation information analysis unit 1110 includes a control command for the first type of device 1010 (control device A) or a control command for the second type of device 1020 (control device B). The second information processing device 1200 is connected to the first information processing device 1100 and, when it is determined by the control command determination unit 1120 that the control command includes a control command for the second type of device 1020 (control device B), controls the second type of device 1020 (control device B) via the network NW. The infrared output device 1070 is connected to the first information processing device 1100 or the second information processing device 1200, and when it is determined by the control command determination unit 1120 that the control command includes a control command for the first type of device 1010 (control device A), outputs an infrared pattern corresponding to the control command to the first type of device 1010 (control device A).

[0281] Therefore, in the operating system 1001 of the present embodiment, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the first type of device, an infrared pattern is sent to the first type of device 1010 (control device A) for control. On the other hand, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the second type of device 1020 (control device B), the operating system 1001 controls the second type of device 1020 (control device B) via the network NW. In other words, a device that cannot be operated via the network NW (the first type of device 1010) is operated by the infrared output device 1070, and a device that can be operated via the network NW (the second type of device 1020) is operated by the second information processing device 1200, so that any device around the operation device 1050 (input receiving device 1060) can be controlled.

[0282] In particular, in the operating system 1001 of the present embodiment, the operation information analysis unit 1110 of the first information processing device 1100 analyzes the operation information input by voice. Therefore, the operating system 1001 can control the first type of device 1010 and the second type of device 1020 by voice input.

[0283] In addition, in the operating system 1001 of the present embodiment, the second information processing device 1200 receives the determination result of the control command determination unit 1120 from the first information processing device 1100. Then, when the determination result includes a control command for the first type of device 1010 (control device A), the second information processing device 1200 sends an output command for outputting an infrared pattern corresponding to the control command to the first type of device 1010 (control device A) to the infrared output device 1070.

[0284] In this way, since the second information processing device 1200 sends an output command to the infrared output device 1070, it is possible to determine whether the control of the first type of device 1010 (control device A) is executed in the second information processing device 1200. As a result, the reliability of the operating system 1001 can be improved.

[0285] (1-1-3-2)

[0286] In addition, the operating system 1001 of the present embodiment includes an operating device 1050 that houses the input receiving device 1060 and the infrared output device 1070 in the same housing. In this way, since the input receiving device 1060 and the infrared output device 1070 are housed as the operating device 1050 in the same housing, any device around the operating device 1050 can be controlled regardless of whether it is a device (second type of device 1020) that can be operated via the network NW.

[0287] (1-1-3-3)

[0288] In addition, as Figure 7 shown in the sequence, the operating system 1001 of the present embodiment may also be such that the input receiving device 1060 determines whether the second type of device 1020 is controlled by the second information processing device 1200 and sends the determination result to the first information processing device 1100 (steps S14, S15). For example, the input receiving device 1060 determines whether the second type of device 1020 is controlled based on whether a peripheral device is operated within a specified time from the transmission of voice information.

[0289] Accordingly, even when the managers of the first information processing apparatus 1100 and the second information processing apparatus 1200 are not the same, the manager of the first information processing apparatus 1100 can determine whether the second type device 1020 (control device B) has been controlled by the second information processing apparatus 1200. As a result, the operating system 1001 can be appropriately managed.

[0290] (1-1-3-4)

[0291] In addition, as Figure 8 shown in the sequence, the operating system 1001 of the present embodiment may also be such that after step S9, the input receiving device 1060 determines whether the first type device 1010 has been controlled by the transmission of an infrared pattern, and sends the determination result to the second information processing apparatus 1200 (steps S16, 17).

[0292] Accordingly, the manager of the second information processing apparatus 1200 can determine whether the first type device 1010 (control device A) has been controlled. Moreover, when receiving the determination result indicating that the first type device 1010 has not been controlled, the second information processing apparatus 120 may issue a command to the infrared output device 1070 to transmit an infrared pattern again. As a result, the reliability of the operating system 1001 can be improved.

[0293] (1-1-3-5)

[0294] In addition, in the operating system 1001 of the present embodiment, the first type device 1010 includes multiple models, and the infrared pattern corresponding to the control command is different for each model. With this configuration, multiple models of the first type device 1010 can be controlled using different infrared patterns (dedicated commands) for each model.

[0295] Furthermore, such infrared patterns are stored in the storage unit 1054 of the operating device 1050. In addition, the information of these infrared patterns can be appropriately updated via the second information processing apparatus 1200.

[0296] (1-1-4) Variation

[0297] (1-1-4-1) Variation 1A

[0298] In the above description, the input receiving device 1060 and the infrared output device 1070 are housed in the same housing, but these devices may also be housed in different housings. Accordingly, the degree of freedom of the system configuration can be increased.

[0299] (1-1-4-2) Variation 1B

[0300] In the above description, the operating system 1001 of the present embodiment is configured such that the input receiving device 1060 determines whether the first type of device 1010 has been controlled by the transmission of an infrared pattern and sends the determination result to the second information processing device 1200. However, the operating system 1001 of the present embodiment is not limited thereto. For example, it may be a configuration in which the input receiving device 1060 determines whether the first type of device 1010 has been controlled by the transmission of an infrared pattern and sends the determination result only to the first information processing device 1100, or it may be a configuration in which the determination result is sent to both the first information processing device 1100 and the second information processing device 1200. Any configuration can improve the reliability of the operating system 1001.

[0301] (1-1-4-3) Variant Example 1C

[0302] The operating system 1001 of the present embodiment may also be configured such that the second information processing device 1200 or the infrared output device 1070 further includes an infrared pattern generation unit that generates an infrared pattern corresponding to the control content for the first type of device 1010. With such a configuration, the desired first type of device 1010 can be controlled. As a result, the expandability to the first type of device 1010 can be improved.

[0303] (1-1-4-4) Variant Example 1D

[0304] The operating system 1001 of the present embodiment may also be configured such that the second type of device 1020 includes the input receiving device 1060 and / or the infrared output device 1070. Specifically, it is a configuration in which one of the operation devices 1050 of the second type of device 1020 existing in the building 1002 is incorporated. Thereby, the system configuration can be simplified.

[0305] (1-1-4-5) Variant Example 1E

[0306] In addition, in the above description, the operation input is set to voice input, but the operating system 1001 of the present embodiment is not limited thereto. The operation input can also adopt a configuration input by an arbitrary input unit in addition to voice input.

[0307] (1-1-4-6) Variant Example 1F

[0308] Figure 9 It is a schematic diagram showing the configuration of the operating system of Variant Example 1F. Figure 10 It is a schematic diagram showing the configuration of the operation device 1050 of the variant example.

[0309] In Modification 1F, the storage unit 1054 of the operation device 1050 functions as a specific operation storage unit 1061, and the processing unit 105 of the operation device 105 functions as a specific operation information recognition unit 1062 and a specific operation execution unit 1063.

[0310] The specific operation storage unit 1061 stores specific operation information in association with specific operations. For example, the specific operation storage unit 1061 stores in advance sound information corresponding to "turning on the power of the electric fan 1020a of model D" and so on in association with the specific operation of turning on the power of the electric fan 1020a of model D.

[0311] The specific operation information recognition unit 1062 recognizes specific operation information for the second type of device 1020 in the operation information corresponding to the operation input.

[0312] When the specific operation information recognition unit 1072 recognizes the specific operation information, the specific operation execution unit 1063 performs a specific operation on the second type of device 1020.

[0313] Figure 11 、 12 is a sequence diagram showing the operation of Modification 1F.

[0314] In Modification 1F, the operations of the above steps S1 to S13 are performed. Here, after step S2, the operations of the following steps V1 to V3 are added. That is, after the input receiving device 1060 converts the voice input of the user 1005 into voice information, the "specific operation" process is performed.

[0315] In the process of "specific operation", the specific operation information recognition unit 1062 recognizes specific operation information for the second type of device 1020 in the operation information corresponding to the operation input (V1). Here, the specific operation information recognition unit 1062 recognizes whether it is specific operation information by comparing with the information stored in the specific operation storage unit 1061. Next, when the specific operation information recognition unit 1062 recognizes the specific operation information (V1 - Yes), the specific operation execution unit 1063 performs a specific operation on the second type of device 1020 (control device B) (V2, V3). On the other hand, when the specific operation information recognition unit 1062 does not recognize the specific operation information (V1 - No), the specific operation execution unit 1063 ends the process and returns to the process of step S4.

[0316] As described above, in the operating system 1001 of Modification Example 1F, when specific operation information for the second type of device 1020 (control device B) is recognized, the input reception device 1060 performs a specific operation on the second type of device 1020 (control device B). Therefore, the second type of device 1020 (control device B) can be controlled without accessing the first information processing device 1100 or the second information processing device 1200 on the network NW.

[0317] Supplementary note: When controlling a device by voice input, since the amount of information processing becomes large, a voice analysis device on the network NW is sometimes used. In contrast, in this Modification Example 1F, for example, for voice analysis with a low load on the amount of information processing, the analysis process is executed on the terminal side (input reception device 1060). Thereby, access to the network NW is avoided, and rapid device operation is achieved.

[0318] (1-1-4-7) Modification Example 1G

[0319] Figure 13 It is a schematic diagram showing the structure of the operating system of Modification Example 1G. Figure 14 It is a sequence diagram showing the operation of Modification Example 1G. In Modification Example 1G, the operations of steps U1 and U2 are added to the operations of steps S1 to S13 already described, and steps S7 and S12 are replaced with U3 and U4.

[0320] In Modification Example 1G, there is an environment information detection device K around the control devices A and B. The environment information detection device K is the second type of device 1020k, and detects "environment information" (U1) indicating the state of the surrounding environment. The environment information includes, for example, information such as temperature, humidity, and illuminance.

[0321] In addition, in Modification Example 1G, the processing unit 1205 of the second information processing device 1200 further functions as an environment information acquisition unit 1241. The environment information acquisition unit 1241 acquires environment information from the environment information detection device K at a prescribed timing (U2).

[0322] Moreover, the second information processing device 1200 of Modification Example 1G receives the determination result of the control command determination unit 1120 from the first information processing device 1100. When the determination result includes a control command for the first type of device 1010 (control device A), the infrared pattern output command based on the control command and the environment information is sent to the infrared output device 1070 (U3). In response to this, the infrared output device 1070 controls the first type of device 1010 (control device A). Additionally, when it is determined that the determination result includes a control command for the second type of device 1020 (control device B), the second information processing device 1200 controls the second type of device 1020 (control device B) via the network based on the control command and the environment information (U4).

[0323] In the operating system 1001 of the above Modification Example 1G, since the device is controlled based on the control command and the environment information, the device can be appropriately controlled according to the environment of the user 1005.

[0324] (1-1-4-8) Modification Example 1H

[0325] Figure 15 It is a schematic diagram showing the structure of the operating system of Modification Example 1H. Figure 16 It is a schematic diagram showing the structure of the second information processing device 1200 of Modification Example 1H.

[0326] In Modification Example 1H, there is an environment information detection device K around the control devices A and B. The environment information detection device K is the second type of device 1020k, and it detects the environment information indicating the state of the surrounding environment.

[0327] In addition, in this Modification Example 1H, the storage unit 1204 of the second information processing device 1200 functions as an associated device storage unit 1240, and the processing unit 1205 of the second information processing device 1200 also functions as an environment information acquisition unit 1241, an associated device extraction unit 1242, and an associated device control unit 1243.

[0328] The associated device storage unit 1240 stores, as associated devices, any one or any combination of other first type of devices 1010r (associated device D) or other second type of devices 1020r (associated device E) in association with any one of the first type of device 1010 (control device A) or the second type of device 1020 (control device B) and the environment information. For example, as Figure 17As shown, for "illuminance information" as environmental information and "TV of S model" as the first type of device 1010 (control device A), the associated device storage unit 1240 stores the "lighting device of S model" of the first type of device 1010r as an associated device (associated device D). Additionally, for example, for "temperature information" as environmental information and "air conditioner of H model" as the second type of device 1020 (control device B), the associated device storage unit 1240 stores the "electric fan of D model" of the first type of device 1010r as an associated device. Further, for example, for "temperature information" as environmental information and "air conditioner of D model" as the second type of device 1020 (control device B), the associated device storage unit 1240 stores the "far-infrared heater of C model" of the first type of device 1010r and the "far-infrared heater of D model" of the second type of device 1020r as associated devices.

[0329] The environmental information acquisition unit 1241 acquires "environmental information" from the environmental information detection device K at a specified timing. The environmental information includes, for example, information such as temperature, humidity, and illuminance.

[0330] When it is determined by the control command determination unit 1120 of the first information processing device 1100 that the control command includes a control command for the first type of device 1010 or a control command for the second type of device 1020, the associated device extraction unit 1242 extracts associated devices from the associated device storage unit 1240.

[0331] When the associated device extraction unit 1242 extracts another first type of device 1010r as an associated device (associated device D), the associated device control unit 1243 sends an output command for the extracted associated device (associated device D) to the infrared output device 1070. Additionally, when the associated device extraction unit 1242 extracts another second type of device 1020r as an associated device (associated device E), the associated device control unit 1243 controls the extracted associated device (associated device E) via the network NW.

[0332] Figure 18 、 19 is a sequence diagram showing the operations of Modification Example 1H. In Modification Example 1H, the operations of the already described steps S1 to S6, S8 to S11, S13, U1 to U4 are performed. Here, between steps S6 and U3, and between S11 and U4, the processing of the following steps R1 to R8 of "controlling associated devices" is added.

[0333] In the process of "controlling associated devices", when the control command determination unit 1120 of the first information processing device 1100 determines that the control command includes a control command for the first type of device 1010 (control device A) or a control command for the second type of device 1020 (control device B), the associated device extraction unit 1242 of the second information processing device 1200 extracts associated devices (associated devices D, E) from the associated device storage unit 1240 (R1).

[0334] Here, when the associated device extraction unit 1242 extracts another first type of device 1010r as an associated device (associated device D) (R2 - Yes), the associated device control unit 1243 of the second information processing device 1200 sends an output command for the extracted associated device (associated device D) to the infrared output device 1070 (R3). In response to this, the infrared output device 1070 outputs an infrared pattern to the first type of device 1010r (associated device D) for control (R4, R5).

[0335] On the other hand, when the associated device extraction unit 1242 does not extract another first type of device 1010r as an associated device (associated device D) (R2 - No), the associated device control unit 243 of the second information processing device 1200 enters the process of step R6. In the process of step R6, when the associated device extraction unit 1242 extracts another second type of device 1020r as an associated device (associated device E) (R6 - Yes), the associated device control unit 1243 of the second information processing device 1200 controls the extracted associated device (associated device E) via the network NW (R7, R8). In addition, when the associated device extraction unit 1242 does not extract another second type of device 1020r as an associated device (associated device E) (R6 - Yes), the process ends.

[0336] In addition, the processing order of the above steps R2 to R5 and steps R6 to R8 is different, and either one can be processed first.

[0337] The second information processing apparatus 1200 of the operating system 1001 in the above-described modification example 1H further includes an environmental information acquisition unit 1241, an associated device storage unit 1240, an associated device extraction unit 1242, and an associated device control unit 1243. The environmental information acquisition unit 1241 acquires environmental information from an environmental information detection device K that detects environmental information indicating the state of the surrounding environment at a specified timing. The associated device storage unit 1240 stores, in association with environmental information, any one or any combination of other first type devices 1010r (associated devices D) or other second type devices 1020r (associated devices E) as associated devices with respect to any one of the first type device 1010 (control device A) or the second type device 1020 (control device B). When the control command determination unit 1120 determines that a control command for the first type device 1010 (control device A) or the second type device 1020 (control device B) is included, the associated device extraction unit 1242 extracts associated devices (associated devices D, associated devices E) from the associated device storage unit 1240. When the associated device extraction unit 1242 extracts another first type device 1010r as an associated device (associated device D), the associated device control unit 1243 sends an output command to the infrared output device 1070 for outputting an infrared pattern corresponding to the control content for the extracted associated device to the associated device (associated device D). Further, when the associated device extraction unit 1242 extracts another second type device 1020r as an associated device (associated device E), the associated device control unit 1243 controls the extracted associated device (associated device E) via the network NW.

[0338] Therefore, in the operating system 1001 of the modification example 1H, not only the first type device 1010 (control device A) or the second type device 1020 (control device B) is controlled according to the environment of the user 1005, but also the associated devices (associated devices D, associated devices E) are controlled according to the environment of the user 1005. Thus, the comfort of the user 1005 can be improved.

[0339] (1-1-4-9) Modification example 1I

[0340] Figure 20 is a schematic diagram showing the structure of the operating system of the modification example 1I. Figure 21 is a schematic diagram showing the structure of the second information processing apparatus 1200 of the modification example 1I. Figure 22 is a sequence diagram showing the operation of the modification example 1I. In the modification example 1I, different from the operations of the steps S1 to S13 already described, "control in a specific situation" as shown in steps Q1 to Q5 is executed.

[0341] In Modification Example 1I, the storage unit 1204 of the second information processing device 1200 functions as a specific situation storage unit 1250, and the processing unit 1205 of the second information processing device 1200 functions as a specific situation detection unit 1251 and a specific situation control unit 1252.

[0342] The specific situation storage unit 1250 stores the specific situation in association with a specified first type of device 1010t and the control content for the first type of device 1010t. Further, the specific situation storage unit 1250 stores the specific situation in association with a specified second type of device 1020t and the control content for the second type of device 1020t. For example, when the specific situation is "tsunami", the specified first type of device 1010t is set to "TV of model S", and it is stored in association with the control content such as "play national broadcast programs". In addition, for example, when the specific situation is "tsunami", the second type of device 1020t is set to "air conditioner of model D", and it is stored in association with the control content such as "cut off the power supply".

[0343] The specific situation detection unit 1251 detects a specific situation (Q1). For example, examples of the specific situation include tsunami, terrorist attack, major earthquake, etc.

[0344] When a specific situation is detected (Q1 - Yes), regardless of the operation information, the specific situation control unit 152 sends an infrared pattern corresponding to the control content related to the specific situation to the infrared output device 1070 for output to a specified first type of device 1010t (control device A) (Q2). Thereby, the infrared output device 70 outputs an infrared pattern to control the specified first type of device 1010t (control device A) (Q3, Q4). In addition, when a specific situation is detected (Q1 - Yes), regardless of the operation information, the specific situation control unit 1272 controls a specified second type of device 1020t (control device B) according to the control content associated with the specific situation (Q2, Q5).

[0345] In the operating system 1001 of the above-described modification example 1I, when a specific situation is detected, the first type of device 1010t (control device A) associated with the specific situation operates, whereby the user 1005 can recognize the specific situation. In addition, control is performed according to the type of the first type of device 1010t to ensure safety in a specific situation. Moreover, when a specific situation is detected, the second type of device 1020t (control device B) is controlled according to the control content associated with the specific situation, so that the user 1005 can recognize the specific situation. In addition, control is performed according to the type of the second type of device 1020t to ensure safety in a specific situation. Specifically, whether it is the first type of device 1010t or the second type of device 1020t, as long as the device is a "TV", the user 1005 can recognize the specific situation by "playing a program such as a nationwide broadcast". In addition, whether it is the first type of device 1010t or the second type of device 1020t, as long as the device is an "air conditioner", control can be performed by "cutting off the power supply" to ensure safety in a specific situation.

[0346] (1-1-4-10) Modification example 1J

[0347] In addition, in the above description, it is assumed that the second information processing device 1200 receives the content of the control command from the first information processing device 1100 and sends the control command to the infrared output device 1070, but the structure of the operating system 1001 of the present embodiment is not limited thereto. Specifically, it may also be a structure in which the first information processing device 1100 directly sends a control command to the infrared output device 1070.

[0348] <Second Embodiment>

[0349] (1-2-1) Structure of the operating system 1001S

[0350] Figure 23 It is a schematic diagram showing the concept of the operating system 1001S of the second embodiment of the first invention. Figure 24 It is a schematic diagram showing the structure of the operating system 1S of the same embodiment. In addition, in the following description, the same reference numerals are given to the structures that have been described and the repeated description is omitted. In addition, in the present embodiment, subscript S may be used to describe the structures different from those of other embodiments.

[0351] The operating system 1001S has an operating device 1050 including an input receiving device 1060 and an infrared output device 1070, a first information processing device 1100S, and a second information processing device 1200S. In addition, the first information processing device 1100S and the second information processing device 1200S of the operating system 101S are connected to a third information processing device 1300S via a network NW. In this operating system 1001S, by a user 1005 performing an operation input on the operating device 1050, devices existing around the operating device 1050 can be operated. Here, the devices include a "first type device 1010", a "second type device 1020", and a "third type device 1030". In addition, these devices are arranged in a building 1002.

[0352] The third type device 1030 can be operated at least via the network NW. Here, the third type device 1030 is managed by the third information processing device 1300S. The third type device 1030 can also be exemplified by an electric fan 1030a, a lighting device 1030b, a television 1030c, an air conditioner 1030d, etc., in the same way as the first type device 1010 and the second type device 1020. In addition, in the following description, the reference numeral 1030 is used to represent any third type device, and a lowercase letter subscript is added when representing an individual third type device.

[0353] In addition, the second information processing device 1200S and the second type device 1020 are connected via a communication adapter 1007A that communicates through a first communication protocol. In addition, the third information processing device 1300S and the third type device 1030 are connected via a communication adapter 1007B that communicates through a second communication protocol different from the first communication protocol.

[0354] In the second embodiment, the control command determination unit 1120S of the first information processing device 1100S also determines whether the analysis result of the operation information analysis unit 1110 includes a control command for the control command of the third type device 1030. And, when it is determined that the control command for the third type device 1030 is included, the control command determination unit 1120S sends an operation instruction corresponding to the control command to the third information processing device 1300S.

[0355] (1-2-2) Operation of the operating system 1001S

[0356] Figure 25A 、 25BIt is a sequence diagram for explaining the operation of the operating system 1001S of the present embodiment. In addition, in the following description, for convenience, it is assumed that there is a control device A as the first type of device 1010, a control device B as the second type of device 1020, and a control device C as the third type of device 1030 around the user 1005.

[0357] First, the user 1005 performs voice input (W1) on the devices present around. For example, commands such as "Turn on the power of control device A" and "Turn off control device B" are input by voice.

[0358] Next, the input receiving device 1060 receives the voice input of the user 1005, converts the voice input into voice information, and sends it to the first information processing device 1100S and the second information processing device 1200S (W2).

[0359] In the second information processing device 1200S, the voice information is stored at any time (W3).

[0360] In the first information processing device 1100S, the operation information analysis unit 1110 analyzes the voice information received from the operation device 1050 (W4). For example, the operation information analysis unit 1110 of the first information processing device 1100S uses a neural network or the like to analyze the voice information. Moreover, the operation information analysis unit 1110 of the first information processing device 1100S analyzes the meaning corresponding to the voice information from the voice information and converts it into text information.

[0361] Next, the control command determination unit 1120 of the first information processing device 1100S determines whether the analysis result of the operation information analysis unit 1110 includes a control command for the first type of device 1010 (W5). In the case where it is determined that the control command for the first type of device 1010 (control device A) is included (W5 - Yes), the first information processing device 1100S sends the determination result to the second information processing device 1200S. Here, the analysis result includes a control command for the control device A as the first type of device 1010.

[0362] Next, the second information processing device 1200S receives the determination result from the first information processing device 1100S (W6), and determines the control content for the first type of device 1010 (control device A) (W7). Moreover, the first control unit 1210 of the second information processing device 1200S sends an infrared pattern output command corresponding to the control command to the operation device 1050 (infrared output device 1070) via the communication unit 1203.

[0363] Next, the infrared output device 1070 receives an output command from the second information processing device 1200S, and based on this, outputs an infrared pattern (W8) to control the control device A (W9) which is a first type of device 1010.

[0364] On the other hand, in the above step W5, when the first information processing device 1100S determines that the control command for the first type of device 1010 is not included (W5 - No), the first information processing device 1100S determines whether a control command for the second type of device 1020 is included (W10). When it is determined that a control command for the second type of device 1020 is included (W10 - Yes), the first information processing device 1100S sends the determination result to the second information processing device 1200S. Here, the analysis result includes a control command for the control device B which is a second type of device 1020.

[0365] Next, the second information processing device 1200S receives the determination result from the first information processing device 1100S (W11), and determines the control content for the second type of device 1020 (control device B) (W12). Moreover, the second control unit 1220 of the second information processing device 1200S controls the control device B which is a second type of device 1020 via the network NW based on the control command (W13).

[0366] On the other hand, in the above step W10, when the first information processing device 1100S determines that the control command for the second type of device 1010 is not included (W10 - No), the first information processing device 1100S determines whether a control command for the third type of device 1030 is included (W14). When it is determined that a control command for the third type of device 1030 is included (W14 - Yes), the first information processing device 1100S sends the determination result to the third information processing device 1300S. Here, the analysis result includes a control command for the control device C which is a third type of device 1030.

[0367] Next, the third information processing device 1300S receives the determination result from the first information processing device 1100S (W15), and determines the control content for the third type of device 1030 (control device C) (W16). Moreover, the third information processing device 1300S controls the control device C which is a third type of device 1030 via the network NW based on the control command (W17).

[0368] In the above step W14, when it is determined that the control command for the third type of device 1030 (control device C) is not included (W14 - No), the operating system 1001S ends the process.

[0369] In addition, the processing orders of the above steps W5 to W9, steps W10 to W13, and steps W14 to W17 are different, and any one of them can be processed first.

[0370] (1-2-3) feature

[0371] (1-2-3-1)

[0372] As described above, in addition to the structure of the operating system 1001 of the first embodiment, the operating system 1001S of the present embodiment has the first information processing device 1100S communicate with a third information processing device 1300S that can operate a third type of device 1030 different from the second type of device 1020 via the network NW. In addition, the control command determination unit 1120S of the first information processing device 1100S also determines whether the analysis result of the operation information analysis unit 1110 includes a control command for the control command of the third type of device 1030. Moreover, when the control command determination unit 1120S determines that the control command for the third type of device 1030 is included, the first information processing device 1100S sends an operation instruction corresponding to the control command to the third information processing device 1300S.

[0373] Therefore, in the operating system 1001S of the present embodiment, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the first type of device 1010 (control device A), an infrared pattern is sent to the first type of device (control device A) for control. In addition, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the second type of device (control device B), the operating system 1001S controls the second type of device 1020 (control device B) via the network NW. In addition, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the third type of device 1030 (control device C), the operating system 1001S sends an operation instruction for the third type of device 1030 (control device C) to the third information processing device 1300S that can operate the third type of device 1030 (control device C) via the network NW.

[0374] Therefore, an operating system can be provided that not only operates the first type of device 1010 (control device A) and the second type of device 1020 (control device B), but also can send an operation instruction to the third type of device 1030 (control device C) that cannot be operated by the second information processing device 1200S. As a result, an operating system with higher scalability can be provided.

[0375] (1-2-3-2)

[0376] In addition, in the operating system 1001S of the present embodiment, the second information processing device 1200S and the second type of device 1020 are connected via the first communication adapter 1007A that communicates through the first communication protocol. In addition, the third information processing device 1300S and the third type of device 1030 are connected via the second communication adapter 1007B that communicates through the second communication protocol different from the first communication protocol. In this way, in the operating system 1001S, an operating system 1001S that can also send an operation instruction to the third type of device 1030 that communicates through a communication protocol different from that of the second type of device 1020 can be provided.

[0377] (1-2-4) Variant

[0378] (1-2-4-1) Variant 2A

[0379] As Figure 26A 、 26B shown in the sequence of, the operating system 1001S of the present embodiment may also be: the input receiving device 1060 determines whether the third type of device 1030 is controlled by the third information processing device 1300S, and sends the determination result to the first information processing device 1100S and / or the second information processing device 1200S (steps W18-W20).

[0380] In this case, the input receiving device 1060 (operation device 1050) determines whether the third type of device 1030 has been controlled, and sends the determination result to the first information processing device 1100S and / or the second information processing device 1200S. Therefore, even when the managers of the first information processing device 1100S and / or the second information processing device 1200S are different from the manager of the third information processing device 1300S, the managers of the first information processing device 1100S and / or the second information processing device 1200S can determine whether the third type of device 1030 has been controlled through the third information processing device 1300S. For example, the input receiving device 1060 determines whether the third type of device 1030 has been controlled based on whether the peripheral device has been operated within a specified time from the transmission of the sound information. Thus, the operating system 1001S can be managed more appropriately.

[0381] (1-2-4-2) Variant 2B

[0382] Figure 27 is a schematic diagram showing the structure of the operating system 1001S of Variant 2B. Figure 28 is a schematic diagram showing the structure of the second information processing device 1200S of Variant 2B.

[0383] In Modification Example 2B, there is an environmental information detection device K around the control devices A, B, and C. The environmental information detection device K is a second type device 1020k that detects "environmental information" indicating the state of the surrounding environment. The environmental information includes, for example, information such as temperature, humidity, and illuminance.

[0384] In addition, in Modification Example 2B, the storage unit 1204S of the second information processing device 1200S functions as an associated device storage unit 1240S, and the processing unit 1205S of the second information processing device 1200S also functions as an environmental information acquisition unit 1241S, an associated device extraction unit 1242S, and an associated device control unit 1243S.

[0385] The associated device storage unit 1240S stores, as associated devices, any one or any combination of other first type devices 1010r (associated device D), other second type devices 1020r (associated device E), or other third type devices 1030r (associated device F) in association with any one of the first type device 1010 (control device A), the second type device 1020 (control device B), or the third type device 1030 (control device C) and the environmental information. For example, as Figure 29As shown, for "illuminance information" as environmental information and "TV of S model" as the first type of device 1010 (control device A), the associated device storage unit 1240S stores "lighting of S model" of the first type of device 1010r (associated device D) and "lighting fixture of T model" of the third type of device 1030r (associated device E) as associated devices. Additionally, for example, for "illuminance information" as environmental information and "TV of T model" as the third type of device 1010 (control device C), the associated device storage unit 1240S stores "lighting device of T model" of the first type of device 1010r (associated device D) as an associated device. Additionally, for example, for "temperature information" as environmental information and "air conditioner of H model" as the first type of device 1010 (control device A), the associated device storage unit 1240S stores "electric fan of D model" of the first type of device 1010r (associated device D) as an associated device. Additionally, for example, for "temperature information" as environmental information and "air conditioner of D model" as the second type of device 1020 (control device B), the associated device storage unit 1240S stores "far-infrared heater of C model" of the first type of device 10r (associated device D) and "far-infrared heater of D model" of the second type of device 1020r (associated device E) as associated devices. Additionally, for example, for "temperature information" as environmental information and "air conditioner of M model" as the third type of device 1030 (control device C), the associated device storage unit 1240S stores "electric fan of D model" of the first type of device 1010r (associated device D) and "electric fan of M model" of the third type of device 1030r (associated device F) as associated devices.

[0386] The environmental information acquisition unit 1241S acquires environmental information from the environmental information detection device K at a prescribed timing.

[0387] When it is determined by the control command determination unit 1120S that the control command includes any one of the control commands for the first type of device 1010 (control device A), the second type of device 1020 (control device B), or the third type of device 1030 (control device C), the associated device extraction unit 1242S extracts associated devices from the associated device storage unit 1240S.

[0388] When the associated device extraction unit 1242S extracts another first type of device 1010r (associated device D) as an associated device, the associated device control unit 1243S sends an output command for the extracted associated device (associated device D) to the infrared output device 1070. In addition, when the associated device extraction unit 1242S extracts another second type of device 1020r (associated device E) as an associated device, the associated device control unit 1243S controls the extracted associated device (associated device E) via the network NW. In addition, when the associated device extraction unit 1242S extracts another third type of device 1030r (associated device F) as an associated device, the associated device control unit 1243S sends an operation instruction corresponding to a control command for the associated device (associated device F) to the third information processing device 1300S.

[0389] Figure 30A , 30B , 31A, 31B are sequence diagrams showing the operations of Modification 2B. In Modification 2B, the operations of the already described steps W1 to W17 are performed. Here, between steps W6 and W7, and between W11 and W12, the process of "controlling associated devices" of steps X1 to X13 is added. As a premise, in Modification 2B, there is an environmental information detection device K around the control devices A, B, and C, and environmental information is sent from the environmental information detection device K to the second information processing device 1200S at a specified timing (steps W18, 19).

[0390] Moreover, in the process of "controlling associated devices", when the control command determination unit 1120S of the first information processing device 1100S determines that it includes a control command for the first type of device 1010 (control device A), a control command for the second type of device 1020 (control device B), or a control command for the third type of device 1030 (control device C), the associated device extraction unit 1242S of the second information processing device 1200S extracts associated devices (associated devices D, associated devices E, associated devices F) from the associated device storage unit 1240S (X1).

[0391] Here, when the associated device extraction unit 1242S extracts another first type of device 1010r as an associated device (associated device D) (X2 - Yes), the associated device control unit 1243S of the second information processing device 1200S sends an output command for the extracted associated device (associated device D) to the infrared output device 1070 (X3). In response to this, the infrared output device 1070 outputs an infrared pattern to the first type of device 1010r (associated device D) for control (X4, X5).

[0392] On the other hand, in step X2, when the associated device extraction unit 1242S does not extract any other first type devices 1010r as associated devices (associated device D) (X2 - No), the process proceeds to step X6. In step X6, when the associated device extraction unit 1242S extracts any other second type devices 1020r as associated devices (associated device E) (X6 - Yes), the associated device control unit 1243S of the second information processing device 1200S controls the extracted associated devices (associated device E) via the network NW (X7, X8).

[0393] On the other hand, in step X6, when the associated device extraction unit 1242S does not extract any other second type devices 1020r as associated devices (associated device E) (X6 - No), the process proceeds to step X9. In step X9, when the associated device extraction unit 1242S extracts any other third type devices 1030r as associated devices (associated device F) (X9 - Yes), the associated device control unit 1243S of the second information processing device 1200S sends an operation instruction for the extracted associated devices (associated device F) via the network NW (X10). In response to this, the third information processing device 1300S controls the third type devices 1030r (associated device F) via the network NW (X11 - X13).

[0394] In addition, when the associated device extraction unit 1242S does not extract any other third type devices 1030r as associated devices (associated device F) (X9 - No), the process ends.

[0395] In addition, the processing orders of the above steps X2 - X5, steps X6 - X8, and steps X9 - X13 are different, and any one of them can be processed first.

[0396] In the operating system 1001S of the above-described modification 2B, when the second information processing device 1200S extracts the third type devices 1030r (associated device F) as associated devices, an operation instruction for the third type devices 1030r (associated device F) is sent via the network based on the control command and the environment information. Therefore, the devices can be appropriately controlled according to the environment of the user 1005.

[0397] (1 - 2 - 4 - 3) Other modifications

[0398] Modifications 1A - 1J can also be directly applied in the present embodiment.

[0399] <Third Embodiment>

[0400] In the operating system 1001 of the first embodiment, it is configured such that the first information processing device 1100 includes the control command determination unit 1120, but this function may also be a function of the second information processing device.

[0401] (1-3-1) Structure of the operating system 1001

[0402] In the operating system 1001T of the third embodiment of the present invention, as Figure 32 shown, the second information processing device 1200T includes the control command determination unit 1207T. That is, in the second information processing device 1200T, the processing unit 1205 also functions as the "control command determination unit 1207T". In addition, in the operating system 1001T of the third embodiment, the operation information analysis unit 1110T of the first information processing device 1100T sends the text information converted from the voice information to the control command determination unit 1207T of the second information processing device 1200T.

[0403] The control command determination unit 1207T determines whether the analysis result of the operation information analysis unit 1110T of the first information processing device 1100T includes a control command for the first type of device 1010 or a control command for the second type of device 1020.

[0404] Here, when the control device is specified as the first type of device 1010, the control command determination unit 1207T sends the control content corresponding to the control device to the first control unit 1210T. On the other hand, when the control device is specified as the second type of device 1020, the control command determination unit 1207 sends the control content corresponding to the control device to the second control unit 1220T.

[0405] When the determination result of the control command determination unit 1207T includes a control command for the first type of device 1010, the first control unit 1210T sends the output command of the infrared pattern corresponding to the control command to the operation device 1050 (infrared output device 1070) via the communication unit 1203.

[0406] When the determination result of the control command determination unit 1207T includes a control command for the second type of device 1020, the second control unit 1220T controls the second type of device 1020 via the network NW based on the control command.

[0407] (1-3-2) Operation of the operating system 1T

[0408] Figure 33 is a sequence diagram for explaining the operation of the operating system 1001T of the present embodiment. According to the above structure, in the operating system 1001T of the third embodiment, the following operations are performed asFigure 33 The processing shown.

[0409] In addition, in the following description, for convenience, it is assumed that there is a control device A as a first type of device 1010 and a control device B as a second type of device 1020 around the user 1005.

[0410] First, the user 1005 inputs an operation on the devices existing around. Here, the user 1005 inputs an operation instruction (A1) for the control device A or the control device B by voice. For example, the user 1005 inputs commands such as "Turn on the power of the control device A" and "Turn off the control device B" by voice.

[0411] Next, the input receiving device 1060 receives the voice input of the user 1005, converts the voice input into voice information, and sends it to the first information processing device 1100T and the second information processing device 1200T (A2).

[0412] In the second information processing device 1200T, the received voice information is stored at any time (A3).

[0413] In the first information processing device 1100T, the operation information analysis unit 1110T analyzes the voice information received from the operation device 1050 (A4). For example, the operation information analysis unit 1110T of the first information processing device 1100T uses a neural network or the like to analyze the voice information. Here, the operation information analysis unit 1110T of the first information processing device 1100T analyzes the meaning corresponding to the voice information from the voice information and converts it into text information. Then, the analysis result of the voice information is sent to the second information processing device 1200T.

[0414] Next, the control command determination unit 1207T of the second information processing device 1200T determines whether the analysis result of the operation information analysis unit 1110T includes a control command for the first type of device 1010 or a control command for the second type of device 1020 (A5). When it is determined that the control command for the first type of device 1010 is included (A5 - Yes), the second information processing device 1200T sends the determination result to the first control unit 1210T. Here, the analysis result includes a control command for the control device A as the first type of device.

[0415] Next, the first control unit 1210T of the second information processing device 1200T acquires the determination result (A6), and determines the control content (A7) for the first type of device 1010 (control device A) based on the determination result. Then, the first control unit 1210T of the second information processing device 1200T sends an infrared pattern output command corresponding to the control command to the operation device 1050 (infrared output device 1070) via the communication unit 1203.

[0416] Next, the infrared output device 1070 receives the output command from the second information processing device 1200T, and outputs an infrared pattern (A8) based on this to control the control device A as the first type of device 1010 (A9).

[0417] On the other hand, in the above step A5, when the second information processing device 1200T determines that the control command for the first type of device 1010 is not included (A5 - No), it determines whether a control command for the second type of device 1020 is included (A10). When it is determined that a control command for the second type of device 1020 is included (A10 - Yes), the second information processing device 1200T sends the determination result to the second control unit 1220T. Here, the analysis result includes a control command for the control device B as the second type of device 1020.

[0418] Next, the second control unit 1220T of the second information processing device 1200T acquires the determination result (A11), and determines the control content (A12) for the second type of device 1020 (control device B). Moreover, the second control unit 1220T of the second information processing device 1200T controls the control device B as the second type of device 1020 via the network NW based on the control command (A13).

[0419] In the above step A10, when the second information processing device 1200T determines that the control command for the second type of device 1020 (control device B) is not included (A10 - No), the operating system 1001 ends the process.

[0420] In addition, the processing order of the above steps A5 - 9 and steps A10 - A13 is different, and either one can be processed first.

[0421] (1 - 3 - 3) Feature

[0422] (1 - 3 - 3 - 1)

[0423] As described above, the operating system 1001T of the present embodiment includes an input receiving device 1060, a first information processing device 1100T, a second information processing device 1200T, and an infrared output device 1070, and operates a first type of device 1010 that can be operated at least by infrared pattern communication and a second type of device 1020 that can be operated via a network NW. The input receiving device 1060 receives operation inputs. The first information processing device 1100T is connected to the input receiving device 1060 and has an operation information analysis unit 1110T that analyzes operation information corresponding to the operation inputs. The second information processing device 1200T is connected to the first information processing device 1100T, and when it is determined by a control command determination unit 1207T that the analysis result includes a control command for the second type of device 1020 (control device B), controls the second type of device 1020 (control device B) via the network NW based on the control command. The infrared output device 1070 is connected to the first information processing device 1100 or the second information processing device 1200, and when it is determined by the control command determination unit 1207T that the analysis result includes a control command for the first type of device 1010 (control device A), outputs an infrared pattern corresponding to the control command to the first type of device 1010 (control device A).

[0424] In addition, in the operating system 1001T of the present embodiment, the second information processing device 1200T has a control command determination unit 1207T that determines whether the analysis result of the operation information analysis unit 1110T includes a control command for the first type of device 1010 (control device A) or a control command for the second type of device 1020 (control device B).

[0425] Therefore, in the operating system 1001T of the present embodiment, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the first type of device, an infrared pattern is sent to the first type of device 1010 (control device A) for control. On the other hand, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the second type of device 1020 (control device B), the operating system 1001T controls the second type of device 1020 (control device B) via the network NW. In other words, a device that cannot be operated via the network NW (the first type of device 1010) is operated by the infrared output device 1070, and a device that can be operated via the network NW (the second type of device 1020) is operated by the second information processing device 1200T. Therefore, any device around the operation device 1050 (input receiving device 1060) can be controlled.

[0426] In particular, in the operating system 1001T of the present embodiment, the operation information analysis unit 1110T of the first information processing device 1100T analyzes the operation information input by voice. Therefore, the operating system 1001 can control the first type of device 1010 and the second type of device 1020 by voice input.

[0427] In addition, in the operating system 1001T of the present embodiment, when the determination result of the control command determination unit 1207 includes a control command for the first type of device 1010 (control device A), the second information processing device 1200T sends an output command for outputting an infrared pattern corresponding to the control command to the first type of device 1010 (control device A) to the infrared output device 1070.

[0428] In this way, since the second information processing device 1200 sends the output command to the infrared output device 1070, in the second information processing device 1200, it is possible to determine whether the control of the first type of device 1010 (control device A) has been executed. As a result, the reliability of the operating system 1001 can be improved.

[0429] (1-3-3-2)

[0430] In addition, the operating system 1001T of the third embodiment has the same features as the operating system 1001 of the first embodiment. In addition, in the operating system 1001T of the third embodiment, the modification example of the first embodiment can also be directly applied. Specifically, Figure 7 、 8 Steps S5 and S10 in 11, 14, 18 are replaced with the above steps A5 and A10.

[0431] <Fourth Embodiment>

[0432] Similar to the first embodiment, the operating system 1001T of the control system of the third embodiment can also be added with the same structure as the operating system 1001S of the second embodiment.

[0433] (1-4-1) Structure of Operating System 1001V

[0434] In the operating system 1001T of the fourth embodiment of the first invention, as Figure 34 shown, the second information processing device 1200V includes a control command determination unit 1207V. In addition, in the fourth embodiment, the operation information analysis unit 1110V of the first information processing device 1100V sends the text information converted from the voice information to the control command determination unit 1207V of the second information processing device 1200V.

[0435] In the fourth embodiment, the control command determination unit 1207V of the second information processing device 1200V also determines whether the analysis result of the operation information analysis unit 1110V includes a control command for controlling the third type of device 1030. Moreover, when the control command determination unit 1207V determines that the analysis result includes a control command for controlling the third type of device 1030, the control command determination unit 1207V sends an operation instruction corresponding to the control command to the third information processing device 1300V.

[0436] (1-4-2) Operation of the operating system 1001V

[0437] Figure 35A , 35B FIG. is a sequence diagram for explaining the operation of the operating system 1001V of the present embodiment. In addition, in the following description, for convenience, it is assumed that there is a control device A as the first type of device 1010, a control device B as the second type of device 1020, and a control device C as the third type of device 1030 around the user 1005.

[0438] First, the user 1005 makes a voice input (B1) to the devices existing around. For example, commands such as "Turn on the power of the control device A" and "Turn off the control device B" are input by voice.

[0439] Next, the input receiving device 1060 receives the voice input of the user 1005, converts the voice input into voice information, and sends the voice information to the first information processing device 1100V and the second information processing device 1200V (B2).

[0440] In the second information processing device 1200V, the voice information is stored at any time (B3).

[0441] In the first information processing device 1100V, the operation information analysis unit 1110 analyzes the voice information received from the operation device 1050 (B4). For example, the operation information analysis unit 1110V of the first information processing device 1100V analyzes the voice information using a neural network or the like. Then, the operation information analysis unit 1110V of the first information processing device 1100V analyzes the meaning corresponding to the voice information from the voice information and converts it into text information.

[0442] Next, the control command determination unit 1207V of the second information processing device 1200V determines whether the analysis result of the operation information analysis unit 1110V includes a control command for the first type of device 1010 (B5). When it is determined that the analysis result includes a control command for the first type of device 1010 (control device A) (B5 - Yes), the second information processing device 1200V sends the determination result to the first control unit 1210V. Here, the analysis result includes a control command for control device A, which is the first type of device 1010.

[0443] Next, the first control unit 1210V of the second information processing device 1200V obtains the determination result (B6), and based on the determination result, determines the control content for the first type of device 1010 (control device A) (B7). Moreover, the first control unit 1210V of the second information processing device 1200V sends an output command for an infrared pattern corresponding to the control command to the operation device 1050 (infrared output device 1070) via the communication unit 1203.

[0444] Next, the infrared output device 1070 receives the output command from the second information processing device 1200V, and based on this, outputs an infrared pattern (B8) to control control device A, which is the first type of device 1010 (B9).

[0445] On the other hand, in step B5 above, when the second information processing device 1200V determines that the analysis result does not include a control command for the first type of device 1010 (B5 - No), it determines whether it includes a control command for the second type of device 1020 (B10). When it is determined that the analysis result includes a control command for the second type of device 1020 (B10 - Yes), the second information processing device 1200V sends the determination result to the second control unit 1220V. Here, the analysis result includes a control command for control device B, which is the second type of device 1020.

[0446] Next, the second control unit 1220V of the second information processing device 1200V obtains the determination result (B11), determines the control content for the second type of device 1020 (control device B) (B12). Moreover, the second control unit 1220V of the second information processing device 1200V controls control device B, which is the second type of device 1020, via the network NW based on the control command (B13).

[0447] On the other hand, in the above step B10, when the second information processing device 1200V determines that the control command for the second type of device 1010 is not included (B10 - No), the control command determination unit 1207V of the second information processing device 1200V determines whether a control command for the third type of device 1030 is included (B14). When it is determined that a control command for the third type of device 1030 is included (B14 - Yes), the second information processing device 1200V sends the determination result to the third information processing device 1300V. Here, the analysis result includes a control command for the control device C which is the third type of device 1030.

[0448] Next, the third information processing device 1300V receives the determination result from the second information processing device 1200V (B15), and determines the control content for the third type of device 1030 (control device C) (B16). Moreover, the third information processing device 1300V controls the control device C which is the third type of device 1030 via the network NW based on the control command (B17).

[0449] In the above step B14, when it is determined that the control command for the third type of device 1030 (control device C) is not included (B14 - No), the operating system 1001V ends the process.

[0450] In addition, the processing order of the above steps B5 - B9, steps B10 - B13, and steps B14 - B17 is different, and any one of them can be processed first.

[0451] (1 - 4 - 3) Feature

[0452] (1 - 4 - 3 - 1)

[0453] As described above, in addition to the structure of the operating system 1001T of the third embodiment, the operating system 1001V of the present embodiment enables the second information processing device 1200V to communicate with the third information processing device 1300V that can operate a third type of device 1030 different from the second type of device 1020 via the network NW. In addition, the control command determination unit 1207V of the second information processing device 1200V also determines whether the analysis result of the operation information analysis unit 1110V includes a control command for the control command of the third type of device 1030. Moreover, when the control command determination unit 1207V determines that a control command for the third type of device 1030 is included, the second information processing device 1200V sends an operation instruction corresponding to the control command to the third information processing device 1300V.

[0454] Therefore, in the operating system 1001V of the present embodiment, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the first type of device 1010 (control device A), an infrared pattern is sent to the first type of control device A (control device A) for control. In addition, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the second type of device (control device B), the operating system 1001V controls the second type of device 1020 (control device B) via the network NW. In addition, when it is determined based on the analysis result of the operation information that the operation information includes a control command for the third type of device 1030 (control device C), the operating system 1001V sends an operation instruction for the third type of device 1030 (control device C) to the third information processing device 1300V that can operate the third type of device 1030 (control device C) via the network NW.

[0455] Therefore, an operating system can be provided that not only operates the first type of device 1010 (control device A) and the second type of device 1020 (control device B), but also can send an operation instruction for the third type of device 1030 (control device C) that cannot be operated by the second information processing device 1200V. As a result, an operating system with higher expandability can be provided.

[0456] (1-4-3-2)

[0457] In addition, the operating system 1001V of the fourth embodiment has the same features as the operating system 1001S of the second embodiment. In addition, in the operating system 1001V of the fourth embodiment, the modification examples of the second embodiment can also be directly applied. Specifically, Figure 25A 、 25B Steps W5, W10, and W14 in 26A, 26B, 30A, and 30B are replaced with the above steps B5, B10, and B14.

[0458] [Second Invention]

[0459] <First Embodiment>

[0460] (2-1-1) Structure of the control system 2001

[0461] Figure 36 、 37 is a schematic diagram showing the structure of the control system 2001 according to the first embodiment of the second invention.

[0462] The control system 2001 includes an input receiving device 2060, an infrared output device 2070, and an information processing device 2100. In the control system 2001, the user 2005 can control a specified control device by inputting a control instruction to the input receiving device 2060. Here, as the control devices, there are a "first type device 2010" and a "second type device 2020". In addition, these control devices are arranged in the room R.

[0463] In addition, in Figure 36 、 37 , one input receiving device 2060, one infrared output device 2070, and one information processing device 2100 are shown respectively, but the number of each device is not limited to this. The information processing device 2100 can be connected to any number of devices and manage these devices.

[0464] The first type device 2010 can be controlled by an output signal of infrared rays. For example, as the first type device 2010, an electric fan 2010a, a lighting device 2010b, a television 2010c, an air conditioner 2010d, etc. can be cited. Additionally, a pattern of the infrared output signal is preset for each control device, and by using this pattern, the control device 2010 can be controlled. Here, the correspondence relationship between the pattern of the infrared output signal and the control content is stored in the infrared pattern DB2104A described later. In addition, in the following description, the reference numeral 2010 is used to represent any first type device, and a lowercase letter subscript is marked when representing an individual first type device.

[0465] The second type device 2020 can be directly controlled by the information processing device 2100 via the network NW. Similar to the first type device 2010, the second type device 2020 can also be an electric fan 2020a, a lighting device 2020b, a television 2020c, an air conditioner 2020d, etc. In addition, in the following description, the reference numeral 2020 is used to represent any second type device, and a lowercase letter subscript is marked when representing an individual second type device.

[0466] The input receiving device 2060 receives an input of a control instruction for the specified control devices 2010 and 2020. Here, the input receiving device 2060 has a microphone, and receives a control instruction for the control devices 2010 and 2020 from the user 2005 through voice input via this microphone. Moreover, the input receiving device 2060 sends voice information corresponding to the received voice input to the information processing device 2100. In addition, when the input receiving device 2060 detects the voice emitted by the user 2005, it sends this voice information as it is to the information processing device 2100.

[0467] The infrared ray output device 2070 outputs infrared rays to the control device (first type device) 2010. In addition, the infrared ray output device 2070 has a posture control mechanism 2070A, and when receiving relative position information described later from the information processing device 2100, controls the posture of the infrared ray output device 2070 based on the relative position information. Further, the infrared ray output device 2070 can be installed inside a fixed device 2020F described later.

[0468] As Figure 38 shown, the information processing device 2100 has an input unit 2101, an output unit 2102, a communication unit 2103, a storage unit 2104, and a processing unit 2105, and is connected to the input reception device 2060 and the infrared ray output device 2070 via a network NW such as the Internet.

[0469] Here, the input unit 2101 is implemented by an arbitrary input device and inputs various information to the information processing device 2100. The output unit 2102 is implemented by an arbitrary output device and outputs various information from the information processing device 2100. The communication unit 2103 is connected to an external network NW and can perform information communication.

[0470] The storage unit 2104 is implemented by a ROM, a RAM, etc., and stores information input to the information processing device 2100, information calculated by the information processing device 2100, etc. Further, the storage unit 2104 stores an "infrared pattern database (DB) 2104A" and a "relative position database (DB) 2104B".

[0471] The infrared ray pattern DB 2104A stores the correspondence between the pattern of the infrared ray output signal and the prescribed control content for each control device (first type device 2010).

[0472] The relative position DB 2104B stores "relative position information" indicating the relative position relationship between the infrared ray output device 2070 and the control device (first type device 2010) in a prescribed space (room R). Further, when the infrared ray output device 2070 is fixed in the fixed device 2020F, information indicating the relative position relationship between the position of the fixed device 2020F and the position of the first type device 2010 can be used as the relative position information instead of the information indicating the relative position relationship between the position of the infrared ray output device 2070 and the position of the first type device 2010.

[0473] The processing unit 2105 is implemented by a CPU or the like and executes information processing in the information processing apparatus 2100. Here, the processing unit 2105 functions as a "voice input analysis unit 2110", a "control content specifying unit 2120", a "first control unit 2130", and a "second control unit 2135" by executing a program stored in the storage unit 2104.

[0474] The voice input analysis unit 2110 analyzes the input content received from the input receiving apparatus 2060. Specifically, the input receiving apparatus 2060 analyzes the meaning corresponding to the voice from the voice information using a neural network or the like and converts it into text information.

[0475] The control content specifying unit 2120 specifies the control content indicating the control device and the control instruction according to the analysis result of the voice input analysis unit 2110. For example, when the input receiving apparatus 2060 receives a voice input, the control content specifying unit 2120 determines whether the text information converted by the voice input analysis unit 2110 includes language information corresponding to the control device and the control instruction and specifies the control content.

[0476] Here, when the control device is specified as the first type device 2010, the control content specifying unit 2120 sends the control content corresponding to the control device to the first control unit 2130. On the other hand, when the control device is specified as the second type device 2020, the control content specifying unit 2120 sends the control content corresponding to the control device to the second control unit 2135.

[0477] When the control content specifying unit 2120 specifies the control content related to the first type device 2010, the first control unit 2130 sends an infrared pattern corresponding to the control content to the infrared output device 2070. Specifically, the first control unit 2130 sends an output command of infrared rays to the infrared output device 2070 based on the control content specified by the control content specifying unit 2120 and the information stored in the infrared pattern DB2104A. Thereby, the first type device 2010 is controlled via the infrared output device 2070. In addition, the first control unit 2130 sends the relative position information of the infrared output device 2070 and the target first type device 2010 to the infrared output device 2070 together with the output command of infrared rays. The relative position information is extracted from the relative position DB2104B.

[0478] When the control content specifying unit 2120 specifies the control content related to the second type device 2020, the second control unit 2135 controls the second type device 2020 via the network NW based on the control content.

[0479] (2-1-2) Operation of the control system 2001

[0480] Figure 39A , 39B is a sequence diagram for explaining the operation of the control system 2001 of the present embodiment.

[0481] First, the user 2005 uses the input receiving device 2060 to perform voice input (D1) on the control devices 2010 and 2020. Then, the input receiving device 2060 sends input information corresponding to the received voice input to the information processing device 2100 (D2).

[0482] Next, the information processing device 2100 receives the input information (D3) and analyzes the content of the voice input (D4). Then, the information processing device 2100 specifies the control content indicating the control devices 2010 and 2020 and the control instructions for the control devices 2010 and 2020 (D5).

[0483] Here, when it is specified that the control content is related to the first type of device 2010 (D6 - Yes), the information processing device 2100 extracts the information of the infrared pattern from the infrared pattern DB2104A based on the control content (D7). Further, the information processing device 2100 extracts the relative position information between the first type of device 2010 and the infrared output device 2070 (or the fixed device 2020F) from the relative position DB2104B (D8). Then, the information processing device 2100 sends the information of the infrared pattern, the relative position information, and the infrared output command to the infrared output device 2070 (D9).

[0484] Next, when the infrared output device 2070 receives the information of the infrared pattern, the relative position information, and the infrared output command (D10), it changes its posture toward the corresponding control device 2010 based on the relative position information (D11). Then, the infrared output device 2070 outputs infrared rays to the control device (the first type of device) 2010 based on the received information of the infrared pattern (D12).

[0485] On the other hand, in parallel with the above step D6, when it is specified that the control content is related to the second type of device 2020 (D13 - Yes), the information processing device 2100 controls the control device (the second type of device) 2020 via the network NW based on the control content (D14).

[0486] In the above steps D6 and D13, when the information processing device 2100 cannot specify that the control content is related to the first type of device 2010 and the second type of device 2020, the process ends (D6 - No, D13 - No).

[0487] In addition, the processing order of the above steps D6 to 9 is different from that of steps D13 and 14, and either one can be processed first.

[0488] (2-1-3) Feature

[0489] As described above, the control system 2001 of the present embodiment includes an input receiving device 2060, an infrared output device 2070, and an information processing device 2100. Here, the input receiving device 2060 receives control instructions for the control devices 2010 and 2020 from the user 2005 through voice input. The infrared output device 2070 outputs infrared rays to the control devices 2010 and 2020. The information processing device 2100 includes a voice input analysis unit 2110, a control content specifying unit 2120, a first control unit 2130, and a second control unit 2135. The voice input analysis unit 2110 analyzes the input content received from the input receiving device 2060. The control content specifying unit 2120 specifies the control content indicating the control device and the control instruction based on the analysis result of the voice input analysis unit 2110. When the control content specifying unit 2120 specifies the control content related to the first type of device 2010, the first control unit 2130 sends an infrared pattern corresponding to the control content to the infrared output device 2070. When the control content specifying unit 2120 specifies the control content related to the second type of device 2020, the second control unit 2135 controls the second type of device 2020 via the network NW based on the control content.

[0490] Therefore, in the control system 2001 of the present embodiment, it is possible to control the first type of device 2010 that can be controlled by the output of an infrared pattern and the second type of device 2020 that can be controlled via the network NW.

[0491] Furthermore, in the control system 2001 of the present embodiment, the information processing device 2100 on the network NW can send an infrared output command to the infrared output device 2070S according to the analysis result of the voice input. Here, when controlling a device by voice input, the amount of information processing sometimes becomes large. Even in such a case, in the control system 2001S, by using the information processing device 2100 that implements a neural network or the like constructed on the network NW, it is possible to perform voice analysis with high accuracy. As a result, even for voice input, it is possible to accurately specify the control devices 2010 and 2020 and the control instruction. As a result, a control system 2001 that can easily control any device can be provided.

[0492] In addition, in the control system 2001 of the present embodiment, the information processing device 2100 on the network NW has an infrared pattern DB2104A, which stores the correspondence between the pattern of the infrared output signal and the specified control content for each control device. Thus, changes, updates, additions, etc. of the pattern of the infrared output signal can be set uniformly. However, in the control system 2001 of the present embodiment, the information of the infrared pattern DB2104A may also be stored in the storage unit of each infrared output device 2070 instead of the storage unit of the information processing device 2100.

[0493] (2-1-4) Use of the fixed device 2020F

[0494] As Figure 37 shown, the infrared output device 2070 can be installed inside the fixed device 2020F whose position is fixed in a specified space (room R). The fixed device 2020F is, for example, an air conditioner, a lighting fixture, a television, etc., and is installed and fixed on the ceiling or wall of the room R. Alternatively, the fixed device 2020F can also be embedded and fixed in the ceiling or wall of the room R. In addition, the fixed device 2020F can be composed of the second type of device 2020.

[0495] As an example of such a fixed device 2020F, an air conditioner, a lighting fixture, a television, etc. can be cited. For example, when using the air conditioner 2020d as the fixed device 2020F, as Figure 40 shown, the infrared output device 2070 is mounted on the control mechanism behind the right side of the front panel.

[0496] In this way, in the control system 2001 of the present embodiment, the infrared output device 2070 is installed inside the fixed device 2020F whose position is fixed in a specified space (for example, room R). Moreover, since the position of the fixed device 2020F is fixed in the specified space (room R), the reach of the infrared rays output by the infrared output device 2070 installed in the fixed device 2020F can be foreseen in advance. Therefore, the infrared output device 2070 can easily control any control device (the first type of device 2010) as long as the device within its reach can be controlled by infrared rays. In addition, since the infrared output device 2070 is installed inside the fixed device 2020F, a setting space for the infrared output device 2070 may not be required.

[0497] In addition, in the control system 2001 of the present embodiment, the fixed device 2020F is installed and fixed on the ceiling or wall of the room R (refer to Figure 37) As a fixed device installed and fixed on the ceiling or wall of the room R, for example, lighting fixtures, air conditioning devices, etc. can be cited. They are all installed at a relatively high position within a specified space (room R). Therefore, the probability of preventing obstacles from entering the propagation path of infrared rays within the specified space can be increased. In other words, the probability of infrared rays reaching the control device (the first type of device 2010) can be increased. As a result, the reliability of the control system 2001 can be improved.

[0498] In addition, in the control system 2001 of the present embodiment, the information processing device 2100S on the network NW has a relative position DB2104B, which stores relative position information representing the relative position relationship between the position of the infrared ray output device 2070 (or the fixed device 2020F) and the position of the control device 2010 within the specified space. Thereby, the posture control of each infrared ray output device 2070 can be performed by the information processing device 2100. However, in the control system 2001, it may also be configured such that the information of the relative position DB2104B is stored in the storage unit of each infrared ray output device 2070 instead of being stored in the information processing device 2100.

[0499] (2-1-4-1) Variant 3A

[0500] In addition, in the control system 2001 of the present embodiment, as Figure 41 conceptually shown, the fixed device 2020F can also be embedded and fixed in the ceiling or wall of the room R. As the fixed device embedded and fixed in the ceiling or wall of the room R, for example, lighting fixtures, air conditioning devices, wall-mounted TVs, etc. can be cited. Regardless of which fixed device it is, it is installed at a relatively high position within the specified space (room R). Therefore, the probability of preventing obstacles from entering the propagation path of infrared rays within the specified space can be increased.

[0501] (2-1-4-2) Variant 3B

[0502] In addition, in the control system 2001 of the present embodiment, as Figure 42 conceptually shown, the input receiving device 2060 can also be arranged inside the fixed device 2020F. Thereby, the system structure can be simplified. In addition, there is no need to newly ensure a setting space for the input receiving device 2060.

[0503] (2-1-4-3) Variant 3C

[0504] The infrared output device 2070 of this embodiment can also be installed in the upper half area of the body of the fixed device 2020F. If it has such a structure, infrared rays can be output from a high position. Thereby, the probability of preventing an obstacle from entering the propagation path of the infrared rays in the specified space can be increased. For example, the infrared output device is installed on the upper part of a floor-standing air conditioner device.

[0505] <Second Embodiment>

[0506] (2-2-1) Structure of the control system 2001S

[0507] Figure 43 It is a schematic diagram showing the structure of the control system 2001S of the second embodiment of the second invention. In addition, in the following description, the structures that have been described are labeled with substantially the same reference numerals and repeated descriptions are omitted. In addition, in this embodiment, sometimes subscript S is used to label the structures different from those of other embodiments for description.

[0508] In the control system 2001S of this embodiment, different from the first embodiment, the input receiving device 2060S directly communicates with the infrared output device 2070S, and the structure of the information processing device 2100 is omitted. That is, the control system 2001S includes an input receiving device 2060S and an infrared output device 2070S, and controls a specified control device (first type device) 2010. Here, these devices are arranged in the room R. In addition, in Figure 43 For convenience of explanation, one control device 2010 is shown, but there may be multiple control devices 2010.

[0509] The input receiving device 2060S receives the input of the control instruction for the control device 2010. Moreover, the input receiving device 2060S sends the voice information corresponding to the received voice input to the infrared output device 2070S.

[0510] As Figure 44 shown, the infrared output device 2070S includes an input unit 2071, an output unit 2072, a communication unit 2073, a storage unit 2074, and a processing unit 2075. Moreover, the infrared output device 2070S outputs infrared rays to the control device 2010 via the output unit 2072. In addition, the infrared output device 2070S is installed in a fixed device 2020F whose position is fixed in a specified space (room R).

[0511] Specifically, the input unit 2071 inputs various information to the infrared ray output device 2070S. The output unit 2072 outputs various information from the infrared ray output device 2070S. Here, infrared rays are output through the function of the infrared ray emitter which serves as the output unit 2072. The communication unit 2073 can perform direct or indirect connection with an external network NW or the like. Here, the infrared ray output device 2070S and the input receiving device 2060S are connected through the function of the communication unit 2073.

[0512] The storage unit 2074 is implemented by a ROM, a RAM, etc., and stores information input to the infrared ray output device 2070, information calculated by the infrared ray output device 2070S, and the like. For example, an "infrared ray pattern DB2074A" is stored in the storage unit 2074. The infrared ray pattern DB2074A stores the correspondence between the pattern of the infrared ray output signal and the specified control content for each control device.

[0513] The processing unit 2075 is implemented by a CPU or the like, and executes information processing in the infrared ray output device 2070S. Here, the processing unit 2075 functions as an "output command sending unit 2075A" by executing the program stored in the storage unit 2074. When receiving a control instruction from the input receiving device 2060, the output command sending unit 2075A outputs infrared rays to the control device 2010 based on the information stored in the infrared ray pattern DB2074A.

[0514] (2 - 2 - 2) Features

[0515] As described above, the control system 2001S of the present embodiment includes an input receiving device 2060S and an infrared ray output device 2070S. The input receiving device 2060S receives a control instruction for the control device 2010 that can be controlled by infrared rays through voice input. The infrared ray output device 2070S is installed inside a fixed device 2020F whose position is fixed in a specified space (for example, room R). In addition, when the input receiving device 2060S receives a control instruction, the infrared ray output device 2070S outputs infrared rays to the control device 2010.

[0516] Therefore, in the control system 2001S of the present embodiment, the infrared control device 2010 can be controlled via voice input. In addition, since the position of the fixed device 2020F is fixed within a specified space (room R), the reach range of the infrared rays output by the infrared output device 2070S installed in the fixed device 2020F can be foreseen in advance. Therefore, the infrared output device 2070S can easily control any control device 2010 as long as the device within this reach range can be controlled by infrared rays. In addition, since the infrared output device 2070S is installed in the fixed device 2020F, a setting space for the infrared output device 2070S is not required.

[0517] In addition, in the control system 2001 of the present embodiment, the fixed device 2020F is installed and fixed on the ceiling or wall of the room R (refer to Figure 36 ). As fixed devices installed on the ceiling or wall of the room R, for example, lighting fixtures, air conditioning devices, etc. can be cited. They are all installed at a relatively high position within the specified space (room R). Therefore, the probability of preventing obstacles from entering the propagation path of the infrared rays within the specified space can be increased. In other words, the probability of the infrared rays reaching the control device 2010 can be increased. As a result, the reliability of the control system 2001 can be improved.

[0518] (2-2-3) Variation

[0519] In addition, as Figure 45 shown, the control system 2001S of the present embodiment can also incorporate a posture control mechanism 2070A in the infrared output device 2070S. Here, as Figure 46 shown, the storage unit 2074 of the infrared output device 2070S has a "relative position DB2074B". In the relative position DB2074B, "relative position information" indicating the relative position relationship between the infrared output device 2070S and the control device 2010 within the specified space (room R) is stored. Moreover, when the infrared output device 2070S outputs infrared rays, the processing unit 2075 functions as a posture control unit 2075B. The posture control unit 2075B extracts the relative position information from the relative position DB2074B, drives the posture control mechanism 2070A based on this relative position information, and changes the position of the infrared output device 2070. As a result, the output direction of the infrared rays of the infrared output device 2070S is changed to a desired direction. As a result, the probability of the infrared rays reaching the control device 2010 can be increased, and the reliability of the control system can be improved.

[0520] In addition, since the infrared ray output device 2070S is fixed within the fixed device 2020F, information indicating the relative positional relationship between the position of the fixed device 2020F and the position of the control device 2010 can be used as the relative position information instead of the information indicating the relative positional relationship between the position of the infrared ray output device 2070S and the position of the control device 2010.

[0521] In addition, in the present embodiment, the modification examples 3A to 3C of the first embodiment can also be directly applied.

[0522] [Third Invention]

[0523] (3-1) Structure of the control system 3001

[0524] Figure 47 、 48 is a schematic diagram showing the structure of a control system 3001 according to an embodiment of the third invention.

[0525] The control system 3001 includes an input receiving device 3060, an infrared ray output device 3070, and an information processing device 3100. In the control system 3001, the user 3005 can control a prescribed control device by inputting a control instruction to the input receiving device 3060. Here, as the control device, there are a "first type device 3010" and a "second type device 3020". In addition, these control devices are arranged in the room R.

[0526] In addition, in Figure 47 、 48 , one input receiving device 3060, one infrared ray output device 3070, and one information processing device 3100 are shown, but the number of each device is not limited thereto. The information processing device 3100 can be connected to any number of devices and manage these devices.

[0527] The first type device 3010 can be controlled by an output signal of infrared rays. For example, as the first type device 3010, an electric fan 3010a, a lighting device 3010b, a television 3010c, an air conditioner 3010d, etc. can be cited. Supplementary note: An infrared ray output signal pattern is preset for each control device, and the device 3010 can be controlled by using the infrared ray output signal pattern. Here, the correspondence relationship between the infrared ray output signal pattern and the control content is stored in the infrared ray pattern DB3104A described later. In addition, in the following description, the reference numeral 3010 is used to represent any first type device, and a lowercase letter subscript is added when representing an individual first type device.

[0528] The second type of device 3020 can directly control the information processing device 3100 via the network NW. Similar to the first type of device 3010, examples of the second type of device 3020 also include an electric fan 3020a, a lighting device 3020b, a television 3020c, an air conditioner 3020d, etc. In addition, in the following description, the reference numeral 3020 is used to represent any second type of device, and a lowercase letter subscript is used to represent an individual second type of device.

[0529] The input receiving device 3060 receives an input of a control instruction for the specified control devices 3010 and 3020. Here, the input receiving device 3060 has a microphone and can receive, via the microphone, a control instruction for the control devices 3010 and 3020 from the user 3005 by voice input. Moreover, the input receiving device 3060 sends voice information corresponding to the received voice input to the information processing device 3100. In addition, when the input receiving device 3060 detects the voice emitted by the user 3005, it sends the voice information as it is to the information processing device 3100. However, the input receiving device 3060 accepts an input from any input unit and is not limited to the input receiving device.

[0530] The infrared ray output device 3070 outputs infrared rays to the control device (first type of device) 3010. In addition, the infrared ray output device 3070 has a posture control mechanism 3070A, and when receiving relative position information described later from the information processing device 3100, it controls the posture of the infrared ray output device 3070 based on the relative position information. Moreover, the infrared ray output device 3070 can be installed inside a fixed device 3020F whose position is fixed in a specified space (room R). The fixed device 3020F is, for example, an air conditioning device, a lighting fixture, a television, etc., and is installed and fixed on the ceiling or wall of the room R. Alternatively, the fixed device 3020F can also be embedded and fixed in the ceiling or wall of the room R.

[0531] As Figure 49 shown, the information processing device 3100 has an input unit 3101, an output unit 3102, a communication unit 3103, a storage unit 3104, and a processing unit 3105, and is connected to the input receiving device 3060 and the infrared ray output device 3070 via a network NW such as the Internet.

[0532] Here, the input unit 3101 is implemented by an arbitrary input device and inputs various information to the information processing device 3100. The output unit 3102 is implemented by an arbitrary output device and outputs various information from the information processing device 3100. The communication unit 3103 is connected to the external network NW and can perform information communication.

[0533] The storage unit 3104 is implemented by a ROM, a RAM, etc., and stores information input to the information processing device 3100, information calculated by the information processing device 3100, etc. Moreover, the storage unit 3104 stores an "infrared pattern database (DB) 3104A" and a "relative position database (DB) 3104B".

[0534] The infrared pattern DB 3104A stores the correspondence between the pattern of the infrared output signal and the specified control content for each control device (first type device 3010).

[0535] The relative position DB 3104B stores "relative position information" indicating the relative position relationship between the infrared output device 3070 and the control device (first type device 3010) in the specified space (room R). In addition, when the infrared output device 3070 is fixed in the fixed device 3020F, as the relative position information, information indicating the relative position relationship between the position of the fixed device 3020F and the position of the first type device 3010 can be used instead of the information indicating the relative position relationship between the position of the infrared output device 3070 and the position of the first type device 3010.

[0536] The processing unit 3105 is implemented by a CPU, etc., and executes information processing in the information processing device 3100. Here, the processing unit 3105 functions as an "input analysis unit 3110", a "control content specifying unit 3120", a "first control unit 3130", and a "second control unit 3135" by executing the program stored in the storage unit 3104.

[0537] The input analysis unit 3110 analyzes the input content received from the input receiving device 3060. For example, when the input receiving device 3060 receives a voice input, the content of the voice input is converted into text information and analyzed. In addition, when analyzing the content of the voice input, the input analysis unit 3110 can use a neural network, etc., to analyze the content with high precision.

[0538] The control content specifying unit 3120 specifies the control content indicating the control device and the control instruction according to the analysis result of the input analysis unit 3110. For example, when the input receiving device 3060 receives a voice input, the control content specifying unit 3120 determines whether the text information converted by the input analysis unit 3110 includes language information corresponding to the control device and the control instruction and specifies the control content.

[0539] Here, when the control content specifying unit 3120 determines that the control device is the first type of device 3010, it sends the control content corresponding to the control device to the first control unit 3130. On the other hand, when the control content specifying unit 3120 determines that the control device is the second type of device 3020, it sends the control content corresponding to the control device to the second control unit 3135.

[0540] When the control content specifying unit 3120 determines the control content related to the first type of device 3010, the first control unit 3130 sends the infrared pattern corresponding to the control content to the infrared output device 3070. Specifically, the first control unit 3130 sends an infrared output command to the infrared output device 3070 based on the control content determined by the control content specifying unit 3120 and the information stored in the infrared pattern DB 3104A. Thus, the first type of device 3010 is controlled via the infrared output device 3070. In addition, the first control unit 3130 sends the relative position information of the infrared output device 3070 and the target first type of device 3010 to the infrared output device 3070 together with the infrared output command. Further, the relative position information is extracted from the relative position DB 3104B.

[0541] When the control content specifying unit 3120 determines the control content related to the second type of device 3020, the second control unit 3135 controls the second type of device 3020 via the network NW based on the control content.

[0542] (3-2) Operation of the control system 3001

[0543] Figure 50A 、 50B is a sequence diagram for explaining the operation of the control system 3001 of the present embodiment.

[0544] First, the user 3005 uses the input receiving device 3060 to perform voice input (E1) on the control devices 3010 and 3020. Then, the input receiving device 3060 sends the input information corresponding to the received voice input to the information processing device 3100 (E2). Here, the input receiving device 3060 receives the operation input by voice (voice input).

[0545] Next, the information processing device 3100 receives the input information (E3) and analyzes the input content (E4). Then, the information processing device 3100 determines the control content indicating the control devices 3010 and 3020 and the control instruction for the control devices 3010 and 3020 (E5).

[0546] Here, when the information processing device 3100 determines that the control content is related to the first type of device 3010 (E6 - Yes), it extracts the information of the infrared pattern from the infrared pattern DB 3104A based on the control content (E7). Furthermore, the information processing device 3100 extracts the relative position information between the first type of device 3010 and the infrared output device 3070 (or the fixed device 3020F) from the relative position DB 3104B (E8). Then, the information processing device 3100 sends the information of the infrared pattern and the relative position information together with the infrared output command to the infrared output device 3070 (E9).

[0547] Next, when the infrared output device 3070 receives the infrared output command, the infrared pattern information, and the relative position information (E10), it changes its posture toward the corresponding control device 3010 based on the relative position information (E11). Then, the infrared output device 3070 outputs infrared rays toward the control device (the first type of device) 3010 based on the received infrared pattern information (E12).

[0548] On the other hand, in parallel with the above step E6, when the information processing device 3100 determines that the control content is related to the second type of device 3020 (E13 - Yes), it controls the control device (the second type of device) 3020 via the network NW based on the control content (E14).

[0549] In the above steps E6 and E13, when the information processing device 3100 cannot determine that the control content is related to the first type of device 3010 and the second type of device 3020, the process ends (E6 - No, E13 - No).

[0550] In addition, the processing order of the above steps E6 to 9 and the processing of steps E13 and 14 are different, and either one can be processed first.

[0551] (3 - 3) Features

[0552] As described above, the control system 3001 of the present embodiment includes an input receiving device 3060, an infrared output device 3070, and an information processing device 3100. Here, the input receiving device 3060 receives control instructions for the control devices 3010 and 3020 from the user 3005 through voice input. The infrared output device 3070 outputs infrared rays to the control devices 3010 and 3020. The information processing device 3100 includes an input analysis unit 3110, a control content specifying unit 3120, a first control unit 3130, and a second control unit 3135. The input analysis unit 3110 analyzes the input content received from the input receiving device 3060. The control content specifying unit 3120 specifies the control content indicating the control device and the control instruction based on the analysis result of the input analysis unit 3110. When the control content specifying unit 3120 specifies the control content related to the first type of device 3010, the first control unit 3130 sends an infrared pattern corresponding to the control content to the infrared output device 3070. When the control content specifying unit 3120 specifies the control content related to the second type of device 3020, the second control unit 3135 controls the second type of device 3020 via the network NW based on the control content.

[0553] Therefore, in the control system 3001 of the present embodiment, it is possible to control the first type of device 3010 that can be controlled by the output of an infrared pattern and the second type of device 3020 that can be controlled via the network NW.

[0554] Furthermore, in the control system 3001S of the present embodiment, the information processing device 3100 on the network NW can send an infrared output command to the infrared output device 3070S according to the analysis result of voice input. Here, when controlling a device by voice input, the amount of information to be processed sometimes becomes large. Even in such a case, in the control system 3001S, it is possible to perform voice analysis with high accuracy by using the information processing device 3100 that implements a neural network or the like constructed on the network NW. As a result, even for voice input, it is possible to accurately specify the control devices 3010 and 3020 and the control instruction. As a result, a control system 3001 that can easily control any device can be provided.

[0555] In addition, in the control system 3001 of the present embodiment, the information processing device 3100 on the network NW has an infrared pattern DB3104A that stores the correspondence between the pattern of the infrared output signal and the specified control content for each control device. Thereby, it is possible to uniformly set changes, updates, additions, etc. of the pattern of the infrared output signal. However, in the control system 3001 of the present embodiment, the structure may also be such that the information of the infrared pattern DB3104A is stored in the storage unit of each infrared output device 3070 instead of being stored in the information processing device 3100.

[0556] (3-4) Utilization of the environmental information detection device 3020K

[0557] (3-4-1) Structure of the control system 3001

[0558] In the control system 3001 of the present embodiment, as Figure 51 shown, a structure further equipped with the environmental information detection device 3020K can be adopted.

[0559] The environmental information detection device 3020K detects the environmental information around the control devices 3010 and 3020. "Environmental information" includes, for example, information such as temperature, humidity, and illuminance. As an example of the environmental information detection device 3020K, devices that utilize a sound sensor, an illuminance sensor, an air volume sensor, an image sensor (camera), an infrared sensor, a temperature sensor, a pressure sensor, a humidity sensor, a thermostat, etc. can be cited. This environmental information is sent to the information processing device 3100. In addition, the environmental information detection device 3020K can be constituted by the second type device 3020.

[0560] In the information processing device 3100, as Figure 52 shown, the processing unit 3105 also functions as a "control determination unit 3140" and an "abnormal processing unit 3150".

[0561] The control determination unit 3140 receives the environmental information from the environmental information detection device 3020K, and determines whether the control device (the first type device) 3010 is controlled based on the infrared output command and the environmental information. For example, when the control device 3010 is an air conditioner, the temperature of the surrounding environment changes. Then, the control determination unit 3140 acquires the temperature information as the environmental information, determines whether a specified temperature change has occurred, and thereby determines whether the control device 3010 is controlled. In addition, for example, when the control device 3010 is a television, the illuminance of the surrounding environment changes. Then, the control determination unit 3140 acquires the illuminance information as the environmental information, determines whether a specified illuminance change has occurred, and thereby determines whether the control device 3010 is controlled.

[0562] When it is determined by the control determination unit 3140 based on the infrared output command and the environmental information that the control device 3010 is not controlled (abnormal determination), the abnormal processing unit 3150 executes abnormal processing. For example, the abnormal processing unit 3150 executes the process of retransmitting the infrared output command to the infrared output device 3070 as the abnormal processing.

[0563] (3-4-2) Operation of the control system 3001

[0564] Figure 53A 、53B This is a sequence diagram for explaining the operation of the control system 3001 according to the present embodiment. In the following description, it is assumed that the control device is a first type of device 3010 for explanation.

[0565] In the control system 3001 of the present embodiment, by adopting a structure equipped with the environmental information detection device 3020K, the processing of the following steps F1 to F4 can be added to the above steps E1 to E12.

[0566] That is, the environmental information detection device 3020K sends the environmental information around the control device 3010 to the information processing device 3100 at any time (F1).

[0567] In response to this, in the information processing device 3100, based on the time of the output command sent to the infrared output device 3070, the time of the environmental information received from the environmental information detection device 3020K, and the change amount, it is determined whether the control device 3010 has been controlled according to the output command (F2, F3).

[0568] In the information processing device 3100, when it is determined that the control device 3010 has been controlled according to the output command, the control confirmation process is ended (F3 - Yes).

[0569] On the other hand, in the information processing device 3100, when it is determined that the control device 3010 has not been controlled according to the output command, it is determined that an abnormality has occurred, and the abnormality process is executed (F3 - No, F4). For example, as the abnormality process, the information processing device 3100 re - sends the output command to the infrared output device 3070 (E9). Thus, the output command is repeatedly sent to the control device 3010 from the infrared output device 3070 until the control device 3010 is normally controlled.

[0570] (3 - 4 - 3) Features

[0571] As described above, the control system 3001 of the present embodiment includes an input receiving device 3060, an infrared output device 3070, an environmental information detection device 3020K, and an information processing device 3100. The input receiving device 3060 receives the input of the control instruction for the control device (first type of device) 3010 that can be controlled by infrared rays. The infrared output device 3070 outputs infrared rays to the control device 3010. The environmental information detection device 3020K detects the environmental information around the control device 3010. The information processing device 3100 receives the control instruction from the input receiving device 3060, and based on the control instruction, sends an infrared output command to the infrared output device 3070. Here, the information processing device 3100 receives the environmental information from the environmental information detection device 3020K, and determines that the control device 3010 is controlled based on the output command and the environmental information.

[0572] Therefore, in the control system 3001 of this embodiment, the information processing device 3100 receives environmental information from the environmental information detection device 3020K, and determines whether the control device 3010 is controlled based on the output command and the environmental information. Therefore, when the control device 3010 is not controlled, processing such as controlling the control device 3010 can be performed.

[0573] For example, when it is determined based on the infrared output command and the environmental information that the control device 3010 is not controlled, the information processing apparatus 3100 resends the output command to the infrared output device 3070. Thus, the control device 3010 is reliably controlled, and thus a highly reliable control system 3001 can be provided.

[0574] (3-4-4) Modification

[0575] (3-4-4-1)

[0576] In the above description, when the control device 3010 is determined to be not controlled based on the output command of infrared rays and the environmental information, the output command is repeatedly sent from the infrared output device 3070 to the control device 3010 until the control device 3010 is normally controlled. However, the processing in the control system 3001 of this embodiment is not limited to such control. For example, the number of output commands to the control device 3010 can also be limited to a specified number of times. Thus, the load of the system can be reduced. In addition, when the information processing device 3100 determines that the control device 3010 is not controlled based on the output command of infrared rays and the environmental information, it can also send a notification of the subject that it is not controlled to the input receiving device 3060. Thus, the user 3005 of the input receiving device 3060 is prompted to re-input the control instruction, so that the control device 3010 is reliably controlled. As a result, a control system 3001 with high reliability can be provided.

[0577] In particular, in the control system 3001 of this embodiment, since the infrared output device 3070 is operated via the information processing device 3100 on the network NW, the control device 3010 can be remotely controlled. On the other hand, in the case of remote control, the user 3005a controlling the control device 3010 and the user 3005b using the control device 3010 may be different (see Figure 51 ). Even in this case, as long as it is the control system 3001 of this variation, when it is determined to be abnormal, the user 3005a who controls the control device 3010 will be notified of the fact that it is not controlled, so the control device 3010 can be properly managed by the user 3005a who controls the control device 3010.

[0578] (3-4-4-2)

[0579] In addition, each function of the above information processing device 3100 can also be executed distributively in a plurality of information processes. For example, as Figure 54 , 55 shown, the control system 3001 can also be configured to include a first information processing device 3100A and a second information processing device 3200A instead of the information processing device 3100. Here, the first information processing device 3100A has the function of the above input analysis unit, and the second information processing device 3200A has other functions. It should be added that in the case of controlling a device by voice input control, the analysis of voice input sometimes requires a large amount of processing. Even in such a case, in the control system 3001, by using the first information processing device 3100A that implements a neural network or the like constructed on the network NW, voice analysis can be performed with high accuracy. As a result, even for voice input, the control device and the control instruction can be accurately specified. As a result, a control system 3001 that can easily control any device can be provided.

[0580] (3-4-4-3)

[0581] In the above description, the information processing device 3100 is configured to have the infrared pattern DB3104A, but this information can also be stored by the infrared output device 3070. In this case, the storage unit of the infrared output device 3070 stores the infrared pattern DB.

[0582] (3-4-4-4)

[0583] In the above description, the information processing device 3100 is configured to have the relative position DB3104B, but this information can also be stored by the infrared output device 3070. In this case, the storage unit of the infrared output device 3070 stores the relative position DB. In addition, even if the information processing device 3100 and the infrared output device do not have the structure of the relative position DB, the control of the device by the control system 3001 of the present embodiment can be achieved.

[0584] [Fourth Invention]

[0585] Hereinafter, with reference to the drawings, an operating system 4001 of an embodiment of the operating system of the present invention will be described.

[0586] In addition, the following embodiments are specific examples of the present invention and do not limit the technical scope of the present invention. The following embodiments can be appropriately changed without departing from the gist of the present invention.

[0587] (4-1) Overall Outline of the Device System

[0588] Figure 56 It is a schematic structural diagram of a device system 4000 according to an embodiment of the fourth invention. Figure 57 It is a schematic block diagram of the device system 4000. In addition, in Figure 57 the drawing of a part of the structure of the device system 4000 is omitted.

[0589] In this embodiment, the operating system 4001 is a system that operates the air conditioner 4010, the devices 4050a, 4050b, … 4050n included in the first device group (also referred to as the first type of device) 4050, and the devices 4060a, 4060b, … 4060m included in the second device group (also referred to as the second type of device) 4060 according to the instructions issued by the operator through voice. In the operating system 4001, by inputting the voice of the instruction to the operation unit 4200, the air conditioner 4010, the devices of the first device group 4050, and the devices of the second device group 4060 can be operated. In addition, the devices 4050a, 4050b, … 4050n included in the first device group 4050 are an example of the target devices to be operated. That is, the devices 4050a, 4050b, … 4050n included in the first device group 4050 are devices that can be operated by infrared signals in addition to the air conditioner 4010.

[0590] The device system 4000 mainly includes an operation unit 4200, an air conditioner 4010, a first device group 4050, a second device group 4060, an infrared output device (also referred to as an infrared transmitter) 4040, an analysis server 4020, an air conditioner server 4030, and a device server 4070 (refer to Figure 56 and Figure 57 ). The operating system 4001 mainly includes an operation unit 4200, an air conditioner 4010, and an infrared output device 4040. In addition, the operating system 4001 includes sensors 4410 for measuring the current or power of the first device group 4050, and environmental sensors 4430 such as illuminance sensors, temperature sensors, and air pressure sensors (refer to Figure 57 ).

[0591] The air conditioner 4010, the first device group 4050, the second device group 4060, and the infrared output device 4040 are devices configured in the building B (refer to Figure 56 ). For example, the building B is a single-family house, but it is not limited thereto. The building B can also be an office building, a commercial facility, a factory, etc. The analysis server 4020, the air conditioner server 4030, and the device server 4070 are not limited, but are usually set in a place different from the building B.

[0592] In addition, in Figure 56In this figure, only a building B is depicted, which is equipped with an air conditioner 4010, a first device group 4050, and a second device group 4060 whose operations are controlled by an operating system 4001. However, there can be multiple buildings B. That is, the operating system 4001 can also be a system that controls the operations of the air conditioners 4010, the first device group 4050, and the second device group 4060 respectively configured in multiple buildings B. Here, for the sake of simplicity of explanation, the building B is set to be one.

[0593] In addition, the number of each of the air conditioner 4010, the devices of the first device group 4050, the devices of the second device group 4060, the infrared output device 4040, and the environment sensor 4430 configured in the building B can be one or multiple, regardless of Figure 56 the number depicted in the figure. In addition, here, it is assumed that the number of the air conditioner 4010, the infrared output device 4040, and the environment sensor 430 configured in the building B is one, and the number of the devices of the first device group 4050 and the second device group 4060 configured in the building B are multiple respectively for the purpose of explanation.

[0594] The operation unit 4200 is set inside the building B and is used to operate the air conditioner 4010, the devices of the first device group 4050, and the devices of the second device group 4060 inside the building B. In addition, in Figure 56 and Figure 57 the figure, only one operation unit 4200 is depicted, but the number of the operation units 4200 is not limited to one and can also be multiple. For example, the operation units 4200 can also be set in multiple places inside the building B.

[0595] In addition, the operation unit 4200 can also be a portable terminal that can be carried outside the building B. In other words, the air conditioner 4010, the first device group 4050, and the devices of the second device group 4060 can also be configured to be operable from the outside of the building B using the portable operation unit 4200.

[0596] (4-2) Detailed Structure

[0597] The operation unit 4200, the air conditioner 4010, the first device group 4050, the second device group 4060, the infrared output device 4040, the analysis server 4020, the air conditioner server 4030, and the device server 4070 of the device system 4000 are described below.

[0598] (4-2-1) Operation Unit

[0599] The operation unit 4200 is used for input of operations of the air conditioner 4010, the devices 4050a, 4050b, … 4050n included in the first device group 4050, and the devices 4060a, 4060b, … 4060m included in the second device group 4060. The operation unit 4200 is an example of an instruction receiver that receives instructions for the devices 4050a, 4050b, … 4050n included in the first device group 4050 as instruction sounds. In addition, the operation unit 4200 receives instructions for the air conditioner 4010 and the devices 4060a, 4060b, … 4060m included in the second device group 4060 as instruction sounds.

[0600] The operation unit 4200 is installed, for example, inside the building B. For example, the operation unit 4200 is fixed to a wall or the like, or placed on a table or a shelf. The operation unit 4200 can also be a device dedicated to operating the air conditioner 4010, the first device group 4050, and the second device group 4060 and having the functions described below. In addition, the operation unit 4200 can also be a device having other functions (such as functions as a clock or a music player) in addition to the functions described below.

[0601] The operation unit 4200 can also be a portable terminal. Although not limited to a specific type, the portable terminal is a smartphone, a mobile phone, a tablet terminal, a wearable terminal, etc. having a sound receiving unit. For example, specifically, the operation unit 4200 is a watch-type device worn on the operator's wrist for carrying.

[0602] In addition, when multiple operation units 4200 are used, the types of the multiple operation units 4200 can be different from each other.

[0603] The operation unit 4200 includes a CPU (not shown) that performs various processes, a storage device (not shown) that stores programs or various information executed by the CPU, etc. In addition, the operation unit 4200 includes a microphone element 4210a as a sound receiving unit 4210, a speaker as a notification unit 4220, a chip for sound processing that performs various processes on the sound acquired by the microphone element 4210a, a wireless LAN adapter that functions as a communication unit 4250, etc.

[0604] The operation unit 4200 has a sound receiving unit 4200, a notification unit 4220, a sound processing unit 4230, a communication unit 4250, and a switch 4260 as functional units (refer to Figure 57 ).

[0605] (4-2-1-1) Sound receiving unit

[0606] The sound receiving unit 4210 receives the input of the instruction sound for the air conditioner 4010, the devices of the first device group 4050, and the devices of the second device group 4060.

[0607] The sound receiving unit 4210 includes a microphone element 4210a for receiving the instruction sound. The number of microphone elements 4210a may be one or more (in Figure 57 it, the number of microphone elements 4210a is set to two).

[0608] For example, when the operation unit 4200 is a mounted device, by providing a plurality of microphone elements 4210a and arranging the microphone elements 4210a so as to be respectively easy to pick up the instruction sound from different places, it is easy to reliably pick up the instruction sound through the sound receiving unit 4210 regardless of the position of the operator (the sound emitter).

[0609] (4-2-1-2) Notification unit

[0610] Here, the notification unit 4220 is a speaker.

[0611] The notification unit 4220 mainly notifies the reception of the instruction sound by the sound receiving unit 4210. For example, specifically, when the sound receiving unit 4210 receives the instruction sound, the notification unit 4220 emits a sound such as "sound received" or emits a sound in a manner of repeating the received instruction sound, thereby notifying the reception of the instruction sound by the sound receiving unit 4210. In addition, the notification unit 4220 may be configured to notify the operation content (for example, a sentence such as "starting operation") when the air conditioner 4010 performs various operations. In addition, the notification unit 4220 may be configured to notify the operation content when the devices of the second device group 4060 perform various operations.

[0612] In addition, the notification unit 4220 notifies the information related to the determination result of the determination unit 4318 of the device management device 4300 output (transmitted) from the transmission unit 4170a of the device management device 4300 of the air conditioner 4010, which will be described later, to the communication unit 4250. In addition, here, the determination result refers to the determination result of whether the content of the instruction instructed to a certain device of the first device group 4050 using the operation unit 4200 deviates from the operation content of the device.

[0613] When the communication unit 4250 receives information indicating that the command content for a certain device in the first device group 4050 does not deviate from (is consistent with) the operation content of the device, the notification unit 4220 emits a sound such as the sentence "The device is operating normally". Additionally, when the communication unit 4250 receives information indicating that the command content for a certain device in the first device group 4050 deviates from the operation content of the device, the notification unit 4220 emits a sound such as the sentence "The device is not operating normally". Furthermore, the "device" part in the sentence can also be replaced with, for example, the name of the device.

[0614] In addition, the sentences emitted by the above-mentioned notification unit 4220 are examples, and as long as the sentences emitted by the notification unit 4220 are appropriately determined.

[0615] In addition, the speaker of the notification unit 4220 does not have to notify by emitting the sound of sentences or words, and can also notify by a beeping sound or the like.

[0616] Furthermore, the notification unit 4220 does not have to be a speaker. For example, the notification unit 4220 can utilize a notifier of other notification methods, such as a lamp that notifies by light, a vibrator that notifies by vibration, a display that notifies by displaying information, etc.

[0617] (4-2-1-3) Sound Processing Unit

[0618] The sound processing unit 4230 is an integrated circuit that converts the command sound received by the sound receiving unit 4210 into data suitable for communication. In addition, various processes can be implemented by hardware processing or by software processing.

[0619] For example, the sound processing unit 4230 converts the command sound received by the microphone element 4210a into a digital sound signal by performing A / D conversion, and further performs sound compression processing of various sound data compression methods (such as MP3, etc.) to generate a signal S for transmission from the communication unit 4250.

[0620] In addition, the processing content of the sound processing unit 4230 is an example. For example, the sound processing unit 4230 can also perform A / D conversion on the command sound received by the microphone element 4210a to generate a digital sound signal as the signal S. Additionally, the sound processing unit 4230 can also textify the command sound received by the microphone element 4210a to generate text data as the signal S.

[0621] (4-2-1-4) Communication Unit

[0622] The communication unit 4250 is a functional unit for the operation unit 4200 to communicate with the air conditioner 4010, the analysis server 4020, etc. (refer to Figure 57)。

[0623] The operation unit 4200 is connected to the analysis server 4020 via the network 4080 (refer to Figure 56 ). The network 4080 is the Internet here, but it can also be other WANs. The operation unit 4200 is connected to the router 4082 via a wireless LAN and is connected to the network 4080 via the router 4082 (refer to Figure 56 ). The router 4082 has a WAN-side interface and a LAN-side interface, connecting the WAN and the LAN to each other. In addition, the operation unit 4200 and the router 4082 can also be connected via a wired LAN instead of a wireless LAN. The network 4080 can also be a LAN.

[0624] The communication unit 4250 is, for example, a wireless LAN adapter that performs wireless communication between it and the router 82.

[0625] The communication unit 4250 transmits a signal S related to the instruction sound received by the sound receiving unit 4250 (the signal S generated by the sound processing unit 4230 from the instruction sound) (refer to Figure 57 ). Specifically, the communication unit 4250 transmits the signal S related to the instruction sound received by the sound receiving unit 4210 to the analysis server 4020 via the network 4080 (refer to Figure 57 ).

[0626] In addition, the communication unit 4250 can also further transmit the signal S to the air conditioner server 4030 or the device server 4070. That is, the communication unit 4250 can also transmit the signal S to multiple addresses (for example, the analysis server 4020 and the air conditioner server 4030) (refer to Figure 57 ).

[0627] In addition, the communication unit 4250 receives information related to the determination result of the determination unit 4318 of the device management device 4300, which is output (transmitted) from the transmission unit 4170a of the device management device 4300 of the air conditioner 4010 described later to the communication unit 4250.

[0628] In addition, the communication unit 4250 can also be configured to receive information related to the operation contents of the air conditioner 4010, the devices 4060a, 4060b,... 4060m of the second device group 4060, which are respectively transmitted by the transmission unit 4170a of the air conditioner 4010 and the transmission units (not shown) of the devices 4060a, 4060b,... 4060m of the second device group 4060.

[0629] (4-2-1-5) Switch

[0630] The switch 4260 is a switch for switching the operation state of the sound receiving unit 4210.

[0631] Although not limited, the switch 4260 is a push-button switch. By pressing the switch 4260, the operation state of the sound receiving unit 4210 is switched between a sleep state in which an instruction sound is not received and an active state in which an instruction sound can be received.

[0632] In addition, it may be that each time the switch 4260 is pressed, the operation state of the sound receiving unit 4210 is switched between the sleep state and the active state. Alternatively, it may be that when the switch 4260 is pressed, the operation state of the sound receiving unit 4210 is switched from the sleep state to the active state only for a specified time.

[0633] In addition, it may be that the operation unit 4200 does not have the switch 4260, and the operation state of the sound receiving unit 4200 is always set to the active state. However, in order to prevent the sound receiving unit 4210 from receiving a sound at an unexpected timing (to prevent unexpected malfunction of the air conditioner 4010, the first device group 4050, and the second device group 4060), it is preferable to provide the switch 4260 in the operation unit 4200.

[0634] (4-2-2) Air conditioner

[0635] The air conditioner 4010 is an air conditioner that can be operated by inputting an instruction sound to the sound receiving unit 4210 of the operation unit 4200. The instruction sound is not limited, and examples thereof include sounds such as "turn on the air conditioner" and "set the set temperature to 25°C". In addition, the air conditioner 4010 may be configured to be operable by a normal remote controller in addition to sound operation.

[0636] In addition, the air conditioner 4010 also has a management function for managing devices 4050a, 4050b,..., 4050n of the first device group 4050. Specifically, the air conditioner 4010 has a device management device 4300 for managing devices 4050a, 4050b,..., 4050n of the first device group 4050.

[0637] The air conditioner 4010 mainly includes an indoor unit 4012, an outdoor unit 4014, a refrigerant communication pipe (not shown) connecting them, a controller 4150, a device management unit 4310, and a camera 4420 (see Figure 56 and Figure 57 ). A part of the device management unit 4310 and the controller 4150 (specifically, the communication unit 4170) functions as the device management device 4300.

[0638] The air conditioner 4010 is a device for conditioning the air in an air-conditioning target space. The air-conditioning target space is, for example, a room in the building B where the indoor unit 4012 is disposed.

[0639] In this embodiment, the indoor unit 4012 is wall-mounted. Figure 58A FIG. is a schematic front view of the indoor unit 4012 of the air conditioner 4010 according to this embodiment. In addition, hereinafter, in order to describe directions or orientations, expressions such as "left", "right", "up", and "down" may be used, but unless otherwise specifically stated, the orientations indicated by these expressions conform to Figure 58A the orientation of the arrow in

[0640] The indoor unit 4012 has a main body 4100 mounted on the wall on the back side (see Figure 56 and Figure 58A ). The main body 4100 is a housing that internally houses an indoor heat exchanger, a fan, and a fan motor (not shown). An air outlet 4120 and an air inlet 4130 are formed on the main body 4100 (see Figure 56 and Figure 58A ).

[0641] The air inlet 4130 is an opening for sucking the air in the air-conditioning target space into the interior of the main body 4100. When viewed from the front, the air inlet 4130 extends in the left-right direction as the longitudinal direction (see Figure 58A ). The air inlet 4130 is formed from the upper part of the front surface of the main body 4100 to the upper surface of the main body 4100.

[0642] The air outlet 4120 is an opening for blowing the air-conditioned air into the air-conditioning target space. The air outlet 4120 is formed in the lower part of the main body 4100. A baffle 4122 for adjusting the air direction in the up-down direction is disposed at the air outlet 4120 (see Figure 56 ).

[0643] In addition, the type of the indoor unit of the air conditioner is not limited to the wall-mounted type. For example, the air conditioner may also use Figure 58B the ceiling-embedded indoor unit 4012' depicted in Figure 58B FIG. is a schematic bottom view of the indoor unit 4012' of the air conditioner 4010 according to this embodiment. In addition, hereinafter, in order to describe directions or orientations, expressions such as "front", "rear", "left", and "right" may be used, but unless otherwise specifically stated, the orientations indicated by these expressions conform to Figure 58B the orientation of the arrow in

[0644] The indoor unit 4012' has a main body 4100' (see Figure 58B ). The main body 4100' is a housing that internally houses an indoor heat exchanger, a fan, and a fan motor (not shown). An air outlet 4120' and an air inlet 4130' are formed on the main body 4100' (see Figure 58B ).

[0645] In the main body 4100', the suction port 4130' is formed in a square shape (refer to Figure 58B ). The suction port 4130' is formed in the central portion of the main body 4100' when viewed from below (refer to Figure 58B ).

[0646] In addition, in the main body 4100', the air outlets 4120' are formed at four locations on the lower surface of the main body 4100'. When viewed from below, the air outlets 4120' are respectively formed near the front edge, near the rear edge, near the left edge, and near the right edge along the four sides of the square main body 4100'. When viewed from below, the air outlets 4120' are formed to surround the suction port 4130' disposed in the central portion of the main body 4100'.

[0647] In addition, although illustration and description are omitted, the indoor unit of the air conditioner may also be an indoor unit of a type other than the one described here, such as a ceiling-suspended type or a floor-standing type.

[0648] In addition, the indoor unit of the air conditioner may also be an in-built type unit in which its main body does not protrude into the air-conditioning target space or hardly protrudes into the air-conditioning target space. The main body of the in-built type unit is disposed inside a wall or in a ceiling. For example, in the in-built type unit, the air blown out from the air outlet of the main body is sent through a duct to an opening provided on the surface of a wall or a ceiling and blown out into the air-conditioning target space.

[0649] In the air conditioner 4010, the indoor unit 4012 and the outdoor unit 4014 are connected via a refrigerant communication pipe, so that the indoor heat exchanger (illustration omitted) of the indoor unit 4012, the compressor, the outdoor heat exchanger, the expansion valve, etc. (illustration omitted) of the outdoor unit 4014 are connected by pipes to form a refrigerant circuit. In the air conditioner 4010, by circulating the refrigerant in the refrigerant circuit, the space where the indoor unit 4012 is provided is cooled / heated.

[0650] Regarding the operation principle and operation content of the air conditioner 4010 using a vapor compression refrigeration cycle, they are generally well known, so the description is omitted here. In addition, the air conditioner 4010 may also be a refrigeration-only or heating-only air conditioner, and does not have to be an air conditioner capable of performing both cooling and heating of the air-conditioning target space.

[0651] In addition, in the present embodiment, the air conditioner 4010 exchanges heat between the refrigerant flowing through the indoor heat exchanger of the indoor unit 4012 and the air in the air-conditioning target space. However, the air conditioner of the present invention is not limited to such a device. For example, the air conditioner 4010 may also be a device that exchanges heat between the chilled water / hot water flowing through the indoor heat exchanger of the indoor unit 4012 (fan coil unit) and the air in the air-conditioning target space.

[0652] (4-2-2-1) Controller

[0653] The controller 4150 is a control device that controls the operation of the air conditioner 4010.

[0654] The controller 4150 includes a control board (not shown) provided in the indoor unit 4012 and a control board (not shown) provided in the outdoor unit 4014. The CPUs of the control boards of the indoor unit 4012 and the outdoor unit 4014 that constitute the controller 4150 execute various processes by executing various programs stored in storage devices such as the control boards. In addition, the controller 4150 also includes devices such as a wireless LAN adapter that functions as a communication unit 4170 described later.

[0655] The controller 4150 mainly has a communication unit 4170 and an air conditioner control unit 4190 as functional units.

[0656] (4-2-2-1-1) Communication Unit

[0657] The communication unit 4170 is used for the air conditioner 4010 to communicate with the operation unit 4200, the analysis server 4020, or the air conditioner server 4030 (refer to Figure 57 ). In addition to controlling the air conditioner 4010, the communication unit 4170 also functions as a part of the device management device 4300.

[0658] The air conditioner 4010 (communication unit 4170) is connected to the operation unit 4200, the analysis server 4020, and the air conditioner server 4030 via the network 4080 (refer to Figure 56 ). The air conditioner 4010 is connected to the router 4082 through a wireless LAN and is connected to the network 4080 via the router 4082 (refer to Figure 56 ). In addition, the air conditioner 4010 and the router 4082 may be connected through a wired LAN instead of a wireless LAN.

[0659] The communication unit 4170 is, for example, a wireless LAN adapter that performs wireless communication between it and the router 4082. The communication unit 4170 has a transmission unit 4170a that transmits information and a reception unit 4170b that receives information as functional units (refer toFigure 57 )。

[0660] The transmitting unit 4170a outputs (transmits), for example, information related to the determination result of the determination unit 4318 of the device management device 4300 described later to the communication unit 4250 of the operation unit 4200 (see Figure 57 ). That is, the transmitting unit 4170a is an example of the output unit of the device management device. The information related to the determination result of the determination unit 4318 is information related to the result of the determination unit 4318 determining whether the instruction content for using a certain device assigned to the first device group 4050 by the operation unit 4200 deviates from the operation content of the device. For example, the information related to the determination result includes a device identifier indicating which device among the multiple devices 4050a, 4050b,..., 4050n of the first device group 4050 the information is related to, and information indicating whether the instruction content assigned to the device deviates from the actual operation content.

[0661] In addition, the transmitting unit 4170a preferably transmits information J about the state quantity related to at least one of the air conditioner 4010 and the air conditioning target space to the air conditioner server 4030 (see Figure 57 ). Although not limited, the state quantities related to the air conditioner 4010 include, for example, the temperature / pressure of the refrigerant measured by sensors (not shown) at various parts in the refrigerant circuit, the rotational speed of the inverter control motor (not shown) of the compressor of the outdoor unit 4014, the opening degree of the expansion valve of the outdoor unit 4014, etc. The state quantities related to the air conditioning target space are not limited, but include the measured temperature of the air conditioning target space, etc.

[0662] The receiving unit 4170b receives, for example, an instruction C corresponding to the signal S (especially the signal S based on the instruction sound related to the control of the air conditioner 4010) transmitted by the communication unit 4250 of the operation unit 4200 from the outside. More specifically, the receiving unit 4170b receives the instruction C generated based on the analysis result of the analysis server 4020 on the signal S (especially the signal S based on the instruction sound related to the control of the air conditioner 4010). Preferably, the receiving unit 4170b receives the instruction C generated by the air conditioner server 4030 based on the analysis result of the analysis server 4020 on the signal S (especially the signal S based on the instruction sound related to the control of the air conditioner 4010) and the information J about the state quantity transmitted from the transmitting unit 4170a to the air conditioner server 4030.

[0663] Although not limited, the instruction C is related to, for example, at least one of the on / off operation of the air conditioner 4010, the switching of the operation mode (cooling / heating / dehumidifying / air supply, etc.) of the air conditioner 4010, the change of the set temperature (target temperature of the air-conditioning target space), the target value of the rotational speed of the inverter control motor (not shown) of the compressor of the outdoor unit 4014, the target value of the opening degree of the expansion valve of the outdoor unit 4014, and the target value of the rotational speed of the inverter-controlled fan motor of the indoor unit 4012.

[0664] In addition, for example, the receiving unit 4170b receives from the outside the second information A402 related to the instruction content for the devices of the first device group 4050 corresponding to the signal S (especially the signal S based on the instruction sound related to the control of the devices of the first device group 4050) transmitted by the communication unit 4250 of the operation unit 4200. The receiving unit 4170b is an example of the instruction information receiving unit of the device management device. Specifically, the receiving unit 4170b receives the second information A402 related to the instruction content for the devices of the first device group 4050 corresponding to the signal S (especially the signal S based on the instruction sound related to the control of the devices of the first device group 4050) transmitted by the analysis server 4020. The second information A402 includes a device identifier indicating which device among the devices 4050a, 4050b,..., 4050n of the first device group 4050 the instruction is related to and information indicating the instruction content for the device. For example, specifically, the second information A402 includes a device identifier indicating the device 4050a and information indicating the content of an instruction such as "operation".

[0665] When the receiving unit 4170b receives the second information A402, the second information A402 is stored in the storage unit 4314 of the device management unit 4310 described later. In addition, when the receiving unit 4170b receives the second information A402, the first information sending unit 4312 of the device management unit 4310 described later generates the first information A401 based on the second information A402 received by the receiving unit 4170b and sends the generated first information A401 to the infrared output device 4040.

[0666] In addition, the second information A402 may not include the device identifier and the information indicating the instruction content for the device as described above. For example, the second information A402 may be text information, which is the analysis result of the signal S as a sound signal. Moreover, the interpretation of the text information (interpretation of the instruction content, etc.) may also be performed by the device management device 4300.

[0667] (4-2-2-1-2) Air conditioner control unit

[0668] The air conditioner control unit 4190 controls the operation of the air conditioner 4010 according to the instruction C received by the receiving unit 4170b, instructions from a general remote controller (not shown), etc. For example, the air conditioner control unit 4190 controls the operation of the compressor of the outdoor unit 4014, the expansion valve, the fan of the indoor unit 4012, etc. according to the instruction C received by the receiving unit 4170b and based on the settings of the air conditioner 4010 (such as the set temperature) and the measured values of various sensors (not shown). In addition, the air conditioner control unit 4190 can also use the information obtained by the camera 4420 (refer to Figure 58A and Figure 58B ) provided in the air conditioner 4010 (such as information on where there are people in the air-conditioned target space) to control the operation of each part of the air conditioner 4010.

[0669] (4-2-2-2) Device management device

[0670] The device management device 4300 manages the devices 4050a, 4050b,..., 4050n of the first device group 4050 which is the management target (the devices targeted by the operating system 4001).

[0671] The device management device 4300 includes a device management unit 4310 and a communication unit 4170. The device management unit 4310 of the device management device 4300 has a control board (not shown) disposed in the indoor unit 4012 and / or the outdoor unit 4014 as its structure. Various programs and various data are stored in the storage device of the control board. The CPU of the control board executes various processes by executing various programs.

[0672] The device management unit 4310 includes a first information sending unit 4312, a storage unit 4314, a determination unit 4316, and a determination unit 318 as functional units (refer to Figure 57 ).

[0673] Hereinafter, the device management unit 4310 will be described. In addition, the communication unit 4170 constituting the device management device 4300 has already been described as a part of the controller 4150, and thus, the description thereof will be omitted here.

[0674] (4-2-2-2-1) First information sending unit

[0675] The first information sending unit 4312 sends the first information A401 to the infrared output device 4040. The first information A401 is information related to the instructions for the devices 4050a, 4050b,..., 4050n of the first device group 4050.

[0676] When the receiving unit 4170b of the communication unit 4170 receives the second information A402, the first information transmitting unit 4312 generates the first information A401 based on the second information A402 and transmits the generated first information A401 to the infrared output device 4040. In addition, the second information A402 is information based on the analysis result of the signal S by the analysis server 4020. That is, the first information A401 generated based on the second information A402 is information based on the analysis result of the signal S by the analysis server 4020.

[0677] For example, assume that the receiving unit 4170b of the communication unit 4170 has received the second information A402 including information indicating the device identifier of the device 4050a that is the target device to be operated and the content of an instruction such as "operation". At this time, the first information transmitting unit 4312 transmits a signal as the first information A401 to the infrared output device 4040, commanding it to send an instruction indicating the start of operation to the device 4050a using an infrared signal.

[0678] In addition, the first information transmitting unit 4312 may also transmit the first information A401 except when the receiving unit 4170b receives the second information A402. For example, when the determination unit 4318 determines that the instruction content given to a certain device in the first device group 4050 deviates from the operation content of the device, the first information transmitting unit 4312 may also transmit (re - transmit) the first information A401 to the infrared output device 4040. The re - transmission of the first information A401 performed by the first information transmitting unit 4312 will be described later.

[0679] In addition, the device management device 4300 is connected to the infrared output device 4040 via a communication line, and the first information transmitting unit 4312 transmits the first information A401 to the infrared output device 4040 via the communication line. However, the device management device 4300 may be connected to the infrared output device 4040 wirelessly, and the first information transmitting unit 4312 may also transmit the first information A401 to the infrared output device 4040 wirelessly.

[0680] (4-2-2-2-2) Storage unit

[0681] Various programs and various data are stored in the storage unit 4314.

[0682] The data stored in the storage unit 4314 includes various information related to the devices 4050a, 4050b, …, 4050n of the first device group 4050 that is the management target of the device management device 4300.

[0683] For example, a list of devices in the first device group 4050, which is the management target of the device management device 4300, is stored in the storage unit 4314. The management target devices of the device management device 4300 are, for example, devices (configured at positions where infrared signals transmitted by the infrared output device 4040 can be received) that can transmit infrared signals and are configured in the indoor unit 4012 or near the indoor unit 4012.

[0684] In addition, for example, when the receiving unit 4170b receives the second information A402, the second information A402 received by the receiving unit 4170b is stored in the storage unit 4314. For example, it is assumed that the receiving unit 4170b of the communication unit 4170 has received the second information A402 including information representing the device identifier of the device 4050a that is the operation target device and an instruction such as "operation". In this case, the information representing the content of the instruction ("operation") is stored in the storage unit 4314 as information related to the device 4050a.

[0685] In addition, it is preferable to store the operation content judged by the judgment unit 4316, which will be described later, in the storage unit 4314 for the devices 4050a, 4050b,..., 4050n of the first device group 4050.

[0686] That is, preferably, as Figure 60 shown, for all the devices 4050a, 4050b,..., 4050n of the first device group 4050 that are the management targets of the device management device 4300, the device identifier for identifying the device, the content of the instruction for the device, and the operation content of the device are stored in the storage unit 4314 in association with each other. By maintaining such information, the device management device 4300 can grasp whether the operation content of the devices 4050a, 4050b,..., 4050n of the first device group 4050 deviates from the indicated content.

[0687] (4-2-2-2-3) Judgment Unit

[0688] The judgment unit 4316 judges the operation content of the devices in the first device group 4050 based on the operation state detected by the operation state detection unit that detects the operation state of the devices in the first device group 4050.

[0689] The operation state detection unit includes, for example, at least one of the microphone element 4210a of the sound receiving unit 4210 of the operation unit 4200, the camera 4420 of the air conditioner 4010, the sensor 4410 that measures the current or current of the devices in the first device group 4050, and the environmental sensor 4430 (refer to Figure 57 ). In addition, in Figure 57Among them, only the sensor 4410 for measuring the current or power of the device 4050a of the first device group 4050 is depicted, but the sensor 4410 can also be provided on the devices 4050a, 4050b, …, 4050n of the first device group 4050 respectively. The environmental sensor 4430 is, for example, an illuminance sensor, a temperature sensor, a barometric pressure sensor, etc. The environmental sensors 4430 configured in the building B may not be of one type, or multiple types of environmental sensors may be configured in the building B. In addition, in Figure 57 the depiction of the communication line is omitted, but the device management device 4300 is configured to be communicably connected to the microphone element 4210a, the sensor 4410, the camera 4420, and the environmental sensor 4430, which are operation state detection units, wirelessly or wiredly, and can obtain information from the devices 4210a, 4410, 4420, 4430.

[0690] In addition, among the illustrated microphone element 4210a, camera 4420, sensor 4410, and environmental sensor 4430, which device is used as the operation state detection unit in the operating system 4001 can be appropriately selected according to the types of the devices 4050a, 4050b, …, 4050n of the first device group 4050 for which the operation state is to be detected and the characteristics of each device. The operating system 4001 can have all the illustrated devices 4210a, 4410, 4420, 4430 as the operation state detection unit, or can have only a part of them as the operation state detection unit. In addition, the operating system 4001 can also use different devices 4210a, 4410, 4420, 4430 as the operation state detection unit according to the devices of the first device group 4050. For example, for the device 4050a, the sensor 4410 can be used as the operation state detection unit, and for the other device 4050b, the microphone element 4210a can be used as the operation state detection unit.

[0691] When the microphone element 4210a is used as the operation state detection unit, the operation state detection unit detects, for example, the operation sound of the devices of the first device group 4050 and the notification sound when the devices of the first device group 4050 perform a certain action (such as the beeping sound emitted from the speakers of the devices of the first device group 4050 during various actions) as the operation state of the devices of the first device group 4050.

[0692] When the camera 4420 is used as the operation state detection unit, the operation state detection unit detects, for example, the movement of the devices of the first device group 4050 and the lighting / extinguishing of the lights indicating the operation content provided on the devices of the first device group 4050 as the operation state of the devices of the first device group 4050.

[0693] When the sensor 4410 is used as the operation state detection unit, the operation state detection unit detects the magnitude of the current / power supplied to the devices of the first device group 4050 as the operation state of the devices of the first device group 4050.

[0694] When the environment sensor 4430 is used as the operation state detection unit, the operation state detection unit detects the environmental values (e.g., illuminance, temperature, air pressure, etc.) that change according to the operation content of the devices of the first device group 4050 as the operation state of the devices of the first device group 4050. In addition, the type of the environment sensor 4430 used as the operation state detection unit in the operating system 4001 may be appropriately determined according to the type of the device for which the operation state is to be detected, etc.

[0695] Preferably included in the operation content of the devices of the first device group 4050 determined by the determination unit 4316 are, for example, the operation / stop of the devices of the first device group 4050.

[0696] In addition, preferably included in the operation content of the devices of the first device group 4050 determined by the determination unit 4316 are, for example, the intensity setting of the actions of the devices of the first device group 4050.

[0697] For example, when the device of the first device group 4050 is an electric fan, the intensity setting of the action refers to the air volume setting of the electric fan. Although not limited, the determination unit 4316 can determine the air volume setting of the electric fan by, for example, detecting the wind noise with the microphone element 4210a or detecting the current / power value with the sensor 4410 and comparing the detection results with the magnitudes of the sounds and the current / power values at the respective intensity settings stored in advance.

[0698] In addition, for example, when the device of the first device group 4050 is a lighting device whose brightness can be changed, the intensity setting of the action refers to the brightness setting. Although not limited, the determination unit 4316 can determine the brightness setting of the lighting device by, for example, detecting the illuminance with an illuminance sensor as an example of the environment sensor 4430 and comparing the detection results with the illuminances at the respective brightness settings stored in advance.

[0699] In addition, for example, when the device of the first device group 4050 is an audio device, the intensity of the action refers to the volume setting. Although not limited, the determination unit 4316 can determine the volume setting of the audio device by, for example, detecting the sound with the microphone element 4210a and comparing the detection results with the magnitudes of the sounds at the respective volume settings stored in advance.

[0700] (4-2-2-2-4) Determination Unit

[0701] The determination unit 4318 determines whether there is a deviation between the operation content of the devices in the first device group 4050 and the second information related to the instruction content for the devices, based on the operation content of the devices in the first device group 4050 and the second information related to the instruction content for the devices.

[0702] Here, the case where the determination unit 4318 makes a determination related to the device 4050a in the first device group 4050 (the case where the reception unit 4170b has received the second information A402 including the device identifier indicating the device 4050a and the information indicating the instruction content for the device 4050a) will be described in detail as an example. For example, here, it is assumed that the reception unit 4170b has received the second information A402 including the device identifier of the device 4050a and the information indicating the content of an instruction such as "operation".

[0703] After the reception unit 4170b receives the above second information A402, and the first information transmission unit 4312 transmits a signal as the first information A401 to the infrared output device 4040, commanding it to transmit an instruction indicating operation to the device 4050a using an infrared signal, the determination unit 4318 obtains the determination result of the determination unit 4316. Then, the determination unit 4318 determines whether there is a deviation (whether they are consistent) between the operation content of the device 4050a (here, whether the device 4050a is in operation) and the instruction content for the device 4050a stored in the storage unit 4314 (here, "operation").

[0704] In addition, when the determination unit 4318 determines that there is a deviation between the operation content of the device 4050a and the instruction content for the device 4050a, as described later, the first information transmission unit 4312 re-transmits the first information A401 to the infrared output device 4040 (refer to Figure 59 step G7).

[0705] In addition, as described later, the determination result of the determination unit 4318 (whether there is a deviation between the operation of the device 4050a and the instruction content for the device 4050a) is output by the transmission unit 4170a to the communication unit 4250 of the operation unit 4200 (refer to Figure 59 step G6, step G10). Then, the notification unit 4220 of the operation unit 4200 notifies the operator or the like of the determination result of the determination unit 4318 received by the communication unit 4250.

[0706] (4 - 2 - 2 - 2 - 5) Actions of the device management device when operating the devices in the first device group

[0707] The operation of the device management apparatus 4300 when operating devices 4050a, 4050b, …, 4050n of the first device group 4050 will be described below. In addition, here, the operation of the device management apparatus 4300 when operating device 4050a will be described as an example, but the same applies when operating other devices 4050b, …, 4050n.

[0708] Here, the case where the receiving unit 4170b receives the second information A402 including information representing the device identifier of device 4050a as the operation target device and an instruction such as “operation” will be described below.

[0709] First, in step G1, the second information A402 received by the receiving unit 4170b is stored in the storage unit 4314. Specifically, information representing the content of the instruction (here, “operation”) is stored in the storage unit 4314 as information related to device 4050a (as information related to the device identifier representing device 4050a).

[0710] Next, in step G2, the first information transmitting unit 4312 refers to the second information A402 stored in the storage unit 4314, and generates a signal for instructing the infrared output device 4040 to transmit an instruction indicating operation to device 4050a using an infrared signal as the first information A401. Then, the first information transmitting unit 4312 transmits the first information A401 to the infrared output device 4040.

[0711] Next, after a predetermined time has elapsed since the execution of step G2, the determination unit 4316 determines the operation content of device 4050a based on the operation state detected by the operation state detection unit of device 4050a (step G3).

[0712] Next, in step G4, the determination unit 4318 determines whether there is a deviation between the operation content of device 4050a determined by the determination unit 4316 in step G3 and the instruction content for device 4050a stored in the storage unit 4314. In step G4, if it is determined that there is no deviation (that is, if it is determined to be consistent), the process proceeds to step G5, and if it is determined that there is a deviation, the process proceeds to step G7.

[0713] In step G5, the operation content of device 4050a (the determination content of the determination unit 4316 in step G3) is stored in the storage unit 4314. Specifically, as Figure 60 shown, the device identification symbol of the device, the instruction content for the device, and the operation content of the device determined by the determination unit 4316 are stored in the storage unit 4314 in association with each other.

[0714] Next, in step G6, the sending unit 4170a outputs (sends) the determination result of the determination unit 4318 (whether there is a deviation between the operation content of the device 4050a and the instruction content for the device 4050a) to the communication unit 4250 of the operation unit 4200. In particular, in step G6, the sending unit 4170a sends the case of no deviation (the case where the operation content of the device 4050a is consistent with the instruction content for the device 4050a) to the communication unit 4250 of the operation unit 4200.

[0715] In step G7, the first information sending unit 4312 re - sends the first information A401 sent in step G2 to the infrared output device 4040.

[0716] Next, after a predetermined time has elapsed since the execution of step G7, the determination unit 4316 determines the operation content of the device 4050a (step G8) based on the operation state detected by the operation state detection unit of the detection device 4050a.

[0717] Next, in step G9, the determination unit 4318 determines whether there is a deviation (whether they are consistent) between the operation content of the device 4050a determined by the determination unit 4316 in step G8 and the instruction content for the device 4050a stored in the storage unit 4314. In the case where it is determined that there is no deviation (that is, in the case where it is determined to be consistent), it proceeds to step G5. On the other hand, in the case where it is determined that there is a deviation, it proceeds to step G10.

[0718] In step G10, the operation content of the device 4050a (the determination content of the determination unit 4316 in step G8) is stored in the storage unit 4314. Specifically, as Figure 60 shown, the device identification symbol of the device, the instruction content for the device, and the operation content of the device determined by the determination unit 4316 are stored in the storage unit 4314 in association with each other.

[0719] Next, in step G11, the sending unit 4170a outputs (sends) the determination result of the determination unit 4318 (whether there is a deviation between the operation content of the device 4050a and the instruction content for the device 4050a) to the communication unit 4250 of the operation unit 4200. In particular, in step G11, the sending unit 4170a sends the case of deviation (the case where the operation content of the device 4050a deviates from the instruction content for the device 4050a) to the communication unit 4250 of the operation unit 4200.

[0720] In addition, the processing flow described here is an example of the processing flow of the device management device 4300 and can be changed appropriately.

[0721] For example, the order of the processing steps can be switched appropriately within the range without contradiction.

[0722] In addition, for example, the device management apparatus 4300 may also not perform retransmission of the first information A401. Further, when it is determined in step G4 that the operation content of the device 4050a deviates from the instruction content for the device 4050a, the process may immediately proceed to step G10.

[0723] In addition, for example, here, the device management apparatus 4300 performs retransmission of the first information A401 only once. However, retransmission of the first information A401 may also be performed multiple times (for example, a specified number of times, or until the operation content of the device 4050a does not deviate from the instruction content for the device 4050a).

[0724] (4-2-3) First device group

[0725] Devices 4050a, 4050b,... 4050n of the first device group 4050 are devices that can be operated by an infrared signal. Devices 4050a, 4050b,... 4050n of the first device group 4050 are an example of operation target devices. Devices 4050a, 4050b,... 4050n of the first device group 4050 are not limited, but for example, include electric fans, lighting devices, audio devices, etc. In addition, devices 4050a, 4050b,... 4050n of the first device group 4050 may also include, for example, air conditioners other than the air conditioner 4010 that can be operated by an infrared signal. Devices 4050a, 4050b,... 4050n of the first device group 4050 may not be connected to the network 4080.

[0726] Devices 4050a, 4050b,... 4050n of the first device group 4050 are devices that can be operated by an infrared signal transmitted from the infrared output device 4040 according to an input of an instruction sound to the operation unit 4200. The content that can be operated by the infrared signal includes, for example, on / off of devices 4050a, 4050b,... 4050n, change of the air volume setting if it is an electric fan, change of the brightness setting if it is a lighting device, change of the volume setting if it is an audio device, etc.

[0727] In addition, devices 4050a, 4050b,... 4050n of the first device group 4050 are configured to be able to be operated not only by voice operation (except for operation based on an infrared signal transmitted from the infrared output device 4040 according to an input of an instruction sound) but also by general infrared remote control and switches provided on the main bodies of devices 4050a, 4050b,... 4050n.

[0728] (4-2-4) Second device group

[0729] The devices 4060a, 4060b, …, 4060m of the second device group 4060 are devices that can be operated by signals transmitted via the network 4080. The devices 4060a, 4060b, …, 4060m of the second device group 4060 are not limited, but include, for example, televisions, DVD recorders, etc. The devices 4060a, 4060b, …, 4060m of the second device group 4060 have a wireless LAN adapter (not shown) and are connected to the network 4080 via a router 4082 (see Figure 56 ). The devices 4060a, 4060b, …, 4060m of the second device group 4060 are communicably connected to at least one of the analysis server 4020 and the device server 4070 via the network 4080 (see Figure 56 ). In addition, the devices 4060a, 4060b, …, 4060m of the second device group 4060 and the router 4082 can also be connected by a wired LAN instead of a wireless LAN.

[0730] The devices 4060a, 4060b, …, 4060m of the second device group 4060 are operated by signals sent from the analysis server 4020 or the device server 4070 according to the input of the instruction sound to the operation unit 4200. Among the operations that can be performed by signals sent from the analysis server 4020 or the device server 4070, for example, include turning on / off of the devices 4060a, 4060b, …, 4060m, changing the channel or volume if it is a television, setting a recording reservation if it is a DVD recorder, etc.

[0731] In addition, the devices 4060a, 4060b, …, 4060m of the second device group 4060 are configured to be able to be operated not only by voice operation (except for the operation based on the signal sent via the network 4080 according to the input of the instruction sound), but also by a commonly used remote control and switches provided on the main bodies of the devices 4060a, 4060b, …, 4060m.

[0732] (4-2-5) Analysis Server

[0733] The analysis server 4020 is communicably connected to the operation unit 4200, the air conditioner 4010, the air conditioner server 4030, and the device server 4070 via the network 4080.

[0734] When the operation unit 4200 receives an instruction sound, the communication unit 4250 sends a signal S corresponding to the instruction sound to the analysis server 4020 via the network 4080 (see Figure 57)。In addition, the instruction sounds received by the operation unit 4200 include instruction sounds related to the operation of the air conditioner 4010, instruction sounds related to the operation of the devices 4050a, 4050b, … 4050n of the first device group 4050, and instruction sounds related to the operation of the devices 4060a, 4060b, … 4060m of the second device group 4060. In other words, the analysis server 4020 receives, via the network 4080, a signal S related to an instruction sound that is an instruction for the air conditioner 4010, the devices 4050a, 4050b, … 4050n, or the devices 4060a, 4060b, … 4060m.

[0735] The analysis server 4020 is an example of an analysis device. The analysis server 4020 is a computer that analyzes the received signal S by executing a program stored in a storage device. For example, specifically, the analysis server 4020 performs voice recognition of the voice signal that is the received signal S. In addition, the analysis server 4020 can also interpret the meaning of the text information that is the received signal S.

[0736] In addition, in the storage device of the analysis server 4020, in addition to the program, a list of devices (the air conditioner 4010, the devices 4050a, 4050b, … 4050n of the first device group 4050, and the devices 4060a, 4060b, … 4060m of the second device group 4060) that can be operated by each operation unit 4200 can be stored. That is, the analysis server 4020 knows which device can be operated from each operation unit 4200. In addition, regarding the devices 4060a, 4060b, … 4060m of the second device group 4060, information related to whether the control target devices 4060a, 4060b, … 4060m are direct control targets of the analysis server 4020 (whether they are control targets of either the analysis server 4020 or the device server 4070) is preferably also stored.

[0737] The analysis server 4020, for example, obtains a feature quantity by analyzing the voice that is the signal S, and uses a voice recognition dictionary including a voice model, a language model, and a pronunciation dictionary stored in the storage device to generate text information from the feature quantity. The text information generated by the analysis server 4020 is not limited. For example, it is text information such as "turn on the air conditioner", "set the set temperature of the air conditioner to 25 degrees", "turn off the lighting device", "turn on the TV", etc.

[0738] When the generated text information is related to the control of the air conditioner 4010 (for example, when the text information includes a keyword related to the air conditioner), the analysis server 4020 sends the analysis result of the signal S (that is, the generated text information) to the air conditioner server 4030 via the network 4080 (refer toFigure 57 )。

[0739] When the text information is related to the control of devices 4050a, 4050b, …, 4050n of the first device group 4050 (for example, when the text information includes keywords related to the first device group 4050), the analysis server 4020 generates second information A402 related to the instruction content for devices 4050a, 4050b, …, 4050n of the first device group 4050 and sends it to the device management device 4300 (communication unit 4170) of the air conditioner 4010. Regarding the second information A402, as described above.

[0740] When the text information is related to the control of devices 4060a, 4060b, …, 4060m of the second device group 4060 (for example, when the text information includes keywords related to the second device group 4060), the analysis server 4020 sends an instruction corresponding to the analysis result of the signal S (i.e., the generated text information) to devices 4060a, 4060b, …, 4060m of the second device group 4060. For example, when the text information is information related to a TV included in devices 4060a, 4060b, …, 4060m of the second device group 4060 (for example, "turn on the TV"), the analysis server 4020 sends an instruction to the TV to indicate turning on the switch. The instruction for devices 4060a, 4060b, …, 4060m of the second device group 4060 is sent from the analysis server 4020 to devices 4060a, 4060b, …, 4060m of the second device group 4060 via the network 4080.

[0741] In addition, when the text information is related to the control of devices 4060a, 4060b, …, 4060m of the second device group 4060, that is, when the target devices 4060a, 4060b, …, 4060m are not the direct control targets of the analysis server 4020, the text information is sent to the device server 4070 that controls these devices 4060a, 4060b, …, 4060m. Then, the instruction is sent from the device server 4070 to devices 4060a, 4060b, …, 4060m via the network 4080.

[0742] (4-2-6) Air conditioner server

[0743] The air conditioner server 4030 is an example of an instruction generation device.

[0744] The air conditioner server 4030 generates an instruction C based on the analysis result of the signal S sent from the analysis server 4020 (i.e., the text information generated by the analysis server 4020) and the information J on the state quantity related to at least one of the air conditioner 4010 and the air conditioning target space appropriately sent from the sending unit 4170a of the air conditioner 4010. Then, the air conditioner server 4030 sends the instruction C to the receiving unit 4170b of the air conditioner 4010 via the network 4080. Although not limited, for example, when receiving an instruction of "turn on the air conditioner" as the text information, the air conditioner server 4030 determines the operations of the respective parts of the air conditioner 4010 based on the temperature of the current air conditioning target space, etc., and sends it as the instruction C.

[0745] In addition, here, in addition to the analysis result of the signal S by the analysis server 4020, the air conditioner server 4030 generates the instruction C based on the information J, but is not limited thereto. The air conditioner server 4030 may also generate the instruction C only based on the analysis result of the signal S by the analysis server 4020.

[0746] In addition, the air conditioner server 4030 stores the signal S sent from the operation unit 4200 and uses the signal S for various analyses.

[0747] Furthermore, in the present embodiment, the device system 4000 includes the air conditioner server 4030, but is not limited thereto. For example, when the air conditioner 4010 can directly determine the operation content based on the analysis result of the signal S by the analysis server 4020 (i.e., the text information generated by the analysis server 4020), the air conditioner server 4030 may not be provided. Moreover, the analysis result of the signal S by the analysis server 4020 may also be directly sent as the instruction C to the receiving unit 4170b of the air conditioner 4010.

[0748] (4-2-7) Device Server

[0749] The device server 4070 generates instructions for the devices 4060a, 4060b,... 4060m of the second device group 4060 based on the analysis result of the signal S sent from the analysis server 4020 (i.e., the text information generated by the analysis server 4020). Then, the device server 4070 sends the instructions to the devices 4060a, 4060b,... 4060m of the operation target second device group 4060 via the network 4080.

[0750] In addition, in Figure 56Among them, there is one device server 4070. However, when there are multiple types of devices 4060a, 4060b, … 4060m that are operated by the device server 4070 (not according to instructions from the analysis server 4020), it is preferable to have the device server 4070 in the number corresponding to the number of types.

[0751] In addition, when all of the devices 4060a, 4060b, … 4060m are operated by instructions from the analysis server 4020, the device server 4070 may not be provided.

[0752] (4-2-8) Infrared output device

[0753] The infrared output device 4040 is a device that transmits instructions to the devices 4050a, 4050b, … 4050n of the first device group 4050 using infrared signals.

[0754] In one embodiment, the infrared output device 4040 is mounted on the indoor unit 4012 or the indoor unit 4012′ of the air conditioner 4010. For example, the infrared output device 4040 is provided on the indoor units 4012, 4012′ in such a manner that the infrared light emitting part (e.g., infrared LED, not shown) of the infrared signal transmitting part 4044 to be described later is disposed outside the main body 4100 of the indoor unit 4012 or the main body 4100′ of the indoor unit 4012′ (refer to Figure 58A and Figure 58B the infrared output device 4040 depicted by the solid line). In addition, the infrared light emitting part of the infrared signal transmitting part 4044 is preferably disposed near an infrared signal receiving part (a receiving part for infrared signals for the air conditioner 4010 from a normal remote controller) of the indoor units 4012, 4012′ that is not shown. A part of the structure of the infrared output device 4040 may also be disposed inside the main body 4100 of the indoor unit 4012 or the main body 4100′ of the indoor unit 4012′.

[0755] In addition, in other embodiments, the infrared output device 4040 may not be mounted on the indoor unit 4012 or the indoor unit 4012′. That is, the infrared output device 4040 is a device independent of the air conditioner 4010. The infrared output device 4040 is provided on the main body 4100 of the indoor unit 4012 or the main body 4100′ of the indoor unit 4012′ (refer to Figure 58A and Figure 58B the infrared output device 4040 depicted by the solid line), or on the wall surface near the main body 4100 of the indoor unit 4012 (refer to Figure 58A the infrared output device 4040 depicted by the dashed line), or on the ceiling surface near the main body 4100′ of the indoor unit 4012′ (refer to Figure 58BThe infrared output device 4040 depicted by the dashed line.

[0756] In addition, in the present embodiment, one infrared output device 4040 is provided for the indoor units 4012 and 4012', but it is not limited thereto. In other embodiments, multiple infrared output devices 4040 may be provided for the indoor units 4012 and 4012'.

[0757] The infrared output device 4040 mainly includes a first information receiving unit 4042, an infrared signal transmitting unit 4044, and a storage unit 4046.

[0758] The first information receiving unit 4042 receives the first information A401 transmitted by the first information transmitting unit 4312 of the device management device 4300.

[0759] In the storage unit 4046, infrared signal patterns for control are stored according to the devices 4050a, 4050b,... 4050n of the first device group 4050 and the content of the instructions.

[0760] The infrared signal transmitting unit 4044 refers to the storage unit 4046 and transmits an infrared signal corresponding to the pattern of the first information A401 received by the first information receiving unit 4042 from an infrared light emitting unit (not shown) to the operation target device (if the first information A401 is information related to an instruction for the device 4050, it is the device 4050a).

[0761] (4 - 3) Features

[0762] (4 - 3 - 1)

[0763] The operating system 4001 of this embodiment includes an air conditioner 4010 and an infrared output device 4040. The air conditioner 4010 has an indoor unit 4012. The infrared output device 4040 is provided on the indoor unit 4012 or on the surface of a wall or ceiling near the indoor unit 4012. The infrared output device 4040 receives first information A401 related to an instruction for a device of the first device group 4050 (hereinafter sometimes referred to as an operation target device), and sends an infrared signal corresponding to the first information A401 to the operation target device. The operation target device is a device other than the air conditioner 4010 that can be operated by an infrared signal. The air conditioner 4010 has a device management device 4300 for managing the operation target device. The device management device 4300 includes a receiving unit 4170b and a determination unit 4318, where the receiving unit 4170b is an example of a specified information receiving unit. The receiving unit 4170b receives second information A402 related to the content of the instruction. The determination unit 4318 determines whether there is a deviation between the operation content of the operation target device and the content of the instruction for the operation target device based on the operation content of the operation target device and the second information A402.

[0764] Here, since the device management device 4300 provided in the air conditioner 4010 determines whether there is a deviation between the actual operation content of the operation target device and the content of the instruction for the operation target device (the device of the first device group 4050), it is difficult to ignore the state where the two deviate (operation failure state).

[0765] In addition, by having the device management device 4300 in the air conditioner 4010, there are particularly the following advantages.

[0766] Most of the residential or office spaces are air-conditioned by the air conditioner 4010. Therefore, by providing the device management device 4300 in the air conditioner 4010, it is possible to manage the operation target device without separately providing a dedicated device for device management, which is easy to control the device cost.

[0767] In addition, here, by providing the infrared output device 4040 on the indoor unit 4012 of the air conditioner 4010 or on the surface of a wall or ceiling near the indoor unit 4012, there are particularly the following advantages.

[0768] Since furniture and the like are placed in a residence or an office, etc., depending on the installation position of the infrared output device 4040, furniture and the like become obstacles, and the infrared signal may not reach the infrared light receiving part of the operation target device.

[0769] The indoor unit 4012 is, from the perspective of its original functionality, mostly installed on the ceiling or near the ceiling where it can overlook the space. Moreover, on the basis of achieving the purpose of air conditioning, the possibility that furniture such as shelves is arranged near the indoor unit 4012 and obstructs the air supply is relatively low. That is, the possibility that an obstacle that obstructs the infrared signal transmission is arranged near the indoor unit 4012 is relatively low.

[0770] Therefore, in this operating system where the infrared output device 4040 is arranged on the indoor unit 4012 of the air conditioner 4010 or on the surface of the wall or ceiling near the indoor unit 4012, the state where the operation content indicated by the infrared output device 4040 deviates from the actual device operation content is originally very difficult to occur.

[0771] (4-3-2)

[0772] In the operating system 4001 of this embodiment, the device management device 4300 includes a first information sending unit 4312. The first information sending unit 4312 sends the first information A401 to the infrared output device 4040.

[0773] In this operating system 4001, by sending the first information A401 from the device management device 4300 to the infrared output device 4040, an infrared signal corresponding to the first information A401 is sent to the operation target device. That is, the sending operation of the infrared output device 4040 is controlled by the device management device 4300 of the air conditioner 4010. Moreover, since the infrared output device 4040 is arranged on the indoor unit 4012 or near the indoor unit 4012, the operating system 4001 can be realized with almost no need for wiring work for arranging the infrared output device 4040.

[0774] (4-3-3)

[0775] In the operating system 4001 of this embodiment, when the determination unit 4318 determines that there is a deviation, the first information sending unit 4312 re - sends the first information A401 to the infrared output device 4040.

[0776] In this operating system 4001, when the actual operation content of the operation target device deviates from the indicated operation content, the first information A401 is re - sent. As a result, an infrared signal corresponding to the first information A401 is re - sent from the infrared output device 4040 to the operation target device. Therefore, the operation failure state is difficult to be ignored.

[0777] (4-3-4)

[0778] In the operating system 4001 of this embodiment, the infrared output device 4040 is mounted on the indoor unit 4012.

[0779] Here, since the infrared output device 4040 is mounted on the indoor unit 4012, there is no need to perform the operation of connecting the infrared output device 4040 and the indoor unit 4012 on site.

[0780] (4-3-5)

[0781] The operating system 4001 of this embodiment includes an operating state detection unit. The operating state detection unit detects the operating state of the operation target device. The device management device 4300 includes a determination unit 4316. The determination unit 4316 determines the operation content of the operation target device based on the operating state detected by the operating state detection unit.

[0782] Most devices operated by infrared do not have an output unit that outputs the operation content to the outside. However, here, since the operating system 4001 has an operating state detection unit that detects the operating state of the operation target device and determines the operation content of the operation target device based on the detected operating state, even an operation target device that does not have an output unit for outputting the operation content can be managed by the device management device 300.

[0783] (4-3-6)

[0784] In the operating system 4001 of this embodiment, the operating state detection unit includes at...

Claims

1. A control system (2001, 2001S) comprising: A voice input receiving device (2060, 2060S) that receives a control instruction for a control device including a first type of device controllable by infrared rays and a second type of device controllable via a network (NW) through voice input; An infrared ray output device (2070, 2070S), which is installed inside a lighting device, an air conditioner or a television set that is a fixed device (2020F) fixed to a ceiling within a specified space, and outputs infrared rays to the first type of device according to the control instruction when the sound input receiving device receives the control instruction; And An information processing device (2100) that can communicate with the voice input receiving device and the infrared output device via the network (NW), The second type of device can be directly controlled by the information processing device via the network, The information processing device comprises: A voice analysis unit (2110) that analyzes the voice input; A control content specifying unit (2120) that specifies control content representing the control device and the control instruction for the control device based on the analysis result of the voice analysis unit; A first control unit (2130) that, when the control content specifying unit specifies control content related to the first type of device, sends an infrared output command corresponding to the control content to the infrared output device; And A second control unit (2135) that, when the control content specifying unit specifies control content related to the second type of device, controls the second type of device via the network based on the control content.

2. The control system according to claim 1, wherein The fixed device is installed and fixed on the ceiling of the room or embedded and fixed in the ceiling of the room.

3. The control system according to claim 1 or 2, wherein The infrared output device is installed in the upper half area of the body of the fixed device.

4. The control system according to claim 1 or 2, wherein The voice input receiving device is arranged inside the fixed device.

5. The control system according to claim 1 or 2, wherein A posture control device (2070A) for controlling the posture of the infrared output device is installed at the infrared output device.

6. An infrared output device (2070, 2070S) installed inside a lighting, air conditioning device or television set of a fixed device (2020F) fixed to the ceiling in a specified space. When a voice input receiving device (2060, 2060S) that receives a control instruction for a control device including a first type of device controllable by infrared rays and a second type of device controllable via a network (NW) through voice input receives the control instruction, and a first control unit (2130) of an information processing device (2100) that can communicate with the voice input receiving device (2060, 2060S) and the infrared output device via the network (NW) outputs an infrared output command via the network, when the infrared output device receives the output command, it outputs infrared rays to the first type of device, The information processing device comprises: A voice analysis unit (2110) that analyzes the voice input; A control content specifying unit (2120) that specifies control content representing the control device and a control instruction for the control device according to the analysis result of the sound analysis unit; The first control unit (2130) that, when the control content specifying unit specifies control content related to the first type of device, sends an infrared output command corresponding to the control content to the infrared output device; and A second control unit (2135) that, when the control content specifying unit specifies control content related to the second type of device, controls the second type of device via a network based on the control content.

Images