Equipment control system, program, and equipment control method

The device control system addresses the challenge of remote operation by integrating biological detection and display processes to ensure safe and appropriate operation of home appliances based on the presence of living organisms.

JP7856555B2Active Publication Date: 2026-05-11MIDEA GROUP CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
MIDEA GROUP CO LTD
Filing Date
2022-12-08
Publication Date
2026-05-11

Smart Images

  • Figure 0007856555000001
    Figure 0007856555000001
  • Figure 0007856555000002
    Figure 0007856555000002
  • Figure 0007856555000003
    Figure 0007856555000003
Patent Text Reader

Abstract

To provide a device control system that makes it easy to grasp a current usage status of a device to be controlled and makes it easy to realize more appropriate and easier remote operation.SOLUTION: A device control system includes at least one control target device that can be a control target, and a program to be executed by a computer of a terminal device capable of remotely controlling the control target device. The control target device includes an information acquisition unit that acquires biodetection information indicating whether a living body is present around the control target device. The program causes the computer to execute an acquisition process and a display process. The acquisition process causes the computer to acquire device information and biodetection information related to the control target device. The display process causes the computer to display an operation screen of the control target device on a display unit of the terminal device, and determines a display mode of the device information on the basis of the biodetection information and displays the display mode on the display unit.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention relate to an equipment control system, a program, and an equipment control method.

Background Art

[0002] Conventionally, a technology for remotely operating home appliances using a portable device has been put into practical use. In addition, home appliances equipped with a human presence sensor for detecting whether or not there is a person around have been put into practical use. Further, a technology for remotely operating home appliances using a portable device as described above has also been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the case of the prior art, when there is a person around the home appliance, there is a configuration that prohibits a third party other than the person near the home appliance from accidentally controlling the home appliance in use from a remote location using a portable device, or only displays the presence of a person and the state of the home appliance on the portable device. As a result, it has been difficult to appropriately grasp the current usage status of the home appliance, and there has been a problem that it is difficult to perform an appropriate remote operation.

[0005] An example of the problem to be solved by the present invention is to provide an equipment control system, a program, and an equipment control method that can make it easier to grasp the current usage status of a control target device such as a home appliance and make it easier to realize a more appropriate and easy remote operation.

Means for Solving the Problems

[0006] A device control system according to one embodiment of the present invention includes at least one device to be controlled, and a program to be executed on a computer of a terminal device capable of remotely controlling the device to be controlled. The device to be controlled includes an information acquisition unit that acquires biological detection information indicating whether or not a living organism is present around the device to be controlled. The program is: Startup process and The computer is instructed to perform the acquisition process and the display process. The startup process starts the information acquisition unit if it is not already running. The acquisition process involves acquiring device information and biometric detection information related to the controlled device. The display process involves displaying the operation screen of the controlled device on the display unit of the terminal device, and determining the display mode of the device information based on the biometric detection information and displaying it on the display unit.

[0007] Also, the above Controlled devices For example, the aforementioned The system includes a first controlled device equipped with an information acquisition unit, and a second controlled device located within the same controlled area as the first controlled device but not equipped with the information acquisition unit, wherein the acquisition process enables the acquisition of first biological detection information for the first controlled device as second biological detection information for the second controlled device. That's good too.

[0008] Also, the above Acquisition process For example, the aforementioned When operation information is obtained indicating that an operation has been performed to operate a movable part in order to use the controlled device, it is assumed that a living organism is present around the controlled device, and the operation information is acquired as the living organism detection information. You may do so.

[0009] Furthermore, the display process is performed, for example, on the controlled device in which the presence of the living organism in the surroundings is detected. When remotely controlled, the operation must be performed in a situation where the living organism is present. The display mode may be determined to provide notification.

[0010] Furthermore, the display process is, for example, the The device information and the corresponding biodetection information are linked and displayed on the display unit. That's fine.

[0011] Also, the above Display processing For example, the aforementioned The display method of the biological detection information to be displayed on the display unit is determined according to whether or not a living organism is present around the controlled device. You may do so.

[0015] A program according to another embodiment of the present invention is: Startup process and The acquisition process and the display process are executed by the terminal device's computer. The startup process starts the information acquisition unit if it is not already running, which acquires biological detection information indicating whether or not living organisms are present around a control target device that may be the target of control. The acquisition process is as follows: The aforementioned Equipment information regarding the controlled equipment, and MemorandumObtain biometric detection information. The display process causes the operation screen of the controlled device to be displayed on the display unit of a terminal device capable of remotely operating the controlled device, and determines and causes the display mode of the device information to be displayed on the display unit based on the biometric detection information.

[0016] The device control method according to another embodiment of the present invention Startup process and includes an acquisition process and a switching process. The startup process starts the information acquisition unit if it is not already running, which acquires biological detection information indicating whether or not living organisms are present around a control target device that may be the target of control. The acquisition process The aforementioned obtains device information regarding the controlled device and the biometric detection information and The display process causes the operation screen of the controlled device to be displayed on the display unit of a terminal device capable of remotely operating the controlled device, and determines and causes the display mode of the device information to be displayed on the display unit based on the biometric detection information.

[0017] According to the above device control system, program, and device control method, it becomes easy to grasp the current usage status of the controlled device, and it becomes possible to more appropriately and easily realize remote operation. [[ID=​​​​​​​​​​​​​​​​​​FIG. 5 is an exemplary and schematic image diagram showing the content of a notification screen displayed on the display unit of the terminal device when the presence of a living body is confirmed around the device to be controlled in the device control system according to the embodiment. [Figure 6] FIG. 6 is an exemplary and schematic image diagram showing the content of a notification screen displayed on the display unit of the terminal device when the presence of a living body is not confirmed around the device to be controlled in the device control system according to the embodiment. [Figure 7] FIG. 7 is an exemplary flowchart showing the flow of display processing of an initial display screen displayed on the display unit of the terminal device in the device control system according to the embodiment. [Figure 8] FIG. 8 is an exemplary flowchart showing the detailed flow of sensor information acquisition processing in the flowchart of FIG. 7. [Figure 9] FIG. 9 is an exemplary flowchart showing the flow of control processing after the initial display screen is displayed on the display unit of the terminal device in the device control system according to the embodiment.

MODE FOR CARRYING OUT THE INVENTION

[0019] Hereinafter, embodiments of a device control system, a program, and a device control method according to the present disclosure will be described with reference to the drawings. In this specification, the components according to the embodiments and the descriptions of those components may be described in a plurality of expressions. The components and their descriptions are examples and are not limited by the expressions in this specification. The components may be specified by different names from those in this specification. Also, the components may be described by expressions different from those in this specification.

[0020] Figure 1 is an illustrative and schematic diagram illustrating the configuration of the equipment control system 100. The equipment control system 100 is composed of, for example, a plurality of controlled devices 10, a management device 12 capable of centrally managing information acquired from the plurality of controlled devices 10, and a terminal device 14 capable of centrally controlling the plurality of controlled devices 10 based on information acquired via the management device 12. The terminal device 14 is a device that enables control of the controlled devices 10 from a remote location, for example, a location different from the room in which the controlled devices 10 are installed, such as outdoors or while away from home. Except for some devices, the controlled devices 10 are equipped with a detection device 16 capable of outputting biological detection information indicating whether or not living organisms are present around the controlled devices 10. As will be described later, the detection device 16 includes a direct detection type that directly detects living organisms and an indirect estimation type that estimates the presence of living organisms (operators of the equipment) in the vicinity based on operation information (such as opening and closing the doors of the equipment) detected when the equipment on which the sensor is installed is being physically operated. Furthermore, the detection device 16 may be capable of outputting biological detection information regardless of whether the controlled device 10 on which the detection device 16 is installed is operating or not. In another embodiment, the detection device 16 may be activated for a short time at a predetermined timing, for example, when an application capable of remotely controlling the controlled device 10 is launched on the terminal device 14, to perform biological detection processing. In this case, the power consumption for driving the detection device 16 can be reduced. The detection device 16 is an example of an information acquisition unit that acquires biological detection information indicating whether or not a living organism is present around the controlled device 10.

[0021] In this embodiment, the multiple controlled devices 10 are classified into a first controlled device group 10A, which has a detection device 16 inside its housing that can directly detect whether or not living organisms are present around the controlled device 10, and a second controlled device group 10B, which differs from the first controlled device group 10A in terms of the type of device or the method of detecting living organisms.

[0022] The first group of controlled equipment 10A includes, for example, air conditioning units 10Aa, 10Ab, ... 10A(n-1), 10An, etc., which have basic functions such as heating and cooling, dehumidification, and air purification. In the explanation, unless otherwise necessary, the air conditioning units 10Aa, 10Ab, ... 10A(n-1), 10An, etc., included in the first group of controlled equipment 10A will be referred to as air conditioning unit E. Each air conditioning unit E can be placed in different rooms, for example, and can operate independently in each room. Furthermore, each air conditioning unit E is equipped with a detection device 16. The detection device 16 is a biological detection sensor, for example, composed of a well-known infrared sensor or radar, either alone or in combination. It forms a predetermined detection area around the air conditioning unit E and outputs biological detection information to the management device 12 indicating whether or not a living organism is present. The living organisms detected by the detection device 16 include humans as well as animals such as pets. Furthermore, the detection device 16 is capable of detecting living organisms in an active state, such as moving (walking) in a room, as well as living organisms in a stationary state, such as sitting on the floor or a chair, or lying on a bed.

[0023] As mentioned above, the second group of controlled devices 10B includes controlled devices 10 that differ from those in the first group of controlled devices 10A in terms of device type or biodetection method. The second group of controlled devices 10B includes, for example, a fan 10Ba, an air conditioner Bb without a detection device 16, a microwave oven 10Bc, a refrigerator 10Bd, etc. In the example shown in Figure 1, the fan 10Ba, microwave oven Bc, and refrigerator 10Bd are equipped with a detection device 16 that has the same function as the air conditioner E in the first group of controlled devices 10A. Therefore, these devices can output biodetection information to the management device 12 indicating whether or not living organisms are present in the surroundings. On the other hand, the air conditioner Bb does not have a detection device 16, so it cannot output biodetection information to the management device 12 on its own. In this case, the detection results of the detection devices 16 of other controlled devices 10 surrounding the air conditioner Bb can be used to estimate whether or not living organisms are present around the air conditioner Bb, and this can be used as living organism detection information corresponding to the air conditioner Bb. Details of the estimation of living organism detection information will be described later. Alternatively, for example, a microwave oven Bc or a refrigerator 10Bd may have an output unit that outputs operation information of the device to the management device 12 instead of the detection device 16. In this case, the management device 12 can obtain information to estimate whether or not living organisms are present in the room where the microwave oven Bc or refrigerator 10Bd is installed, based on the operation information. For example, if the "door" of the microwave oven Bc or refrigerator 10Bd is opened or closed, this opening or closing is performed intentionally by a person as part of the operation. In other words, the operation information indicating the opening or closing operation can be used to estimate whether or not living organisms are present in the room where the microwave oven Bc or refrigerator 10Bd is installed. As a result, it can be assumed that a person is present around the air conditioner Bb, which is installed in the same room but does not have a detection device 16, and the presence or absence of living organisms can be reflected in the control of the air conditioner Bb. In other words, operational information for equipment other than the air conditioner Bb can be treated as biological detection information for the air conditioner Bb. Furthermore, for the controlled equipment 10 included in the first controlled equipment group 10A and the second controlled equipment group 10B, it is sufficient to confirm whether or not there are living organisms in the surroundings; it is not essential that the detection device 16 is installed on the controlled equipment 10.For example, the detection device 16 may exist independently of the controlled device 10, provided that it is linked to the controlled device 10. For instance, the detection device 16 may be installed independently on a wall in a room.

[0024] The control device 12 is connected to each of the control target devices 10 included in the first control target device group 10A and the second control target device group 10B via a communication line such as wireless or wired. Each air conditioner E included in the first control target device group 10A can be operated and controlled via the control device 12 from the terminal device 14. The control device 12 can also acquire biological detection information from each air conditioner E. Similarly, the fan 10Ba, air conditioner Bb, microwave oven 10Bc, refrigerator 10Bd, etc. included in the second control target device group 10B can be operated and controlled via the control device 12 from the terminal device 14. The control device 12 can also acquire biological detection information from the control target devices 10 included in the second control target device group 10B. In this embodiment, the microwave oven 10Bc, refrigerator 10Bd, etc. may function only as devices that output biological detection information.

[0025] The management device 12 may be a server capable of centrally managing each of the control target devices 10 included in the first control target device group 10A and the second control target device group 10B. The installation location of the management device 12 is not limited and may be, for example, in any location in the room or house where the control target devices 10 are installed, or in an external facility (such as a service provider or information center). Furthermore, the management device 12 may be a type for personal use or a type shared by multiple subscribers.

[0026] The management device 12 can be implemented using a typical computer consisting of a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), a storage unit such as an HDD (Hard Disk Drive) or SSD (Solid State Drive), a communication interface, an input / output interface, etc. The management device 12 includes a processing unit 12a and a storage unit 12b, etc.

[0027] The CPU of the processing unit 12a can control each of the control target devices 10 included in the first control target device group 10A and the second control target device group 10B based on operation commands transmitted from the terminal device 14, by executing a processing program read from a storage unit such as ROM. Furthermore, the processing unit 12a temporarily stores biological detection information acquired from the detection device 16 and operation information transmitted from the microwave oven 10Bc, refrigerator 10Bd, etc., in a storage unit 12b such as RAM or HDD, and can also provide information on whether or not a living organism is present to the terminal device 14 based on a request from the terminal device 14, enabling the switching control of the screen displayed on the display unit 14a. In other words, information such as biological detection information can be reflected in the control of each control target device 10 in the terminal device 14.

[0028] The terminal device 14 may be a dedicated controller capable of collectively controlling each of the control target devices 10 included in the first control target device group 10A and the second control target device group 10B, or it may be a mobile terminal device such as a smartphone or tablet capable of executing a predetermined application. The terminal device 14 can acquire various information via the management device 12 and can install and execute applications that enable the operation control of each of the control target devices 10 included in the first control target device group 10A and the second control target device group 10B. The terminal device 14 is equipped with a display unit 14a capable of displaying the execution status of the application. The display unit 14a may be covered with a transparent operation input unit, such as a touch panel. The operator (user of the device control system 100) can view the image displayed on the display unit 14a via the operation input unit. The operator can also perform operation input by touching, pressing, or moving the operation input unit with their fingers or the like at a position corresponding to the image displayed on the display unit 14a. In another embodiment, the terminal device 14 may include a separate keyboard section, operation switches, etc., distinct from the display unit 14a.

[0029] The terminal device 14 may have all or some of the functions of the management device 12, such as the information collection function and relay function from each controlled device 10. In this case, the terminal device 14 can directly control each controlled device 10 included in the first controlled device group 10A and the second controlled device group 10B based on biological detection information provided by the detection device 16 and operation information provided by the microwave oven 10Bc, refrigerator 10Bd, etc. In this case, the management device 12 can be omitted or some of its functions can be omitted.

[0030] Figure 2 is an illustrative and schematic diagram showing the arrangement of the controlled equipment 10 within the controlled area 18 (e.g., 18A to 18D), which is a living space to which the equipment control system 100 can be applied, and the detection areas Sa to Sf of the detection device 16 that outputs biological detection information.

[0031] In Figure 2, the living / dining room 18A, Western-style room 18B, Japanese-style room 18C, and Western-style room 18D are shown as examples of the controlled area 18.

[0032] In the living / dining room 18A, an air conditioner 10Aa equipped with a detection device 16 is installed on the wall in the corner of the room. A fan 18Ba equipped with a detection device 16 is installed in another corner adjacent to the air conditioner 10Aa in a counterclockwise direction. A microwave oven 10Bc and a refrigerator 10Bd equipped with a detection device 16 are installed behind the sink, spaced counterclockwise from the fan 18Ba.

[0033] The detection area of ​​the detection device 16 provided in the air conditioner 10Aa, fan 18Ba, microwave oven 10Bc, and refrigerator 10Bd may differ individually depending on the mounting position and orientation of the detection device 16 in each controlled device 10, and the installation position and orientation of the controlled device 10. For example, the detection area of ​​the detection device 16 provided in the air conditioner 10Aa is detection area Sa. The detection area of ​​the detection device 16 provided in the fan 18Ba is detection area Sb. Also, the detection area of ​​the detection device 16 provided in the microwave oven 10Bc is detection area Sc, and the detection area of ​​the detection device 16 provided in the refrigerator 10Bd is detection area Sd. However, it is difficult for individual detection devices 16 to have the entire living / dining area 18A as their detection area, and blind spots may occur. For example, the detection device 16 in the air conditioner 10Aa may not be able to detect a user Wa (living being, human) in the vicinity of the fan 18ba in the living / dining area 18A. Therefore, in the case where multiple controlled devices 10 equipped with detection devices 16 exist within the same controlled area 18 (for example, living room / dining room 18A), the processing unit 12a of the control device 12 in this embodiment can acquire biological detection information corresponding to a controlled device 10 equipped with a detection device 16 by considering it as biological detection information corresponding to other controlled devices 10. In this case, the processing unit 12a may only be able to acquire biological detection information that determines no living being (user Wa) is present in the living room / dining room 18A if it relies solely on the biological detection information from the detection device 16 of the air conditioner 10Aa. On the other hand, the processing unit 12a can acquire biological detection information that determines a living being (user Wa) is present in the living room / dining room 18A where the air conditioner 10Aa is installed by using the biological detection information from the detection device 16 of the fan 18Ba. In other words, the detection device 16 of the fan 18Ba compensates for the blind spot area created by the detection device 16 of the air conditioner 10Aa. Furthermore, in the case of each controlled device 10 shown in Figure 2, the detection area Sc of the detection device 16 installed in the microwave oven 10Bc and the detection area Sd of the detection device 16 installed in the refrigerator 10Bd overlap with the detection area Sa of the detection device 16 of the air conditioner 10Aa. As a result, the effect of improved detection accuracy can be obtained for the overlapping detection areas.

[0034] In Western-style room 18B, an air conditioner 10Ab equipped with a detection device 16 is installed on the wall in the corner of the room. The detection area of ​​the detection device 16 provided on the air conditioner 10Ab is detection area Se. Although there is a blind spot near the entrance of Western-style room 18B, the detection device 16 of the air conditioner 10Ab can cover most of the area where living organisms are likely to be present. Therefore, the processing unit 12a can be considered to be able to acquire biological detection information indicating whether or not living organisms are present in Western-style room 18B in a generally appropriate manner.

[0035] In the Japanese-style room 18C, an air conditioner 10An equipped with a detection device 16 is installed on the wall in the corner of the room as the controlled device 10, and a fan Baa without a detection device 16 is placed diagonally opposite the air conditioner 10An. The detection area of ​​the detection device 16 provided on the air conditioner 10An is the detection area Sf. In the Japanese-style room 18C, there is a blind spot near the entrance, but the detection device 16 of the air conditioner 10An can cover most of the area where living organisms are likely to be present, and the processing unit 12a can be considered to be able to acquire biological detection information indicating whether or not living organisms are present in the Japanese-style room 18C in an appropriate manner. Furthermore, since the fan Baa does not have a detection device 16, the fan 18Baa cannot be controlled based on biological detection information on its own. The controlled device 10 of this embodiment includes a first controlled device equipped with a detection device 16 (e.g., an air conditioner 10An) and a second controlled device without a detection device 16 (e.g., a fan 18baa) located in the same controlled area 18 (e.g., a Japanese-style room 18C) as the first controlled device. In this case, the processing unit 12a can acquire first biological detection information for the first controlled device (e.g., an air conditioner 10An) as second biological detection information for the second controlled device (e.g., a fan 18baa). In other words, when a controlled device 10 equipped with a detection device 16 and a controlled device 10 without a detection device 16 are located in the same room (area), the biological detection information can be shared to enable control of each controlled device 10. For example, remote operation of the fan 18Baa becomes possible based on whether or not a user Wb (biological entity) is present in the Japanese-style room 18C. Regarding Western-style room 18D, it is the same as Western-style room 18B and Japanese-style room 18C, so the explanation of the arrangement of the controlled device 10 and the detection area will be omitted.

[0036] Figure 3 is an illustrative and schematic functional block diagram illustrating the functions of the equipment control unit 20 implemented in the terminal device 14 of the equipment control system 100.

[0037] The device control unit 20 implements modules such as the registration unit 22, acquisition unit 24, and display processing unit 26 by executing a processing program read from a storage unit such as ROM by the CPU of the terminal device 14. The registration unit 22 includes detailed modules such as the unique information registration unit 22a, the installation area registration unit 22b, and the linking registration unit 22c. The acquisition unit 24 includes detailed modules such as the biometric information acquisition unit 24a, the device information acquisition unit 24b, and the operation information acquisition unit 24c. The display processing unit 26 includes detailed modules such as the display mode processing unit 26a, the linking processing unit 26b, the operation reception unit 26c, the biometric recognition unit 26d, the operation state switching unit 26e, and the notification processing unit 26f. Furthermore, the display mode processing unit 26a includes modules such as the initial display screen display unit 26aa, the biometric icon display unit 26ab, and the control content display unit 26ac.

[0038] The registration unit 22 periodically acquires and registers various basic information necessary for controlling each controlled device 10. For example, the registration unit 22 can register various information when it receives a signal indicating that the terminal device 14 has been activated as an operating terminal for the device control system 100. Information that is not generally changed after being set may be registered during initial setup, and the registration process may be omitted thereafter.

[0039] The unique information registration unit 22a registers unique information for the controlled devices 10 that are to be controlled by the device control system 100. For example, when a new controlled device 10 is installed or, conversely, when an existing controlled device 10 is removed, the registration status of the unique information for the controlled device 10 is updated. In this case, the unique information registration unit 22a also registers information such as the type of device (air conditioner, fan, etc.), identification information (identification within the first controlled device group 10A, etc.), and the presence or absence of a detection device 16 for each controlled device 10. Furthermore, if a detection device 16 exists independently, the unique information registration unit 22a identifies and registers each detection device 16 individually. In short, unique information is information used to identify (specify) the controlled device 10.

[0040] The installation area registration unit 22b registers the installation areas in which each controlled device 10 is installed. The installation area registration unit 22b registers the names of the installation areas so that users of the device control system 100 can identify the installation areas in which the controlled devices 10 are installed. The installation area registration unit 22b can register each controlled area with a specific name, such as "Living / Dining Room," "Western-style Room 1," "Japanese-style Room," "Western-style Room 2," "Children's Room 1," "Children's Room 2," etc. Alternatively, multiple areas may be grouped together and registered with an identifier such as "Area 1," "Area 2," etc. The installation area registration unit 22b mainly performs registration processing during the initial setup of the device control system 100.

[0041] The linking registration unit 22c links the controlled equipment 10 registered by the unique information registration unit 22a with the installation area registered by the installation area registration unit 22b. For example, it links the controlled equipment 10 installed in the "living room / dining room". In Figure 2, the linking registration unit 22c links the air conditioner 10Aa, fan 18ba, microwave oven 10Bc, refrigerator 10Bd, etc. to the living room / dining room 18A. The linking registration unit 22c similarly links the installation area and the controlled equipment 10 individually for other installation areas. As a result, it becomes easier to identify the controlled equipment 10 for each controlled area, and errors such as operating mistakes can be reduced when operating the controlled equipment 10.

[0042] The acquisition unit 24 appropriately acquires various information necessary for controlling each controlled device 10. The biological information acquisition unit 24a acquires biological detection information provided by the detection device 16 linked to each controlled device 10. As mentioned above, the biological detection information is information indicating whether or not a living organism is present around the linked controlled device 10, and living organisms include not only humans but also animals such as pets.

[0043] The device information acquisition unit 24b acquires device information such as information regarding the current operating status of the controlled device 10 located within the controlled area 18. For example, it acquires operating mode information (such as cooling mode, dehumidification mode, or air purification mode) and operating setting values ​​(such as set temperature or airflow). The operating mode information and operating setting information may be the information from when the controlled device 10 last stopped operating, or the information from when it last stopped operating may be reset to its default value. The device information acquisition unit 24b may also acquire environmental information of the controlled area 18 (such as temperature or humidity). Environmental information can be acquired from temperature and humidity sensors mounted on the controlled device 10.

[0044] The operation information acquisition unit 24c acquires operation information if there is a device that outputs operation information in the controlled area 18. In the case of Figure 2, as mentioned above, the microwave oven 10Bc and refrigerator 10Bd are equipped with sensors that detect the opening and closing of doors, and each time an opening or closing operation is performed, a detection signal is sent to the management device 12. As mentioned above, in this embodiment, the opening and closing of the doors of the microwave oven 10Bc and refrigerator 10Bd is performed by the user of the microwave oven 10Bc or refrigerator 10Bd. In other words, it indicates that a user (a human, i.e., a living being) is present around the microwave oven 10Bc or refrigerator 10Bd. The device control unit 20 can consider the operation information as living being detection information and use it to determine whether or not a living being is present in the controlled area 18. As a result, even if there is no detection device 16 such as an infrared sensor or radar that directly detects living beings, it is possible to easily acquire information indicating whether or not a living being is present in the surroundings. Furthermore, the operation information is not limited to information based on the opening and closing of doors of microwave ovens 10Bc or refrigerators 10Bd. It can be any information based on physical operations performed by a human, rather than operations based on remote control, for example, information based on the operation of control switches on audio equipment or video equipment, or information on the use of amusement equipment.

[0045] The display processing unit 26 performs display processing for the operation screen of the controlled device 10 based on the device information acquired by the acquisition unit 24, and processes to determine the display format of the device information based on the biological detection information and display it on the display unit 14a of the terminal device 14. In addition, the display processing unit 26 performs notification processing (notification display processing) such as operation confirmation when controlling the controlled device 10 based on the biological detection information.

[0046] The display mode processing unit 26a, for example, determines (changes) the display mode of the controllable controlled device 10 on the display unit 14a, or determines (changes) the display mode of the control content of the controlled device 10, depending on whether a living organism is considered to be present or not, based on biological detection information.

[0047] The linking processing unit 26b links the unique information of each controlled device 10 registered by the registration unit 22 with the biometric detection information acquired by the acquisition unit 24 that corresponds to said unique information, and displays it on the display unit 14a of the terminal device 14.

[0048] The operation reception unit 26c receives input commands via the operation screen displayed on the display unit 14a of the terminal device 14, processed by the display mode processing unit 26a. For example, it receives mode switching commands and temperature setting commands for the air conditioner 10Aa, etc.

[0049] The biorecognition unit 26d determines whether or not a living organism is present in the controlled area 18 based on the biodetection information and operation information acquired by the acquisition unit 24. As mentioned above, the biorecognition unit 26d recognizes not only humans but also pets and other organisms as living organisms. Furthermore, the biorecognition unit 26d recognizes living organisms in both active and stationary states. Distinguishing between living organisms and non-living objects can be done, for example, by detecting surface temperature, temperature (body temperature) distribution, bodily changes that change in a certain pattern with respiration (such as chest expansion and contraction), and irregular behavior. Similarly, the presence or absence of a stationary organism can be determined by detecting temperature (body temperature) distribution and chest expansion and contraction.

[0050] The operating state switching unit 26e switches the operating state of the controlled device 10 by generating and outputting a control command to switch the operating state of the controlled device 10 based on the operation command received by the operation reception unit 26c.

[0051] Prior to the operation state switching unit 26e outputting a control command, the notification processing unit 26f provides notification information to the user of the terminal device 14. For example, the notification processing unit 26f notifies the controlled equipment 10 in which the presence of a living being has been detected, and when switching the operation state of the controlled equipment 10 by a control command, it generates and outputs notification information to confirm whether it is OK to switch the operation control (e.g., operation stop control). This reduces errors such as mistakenly stopping the operation of the air conditioner E despite the presence of a living being.

[0052] In this embodiment, the device control system 100 determines the display content on the display unit 14a of the terminal device 14 in order to enable the control of multiple control target devices 10 to be performed more appropriately and easily in a single operation based on biological detection information indicating whether or not living organisms are present around the control target devices 10.

[0053] Figure 4 is an illustrative and schematic diagram showing the control screen 28 displayed on the display unit 14a of the terminal device 14. The control screen 28 can display a scrollable display area M1 that can simultaneously display multiple control display areas 30 corresponding to multiple controlled devices 10, and a control switch display area M2 for executing batch control of the controlled devices 10, etc.

[0054] Because there are limitations to the size of the display area of ​​the display unit 14a of the terminal device 14, in this embodiment, the scrollable display area M1 of the control screen 28 is made scrollable, for example, in the vertical direction, so that all control display areas 30 that need to be displayed can be viewed by scrolling. In Figure 4, the upper end of the top control display area 30a and the lower end of the bottom control display area 30d are hidden by scrolling. By adjusting the scroll state, it is possible to display, for example, three control display areas 30 in their complete state. Also, by changing the display size of the control display areas 30, it is possible to display more control display areas 30 in their complete state simultaneously. Furthermore, when scrolling, only control display areas 30 in their complete state may be displayed (control display areas 30a, 30d, etc. may be hidden), or a single control display area 30 may be displayed.

[0055] The control display area 30 can display biological icons 32 based on biological detection information, for example, as shown in the control display area 30b displayed on the second row and the control display area 30c displayed on the third row of the control screen 28. When biological detection information indicates that a living organism is present around the controlled device 10, the biological icon 32a is displayed in a clear state or in a conspicuous color (e.g., blue or red), as shown in the control display area 30b. In Figure 4, for illustrative purposes, the biological icon 32a indicating the presence of a living organism is shown with "hatted lines". On the other hand, when biological detection information indicates that a living organism is not present around the controlled device 10, the biological icon 32b is displayed in a semi-transparent state or in an inconspicuous color (e.g., gray), as shown in the control display area 30c. In Figure 4, for illustrative purposes, the biological icon 32b indicating the absence of a living organism is shown with "dots". If biological detection information cannot be obtained, the biological icon 32 is hidden, for example, as shown in the control display area 30d. In this way, by determining the display mode of the biological detection information, i.e., the biological icon 32, displayed on the display unit 14a according to the presence or absence of living organisms around the controlled device 10, the presence or absence of living organisms can be easily and accurately recognized by the user.

[0056] Furthermore, the control display area 30 includes a selection status display area 34 that shows a selection mark indicating whether the corresponding controlled device 10 is selected as a device for batch operation. The selection mark is activated by, for example, one touch on the control display area 30 where the controlled device 10 to be selected is displayed, and is shown as shown in control display areas 30c and 30d. Also, if the control display area 30 where the selection mark is already displayed is touched twice in succession, for example, it is deactivated and becomes hidden as shown in control display area 30b.

[0057] In addition, the control display area 30 displays multiple pieces of unique information and device information for the controlled device 10. For example, the control display area 30 displays the installation display area 36a, the set temperature display area 36b, the room temperature display area 36c, the timer display area 36d, the target device display area 36e, the operating mode display area 36f, and so on.

[0058] The installation display area 36a displays information that allows the user to identify the installation location, such as living room, children's room 1, or Japanese-style room 1. The display content of the installation display area 36a can be set (registered) and changed as appropriate by the user via the operation panel of the terminal device 14, and may be, for example, "Area A".

[0059] In the initial screen, the set temperature display area 36b displays, for example, the set temperature at the end of the last operation of the controlled device 10, and that set temperature is considered valid. However, by tapping and selecting the set temperature display area 36b, the content of the set temperature display area 36b can be changed, and the set temperature can be modified.

[0060] The room temperature display area 36c can display the temperature of the room in which the controlled device 10 is installed in real time. The room temperature may be displayed based on sensor information installed in the controlled device 10, or it may be displayed based on information obtained from other sensors installed inside the room.

[0061] In the initial screen of the timer display area 36d, for example, the timer time at the end of the last operation of the controlled device 10 is displayed, and that timer time is set to be active. However, by tapping and selecting the timer display area 36d, the contents of the timer display area 36d can be changed, and the timer time can be modified. The timer display area 36d may also be configured to allow the timer to be enabled or disabled by tapping. For example, when enabled, the timer time may be displayed, and when disabled, the timer time may be hidden.

[0062] The target equipment display area 36e can display icons that can identify the controlled equipment 10. Alternatively, text or other symbols may be used instead of icons. In Figure 4, the same icon is displayed to represent the air conditioner E, but different icons of different shapes or different display colors may be displayed for each air conditioner E. In this case, it becomes easier to identify the controlled equipment (air conditioner E) to be controlled.

[0063] In the initial screen, the operating mode display area 36f displays, for example, the operating mode of the controlled device 10 at the end of its last operation, and that operating mode is set to be active. However, by tapping and selecting the operating mode display area 36f, the contents of the operating mode display area 36f can be changed, and the operating mode can be changed.

[0064] Furthermore, the background colors of each control display area 30a to 30d displayed in the control display area 30 may be changed individually to facilitate identification. In addition, control target devices 10 (unique information, device information, etc.) that are deemed not to be associated with biometric detection information may be displayed in a different display manner than control target devices 10 (unique information, device information, etc.) to which biometric detection information is associated. In this case, the background color of the control display area 30 may be changed, or the display manner of the icon of the control target device 10 displayed in the target device display area 36e may be changed. As a result, it becomes easier to identify whether or not biometric detection information has been associated, enabling users to make more appropriate operational decisions. Furthermore, the display content of the control display area 30 may be customized by the user as appropriate. For example, it may be possible to increase or decrease the number of display items or change the background.

[0065] As described above, the device control system 100 can control multiple controlled devices 10 collectively based on biological detection information. Therefore, the control switch display area M2 can display an operation switch image 38 that allows for the collectively executed control of controlled devices 10 for which a selection mark is displayed in the selection / presence display area 34. In the case of Figure 4, as an example, an operation switch image 38 is displayed that turns off all controlled devices 10 for which a selection mark is displayed collectively. In other words, the operation of the controlled devices 10 selected on the display unit 14a can be terminated collectively. As described above, the display mode of the biological icon 32 is determined according to the presence or absence of living organisms around the controlled device 10. In other words, by linking the controlled device 10 and the biological detection information corresponding to the controlled device 10 and displaying them on the display unit 14a, it becomes possible to simultaneously refer to the controlled device 10 (unique information, device information, etc.) and the biological detection information, and switching control can be executed in that state. Therefore, a user attempting to stop all controlled devices 10 at once can easily and appropriately determine whether or not there are living organisms around the controlled devices 10, and can appropriately remotely control the controlled devices 10 in the control display area 30c where no living organisms are present. In this way, the device control system 100 does not prohibit remote control of controlled devices 10 where living organisms are present, but rather, after confirming whether or not it is permissible to stop the operation of controlled devices 10 where living organisms are present, a selection mark is displayed in the selection presence / absence display area 34, enabling intentional stopping operations. As a result, this contributes to improving the usability of the device control system 100. Note that in Figure 4, although the living organism icon 32 is not displayed in the control display area 30d, it shows that the user has confirmed the presence or absence of living organisms, a selection mark has been added, and intentional stopping operations are possible.

[0066] Returning to Figure 3, the initial display screen display unit 26aa of the display mode processing unit 26a performs the generation and display processing of an initial screen to be displayed on the display unit 14a when, for example, an application for using the equipment control system 100 is launched on the terminal device 14. In this case, if, at the time of launch, it is determined that there are no living organisms around the controlled equipment 10 based on the biological detection information, and the controlled equipment 10 is in operation, the initial screen may already display a selection mark indicating that it is possible to remotely stop the controlled equipment 10. In other words, the display content of the initial display screen of the display unit 14a is determined according to the biological detection information. In this case, the operation of selecting the selection mark is simplified, which contributes to improved usability.

[0067] The bio-icon display unit 26ab determines the display mode of the bio-icon 32 based on the bio-detection information and operation information acquired by the acquisition unit 24, and executes control to display it on the control display area 30. In Figure 4, the bio-icon 32 is shown as a mark resembling a human, but the form of the mark can be changed as appropriate, and identification may simply be indicated by turning a lamp on or off or by the color of the lamp.

[0068] As described above, the control content display unit 26ac controls the display content in the installation display area 36a, set temperature display area 36b, room temperature display area 36c, timer display area 36d, target equipment display area 36e, and operation mode display area 36f displayed in the control display area 30, and also controls the display of display information generated by the notification processing unit 26f. For example, if a living organism is present around the controlled equipment 10 based on biological detection information, and the operation switch image 38 is pressed, causing the operation state switching unit 26e to output a control command, the control content display unit 26ac displays a notification image 28A as shown in Figure 5 prior to the output of the control command. Notification image 28A is an example of a display shown when attempting to remotely stop the controlled equipment 10 (air conditioner E: air conditioner) despite the presence of a living organism around the controlled equipment E (air conditioner) that is to be stopped. Notification image 28A includes a message display area MS1 and operation key areas 28Aa and 28Ab. The message display area MS1 shows a warning that the air conditioner is about to be stopped despite the presence of a living being. In this case, the message displays information such as the air conditioner being stopped, the presence of a living being near the air conditioner being stopped, and the need for confirmation before stopping. The message display area MS1 can be made to flash for a predetermined period of time or change its display color to enhance the level of warning. The notification processing unit 26f may also perform notification by voice or other means in addition to the display notification by the control content display unit 26ac. The operation key area 28Aa is a "cancel switch" that outputs a command to stop the air conditioner stop operation based on the notification content displayed in the message display area MS1, and the operation key area 28Ab is an "execute switch" that outputs a command to execute the air conditioner stop operation after confirming the notification content displayed in the message display area MS1. The execute switch may be made to not become active until an operation to confirm that the notification content has been read has been performed (for example, by pressing the read switch). In this case, it can contribute to further reducing erroneous operations.

[0069] In this way, by displaying notification information and requiring confirmation of equipment shutdown, it is possible to reduce the possibility of accidentally remotely shutting down air conditioning equipment E, etc., in the presence of living organisms in the surrounding area, which could lead to health problems such as heatstroke.

[0070] For example, if, based on biological detection information, no living organisms are present around the controlled device 10, and the operation switch image 38 is pressed, causing the operating state switching unit 26e to output a control command, the control content display unit 26ac will display a notification image 28B showing a simplified confirmation, as shown in Figure 6, prior to the output of the control command. The notification image 28B includes the message display area MS2 and the operation key areas 28Ba and 28Bb. The notification image 28B displayed in the message display area MS2 is an example of a display shown when indicating that the controlled device 10 (air conditioning unit E: air conditioner) that is in operation will be stopped. In this case, a simplified message indicating only that the air conditioner will be stopped will be displayed. The operation key area 28Ba is a "cancel switch" that outputs a command to stop the air conditioner stop operation based on the notification content displayed in the message display area MS2, and the operation key area 28Bb is an "execute switch" that outputs a command to execute the air conditioner stop operation after confirming the notification content displayed in the message display area MS2. Furthermore, if no living organisms are detected around the controlled equipment 10, remotely stopping the air conditioner, etc., is unlikely to cause the aforementioned disadvantages. In this case, the display of notification image 28B may be omitted, and the operating state switching unit 26e may immediately output a control command after the operation switch image 38 is pressed. In this case, the display on the display unit 14a of the terminal device 14 is simplified, contributing to improved usability. For example, in the case of the air conditioner E, when remotely controlling the set temperature, airflow, or airflow direction, the aforementioned disadvantages due to stopping are unlikely to occur. Therefore, the display or hiding of notification images 28A and 28B may be selected depending on the control content (operation content).

[0071] An example of the processing operation of the device control system 100 configured as described above will be explained using the flowcharts in Figures 7 to 9. Figure 7 is an exemplary flowchart showing the display process flow of the initial display screen shown on the display unit 14a of the terminal device 14 in the device control system 100. Figure 8 is an exemplary flowchart showing the detailed flow of the sensor information acquisition process in the flowchart of Figure 7. Figure 9 is an exemplary flowchart showing the control process flow after the initial display screen is displayed on the display unit 14a of the terminal device 14 in the device control system 100.

[0072] First, terminal device 14 checks whether the application (device control unit 20) for controlling the controlled device 10 is running (S100). If terminal device 14 checks whether the application is running (No in S100), it terminates this flow. If the application is running in S100 (Yes in S100), the device control unit 20 obtains a list of controlled devices based on the unique information of the controlled device 10 registered via the registration unit 22 (S102). Next, in order to perform processing to enable each detection device 16 (sensor) corresponding to the controlled device 10, the identifier (subscript) i of the detection device 16 (sensor) is reset to i=1 (S104). Next, it checks whether the detection device 16 of the controlled device 10 (i=1 in the first case) is enabled (whether it is in a state where it can output biological detection information) (S106). If the detection device 16 is not active (No. in S106), a start command is sent to the corresponding detection device 16 to activate the detection device 16 of the controlled device 10 (i=1) (S108). Then, it is checked whether the start process has been completed for all detection devices 16 (N) present in the device list acquired in S102, that is, whether the identifier (subscript) i of the detection device 16 (sensor) has become N (S110). If i≠N (No. in S110), i is incremented (i=i+1), and the process proceeds to S106 and beyond to check whether the next detection device 16 is active or not. If i=N in S110 (Yes in S110), that is, if all detection devices 16 are active (activated), the process of acquiring sensor information (biological detection information, operation information, etc.) is performed (S114). Then, after acquiring the sensor information, the initial display screen is displayed on the display unit 14a of the terminal device 14, and the series of processes is temporarily terminated (S116). Note that in S106, if the detection device 16 currently being checked is valid (Yes in S106), the process in S108 is skipped.

[0073] Next, an example of the sensor information acquisition process will be explained using the flowchart in Figure 8. First, in order to select the detection device 16 (sensor) corresponding to the controlled device 10, the identifier (subscript) i of the detection device 16 (sensor) is reset to i=1 (S200). Then, it is checked whether the detection device 16 of the controlled device 10 (i=1 in the initial case) is started (enabled) (i.e., whether it is in a state where it can output biological detection information) (S202). If it is not yet started (No in S202), it waits for it to start. If the detection device 16 (i=1 in the initial case) is started (Yes in S202), sensor information such as biological detection information and operation information is acquired from the detection device 16 (S204). Then, it is checked whether the acquisition of sensor information such as biological detection information and operation information has been completed from all detection devices 16 (N items) in the list of devices acquired in S102 in Figure 7, that is, whether the identifier (subscript) i of the detection device 16 (sensor) has become N (S206). If i≠N (No in S206), i is incremented (i=i+1) (S208), and the process moves to S202, where sensor information such as biological detection information and operation information is acquired from the next detection device 16. If i=N in S206 (Yes in S206), that is, if the acquisition of sensor information has been completed for all detection devices 16, the series of processes is terminated.

[0074] Next, using the flowchart in Figure 9, an example of the control process after the initial display screen is shown on the display unit 14a of the terminal device 14 in the equipment control system 100 will be explained.

[0075] If the initial display screen is not already displayed on the display unit 14a of the terminal device 14 (No in S300), this flowchart is terminated. If the initial display screen is already displayed on the display unit 14a (Yes in S300), if there are any selection changes (including setting changes, etc.) in the control display area 30 displayed on the initial display screen, such as the selection status display area 34 for each controlled target device 10, or in the set temperature display area 36b, room temperature display area 36c, timer display area 36d, and operation mode display area 36f among the device information (Yes in S302), the display content of the display area corresponding to the changed item is changed (S304). Then, if the operation switch image 38 is operated and the operation reception unit 26c receives a batch operation command (Yes in S306), the notification processing unit 26f displays a message on the display unit 14a, such as the notification image 28A and notification image 28B described in Figures 5 and 6 (S308). Then, after the display of notification image 28A or notification image 28B, if an operation command is received by pressing any of the operation key areas 28Aa, 28Ab, 28Ba, or 28Bb (Yes in S310), the operation state switching unit 26e sends a batch operation command (for example, an operation stop command) to the controlled equipment 10 for which a selection mark is displayed in the selection status display area 34 (S312), and terminates this flow.

[0076] If no confirmation command is received in S310 (S310 No.), the process returns to S308 and continues the notification process. Also, if the operation reception unit 26c does not receive a batch operation command in S306 (S306 No.), this flow is terminated. Furthermore, if no selection change (such as a setting change) is confirmed within the specified period in S302 (S302 No.), the process in S304 is skipped and the process proceeds to S306.

[0077] As described above, the device control system 100 of this embodiment includes at least one control target device 10 that can be controlled, and a program to be executed by a computer in a terminal device 14 that can remotely control the control target device 10. The control target device 10 is equipped with an information acquisition unit that acquires biological detection information indicating whether or not living organisms are present around the control target device 10. The program causes the computer to execute an acquisition process that acquires device information and biological detection information related to the control target device 10, and a display process that displays the operation screen of the control target device 10 on the display unit 14a of the terminal device 14, and determines the display mode of the device information based on the biological detection information and displays it on the display unit 14a. With this configuration, it becomes possible to switch the operating mode based on biological detection information, making it easier to grasp the current usage status of the control target device 10 and making it easier to realize more appropriate and easier remote operation.

[0078] Furthermore, the display processing of the device control system 100 may link device information with corresponding biodetection information and display it on the display unit 14a. With this configuration, it becomes possible to control the controlled device 10 more appropriately and easily by remote operation while referring to the relationship between the device information of the controlled device 10 and the biodetection information.

[0079] Furthermore, the display processing of the device control system 100 may determine the display mode of the biological detection information to be displayed on the display unit 14a depending on whether or not there is a living organism around the controlled device 10. This configuration allows for a more appropriate recognition of whether or not there is a living organism around the controlled device 10.

[0080] Furthermore, the display processing of the device control system 100 may be configured to notify the controlled device 10 in which a living organism has been detected in the surrounding area. This configuration can reduce the likelihood of erroneous operation of the controlled device 10 based on biological detection information.

[0081] Furthermore, the display processing of the device control system 100 may display device information that is deemed not to be associated with biometric detection information in a different display manner than that of device information to which biometric detection information is associated. This configuration makes it easier to distinguish between controlled devices 10 to which biometric detection information is associated and controlled devices 10 to which it is not associated, allowing users to more appropriately understand whether or not the controlled devices 10 can be controlled.

[0082] Furthermore, the acquisition process of the device control system 100 may, when it acquires operation information indicating that an operation has been performed on the controlled device 10, assume that a living organism is present around the controlled device and acquire the operation information as biological detection information. With this configuration, it becomes possible to perform the same control processing as when biological detection information is acquired even for the controlled device 10 that does not have a detection device 16 for acquiring biological detection information, thereby contributing to improved usability.

[0083] Furthermore, the controlled devices 10 of the device control system 100 include a first controlled device (e.g., an air conditioner 10An) equipped with a detection device 16 for acquiring biological detection information, and a second controlled device (e.g., a fan 18baa) located within the same controlled area 18 as the first controlled device but without a detection device 16. The acquisition process may be configured to acquire first biological detection information for the first controlled device as second biological detection information for the second controlled device. This configuration makes it possible to perform the same control processing on controlled devices 10 that do not have a detection device for acquiring biological detection information as when biological detection information is acquired, thereby contributing to improved usability.

[0084] Furthermore, if there are multiple controlled devices 10 equipped with detection devices 16 for acquiring biological detection information within the controlled area 18 where the controlled devices 10 of the device control system 100 are installed, the acquisition process may be configured to treat the biological detection information corresponding to the controlled device 10 equipped with the detection device 16 as biological detection information corresponding to other controlled devices 10 and acquire it accordingly. With this configuration, even if there is a blind spot in the detection area of ​​the detection device 16 of one controlled device 10, that blind spot can be compensated for by the detection area of ​​the detection device 16 of another controlled device 10, thereby further improving the accuracy of biological detection.

[0085] Furthermore, the acquisition process of the equipment control system 100 may be configured to acquire the unique information of the controlled equipment 10 and the installation area information in which the controlled equipment is installed, by linking them together. This configuration makes it easier and more accurate for users to understand the relationship between the controlled equipment 10 and its installation area.

[0086] Furthermore, the program of this embodiment causes the computer of the terminal device 14 to execute an acquisition process that acquires device information relating to a control target device 10 that may be controlled and biological detection information indicating whether or not a living organism is present around the control target device 10, and a display process that displays the operation screen of the control target device 10 on the display unit 14a of the terminal device 14 that can remotely control the control target device 10, and determines the display mode of the device information based on the biological detection information and displays it on the display unit 14a. With this configuration, it becomes possible to display a display mode based on biological detection information, making it easier to grasp the current usage status of the control target device 10 and making it easier to realize more appropriate and easier remote operation.

[0087] Furthermore, the device control method of this embodiment includes an acquisition process for acquiring device information relating to a control target device 10 that may be controlled, and biological detection information indicating whether or not a living organism is present around the control target device 10, and a display process for displaying the operation screen of the control target device 10 on the display unit 14a of a terminal device 14 that can remotely control the control target device 10, and for determining the display mode of the device information based on the biological detection information and displaying it on the display unit 14a. With this configuration, it becomes possible to display a display mode based on biological detection information, making it easier to grasp the current usage status of the control target device 10 and making it easier to realize more appropriate and easier remote operation.

[0088] Furthermore, the program for controlling the controlled device 10, which is executed by the processor or the like that realizes the device control unit 20 of the device control system 100 of this embodiment, may be configured to be provided as a file in an installable or executable format, recorded on a computer-readable recording medium such as a CD-ROM, flexible disk (FD), CD-R, or DVD (Digital Versatile Disk).

[0089] Furthermore, the program that executes the processing of this embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Alternatively, the program executed in this embodiment may be provided or distributed via a network such as the Internet.

[0090] In the embodiments described above, examples were shown of using the detection results of the detection device 16 as biological detection information, and of using operation information as biological detection information. In other embodiments, schedule information of the controlled device 10 (air conditioner E, etc.) (e.g., weekly operation schedule information) may be acquired, and the estimation results based on the schedule content may be used as biological detection information. For example, based on the estimation that the controlled device 10 should be in use during the scheduled time period, that is, that living beings (people) should be present around the controlled device 10 (air conditioner E), the estimation results may be treated as biological detection information. In this case, the configuration for acquiring schedule information is an example of an information acquisition unit that acquires biological detection information indicating whether or not living beings are present around the controlled device 10. Note that the management of schedule information may be performed by the controlled device 10 or by an external device.

[0091] Furthermore, the equipment control system 100 of this embodiment is shown as being applicable to a typical house where multiple control target devices 10 exist in multiple rooms. In another embodiment, for example, it can be applied to an office with multiple rooms or a large, open floor without partitions separating the control areas, where control target devices 10 are arranged in each control area, and similar effects can be obtained.

[0092] In the embodiments described above, an example was shown in which the controlled device 10 is mainly an air conditioning system. However, the type of controlled device 10 is not limited to this, and it can be applied to any electrical equipment that can be remotely controlled based on biological detection information, and similar effects can be obtained.

[0093] Although embodiments of the present invention have been described above, these embodiments are merely examples and are not intended to limit the scope of the invention. The above embodiments can be implemented in various forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. The above embodiments are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of symbols]

[0094] 10...Controlled device, 10A...First controlled device group, 10B...Second controlled device group, 12...Management device, 14...Terminal device, 14a...Display unit, 16...Detection device, 18...Controlled area, 20...Device control unit, 22...Registration unit, 22a...Unique information registration unit, 22b...Installation area registration unit, 22c...Linking registration unit, 24...Acquisition unit, 24a...Biometric information acquisition unit, 24b...Device information acquisition unit, 24c...Operation information acquisition 26...Display processing unit, 26a...Display mode processing unit, 26aa...Initial display screen display unit, 26ab...Biometric icon display unit, 26ac...Control content display unit, 26b...Linking processing unit, 26c...Operation reception unit, 26d...Biometric recognition unit, 26e...Operation state switching unit, 26f...Notification processing unit, 28...Control screen, 30...Control display area, 32...Biometric icon, 34...Selection / presence display area, 100...Equipment control system.

Claims

1. At least one controllable device that can be controlled, A program to be executed on the computer of a terminal device capable of remotely controlling the aforementioned controlled device, A device control system including, The aforementioned controlled device is The system includes an information acquisition unit that acquires biological detection information indicating whether or not living organisms are present around the controlled device, The aforementioned program, A startup process to start the information acquisition unit if it is not already running, An acquisition process that acquires device information and biological detection information related to the controlled device, Display processing that causes the operation screen of the controlled device to be displayed on the display unit of the terminal device, and determines the display mode of the device information based on the biological detection information and displays it on the display unit, To cause the computer to execute the above, Equipment control system.

2. The aforementioned controlled device is The system includes a first controlled device equipped with the information acquisition unit, and a second controlled device located within the same controlled area as the first controlled device but not equipped with the information acquisition unit. The device control system according to claim 1, wherein the acquisition process can acquire first biological detection information for the first controlled device as second biological detection information for the second controlled device.

3. The aforementioned acquisition process is, The device control system according to claim 1 or 2, wherein when operation information is obtained indicating that a usage operation has been performed to operate a movable part for the use of the controlled device, the system assumes that a living organism is present around the controlled device and obtains the operation information as the living organism detection information.

4. The aforementioned display process is: The device control system according to claim 1, wherein when the controlled device in which the presence of a living organism has been detected is remotely operated, the display mode is determined to notify the user prior to the operation that the operation is being performed in a situation in which a living organism is present.

5. The aforementioned display process is: The device control system according to claim 1, wherein the device information and the biodetection information corresponding to the device information are linked and displayed on the display unit.

6. The aforementioned display process is: The device control system according to claim 5, wherein the display mode of the biological detection information to be displayed on the display unit is determined according to whether or not there is a living organism in the vicinity of the device to be controlled.

7. A startup process for starting up an information acquisition unit that acquires biological detection information indicating whether or not a living organism is present around a control target device that may be a control target, when the information acquisition unit is not started up, An acquisition process for acquiring device information relating to the controlled device and the biological detection information, Display processing includes displaying the operation screen of the controlled device on the display unit of a terminal device capable of remotely controlling the controlled device, and determining the display mode of the device information based on the biological detection information and displaying it on the display unit, A program to cause the computer of the terminal device to execute it.

8. A startup process for starting an information acquisition unit that acquires biological detection information indicating whether or not a living organism is present around a control target device that may be a control target, when the information acquisition unit is not started, An acquisition process for acquiring device information relating to the controlled device and the biological detection information, Display processing includes displaying the operation screen of the controlled device on the display unit of a terminal device capable of remotely controlling the controlled device, and determining the display mode of the device information based on the biological detection information and displaying it on the display unit, A device control method including the following.