Home system, person detection device, person detection method, and person detection program

Abstract

To provide a home system etc. that can more easily grasp whether a specific resident is at home or not.SOLUTION: A home system includes: a person detection device that has a sensor capable of acquiring vibration information and is capable of acquiring person identification information; and a terminal device capable of communicating with the person detection device. The person identification information is information that associates person identification conditions for identifying a person with a specific person. When detecting the person identification conditions from the vibration information acquired by the sensor, the person detection device detects the presence of the specific person corresponding to the person identification conditions. The terminal device acquires the detection result of the presence of the specific person.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to a home system, a person detection device, a person detection method, and a person detection program. [Background technology]

[0002] The number of home appliances that can be connected to the Internet is increasing. Smart home systems have been proposed that utilize home appliances connected to the Internet to provide residents with comfortable and convenient functions. Home appliances connected to the Internet receive remote control instructions from smartphones and other devices, and then carry out control based on the received control instructions.

[0003] A smart home system can detect whether a resident is at home or not and control home appliances, etc. For example, when a resident is at home, the smart home system will operate the lights, air conditioner, etc. On the other hand, when the resident is not at home, the smart home system will not operate the lights, air conditioner, etc.

[0004] In order to know whether a resident is at home or not, systems are used that detect people entering and leaving a room (for example, Patent Document 1, etc.). These systems use sensors to detect people entering and leaving a room. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-312815 Summary of the Invention [Problem to be solved by the invention]

[0006] However, in a smart home system, it is desirable to be able to more easily determine whether a specific resident is at home or not, rather than whether any person is present or absent.

[0007] In consideration of the above circumstances, an object of the present disclosure is to provide a home system, a person detection device, a person detection method, and a person detection program that can more easily determine whether a specific resident is at home or not. [Means for solving the problem]

[0008] A home system according to a first aspect of the present disclosure includes a person detection device having a sensor capable of acquiring vibration information and capable of acquiring person identification information, and a terminal device capable of communicating with the person detection device, wherein the person identification information is information that associates person identification conditions for identifying a person with a specific person, and when the person detection device detects the person identification conditions from the vibration information acquired by the sensor, it detects the presence of the specific person corresponding to the person identification conditions, and the terminal device acquires the detection result of the presence of the specific person.

[0009] A human detection device according to a second aspect of the present disclosure includes a sensor capable of acquiring vibration information and a control unit capable of acquiring person identification information, wherein the person identification information is information that associates person identification conditions for identifying a person with a specific person, and when the control unit detects the person identification conditions from the vibration information acquired by the sensor, it detects the presence of the specific person corresponding to the person identification conditions.

[0010] A person detection method according to a third aspect of the present disclosure acquires vibration information acquired by a sensor, acquires person identification information that associates person identification conditions that identify a person with a specific person, and, when the person identification conditions are detected from the vibration information acquired by the sensor, detects the presence of the specific person that corresponds to the person identification conditions.

[0011] A person detection program according to a fourth aspect of the present disclosure acquires vibration information acquired by a sensor, acquires person identification information that associates person identification conditions that identify a person with a specific person, and, when the person identification conditions are detected from the vibration information acquired by the sensor, detects the presence of the specific person that corresponds to the person identification conditions. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a diagram showing the overall configuration of a home system according to an embodiment; [Figure 2] FIG. 2 is a functional block diagram of a human detection device in the home system. [Figure 3] FIG. 10 is a diagram showing person identification information. [Figure 4] FIG. 2 is a functional block diagram of a smartphone in the home system. [Figure 5] 10 is a flowchart illustrating an example of a method for setting person specifying information. [Figure 6] FIG. 10 is a sequence diagram of the home system. DETAILED DESCRIPTION OF THE INVENTION

[0013] A home system 100 according to an embodiment of the present disclosure will be described with reference to FIGS.

[0014] [Home System 100] FIG. 1 is a diagram showing the overall configuration of a home system 100. As shown in FIG. The home system 100 includes a household appliance 1, a control device 2, a human detection device 3, an access point 4, a smartphone 6, and a server 7. The server 7 includes a device management server 8 and a user management server 9. The access point 4, the smartphone 6, the device management server 8, and the user management server 9 are connected via a network NW.

[0015] The network NW may be a wide area network (WAN) such as the Internet, a private network (LAN) within the building where the home system 100 is installed, or a combination thereof. The network NW may be either a wired or wireless network. Communication between devices may involve other devices such as an access point.

[0016] The residential equipment 1 is a device installed as equipment in a residential home. The residential home to which the residential equipment 1 is installed includes not only buildings intended for residential use, but also buildings not intended for residential use, such as offices, schools, and hospitals. Residential home also includes various nursing care facilities. The residential home is an example of a "facility." The residential equipment 1 is an example of "facility equipment" installed as equipment in a facility. Facility equipment also includes building equipment in buildings not intended for residential use (for example, buildings). Facility equipment also includes not only equipment installed within the facility, but also equipment installed on the premises where the facility is located.

[0017] The housing equipment 1 includes an open / close sensor 1A, an electric lock 1B, an electric shutter 1C, a camera 1D, an air conditioner 1E, etc. The housing equipment 1 may also include an energy management device such as a distribution board or a solar power generation device, sensors such as a temperature / humidity sensor or a human presence sensor, a faucet device, a toilet device, smart home appliances, etc. The housing equipment 1 has a manual control input mechanism that accepts manual control instructions from a user, and a remote control input mechanism that accepts remote control instructions from a server 7 or the like.

[0018] The household equipment 1 can communicate with the access point 4 via a wireless LAN communication WC1 such as WiFi or a wired LAN communication. The household equipment 1 may also communicate with the access point 4 via a control device 2 that can communicate via a short-range wireless communication WC2 such as Sub-GHz, Bluetooth (registered trademark), ZigBee (registered trademark), or NFC (Near Field Communication).

[0019] In this embodiment, the open / close sensor 1A, the electric lock 1B, and the electric shutter 1C communicate with the control device 2 via short-range wireless communication WC2, and then communicate with the access point 4 via the control device 2. The camera 1D and the air conditioner 1E communicate with the access point 4 via wireless LAN communication WC1 such as WiFi. Note that the communication format of the household equipment 1 is not limited to this.

[0020] The household equipment 1 has a facility network including a LAN (Local Area Network) connected by wireless LAN communication WC1 or wired LAN communication, and a PAN (Personal Area Network) connected by short-range wireless communication WC2. The facility network may also include other networks.

[0021] The household equipment 1 has a remote control input mechanism that accepts remote control instructions from a smartphone 6 via a server 7. For example, a user can remotely control the household equipment 1 using the smartphone 6 whether they are at home or out.

[0022] The operating status of the household equipment 1 is acquired by the smartphone 6 via the server 7. For example, the user can check the operating status of the household equipment 1 using the smartphone 6 whether they are at home or out.

[0023] The control device 2 is a device that controls the connected household equipment 1. The control device 2 also relays communication between the household equipment 1 and the access point 4. The control device 2 is also called a relay device or a home device.

[0024] The control device 2 has an antenna and the like, and has a function of communicating via wireless LAN communication WC1 such as WiFi or wired LAN communication, and a function of communicating via short-range wireless communication WC2 such as BlueTooth (registered trademark) or ZigBee (registered trademark). The control device 2 can communicate with the household equipment 1 via the short-range wireless communication WC2. The control device 2 can communicate with the access point 4 via wireless LAN communication WC1 or wired LAN communication.

[0025] The control device 2 can also communicate with a smartphone 6 via wireless LAN communication WC1 or short-range wireless communication WC2. For example, the control device 2 can control a plurality of household equipment 1 based on instructions from the smartphone 6.

[0026] [Person Detection Device 3] FIG. 2 is a functional block diagram of the human detection device 3. The human detection device 3 is a device that detects the presence of a specific person. When the human detection device 3 is installed in each compartment such as a room or a corridor, the human detection device 3 can detect the presence of a specific person in each compartment. The human detection device 3 may be installed on, for example, a floor, a wall, an interior door, or a ceiling. Note that the object detected by the human detection device 3 is not limited to a person, but may also be an animal such as a pet.

[0027] The human detection device 3 includes a control unit 31 , a wireless communication unit 32 , a recording unit 33 , and a sensor 37 .

[0028] The control unit 31 is a computer capable of executing a program, including a processor such as a CPU, a memory into which a program can be read, a storage unit into which a program and data can be stored, and an input / output control unit. The functions of the control unit 31 are realized by the processor executing a program provided to the control unit 31.

[0029] The wireless communication unit 32 has an antenna and the like, and has a function of communicating via short-range wireless communication WC2 such as Sub-GHz, Bluetooth (registered trademark), ZigBee (registered trademark), or NFC (Near Field Communication). The wireless communication unit 32 can communicate with the control device 2 via short-range wireless communication WC2 based on instructions from the control unit 31. The wireless communication unit 32 may have a function of communicating via wireless LAN communication WC1 or wired LAN communication, and may communicate directly with the access point 4 via wireless LAN communication WC1 or wired LAN communication.

[0030] The recording unit 33 includes a recording medium such as a hard disk or a flash memory. The recording unit 33 records setting information of the human detection device 3. Specifically, the recording unit 33 records person identification information 34 and wireless connection information 35.

[0031] FIG. 3 is a diagram showing the person identification information 34. As shown in FIG. The person identification information 34 is information that associates conditions for identifying a person (hereinafter also referred to as "person identification conditions") with a specific person. The person identification information 34 may include two or more person identification conditions for one specific person. Using multiple person identification conditions makes it possible to reliably detect one specific person.

[0032] At least a part of the person identification information 34 may be recorded in the server 7 instead of in the recording unit 33 of the person detection device 3.

[0033] The wireless connection information 35 includes wireless connection information required for communication with the control device 2 via short-range wireless communication WC2, such as pairing information for Bluetooth (registered trademark).

[0034] The sensor 37 is a sensor that acquires vibration and sound waveform information, and is a vibration sensor, sound sensor, or microphone. The sensor 37 acquires vibration and sound waveform information at the location where the sensor 37 is installed. The sensor 37 may be an acceleration sensor that can acquire vibration waveform information. The sensor 37 is preferably installed near the floor so that it can acquire vibrations or footsteps during walking.

[0035] The control unit 31 detects the person identification condition from the output of the sensor 37. For example, the control unit 31 detects a vibration pattern set as the person identification condition from waveform information of vibrations and sounds detected by the sensor 37.

[0036] In the person identification information 34 illustrated in FIG. 3, the control unit 31 detects that person A is present in the room by detecting vibration pattern A. The control unit 31 detects that person B is present in the room by detecting vibration pattern B. The control unit 31 detects that person C is present in the room by detecting vibration pattern C. The control unit 31 detects that person D is present in the room by detecting vibration pattern D.

[0037] When the control unit 31 detects a person identification condition from the output of the sensor 37, it detects the presence of a person corresponding to the person identification condition based on the person identification information 34. The detection result of the specific person (hereinafter also referred to as the "specific person detection result") is acquired by the home appliance 1, smartphone 6, etc. that requires the specific person detection result, directly or via the server 7, etc.

[0038] [Access Point 4] The access point 4 is installed in the home HO and has the function of communicating via a wireless LAN communication WC1 such as WiFi or via a wired LAN communication. The access point 4 communicates with the home equipment 1 via the wireless LAN communication WC1 or via a wired LAN communication. The access point 4 relays communication with the home equipment 1 via the wireless LAN communication WC1 or the wired LAN communication to the network NW via the Internet provider ISP.

[0039] [Smartphone 6] FIG. 4 is a functional block diagram of the smartphone 6. The smartphone 6 is an example of a mobile terminal or a terminal device. The mobile terminal or the terminal device is not limited to the smartphone 6, and may be, for example, a mobile phone, a smart watch, a tablet terminal, a personal computer, or the like.

[0040] The smartphone 6 includes a control unit 61 , a wireless communication unit 62 , a touch panel 63 , a camera 64 , and a microphone 65 .

[0041] The control unit 61 is a computer capable of executing programs, including a processor such as a CPU, a memory into which programs can be read, a storage unit into which programs and data can be stored, and an input / output control unit. The functions of the control unit 61 are realized by the processor executing a program provided to the control unit 61. The program provided to the control unit 61 is also referred to as an application. The control unit 61 controls the wireless communication unit 62, the touch panel 63, the camera 64, and the microphone 65.

[0042] The wireless communication unit 62 has an antenna and the like, and has the function of communicating via wireless LAN communication WC1 such as WiFi, the function of communicating via short-range wireless communication WC2 such as Bluetooth (registered trademark), ZigBee (registered trademark), or NFC (Near field communication), and the function of communicating via high-speed wireless communication WC3 that can be connected to a network NW using a fourth-generation communication standard, a fifth-generation communication standard, or the like.

[0043] The wireless communication unit 62 is capable of communicating with the household equipment 1, the control device 2, and the access point 4 via wireless LAN communication WC1 (LAN) based on instructions from the control unit 61. The wireless communication unit 62 is capable of communicating with the household equipment 1 and the control device 2 via short-range wireless communication WC2 (PAN) based on instructions from the control unit 61. The wireless communication unit 62 is capable of communicating with the device management server 8 and the user management server 9 via high-speed wireless communication WC3 connected to a base station and the network NW based on instructions from the control unit 61.

[0044] The touch panel 63 is, for example, a capacitance type touch panel. An input operation input by a user to the touch panel is acquired by the control unit 61. The touch panel 63 displays a display screen based on an instruction from the control unit 61. The touch panel 63 functions as an operation unit for inputting operations and a display unit for displaying a display screen.

[0045] The smartphone 6 has installed thereon a smart home application AP, which is an application that provides comfortable and convenient functions to the user by utilizing the home equipment 1 connected to the network NW.

[0046] The smart home application AP can check the status of the household equipment 1 based on a user request. The user can check the status of the household equipment 1 using the smart home application AP whether they are at home or out.

[0047] The smart home application AP can generate remote control instructions for the household equipment 1. The remote control instructions for the household equipment 1 are acquired by the device management server 8 via the network NW. The household equipment 1 performs control based on the control instructions acquired via the network NW. The user can remotely control the household equipment 1 using the smart home application AP whether at home or away from home.

[0048] The smart home application AP can register or change the person identification information 34 of the person detection device 3 by communicating with the person detection device 3 via the network NW or by communicating with the person detection device 3 by short-range wireless communication WC2.

[0049] The smart home application AP acquires the detection result of the specific person or the like detected by the human detection device 3, and notifies the user of the detection result by displaying it on the touch panel 63, for example.

[0050] [Server 7] The server 7 is configured, for example, by one or more servers and can be connected to a network NW. The server includes hardware such as a processor such as a CPU, memory, recording media such as a hard disk or flash memory, and a communication device. The functions of the server 7 are realized by a program executed in the server's processor. The server may be an on-site server, or a cloud server that provides IaaS (Infrastructure as a Service), PaaS (Platform as a Service), SaaS (Software as a Service), or the like, or a server that combines these. In the following description, "server" includes any of the above servers.

[0051] The server 7 includes a device management server 8 and a user management server 9. The device management server 8 and the user management server 9 may be the same server.

[0052] [Device Management Server 8] The device management server 8 is a server that manages the household equipment 1. The device management server 8 acquires control instructions for the household equipment 1 that are generated in the smart home application AP. The control instructions for the household equipment 1 are acquired by the household equipment 1.

[0053] The device management server 8 acquires the status of the household equipment 1 based on a user request. The status of the household equipment 1 is acquired by the smart home application AP.

[0054] [User Management Server 9] The user management server 9 is configured by, for example, one or more servers and can be connected to a network NW. The functions of the user management server 9 are realized by a program executed in a processor of the server.

[0055] The user management server 9 is a server that manages the registration of users who can use the home system 100 (hereinafter also referred to as "user registration"). The user management server 9 assigns a user code to a registered user. The user code is a code that is unique in the home system 100 and is a code that identifies a user in the home system 100. The user code is, for example, a user ID.

[0056] User registration is information that is recorded by associating a user code that identifies a user with the household equipment 1, etc. (including the control device 2 and the person detection device 3) that the user can use. User registration may be recorded collectively for multiple household equipment 1, etc. installed in the home HO, or may be recorded separately for each household equipment 1, etc. A registered user can use the associated household equipment 1, etc.

[0057] A user of the home system 100 can obtain a user code from the user management server 9. The user code obtained by the user is registered in the smart home application AP of the smartphone 6. The user code is also recorded in the device management server 8. Control instructions for the household equipment 1, etc., generated by the user in the smart home application AP are obtained by the device management server 8 and the household equipment 1, etc., which are associated based on the user code.

[0058] Next, a description will be given of advance preparation for the home system 100. Fig. 5 is a flowchart showing an example of a method for setting the person identification information .

[0059] The user can set the person identification information 34 of the person detection device 3 using the smart home application AP of the smartphone 6. The user executes a program for setting person identification conditions for the person identification information 34 in the smart home application AP.

[0060] In step S110, the control unit 61 of the smartphone 6 displays a message prompting the user to select a person identification type of the person identification condition to be set on the touch panel 63. The user operates the touch panel 63 to select a person identification type of the person identification condition to be set. The control unit 61 acquires the person identification type of the person identification condition to be set.

[0061] In step S120, the control unit 61 of the smartphone 6 displays on the touch panel 63 a message urging the user to generate vibrations by walking near the human detection device 3. The user walks near the human detection device 3 to generate vibrations or footsteps. The control unit 31 of the human detection device 3 acquires vibration waveform information from the output of the sensor 37. The control unit 61 acquires the vibration waveform information from the human detection device 3.

[0062] In step S130, the control unit 61 of the smartphone 6 learns a vibration pattern that captures vibration characteristics from the acquired vibration waveform information. Generally, to learn a vibration pattern that captures vibration characteristics from vibration waveform information, waveform information of similar vibrations is required. Learning of the vibration pattern may be signal processing that detects a common pattern from multiple pieces of waveform information, or may be machine learning. Learning of the vibration pattern may be performed by the server 7.

[0063] In step S140, the control unit 61 of the smartphone 6 determines whether learning of the vibration pattern is complete. For example, if the number of pieces of vibration waveform information used in learning is insufficient, the control unit 61 determines that learning of the vibration pattern is not complete. If learning of the vibration pattern is not complete, the control unit 61 executes step S130 again to prompt the user to walk near the person detection device 3 again to generate vibrations or footsteps, and generates similar vibrations or footsteps.

[0064] In step S150, the control unit 61 of the smartphone 6 registers the vibration pattern for which learning has been completed as a person identification condition for the set person identification type. The person identification condition is recorded in the recording unit 33 of the person detection device 3.

[0065] Hereinafter, the operation of the home system 100 will be described with reference to the sequence diagram of the home system 100 shown in FIG.

[0066] In step S210, the human detection device 3 detects a human identification condition from the output of the sensor 37. When the control unit 31 detects the human identification condition from the vibration information acquired by the sensor 37, it detects the presence of a specific human corresponding to the human identification condition based on the human identification information 34.

[0067] The server 7 acquires the specified person detection result from the human detection device 3 in step S220.

[0068] In step S230, the household equipment 1 or the smartphone 6 obtains the specified person detection result from the server 7. The household equipment 1 in the section where the specified person is present performs a predetermined operation set in accordance with the presence of the specified person. For example, the household equipment 1 operates the air conditioner 1E in the room where the presence of the specified person is detected.

[0069] The smartphone 6 updates information about whether family members are at home or not in, for example, a smart home application AP. For example, a user can monitor a specific person living in the home HO from a location far away from the home HO. For example, the user can know in the smart home application AP that an elderly person living in the home HO has left their room.

[0070] When the sensor 37 acquires vibration information but fails to detect the person identification condition, the human detection device 3 can detect that a person other than a person pre-registered in the person identification information 34 is present in the house HO. That is, the human detection device 3 can detect a person other than a specific person. The result of detecting a person other than a specific person is acquired by, for example, the smartphone 6, and a warning to that effect is notified to the user.

[0071] According to the home system 100 of this embodiment, it is possible to more easily grasp whether a specific resident is at home or not by using the person identification information 34. In this way, the home system 100 can accurately grasp the presence / absence status of a person at home in the residence HO based on the pre-registered person identification information 34. Even if the specific person is a user who does not use a device capable of acquiring location information such as a GPS, the home system 100 can easily identify the specific person by the vibration pattern for identifying the specific person and grasp the presence / absence status of the specific person residing in the residence HO, thereby improving convenience for the user. Furthermore, when the home system 100 sensor 37 acquires vibration information but is unable to detect the person identification condition, it is possible to detect the presence of a person other than the specific person. In this way, the home system 100 can detect the presence of not only the specific person residing in the house HO, but also the presence of a person other than the specific person, making it possible to detect a person who is not a resident of the house HO (for example, an intruder).

[0072] While one embodiment of the present disclosure has been described above in detail with reference to the drawings, the specific configuration is not limited to this embodiment and includes design modifications within the scope of the present disclosure. Furthermore, the components shown in the above-described embodiment and modifications can be configured in any suitable combination.

[0073] The programs for the smartphone 6, server 7, and the like are recorded on a computer-readable recording medium. The programs recorded on the recording medium are loaded into a computer system and executed. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. Furthermore, "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into computer systems. Furthermore, "computer-readable recording medium" may also include devices that dynamically store programs for a short period of time, such as communication lines used when transmitting programs over a network such as the Internet or a telephone line, or devices that store programs for a fixed period of time, such as volatile memory within a computer system that serves as a server or client. The programs may also be designed to implement some of the functions described above, or may be capable of implementing the functions in combination with programs already stored in the computer system, or may be implemented using a programmable logic device such as an FPGA (Field Programmable Gate Array). [Explanation of symbols]

[0074] 100...home system, AP...smart home application, 1...home appliance, 2...control device, 3...person detection device, 4...access point, 6...smartphone, 7...server, 8...device management server, 9...user management server

Claims

1. a person detection device having a sensor capable of acquiring vibration information and capable of acquiring person identification information; a terminal device capable of communicating with the human detection device; Equipped with The person identification information is information that associates a person identification condition for identifying a person with a specific person, when the person detection device detects the person identification condition from the vibration information acquired by the sensor, it detects the presence of the specific person corresponding to the person identification condition; the terminal device acquires a detection result of the presence of the specific person; Home system.

2. the human detection device has a recording unit that records at least a part of the human identification information, The home system of claim 1 .

3. a server that can communicate with the terminal device and the human detection device, the server acquires the detection result from the human detection device; The terminal device acquires the detection result from the server. The home system of claim 1 .

4. the person identification condition is that a predetermined vibration pattern is detected from the vibration information; The home system of claim 1 .

5. The predetermined vibration pattern is acquired by learning based on vibration information during walking that is acquired in advance by the sensor. The home system of claim 4.

6. When the sensor acquires the vibration information and the person identification condition cannot be detected, the person detection device detects the presence of a person other than a specific person pre-registered in the person identification information. The home system of claim 1 .

7. a sensor capable of acquiring vibration information; a control unit capable of acquiring person identification information; Equipped with The person identification information is information that associates a person identification condition for identifying a person with a specific person, when the control unit detects the person identification condition from the vibration information acquired by the sensor, it detects the presence of the specific person corresponding to the person identification condition. Person detection device.

8. the person detection device has a recording unit that records at least a part of the person identification information; The human detection device according to claim 7 .

9. the person identification condition is that a predetermined vibration pattern is detected from the vibration information; The human detection device according to claim 7 .

10. The predetermined vibration pattern is acquired by learning based on vibration information during walking that is acquired in advance by the sensor. The human detection device according to claim 9 .

11. when the sensor acquires the vibration information and the person identification condition cannot be detected, the control unit detects the presence of a person other than a specific person registered in advance in the person identification information. The human detection device according to claim 7 .

12. The vibration information acquired by the sensor is acquired, Acquire person identification information that associates a person identification condition for identifying a person with the specific person; When the person identification condition is detected from the vibration information acquired by the sensor, the presence of the specific person corresponding to the person identification condition is detected. Person detection methods.

13. Acquire vibration information acquired by the sensor, acquiring person identification information that associates a person identification condition for identifying a person with the specific person; when the person identification condition is detected from the vibration information acquired by the sensor, the presence of the specific person corresponding to the person identification condition is detected. People detection program.

Images