Monitoring system, server and monitoring method

The monitoring system uses smart home device and elevator operation data to reliably detect an individual's behavior, addressing privacy concerns and improving detection accuracy for elderly monitoring.

JP7760041B2Active Publication Date: 2025-10-24MITSUBISHI ELECTRIC CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2024507350
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-03-17
Publication Date
2025-10-24
Estimated Expiration
2042-03-17

AI Technical Summary

Technical Problem

Existing monitoring systems for elderly individuals struggle to reliably detect whether they have left their home while respecting their privacy, as methods like motion sensors or GPS-equipped devices can be costly or unreliable.

Method used

A monitoring system that utilizes device information from smart home appliances and elevator operation data to estimate the behavior of the individual, improving reliability and privacy by analyzing the operation patterns of these devices and elevators.

Benefits of technology

Enhances the reliability of detecting whether the individual has left or returned home while maintaining privacy, allowing for accurate notification to relevant parties.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007760041000001
    Figure 0007760041000001
  • Figure 0007760041000002
    Figure 0007760041000002
  • Figure 0007760041000003
    Figure 0007760041000003
Patent Text Reader

Abstract

This monitoring system includes: a device information acquisition unit (201) that acquires device information related to operation of a device installed in a residence; an elevator information acquisition unit (202) that acquires elevator information related to operation of an elevator installed in a building to which the residence belongs; a device information storage unit (241) that stores the device information; an elevator information storage unit (242) that stores the elevator information; and an action estimation unit (203) that estimates an action of a person to be watched on the basis of the device information stored in the device information storage unit (241) and the elevator information stored in the elevator information storage unit (242).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a monitoring system, a server, and a monitoring method. [Background technology]

[0002] Various proposals have been made so far regarding technologies for monitoring elderly people, such as elderly people living alone. For example, Patent Document 1 describes a safety confirmation system that keeps track of the behavior of a person being monitored by checking whether a lighting device installed in the home of the person being monitored is turned on or off, so that the person being monitored does not become aware that they are being monitored.

[0003] In this safety confirmation system, a cloud server references the on / off history of lighting devices in the home of the person being watched over, and generates safety information according to pre-registered safety notification rules.The cloud server then transmits the generated safety information to external devices carried by the person being watched over, such as family members living separately from the person being watched over, or watchers such as care managers. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-218969 Summary of the Invention [Problem to be solved by the invention]

[0005] In such monitoring, it is important to detect not only the behavior of the person being monitored within the home, but also whether the person being monitored has gone out.

[0006] In this case, for example, by installing motion sensors throughout the house, it is possible to detect with high accuracy when the person being watched over leaves the house. However, this is costly and there is a concern that it may cause discomfort to the person being watched over.

[0007] Furthermore, if the person being watched over always carries a mobile phone, smartphone, or other mobile device equipped with a GPS (Global Positioning System) function, it is possible to ascertain the person being watched over's current location and therefore to confirm whether the person being watched over has gone out. However, there is a problem in that the person being watched over does not always carry the mobile device, making it unreliable as a basis for determining whether the person being watched over has gone out.

[0008] Therefore, there is a need to propose new technology that can improve reliability while respecting privacy when detecting whether a person being monitored is out or not.

[0009] The present disclosure has been made in consideration of the above-mentioned situation, and aims to provide a monitoring system, server, and monitoring method that can improve reliability while respecting privacy in detecting whether a person being monitored is out or not. [Means for solving the problem]

[0010] In order to achieve the above object, the monitoring system according to the present disclosure includes: of the person being watched a device information acquisition means for acquiring device information relating to the operation of devices installed in the home; an elevator information acquisition means for acquiring elevator information relating to the operation of an elevator installed in a building to which the residence belongs; device information storage means for storing the device information; an elevator information storage means for storing the elevator information; Based on the equipment information stored in the equipment information storage means and the elevator information stored in the elevator information storage means, The aforementioned The monitoring device further includes a behavior estimation means for estimating the behavior of the person being watched over. [Effects of the Invention]

[0011] According to the present disclosure, the behavior of the person being monitored is estimated based on device information regarding the operation of devices installed in the home and elevator information regarding the operation of elevators installed in the building to which the home belongs, making it possible to improve reliability in detecting whether the person being monitored is out or not while respecting privacy. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 shows an overall configuration of a monitoring system according to a first embodiment. [Figure 2] FIG. 1 is a block diagram showing a hardware configuration of a cloud server according to a first embodiment. [Figure 3] FIG. 1 is a block diagram showing a hardware configuration of a user terminal according to a first embodiment. [Figure 4] FIG. 1 is a block diagram showing a functional configuration of a cloud server according to a first embodiment. [Figure 5] FIG. 1 is a diagram showing the relationship between the estimated behavior of a subject and requirements in the first embodiment. [Figure 6] FIG. 10 is a diagram showing an example of a user notification screen according to the first embodiment. [Figure 7] FIG. 10 is a diagram showing an example of a user notification screen according to the first embodiment. [Figure 8] FIG. 10 is a diagram showing an example of a user notification screen according to the first embodiment. [Figure 9] 1 is a flowchart showing a procedure of a monitoring process according to the first embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a user notification screen according to a modification of the first embodiment. [Figure 11] FIG. 10 is a diagram showing an example of a user notification screen according to a modification of the first embodiment. [Figure 12] FIG. 10 is a diagram showing the overall configuration of a monitoring system according to a second embodiment. [Figure 13] A block diagram showing the functional configuration of a cloud server according to a second embodiment. [Figure 14] Flowchart showing the procedure of elevator call processing in the second embodiment DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

[0014] (Embodiment 1) FIG. 1 is a diagram showing the overall configuration of a monitoring system 1 according to a first embodiment of the present disclosure. The monitoring system 1 is an example of a monitoring system according to the present disclosure, and is a system for monitoring a resident of a house H (hereinafter referred to as a "subject"), who is an example of a person to be monitored according to the present disclosure. The monitoring system 1 includes a cloud server 2, a device 3 and a router 4 installed in the house H, an elevator management device 5 installed in a building B, such as an apartment building, to which the house H belongs, and a user terminal 6. The house H is located on the second or higher floor of the building B.

[0015] <Cloud Server 2> The cloud server 2 is an example of a server according to the present disclosure. The cloud server 2 is a server computer installed and operated by a manufacturer, a sales company, or the like of the device 3 and the elevator E installed in the building B, and is connected to a network N, which is a wide area network such as the Internet. As shown in FIG. 2 , the cloud server 2 includes a communication interface 20, a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, and an auxiliary storage device 24. These components are connected to each other via a bus 25.

[0016] The communication interface 20 is hardware for communicating with other devices via the network N. The CPU 21 performs overall control of the cloud server 2. The functions of the cloud server 2 realized by the CPU 21 will be described in detail later. The ROM 22 stores multiple pieces of firmware and data used when these pieces of firmware are executed. The RAM 23 is used as a working area for the CPU 21.

[0017] The auxiliary storage device 24 is composed of a readable / writable nonvolatile semiconductor memory, an HDD (Hard Disk Drive), etc. Examples of the readable / writable nonvolatile semiconductor memory include an EEPROM (Electrically Erasable Programmable Read-Only Memory), a flash memory, etc. The auxiliary storage device 24 stores various programs, including a program (hereinafter referred to as a "monitoring program") for monitoring the behavior of the subject who is a resident of the residence H and notifying related parties of the subject of information based on the monitoring results, and data used when these programs are executed. Related parties include, for example, the subject's relatives, a person in charge of a care support service, a person in charge of the company that manages building B, etc.

[0018] Cloud server 2 can acquire the above-mentioned monitoring program or an update program for updating the monitoring program from another server by communication via network N. These programs can also be stored and distributed on a computer-readable recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD (Digital Versatile Disc), a magneto-optical disk, a USB (Universal Serial Bus) memory, a HDD, an SSD (Solid State Drive), or a memory card. When such a recording medium is directly or indirectly attached to the cloud server 2, the cloud server 2 can read and import the monitoring program or update program from the recording medium.

[0019] <Device 3> Device 3 is an example of a device according to the present disclosure. Device 3 is, for example, a home appliance known as an IoT (Internet of Things) device, an information appliance, a network appliance, or a smart appliance, such as an air conditioner, a lighting device, or a television. Device 3 is wirelessly connected to router 4, which is a wireless LAN (Local Area Network) router such as Wi-Fi (registered trademark), and includes hardware for communicating with cloud server 2 via router 4.

[0020] The device 3 transmits information about its own operation (hereinafter referred to as "device information") to the cloud server 2 at regular intervals (for example, every minute). The device information includes identification information that can uniquely identify the device 3, the current date and time, information indicating the operating status, measurement results of sensors (for example, thermal image sensors such as infrared thermography, temperature sensors, etc.) equipped in the device 3, etc. The identification information of the device 3 is, for example, the serial number and IP address of the device 3.

[0021] The operating state includes information indicating whether the device 3 is operating or stopped, and the details of the operation. For example, if the device 3 is an air conditioner, the details of the operation include an operating mode indicating cooling, heating, ventilation, dehumidification, etc., and settings such as a set temperature, air speed, and timer settings. If the device 3 is a lighting device, the details of the operation include an output level, etc., and if the device 3 is a television, the details of the operation include a channel, volume, etc. The device 3 may be configured to communicate with the cloud server 2 via an external communication adapter (not shown).

[0022] <Elevator control device 5> The elevator control device 5 is a computer that controls the operation of the elevator E installed in the building B. The elevator control device 5 includes hardware for communicating with the cloud server 2 via the network N. The elevator control device 5 transmits information about the operation of the elevator E (hereinafter referred to as "elevator information") to the cloud server 2 at regular intervals (for example, every minute). The elevator information includes identification information that can uniquely identify the elevator E, the current date and time, destination designation information that indicates the destination designated by the user of the elevator E, and the operation record of the elevator E during that regular period.

[0023] <User terminal 6> The user terminal 6 is an example of a terminal device according to the present disclosure. The user terminal 6 is an electronic device carried by the above-mentioned related person, and is, for example, a smart device such as a smartphone or a tablet terminal.

[0024] 3, the user terminal 6 includes a display 60, an operation reception unit 61, a communication interface 62, a CPU 63, a ROM 64, a RAM 65, and an auxiliary storage device 66. These components are connected to each other via a bus 67.

[0025] The display 60 includes a display device such as a liquid crystal display, an organic EL (Electro Luminescence) display, etc. Under the control of the CPU 63, the display 60 displays various screens etc. in response to operations by a user (i.e., a person related to the subject).

[0026] The operation receiving unit 61 includes one or more input devices such as a push button, a touch panel, a touch pad, etc., receives an operation input from a user, and outputs a signal related to the received operation to the CPU 63.

[0027] The communication interface 62 is hardware for communicating with other devices via the network N. The CPU 63 performs overall control of the user terminal 6. The ROM 64 stores multiple pieces of firmware and data used when these pieces of firmware are executed. The RAM 65 is used as a work area for the CPU 63.

[0028] The auxiliary storage device 66 is configured to include a readable / writable nonvolatile semiconductor memory such as an EEPROM, a flash memory, etc. The auxiliary storage device 66 stores various programs including an application program (hereinafter referred to as a "monitoring app") for receiving the monitoring service provided by the monitoring system 1, and data used when these programs are executed.

[0029] The user terminal 6 can acquire the watching app or an update program for updating the watching app from the cloud server 2 or another server via communication. These programs can also be stored and distributed on a computer-readable recording medium such as a CD-ROM, DVD, optical magnetic disk, USB memory, HDD, SSD, or memory card. When such a recording medium is directly or indirectly attached to the user terminal 6, the user terminal 6 may read and acquire the watching app or update program from the recording medium.

[0030] <Functional configuration of cloud server 2> Fig. 4 is a block diagram showing the functional configuration of cloud server 2. As shown in Fig. 4, cloud server 2 includes setting reception unit 200, device information acquisition unit 201, elevator information acquisition unit 202, behavior estimation unit 203, and notification unit 204. These functional units are realized by CPU 21 executing the above-mentioned monitoring program stored in auxiliary storage device 24.

[0031] The setting reception unit 200 receives settings for information related to the monitoring service from users who are involved. The user can use the monitoring app to set various pieces of information via the user terminal 6. For example, the user can set the name of the target person, the target person's address, identification information of the device 3, notification conditions, etc. via the user terminal 6. The identification information of the device 3 can be automatically acquired and set from the device 3 by the user using the monitoring app at the target person's residence H. The setting reception unit 200 stores the setting information related to the settings received from the user in the setting information storage unit 240. The setting information storage unit 240 is a memory area provided by the auxiliary storage device 24.

[0032] The device information acquisition unit 201 is an example of a device information acquisition means according to the present disclosure. The device information acquisition unit 201 receives and acquires the above-mentioned device information sent from the device 3 installed in the subject's home H. The device information may be sent from the device 3 in response to a request from the cloud server 2, or may be sent spontaneously from the device 3. The device information acquisition unit 201 sorts the acquired device information in chronological order and stores it in the device information storage unit 241. In other words, the device information storage unit 241 stores a history of the device information. The device information storage unit 241 is a memory area provided by the auxiliary storage device 24, and is an example of a device information storage means according to the present disclosure.

[0033] The elevator information acquisition unit 202 is an example of an elevator information acquisition means according to the present disclosure. The elevator information acquisition unit 202 receives and acquires the above-mentioned elevator information sent from an elevator management device 5 installed in the building B to which the subject's residence H belongs. The elevator information may be sent from the elevator management device 5 in response to a request from the cloud server 2, or may be sent spontaneously from the elevator management device 5. The elevator information acquisition unit 202 sorts the acquired elevator information in chronological order and stores it in the elevator information storage unit 242. In other words, the elevator information storage unit 242 stores the history of the elevator information. The elevator information storage unit 242 is a memory area provided by the auxiliary storage device 24, and is an example of an elevator information storage means according to the present disclosure.

[0034] The behavior estimation unit 203 is an example of a behavior estimation means according to the present disclosure. The behavior estimation unit 203 estimates the behavior of the subject based on the device information stored in the device information storage unit 241 and the elevator information stored in the elevator information storage unit 242. In detail, the behavior estimation unit 203 estimates the behavior of the subject based on the history of the device information and elevator information and the previous estimation result. In this embodiment, the behavior estimation unit 203 estimates the behavior of the subject as going out, coming home, being out, or being at home. Each estimation method will be described below.

[0035] <Presumed outing> 5, if the previous estimation result was that the subject was at home and elevator E arrived at the subject's residential floor and moved to the first floor within a first hour or more and a second hour after the operation state of device 3 changed from operating to stopped, the behavior estimation unit 203 estimates that the requirements for going out are met and that the subject has gone out. The first and second times mean, for example, the following times. That is, assuming that the subject's behavior when the operation state of device 3 changed from operating to stopped was leaving house H or starting preparations to go out, the first time means the shortest time required from the subject leaving house H to using elevator E, and the second time means the longest time required from the subject starting preparations to go out to using elevator E.

[0036] For example, the user can determine the first time and the second time from the daily behavior of the subject person and set them in the cloud server 2 using a monitoring app. Alternatively, the user can set the distance from the entrance of the house H to the elevator landing on the living floor using the monitoring app, and the cloud server 2 can determine the first time and the second time based on the set distance. Alternatively, the cloud server 2 can derive the first time and the second time by learning.

[0037] If the operation state of the device 3 changes from an operating state to a stopped state due to a previous timer setting, the behavior inferring unit 203 may determine that the requirements for going out are not met. Furthermore, if the device 3 is equipped with a human presence sensor such as a thermal image sensor, the behavior inferring unit 203 may infer that the target person has gone out if the human detection result of the human presence sensor changes from detected to not detected, or even if the operation state of the device 3 has not changed from operating to stopped, as long as the other above conditions are met.

[0038] <Estimated return home> 5, the activity inferrer 203 infers that the subject has returned home if the previous inference result was that the subject was out and the operation state of the device 3 changed from a stopped state to an operating state, satisfying the requirement for returning home. Note that if the operation state of the device 3 changed from a stopped state to an operating state due to a pre-set timer, the activity inferrer 203 may determine that the requirement for returning home is not satisfied. Furthermore, if the device 3 is equipped with a human presence sensor such as a thermal image sensor, the activity inferrer 203 infers that the subject has returned home if the previous inference result was that the subject was out and the human detection result of the human presence sensor changed from undetected to detected, regardless of the operation state of the device 3.

[0039] <Assumed to be out> As shown in FIG. 5, the behavior estimation unit 203 estimates that the subject is out when the previous estimation result is out or out and the above-mentioned requirement for returning home is not satisfied.

[0040] <Estimation of at home> As shown in FIG. 5, the activity estimation unit 203 estimates that the subject is at home if the previous estimation result is that the subject has returned home or is at home and the above-mentioned conditions for going out are not met.

[0041] The behavior estimation unit 203 sorts behavior information including the current date and time and the estimation result in chronological order and stores the sorted information in the behavior information storage unit 243. That is, the behavior information storage unit 243 stores a history of the behavior information. The behavior information storage unit 243 is a memory area provided by the auxiliary storage device 24.

[0042] The notification unit 204 is an example of a notification means according to the present disclosure. The notification unit 204 notifies the user, who is a related party, of information related to the monitoring based on the estimation result by the behavior estimation unit 203. For example, when there is a change in the behavior of the target person, the notification unit 204 generates notification information including information indicating that the target person has gone out or returned home and the current time, and transmits the notification information to the user terminal 6. Upon receiving the notification information, the user terminal 6 displays a user notification screen such as that shown in FIG. 6 on the display 60, for example, by push notification.

[0043] Also, for example, if the target person goes out at a time different from the planned outing time period previously set by the user, the notification unit 204 generates notification information including information indicating this and the current time, and transmits it to the user terminal 6.

[0044] Furthermore, for example, even if there is no change in behavior, the notification unit 204 generates notification information including information indicating whether the user is at home or out and the current time at regular intervals, and transmits the generated notification information to the user terminal 6. FIG. 7 shows an example of a user notification screen displayed on the display 60 of the user terminal 6 in this case. The user can use the monitoring app to set in advance whether or not to receive notification information at regular intervals. The user can also use the monitoring app to set in advance the time interval for receiving notification information at regular intervals. The user can also use the monitoring app to set in advance the time period for receiving notification information at regular intervals.

[0045] Furthermore, for example, if the user continues to stay out beyond a predetermined upper limit of time for going out, the notification unit 204 generates notification information including information indicating that fact and the current time, and transmits the notification information to the user terminal 6. An example of a user notification screen displayed on the display 60 of the user terminal 6 in this case is shown in Fig. 8. The user can use the monitoring app to set the upper limit of time for going out in advance.

[0046] Furthermore, the notification unit 204 may generate notification information indicating the current situation of the subject or the history of the subject's actions in response to the user's operation using the watching app, and transmit the notification information to the user terminal 6. In this case, when the user terminal 6 receives the notification information, the watching app displays a screen based on the notification information.

[0047] <Monitoring process> 9 is a flowchart showing the procedure of the monitoring process executed by the cloud server 2. The cloud server 2 executes the following monitoring process at regular time intervals (for example, every minute).

[0048] (Step S100) The cloud server 2 acquires the device information from the device 3. After that, the process of the cloud server 2 transitions to step S101.

[0049] (Step S101) Cloud server 2 acquires elevator information from elevator control device 5. After that, the processing of cloud server 2 transitions to step S102.

[0050] (Step S102) Cloud server 2 estimates the behavior of the subject person based on the history of device information, the history of elevator information, and the previous estimation result. After that, the process of cloud server 2 proceeds to step S103.

[0051] (Step S103) The cloud server 2 determines whether or not a notification is necessary for the user. Whether or not a notification is necessary is determined based on whether or not there is a change in behavior and the setting information stored in the setting information storage unit 240. As a result, if a notification is necessary (step S103; YES), the processing of the cloud server 2 proceeds to step S104. On the other hand, if a notification is not necessary (step S103; NO), the cloud server 2 ends the monitoring processing for this cycle.

[0052] (Step S104) Cloud server 2 generates the notification information. After that, the process of cloud server 2 proceeds to step S105.

[0053] (Step S105) The cloud server 2 transmits the generated notification information to the user terminal 6. After that, the cloud server 2 ends the monitoring process for this cycle. Upon receiving the notification information, the user terminal 6 displays a user notification screen as shown in FIG. 6 on the display 60 by, for example, push notification.

[0054] As described above, in the monitoring system 1 of this embodiment, the behavior of the target person is estimated based on device information related to the operation of the device 3 installed in the residence H and elevator information related to the operation of the elevator E installed in the building B to which the residence H belongs. This makes it possible to improve the reliability of detecting whether the target person has gone out while respecting their privacy.

[0055] In addition, based on the estimated behavior of the subject, meaningful information regarding monitoring is appropriately notified to relevant parties such as the subject's relatives, enabling those parties to monitor the subject appropriately.

[0056] (Variation 1) The device 3 is not limited to a home appliance, and may be, for example, a human presence sensor that detects a person using infrared rays, visible light, sound waves, or sound sense. The router 4 may also function as the device 3. That is, the router 4 may transmit device information, which is information related to its own operation, to the cloud server 2 at regular intervals (for example, every minute).

[0057] (Variation 2) A plurality of devices 3 may be installed in the subject's home H, and be communicatively connected to the cloud server 2. In this case, if there are a plurality of devices 3 equipped with human sensors, and if any of the human sensors detects a person, the behavior estimation unit 203 of the cloud server 2 excludes "out" and "out" from the subject's behavior.

[0058] (Variation 3) The device 3 may transmit the device information to the cloud server 2 spontaneously when triggered by a change in its operating state, rather than transmitting the device information to the cloud server 2 at regular time intervals. In this case, the device 3 equipped with a human presence sensor spontaneously transmits the device information to the cloud server 2 not only when its operating state changes, but also when the detection result of the human presence sensor changes.

[0059] (Variation 4) The cloud server 2 may send the notification information to the user terminal 6 by email.

[0060] (Variation 5) There may be multiple related parties for one target person. In this case, the cloud server 2 transmits the same notification information to the user terminal 6 of each related party.

[0061] (Variation 6) If the subject possesses a terminal device similar to the user terminal 6 (see Figure 3) and a monitoring app is installed on the terminal device, the setting reception unit 200 of the cloud server 2 may receive settings for information regarding the monitoring service not only from related parties but also from the subject, and the notification unit 204 may send notification information to the terminal device.

[0062] (Variation 7) The notification unit 204 may generate notification information taking into account the device information stored in the device information storage unit 241. For example, if the target person goes out without stopping the operation of the device 3, the notification unit 204 generates notification information including information indicating this and the current time, and transmits the notification information to the user terminal 6. FIG. 10 shows an example of a user notification screen displayed on the display 60 of the user terminal 6 in this case. Furthermore, if the target person is at home but the operation state of the device 3 remains stopped beyond a predetermined upper stop time limit, the notification unit 204 generates notification information including information indicating this and the current time, and transmits the notification information to the user terminal 6. FIG. 11 shows an example of a user notification screen displayed on the display 60 of the user terminal 6 in this case.

[0063] (Variation 8) 5, the activity inferring unit 203 may infer going out, coming home, going out, and at home, as well as getting ready to go out. Specifically, when the previous inferred result is at home and the operation state of the device 3 changes from operating to stopped (or when the detection result of a person by the human presence sensor changes from detected to undetected), the activity inferring unit 203 thereafter infers that the period from when the elevator E arrives at the floor where the subject lives until it moves to the first floor is getting ready to go out. Furthermore, when the getting ready to go out state continues for a third hour or more, the activity inferring unit 203 may determine that an abnormality such as poor health has occurred in the subject, and the notifying unit 204 may notify the user terminal 6 that an abnormality may have occurred while the subject was getting ready to go out.

[0064] Similarly, the activity estimation unit 203 may estimate the time immediately before or immediately after returning home. Specifically, when the previous estimation result was that the subject was out and the elevator E moved from the first floor to the floor where the subject lives, the activity estimation unit 203 estimates the time immediately before or immediately after returning home as the time until the operation state of the device 3 changes from a stopped state to an operating state (or until the human detection result by the human presence sensor changes from undetected to detected). Furthermore, when the time immediately before or immediately after returning home state continues for four hours or more, the activity estimation unit 203 may determine that an abnormality such as poor health has occurred in the subject, and the notification unit 204 may notify the user terminal 6 that an abnormality may have occurred immediately before or immediately after the subject returned home.

[0065] For example, the user can determine the third and fourth times from the daily behavior of the subject person and set them in the cloud server 2 using a monitoring app.

[0066] (Variation 9) The cloud server 2 may be configured with a plurality of separate servers. In this case, the cloud server 2 may be configured with, for example, a device information management server that acquires and manages device information from the device 3, an elevator information management server that acquires and manages elevator information from the elevator management device 5, and a monitoring server that monitors the target person based on the device information acquired from the device information management server and the elevator information acquired from the elevator information management server.

[0067] (Variation 10) An identification information acquisition device that acquires user identification information may be installed in the elevator E or at the boarding and alighting locations on each floor of the elevator E. The identification information acquisition device is an example of a first identification information acquisition means according to the present disclosure. The identification information acquisition device is communicatively connected to the elevator management device 5 and transmits user information, including the acquired user identification information and the current date and time, to the elevator management device 5. The elevator management device 5 transmits the user information received from the identification information acquisition device to the cloud server 2. The setting information stored in the setting information storage unit 240 of the cloud server 2 includes identification information of the target person that has been set in advance by the relevant person. In this way, the behavior estimation unit 203 of the cloud server 2 can more accurately estimate the behavior of the target person using the user information received from the elevator management device 5.

[0068] Furthermore, the cloud server 2 can know that the subject has entered the elevator E to go home, and can therefore operate the device 3 before the subject arrives home. This makes it possible to turn on the lighting device or start the air conditioning before the subject arrives home, improving the subject's comfort.

[0069] The identification information acquisition device is, for example, a receiving device that receives a wireless signal periodically transmitted by BLE (Bluetooth (registered trademark) Low Energy) communication from a mobile terminal such as a mobile phone or smartphone carried by the subject. Such a wireless signal includes the subject's identification information (e.g., ID (identifier)). Furthermore, for example, the identification information acquisition device may be an IC tag reader that reads information including the subject's identification information (e.g., ID) from an IC tag worn by the subject. Alternatively, the identification information acquisition device may be a device that collects the subject's fingerprint as the subject's identification information, or a visible camera configured with an image sensor such as a CCD (Charge-Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) that acquires a facial image of the subject as the subject's identification information.

[0070] (Variation 11) A transmitter that periodically transmits a wireless signal including floor information indicating the floor may be installed at the boarding and disembarking location of each floor of the elevator E. The transmitter is an example of a first transmitter according to the present disclosure. In this case, a mobile terminal such as a mobile phone or smartphone carried by the subject receives the wireless signal transmitted from the transmitter to acquire the floor information, and transmits location information including the subject's identification information (e.g., ID), the acquired floor information, and the current time to the cloud server 2. In this way, the behavior estimation unit 203 of the cloud server 2 can more accurately estimate the subject's behavior by using the location information received from the subject's mobile terminal.

[0071] Furthermore, the cloud server 2 can know that the subject has entered the elevator E to go home, and can operate the device 3 before the subject arrives home. This makes it possible to turn on the lighting device or start the air conditioning before the subject arrives home, improving the subject's comfort.

[0072] (Variation 12) In each of a plurality of other buildings different from building B, the identification information acquisition device of variant 10 may be installed in the elevator or at the boarding and alighting location of each elevator floor, and an elevator management device 5 similar to variant 10 may be installed. The identification information acquisition device is an example of the second identification information acquisition means according to the present disclosure. In this way, when the subject stops by any of the plurality of buildings while out and about, the notification unit 204 of the cloud server 2 can notify relevant parties of the subject's specific whereabouts.

[0073] Furthermore, by using the monitoring app, the relevant person can set in advance the building and time period that the target person is scheduled to visit, allowing the cloud server 2 to determine whether the target person is out during that time period. For example, if the target person does not visit the building during that time period, or visits a different building, the notification unit 204 of the cloud server 2 sends notification information indicating this to the user terminal 6. This allows the relevant person to know whether the target person has arrived at their destination normally.

[0074] (Variation 13) The transmitter of Variation 11 may be installed at the elevator boarding and disembarking area on each floor in each of a plurality of buildings other than building B. The transmitter is an example of a second transmitter according to the present disclosure. In this way, when a subject carrying the mobile terminal of Variation 11 stops by any of the plurality of buildings while out and about, the notification unit 204 of the cloud server 2 can notify relevant parties of the specific whereabouts of the subject.

[0075] (Variation 14) The monitoring system 1 may be applied to monitoring a resident (i.e., a subject) of a house equipped with a home elevator. In this case, the subject's home corresponds to building B, the home elevator corresponds to elevator E, and each room in the home corresponds to house H. The monitoring system 1 of this modification can monitor the subject's entry and exit from each room by using device information and elevator information of devices 3 installed in each room.

[0076] Alternatively, the monitoring system 1 may be applied to monitoring employees in an office building. In this case, the employee corresponds to the target person, the office building corresponds to building B, the elevator in the office building corresponds to elevator E, and each room and other predetermined locations in the office building correspond to residence H. In the monitoring system 1 of this modification, by predetermining the relationship between the device 3 installed in each room etc. and the target person, the behavior of the target person in the office building can be monitored using device information and elevator information of the device 3 related to the target person. The monitoring system 1 can also be applied to monitoring one or more targets such as patients, people requiring care, students, etc. in hospitals, nursing homes, schools, etc.

[0077] (Variation 15) An IC tag reader that reads information from IC tags attached to items may be installed in elevator E, and the information read by the IC tag reader may be transmitted to cloud server 2 via elevator management device 5. In this way, it becomes possible to monitor whether items in house H are being improperly taken by a third party other than the target person.

[0078] (Variation 16) All or part of the functional units (see FIG. 4) of the cloud server 2 may be implemented by dedicated hardware, such as a single circuit, a composite circuit, a programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof.

[0079] The technical ideas according to the above-described modifications may be realized independently or in appropriate combination.

[0080] (Embodiment 2) Next, a description will be given of embodiment 2 of the present disclosure. In the following description, components and the like common to embodiment 1 will be given the same reference numerals and descriptions thereof will be omitted.

[0081] 12 is a diagram showing the overall configuration of a monitoring system 1A according to a second embodiment of the present disclosure. The monitoring system 1A is an example of a monitoring system according to the present disclosure, and is a system for monitoring a resident of a house H (hereinafter referred to as the "subject"), who is an example of a person to be monitored according to the present disclosure, and for improving the convenience of the subject when using an elevator. The monitoring system 1A includes a cloud server 2A, a device 3 and a router 4 installed in the house H, an elevator management device 5A installed in a building B, such as an apartment building, to which the house H belongs, and a user terminal 6. The house H is located on the second or higher floor of the building B.

[0082] <Cloud Server 2A> Cloud server 2A is an example of a server according to the present disclosure. Cloud server 2A is a server computer installed and operated by a manufacturer, a sales company, or the like of device 3 and elevator E installed in building B, and is connected to network N, which is a wide area network such as the Internet. The hardware configuration of cloud server 2A is the same as that of cloud server 2 in embodiment 1 (see FIG. 2). Details of the functions of cloud server 2A will be described later.

[0083] <Elevator control device 5A> The elevator control device 5A is an example of an elevator control means according to the present disclosure. The elevator control device 5A is a computer that controls the operation of an elevator E installed in a building B. Like the elevator control device 5 of the first embodiment, the elevator control device 5A includes hardware for communicating with the cloud server 2A via a network N, and transmits elevator information, which is information relating to the operation of the elevator E, to the cloud server 2A at regular intervals (for example, every minute). The elevator control device 5A also controls the elevator E to move to the floor where the target person resides, in accordance with a command from the cloud server 2A.

[0084] <Functional configuration of cloud server 2A> 13 is a block diagram showing the functional configuration of cloud server 2A. As shown in FIG. 13, cloud server 2A includes setting reception unit 200, device information acquisition unit 201, elevator information acquisition unit 202, behavior estimation unit 203, notification unit 204, and call command unit 205. These functional units are realized by CPU 21 of cloud server 2A executing a monitoring program and an elevator use support program stored in auxiliary storage device 24. The monitoring program is a program for monitoring the behavior of a subject who is a resident of house H and notifying related parties of information based on the monitoring results of the subject, and the elevator use support program is a program for supporting the subject's use of elevator E.

[0085] In cloud server 2A, the functions of setting reception unit 200, device information acquisition unit 201, elevator information acquisition unit 202, behavior estimation unit 203, and notification unit 204 are similar to those of cloud server 2 in the first embodiment.

[0086] The call command unit 205 is an example of a call command means according to the present disclosure. When it is necessary to call the elevator E to the floor where the target person lives, the call command unit 205 commands the elevator management device 5A to call the elevator E. Specifically, the call command unit 205 determines whether it is necessary to call the elevator E to the floor where the target person lives, based on the latest device information stored in the device information storage unit 241 and the setting information stored in the setting information storage unit 240.

[0087] In this embodiment, if the operating state of the device 3 changes from operating to stopped during a scheduled elevator usage time period included in the setting information, the call command unit 205 determines that it is necessary to call the elevator E to the floor where the subject lives. The scheduled elevator usage time period is a time period when the subject is likely to use the elevator E, and is set in advance by the user, who is a related party, via the monitoring app.

[0088] In addition, if the equipment 3 is equipped with a human presence sensor such as a thermal image sensor, the call command unit 205 may determine that it is necessary to call the elevator E to the floor where the target person lives if the detection result by the human presence sensor changes from detected to undetected, and even if the operating state of the equipment 3 has not changed from operating to stopped, as long as it is during the scheduled time period for elevator use.

[0089] When the call command unit 205 determines that it is necessary to call the elevator E to the floor where the target person resides, it generates call command information and transmits it to the elevator management device 5A. The call command information includes information indicating the call floor (i.e., the floor where the target person resides) and the scheduled use time. The scheduled use time is the time when the target person is scheduled to arrive at the elevator boarding and alighting location on the call floor. The scheduled use time is determined by adding the time required for the target person to travel (hereinafter referred to as the "required travel time") to the current time.

[0090] For example, the user can determine the travel time required from the subject's daily activities and set it in the cloud server 2A using a monitoring app. Alternatively, the user can set the distance from the entrance of the house H to the elevator stop on the living floor using the monitoring app, and the cloud server 2A can determine the travel time required based on the set distance. Alternatively, the cloud server 2A can derive the travel time required by learning.

[0091] The elevator control device 5A that has received the call command information controls the operation of the elevator E so that the elevator E arrives at the call floor by the scheduled time of use.

[0092] <Elevator call processing> 14 is a flowchart showing the procedure of elevator call processing executed by cloud server 2 A. Cloud server 2 A executes the following elevator call processing at regular time intervals (for example, every minute) in parallel with the above-mentioned monitoring processing.

[0093] (Step S200) Cloud server 2A acquires the latest device information from device information storage unit 241. After that, the process of cloud server 2A transitions to step S201.

[0094] (Step S201) Cloud server 2A reads and acquires the setting information from setting information storage unit 240. After that, the processing of cloud server 2A transitions to step S202.

[0095] (Step S202) Cloud server 2A determines whether it is necessary to call elevator E to the floor where the target person resides, based on the latest device information and the scheduled elevator usage time period included in the setting information. As a result, if it is necessary to call elevator E to the floor where the target person resides (step S202; YES), the processing of cloud server 2A transitions to step S203. On the other hand, if it is not necessary to call elevator E to the floor where the target person resides (step S202; NO), cloud server 2A ends the elevator call processing for this cycle.

[0096] (Step S203) Cloud server 2A determines the scheduled time of use based on the current time and the required travel time. After that, the process of cloud server 2A transitions to step S204.

[0097] (Step S204) Cloud server 2A generates call command information including information indicating the floor to be called and the scheduled time of use. After that, the process of cloud server 2A proceeds to step S205.

[0098] (Step S205) The cloud server 2A transmits the generated call command information to the elevator control device 5A. After that, the cloud server 2A ends the elevator call process for this cycle. Upon receiving the call command information, the elevator control device 5A controls the operation of the elevator E so that the elevator E arrives at the target user's residential floor by the target user's scheduled usage time.

[0099] As described above, in the monitoring system 1A of this embodiment, the behavior of the target person is estimated based on device information related to the operation of the device 3 installed in the residence H and elevator information related to the operation of the elevator E installed in the building B to which the residence H belongs. This makes it possible to improve the reliability of detecting whether the target person has gone out while respecting their privacy.

[0100] In addition, based on the estimated behavior of the subject, meaningful information regarding monitoring is appropriately notified to relevant parties such as the subject's relatives, enabling those parties to monitor the subject appropriately.

[0101] Furthermore, when the subject goes out, the elevator E can be automatically moved to the subject's residential floor, which significantly improves convenience for the subject when going out.

[0102] (Variation 1) The monitoring system 1A may be configured to include the configuration of variant example 12 in embodiment 1, and when the behavior estimation unit 203 estimates that the subject person has stopped by any of the above-mentioned multiple buildings while going out, the call command unit 205 may call elevator E to the first floor.

[0103] In this case, the call command unit 205 may call elevator E to the first floor when a predetermined required time for returning home corresponding to the building has elapsed since the behavior estimation unit 203 estimated that the subject has stopped by any of the plurality of buildings. The user can use the monitoring app to set the required time for returning home corresponding to each building in the cloud server 2A. In this way, when the subject who has stopped by any of the plurality of buildings arrives at building B on his / her way home, there is a high possibility that he / she will be able to immediately use elevator E, thereby significantly improving convenience for the subject when returning home.

[0104] (Variation 2) The monitoring system 1A may be configured to have the configuration of variant example 13 in embodiment 1, and when the behavior estimation unit 203 estimates that the subject person has stopped by any of the above-mentioned multiple buildings while going out, the call command unit 205 may call elevator E to the first floor.

[0105] In this case, similar to the above-described first modification, the call command unit 205 may call elevator E to the first floor when a predetermined required time for returning home corresponding to the building has elapsed since the behavior estimation unit 203 estimated that the subject has stopped by any of the plurality of buildings. In this way, when the subject who has stopped by any of the plurality of buildings arrives at building B on his / her way home, there is a high possibility that he / she will be able to immediately use elevator E, thereby significantly improving convenience for the subject when returning home. (Variation 3) All or part of the functional units of the cloud server 2A (see FIG. 13) may be realized by dedicated hardware, such as a single circuit, a composite circuit, a programmed processor, an ASIC, an FPGA, or a combination thereof.

[0106] (Variation 4) Modifications 1 to 15 of the first embodiment can also be applied to this embodiment.

[0107] The technical ideas according to the above-described modifications may be realized independently or in appropriate combination.

[0108] The present disclosure allows various embodiments and modifications without departing from the broad spirit and scope. Furthermore, the above-described embodiments are intended to explain the present disclosure and do not limit the scope of the present disclosure. In other words, the scope of the present disclosure is defined by the claims, not the embodiments. Various modifications made within the scope of the claims and within the meaning of the disclosure equivalent thereto are considered to be within the scope of the present disclosure. [Industrial Applicability]

[0109] The present disclosure can be suitably adopted in technology for monitoring elderly people, disabled people, etc. [Explanation of symbols]

[0110] 1,1A Monitoring system, 2,2A Cloud server, 3 Equipment, 4 Router, 5,5A Elevator management device, 6 User terminal, 20,62 Communication interface, 21,63 CPU, 22,64 ROM, 23,65 RAM, 24,66 Auxiliary storage device, 25,67 Bus, 60 Display, 61 Operation reception unit, 200 Setting reception unit, 201 Equipment information acquisition unit, 202 Elevator information acquisition unit, 203 Behavior estimation unit, 204 Notification unit, 205 Call command unit, 240 Setting information storage unit, 241 Equipment information storage unit, 242 Elevator information storage unit, 243 Behavior information storage unit

Claims

1. A device information acquisition means for acquiring device information relating to the operation of devices installed in the home of a person being monitored; an elevator information acquisition means for acquiring elevator information relating to the operation of an elevator installed in a building to which the residence belongs; device information storage means for storing the device information; an elevator information storage means for storing the elevator information; A monitoring system comprising: a behavior estimation means for estimating the behavior of the person being watched over based on the equipment information stored in the equipment information storage means and the elevator information stored in the elevator information storage means.

2. A terminal device; The monitoring system according to claim 1 , further comprising: a notification unit that transmits notification information based on the behavior of the person being watched over estimated by the behavior estimation unit to the terminal device.

3. a first identification information acquisition means for acquiring identification information of the elevator user; The monitoring system according to claim 1 , wherein the behavior estimation means estimates the behavior of the person being watched over, taking into account the identification information acquired by the first identification information acquisition means.

4. further comprising a second identification information acquisition means for acquiring identification information of users of elevators installed in buildings other than the building; The monitoring system according to claim 1 , wherein the behavior estimation means estimates the behavior of the person being watched over, taking into account the identification information acquired by the second identification information acquisition means.

5. a first transmitter that is installed at a boarding and alighting location of each floor of the elevator and that transmits a wireless signal including floor number information that indicates the floor number; The mobile terminal is carried by the person being watched over and receives the wireless signal transmitted from the first transmitter to acquire the floor number information. The monitoring system according to claim 1 or 2, wherein the behavior estimation means estimates the behavior of the person being watched over, taking into account floor number information acquired by the mobile terminal.

6. a second transmitter that is installed at a boarding and alighting location of each floor of an elevator installed in a building different from the building, and that transmits a wireless signal including floor number information indicating the floor number; A mobile terminal carried by the person being watched over and configured to receive the wireless signal transmitted from the second transmitter and acquire the floor number information, The monitoring system according to claim 1 or 2, wherein the behavior estimation means estimates the behavior of the person being watched over, taking into account floor number information acquired by the mobile terminal.

7. an elevator management means for managing the operation of the elevator; A monitoring system as described in any one of claims 1 to 6, further comprising a call command means that determines whether it is necessary to call the elevator to the floor where the person being monitored lives based on the equipment information stored in the equipment information storage means, and if it is determined that it is necessary to call the elevator, commands the elevator management means to call the elevator to the floor where the person being monitored lives.

8. The monitoring system described in claim 7, wherein when the call command means determines that it is necessary to call the elevator, it determines the time at which the monitored person will use the elevator based on the time required for the monitored person to move, and instructs the elevator management means to have the elevator arrive at the residential floor by the determined time.

9. The monitoring system of any one of claims 1 to 8, wherein the behavior estimation means estimates that the person being monitored has gone out if the elevator arrives at the floor where the person being monitored lives and moves to the first floor within a first hour or more and a second hour or less after the equipment changes from an operating state to a stopped state.

10. The monitoring system of any one of claims 1 to 8, wherein the behavior estimation means estimates that the person being monitored has gone out if the elevator arrives at the floor where the person being monitored lives and moves to the first floor within a first hour or more and a second hour or less after the person detection result by the device changes from detected to undetected.

11. A device information acquisition means for acquiring device information regarding the operation of devices installed in the home of the person being monitored; an elevator information acquisition means for acquiring elevator information relating to the operation of an elevator installed in a building to which the residence belongs; device information storage means for storing the device information; an elevator information storage means for storing the elevator information; A server comprising: a behavior estimation means for estimating the behavior of the person being watched over based on the device information stored in the device information storage means and the elevator information stored in the elevator information storage means.

12. The device information acquisition means acquires device information relating to the operation of devices installed in the home of the person being watched over, and stores the acquired device information in the device information storage means; an elevator information acquisition means for acquiring elevator information relating to the operation of an elevator installed in a building to which the house belongs, and storing the acquired elevator information in an elevator information storage means; A monitoring method in which a behavior estimation means estimates the behavior of the person being watched over based on the equipment information stored in the equipment information storage means and the elevator information stored in the elevator information storage means.

Citation Information

Patent Citations

  • Life watching system

    JP2003178378A

  • Information delivery system using face picture identification

    JP2006107187A

  • Residence support system for multiple dwelling house

    JP2014086929A

  • Solitary senior people care system

    JP2014222498A

  • Safety confirmation system, receiver, and safety confirmation method and program

    JP2016218969A