Monitoring device, monitoring method, and monitoring program

Abstract

To provide a monitoring device, a monitoring method, and a monitoring program which properly monitor a monitored person for a period designated by a monitoring person.SOLUTION: A monitoring device 1 comprises: a sensor information acquisition unit 21 that receives an operation on a first consumer electronics apparatus (a refrigerator 8) by a monitored person 5 from a sensor 2 installed on the first consumer electronics apparatus in a house 6 of the monitored person; an attention period management unit 23 that receives input of an attention period for one day from a monitoring person via a terminal device 3 of the monitoring person; and a sensor information processing unit 22 that automatically displays the fact that there was an operation on a terminal device when an operation on the first consumer electronics apparatus in the attention period is received.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] The present invention relates to a monitoring device, a monitoring method, and a monitoring program. [Background technology]

[0002] Recently in developed countries, it has become common for elderly people who live alone to be watched over by someone in a remote location. It has also become common for working parents to watch over schoolchildren who are left at home alone from a remote location.

[0003] The refrigerator safety confirmation device in Patent Document 1 transmits a notice to a preregistered electronic terminal when the number of times the person being watched over opens and closes the refrigerator door falls below a predetermined threshold. The safety confirmation system in Patent Document 2 detects that an abnormality has occurred in the person being watched over when the number of times the person being watched over opens and closes the mailbox door deviates from the average value that reflects the person's lifestyle. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2003-185315 A [Patent Document 2] JP 2015-46156 A Summary of the Invention [Problem to be solved by the invention]

[0005] It is more preferable that the refrigerator safety confirmation device of Patent Document 1 considers the idea of ​​setting the period of the target of monitoring according to the convenience of the watcher when receiving and the actual living conditions of the person being watched. For example, in the device of Patent Document 1, the electronic terminal of the watcher receives the signal every time the elderly person frequently opens and closes the refrigerator door. In addition, the electronic terminal of the watcher may miss the rare opportunity when the schoolchild opens the refrigerator immediately after returning home. The safety confirmation system of Patent Document 2 lacks this idea, and as a result, it takes time to determine whether the number of times the mailbox door is opened and closed deviates from the average value. Moreover, the accuracy of the system decreases if the schoolchild shows no interest in mail. Therefore, an object of the present invention is to enable a watcher to accurately watch over a person being watched for a period specified by the watcher. [Means for solving the problem]

[0006] The monitoring device of the present invention comprises a sensor information acquisition unit that receives an operation of a first home appliance by a person being watched over from a sensor attached to the first home appliance in the person being watched over's residence, an attention period management unit that accepts an attention period for one day input by the person being watched over via the person being watched over's terminal device, and a sensor information processing unit that, if an operation of the first home appliance is received within the attention period, automatically displays on the terminal device a notification that the operation has occurred. The sensor information acquisition unit receives an operation of a third home appliance from a sensor attached to a third home appliance in the residence, and also receives a subject of the operation. The sensor information processing unit, if an operation of the first home appliance is received within the attention period within a predetermined period after an operation of the third home appliance performed by a predetermined person among the subjects is received, The person under supervision ate a meal after returning home. The message is automatically displayed on the terminal device. height , the first home electric appliance is a refrigerator, the operation on the first home electric appliance is an operation to open a door of the refrigerator, the third home electric appliance is an entrance / exit management device that manages entrance / exit to a residence, and the operation on the third home electric appliance is an operation on the entrance / exit management device; It is characterized by: Other means will be described in the description of the embodiment of the invention. Effect of the Invention

[0007] According to the present invention, a watcher can accurately watch over a person being watched for a period of time specified by the watcher. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a diagram illustrating the configuration of an environment and a monitoring device according to the first embodiment. [Diagram 2] 13(a) and 13(b) are diagrams illustrating information acquired by a sensor and a refrigerator. [Diagram 3] FIG. 11 is a diagram illustrating an example of state information. [Figure 4] FIG. 11 is a diagram illustrating an example of state information. [Diagram 5] FIG. 11 is a diagram illustrating an example of state information. [Figure 6] FIG. 11 is a diagram illustrating an example of state information. [Figure 7] 1 is a flowchart of a basic processing procedure. [Figure 8] 13 is an example of a life rhythm screen. [Figure 9] 13 is an example of a push notification screen. [Figure 10] 1 is a flow chart of an overnight processing procedure. [Figure 11] FIG. 11 is a diagram illustrating the configuration of the environment and a monitoring device according to a second embodiment. [Figure 12] FIG. 11 is a diagram illustrating an example of state information. [Figure 13] FIG. 11 is a diagram illustrating an example of state information. [Figure 14] FIG. 11 is a diagram illustrating an example of state information. [Figure 15] FIG. 11 is a diagram illustrating an example of state information. [Figure 16] 13 is a flowchart of a procedure (part 1) of processing a period of interest. [Figure 17] 13 is a flowchart of a second attention period processing procedure. [Figure 18] 13 is a flowchart of a third attention period processing procedure. [Figure 19] 13 is an example of a life rhythm screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, a mode for carrying out the present invention (referred to as the present embodiment) will be described in detail with reference to the drawings etc. The present embodiment is an example in which a child or his / her relatives watches over an elderly person living alone, and an example in which working parents watch over school-aged children left at home. The present embodiment includes a first embodiment for detecting the presence / absence of the person being watched over in the living room, and a second embodiment for detecting the use of the refrigerator by the person being watched over.

[0010] First, the first embodiment will be described.

[0011] (Configuration of environment and monitoring device) FIG. 1 is a diagram for explaining the environment and the configuration of the monitoring device of the first embodiment. A person being watched over 5 lives in a residence 6. There are no other residents in the residence 6 other than the person being watched over 5, who is an elderly person living alone. The residence 6 has multiple rooms, including a living room 6a, a bedroom 6b, and a kitchen 6c. The living room 6a, the bedroom 6b, and the kitchen 6c are independent of each other, with a corridor, a wall, etc. in between. The person being watched over 5 spends the most time in the living room 6a among the rooms other than the bedroom 6b and the kitchen 6c. When the person being watched over 5 is at home, he spends most of the day in the living room 6a and sleeps in the bedroom 6b at night. One sensor 2 is installed on the wall, ceiling, etc. of the living room 6a, and a refrigerator 8 is installed in the kitchen 6c (details will be described later). The toilet and bathroom are omitted.

[0012] The monitoring device 1 is a general server and constitutes a monitoring service center. This center monitors multiple monitored persons in each residence where a sensor 2 is installed. This server includes a central control device 11, an input device 12 such as a mouse or keyboard, an output device 13 such as a display, a main memory device 14, an auxiliary memory device 15, and a communication device 16. These are connected to each other via a bus. The auxiliary memory device 15 stores status information 31 (31a to 31d, described in detail later). The sensor information acquisition unit 21 and the sensor information processing unit 22 in the main memory device 14 are programs. The central control device 11 reads these programs from the auxiliary memory device 15 and loads them into the main memory device 14, thereby realizing the functions of each program (described in detail later). The auxiliary memory device 15 may be configured independent of the monitoring device 1.

[0013] The monitoring device 1 is connected to a sensor 2, a refrigerator 8, and a terminal device 3 via a network 4. The terminal device 3 in this embodiment is a portable computer operated by a monitor (not shown). However, the terminal device 3 may be a computer other than a portable computer.

[0014] (Sensor) 2(a) and (b) are diagrams explaining the information acquired by the sensor 2 and the refrigerator 8. The sensor 2 is a human presence sensor of any type (for example, an infrared type). The sensor 2 detects whether the person being watched over 5 is in the living room 6a or not. In FIG. 2(a), the person being watched over 5 is in the living room 6a. At this time, the sensor 2 transmits in real time to the monitoring device 1 via the network 4 the information "Present" indicating that the person being watched over 5 is in the living room 6a, along with the year, month, day, hour, minute, and second at which this information was generated (symbol 7a).

[0015] In Fig. 2(b), the person being watched over 5 is not in the living room 6a. At this time, the sensor 2 transmits the information "not there" indicating that the person being watched over 5 is not in the living room 6a and the year, month, day, hour, minute, and second of the time when the information was generated (reference symbol 7b) to the monitoring device 1 via the network 4 in real time.

[0016] When the sensor information acquisition unit 21 acquires information from the sensor 2, the sensor information processing unit 22 processes the information at that time, stores the necessary information, and transmits the information to the terminal device 3. When the sensor information processing unit 22 receives "presence" or "absence" information from the sensor 2, it stores the time when "presence" changed to "absence" and the time when "absence" changed to "presence" in the status information 31. In other words, the sensor information processing unit 22 stores the time when "presence" and "absence" changed. Then, the sensor information processing unit 22 transmits to the terminal device 3 of the watcher, described below, information indicating that the person is in the living room if the information is "presence", and information indicating that the person is not in the living room if the information is "absence", together with the time. Note that the "presence" or "absence" information from the sensor is not used after it has been processed by the sensor information processing unit 22, described below.

[0017] (refrigerator) The person being watched over 5 stores foodstuffs and the like in the refrigerator 8, and opens and closes the door of the refrigerator 8 every time the person being watched over takes out or puts away the foodstuffs. The refrigerator 8 has a mechanism (e.g., a sensor) that recognizes the door opening and closing action and / or the open / closed state, and transmits the recognized opening and closing action and / or the open / closed state to the monitoring device 1 via the network 4 in real time. In addition, the opening and closing action and / or the open / closed state recognized by a sensor retrofitted to the refrigerator 8 may be transmitted to the monitoring device 1 via the network 4 in real time. The refrigerator 8 here is an example of a home appliance (a connected home appliance connected to a network) installed in a residence including a living room. A microwave oven, a room temperature food storage, a hot water warmer, etc. may replace the refrigerator 8. Note that the installed sensor 2 has a blind spot, and there is a problem that if the person being watched over 5 passes through the blind spot, the sensor 2 will not detect him / her. In this case, it can be said that the refrigerator 8 plays the role of the sensor 2 in an auxiliary manner.

[0018] (Status information) 3 to 6 are examples of the status information 31. For convenience of explanation, the four status information 31a to 31d will be explained in order below. The four status information 31a to 31d correspond to the following patterns 1 to 4, respectively.

[0019] <Pattern 1> A pattern in which absence continues for a specified period of time or more. <Pattern 2> A pattern in which the person is absent for a specified period of time or more and the refrigerator status turns to “open” at least once before the specified period of time has elapsed. <Pattern 3> A pattern in which the refrigerator state becomes "open" a predetermined number of times or more during a period in which the monitoring device 1 determines that the person being watched over is asleep after the change in presence to absence during the night. Pattern 3 is a pattern related to nighttime operation (details to be described later). <Pattern 4> A pattern in which the monitoring device 1 once judges that the person being watched over is asleep, and then reconsiders the judgment and finds that the person being watched over is actually absent, and the refrigerator state is set to "open" at least once during the period in which it was judged that the person was asleep. Pattern 4 is also a pattern related to nighttime operation.

[0020] Pay attention to Fig. 3. In status information 31a corresponding to pattern 1, in association with the time stored in time column 101, a living room status is stored in living room status column 102, a refrigerator status is stored in refrigerator status column 103, a timer value is stored in timer column 104, a status message is stored in status display column 105, and a notification category is stored in notification category column 106.

[0021] The time in the time column 101 indicates the year, month, day, hour, minute, and second at the time when the sensor 2 acquired the information indicated by reference symbol 7a in Fig. 2(a) or the information indicated by reference symbol 7b in Fig. 2(b). In this embodiment, the sensor 2 acquires this information every five minutes. The living room status in the living room status column 102 is either "present" indicating that the watched over person 5 is in the living room 6a, or "not present" indicating that the watched over person 5 is not in the living room 6a. The refrigerator status in the refrigerator status column 103 is either "open" indicating that the door of the refrigerator 8 is open, or "closed" indicating that the door of the refrigerator 8 is closed.

[0022] The timer value in the timer column 104 is the time since the timer started to run. The watching device 1 is assumed to have a timer (not shown). The status message in the status display field 105 is a character string that the monitoring apparatus 1 causes to be displayed on the output device of the terminal apparatus 3.

[0023] The notification category in the notification category field 106 is either "waiting for request" or "push". "Waiting for request" means that when there is a request from the terminal device 3 to the watching device 1 (hereinafter referred to as "display request"), which starts when the watcher operates the terminal device 3 to launch the application, the watching device 1 displays a status message on the output device of the terminal device 3. Specifically, when the watcher launches this application, the terminal device 3 requests information for every 5 minutes since the last time from the watching device 1, and the watching device 1 transmits information including a status display to the terminal device 3. "Push" means that the watching device 1 automatically (forcibly) displays a status message on the output device of the terminal device 3, regardless of the presence or absence of a display request. When the watching device 1 makes a "push" request to the application of the terminal device 3, the application automatically (forcibly) displays a status message on the output device of the terminal device 3. A status message with a notification category of "push" is particularly important information for the watcher. It is preferable that the monitoring device 1 causes the terminal device 3 to generate an alarm sound, vibration, or the like when displaying such a status message on the output device of the terminal device 3.

[0024] The configuration of each column in status information 31a is also the same in status information 31b (FIG. 4) corresponding to pattern 2. The configuration of each column in status information 31c (FIG. 5) corresponding to pattern 3 and status information 31d (FIG. 6) corresponding to pattern 4 are the same as the configuration of each column in status information 31a, except that timer column 104 is not included.

[0025] The following can be seen from Figure 3: At 17:55:00 on April 1, 2019, the living room status was "Occupied" and the refrigerator status was "Closed." The monitoring device 1 generated a status message "In the living room" and stored it in the status display field 105. At this time, the monitoring device 1 was in a state in which it could display the status message "In the living room" on the output device of the terminal device 3 if there was a display request. For the sake of simplicity, hereinafter, "a state in which an arbitrary status message can be generated and stored, and then the status message can be displayed on the output device of the terminal device 3 if there is a display request" will be referred to as a "request waiting state."

[0026] At 18:00:00 on April 1, 2019, the living room status was "Away" and the refrigerator status was "Closed." The monitoring device 1 started a timer when the living room status changed from "Present" to "Away." The monitoring device 1 generated a status message "Not in living room" and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state.

[0027] At 18:00:00 on April 2, 2019, the living room status was "Away" and the refrigerator status was "Closed." At this time, the timer value reached a predetermined value (24 hours in this case). The monitoring device 1 generated a status message "We haven't seen you for more than 24 hours" and stored it in the status display field 105. At the same time, the monitoring device 1 displayed the status message "We haven't seen you for more than 24 hours" as a push notification on the output device of the terminal device 3.

[0028] At 18:55:00 on April 2, 2019, the living room status was "occupied" and the refrigerator status was "closed." The monitoring device 1 stopped the timer when the living room status changed from "not in" to "occupied." The monitoring device 1 generated a status message "In living room" and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state.

[0029] Let us pay attention to Figure 4. From Figure 4, we can see the following: The same explanation as in Figure 3 applies at 17:55:00 on April 1, 2019 and 18:00:00 on April 1, 2019.

[0030] At 02:00:00 on April 2, 2019, the timer value reached 8 hours without any change in the living room state or the refrigerator state. The monitoring device 1 generated a status message "Not in living room" and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state.

[0031] At 03:00:00 on April 2, 2019, the living room status was "not in the living room" and the refrigerator status was "open." The monitoring device 1 did not reset the timer value, regardless of the fact that the refrigerator status was "open." The monitoring device 1 generated a status message "Not in the living room" and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state. In addition, although not described in the status display field 105 of FIG. 4 and described in detail later in the explanation of FIG. 8, the monitoring device 1 also generated "The refrigerator has been opened once."

[0032] At 18:00:00 on April 2, 2019, the living room status was “absent”, the refrigerator status was “closed”, and the timer value was “24 hours”. 18:00:00 on April 2, 2019 is the time 24 hours have passed since 18:00:00 on April 1, 2019, when the timer was started. However, the monitoring device 1 did not display the status wording “I haven’t seen you for more than 24 hours” as a push notification on the output device of the terminal device 3, as at 18:00:00 on April 2, 2019 in FIG. 3. Instead, the monitoring device 1 generated the status wording “I haven’t seen you for more than 24 hours, but you have used the refrigerator” and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state. This is because, compared to Pattern 1, even if the watched over person 5 has not been in the living room for 24 hours, if the refrigerator has been opened at least once, there is a high probability that the watched over person 5 has been in a room with a refrigerator (often the kitchen) within the 24 hours, and therefore it is considered that no urgency is required. At 18:55:00 on April 2, 2019, the same explanation as in Figure 3 applies.

[0033] (Night operation) Before explaining FIG. 5, we will explain nighttime operation. When the living room state is "Absent" during the day, the person being watched over 5 is likely to be somewhere other than the living room in the house, or to be out. When the living room state is "Absent" at night, the person being watched over 5 is likely to be sleeping in the bedroom 6b. Therefore, the monitoring device 1 sets a specific period (for example, from 18:00 to 04:00 the next day) as the nighttime operation period. The monitoring device 1 considers the living room state of "Absent" during the nighttime operation period to be a state in which the person being watched over 5 is sleeping.

[0034] Let us pay attention to Figure 5. From Figure 5, we can see the following: At 21:55:00 on April 1, 2019, the living room status was "Occupied" and the refrigerator status was "Closed." The monitoring device 1 generated a status message "In the living room" and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state.

[0035] At 22:00:00 on April 1, 2019, the living room status was "Away" and the refrigerator status was "Closed". The monitoring device 1 memorizes the time when the previous time, 21:55:00, was "Present" and the time when it became "Away" at 22:00:00, and judges the person to be asleep when "Away" occurs 12 times in a row (the person is judged to be asleep when the living room status at 23:00:00 on April 1, 2019 (not shown) continues to be "Away"), and rewrites "Not in the living room" from 22:00:00 onwards to "Residing", and stores this in the status display field 105. "Residing" means "Sleeping". At this time, the monitoring device 1 was in a request waiting state.

[0036] At 01:00:00 on April 2, 2019, the living room state was "not home" and the refrigerator state was "open." The monitoring device 1 generated "count number = 1" due to the refrigerator state being "open." The count number did not reach a predetermined threshold (e.g., "3"). The monitoring device 1 generated a status message "Home is closed" and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state. The monitoring device 1 also generated "The refrigerator has been opened once."

[0037] At 01:05:00 on April 2, 2019, the living room status was "not home" and the refrigerator status was "open." The monitoring device 1 generated "count number = 2" because the refrigerator status was "open." The count number did not reach a predetermined threshold. The monitoring device 1 generated a status message "off" and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state. The monitoring device 1 also generated "refrigerator opened twice."

[0038] At 01:10:00 on April 2, 2019, the living room state was "not home" and the refrigerator state was "open." The monitoring device 1 generated "count number = 3" due to the refrigerator state being "open." The count number reached a predetermined threshold. The monitoring device 1 generated a status message "off" and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state. The monitoring device 1 also generated "refrigerator opened 3 times."

[0039] At 08:00:00 on April 2, 2019, the living room status was "absent" and the refrigerator status was "closed." The monitoring device 1 generated "the refrigerator was used at night three or more times" due to the number of times the refrigerator was opened at night reaching a predetermined threshold (three times in this case) and stored it in the status display field 105. At the same time, the monitoring device 1 displayed the status text "the refrigerator was used at night three or more times" as a push notification on the output device of the terminal device 3. The reason for the push notification of the refrigerator being used at night at 8:00 a.m. is that although it is not as urgent as the above-mentioned pattern 1, it is considered to be of high importance and it is necessary to reliably inform the person watching over it. If the refrigerator is opened and closed at night only for one night, it is not a problem, but if it is opened and closed every night, it has the effect of making the person watching over realize that something unusual may be happening.

[0040] Before going into the explanation of Fig. 6, the review of the status from asleep to absent during nighttime operation will be explained. If "absent" occurs consecutively during the night and changes to "present" after a specific time (e.g. 12:00) the next day, there is a high possibility that the person being watched over 5 has gone out to a friend's house or the like and then returned home. Therefore, the monitoring device 1 first determines that the person being watched over 5 is asleep when "absent" occurs 12 times consecutively during the night. Next, if "absent" has not changed to "present" by 12:00 the next day, the monitoring device 1 reviews its determination that the person being watched over 5 is asleep and retroactively determines that the person being watched over 5 was "absent."

[0041] Let us pay attention to Figure 6. From Figure 6, we can see the following: The same explanation as in Figure 5 applies at 21:55:00 on April 1, 2019 and 22:00:00 on April 1, 2019 (the same applies in that it is determined that the user is asleep at 23:00:00 on April 1, 2019, and the status text for the past hour, "Not in the living room," is replaced with "Sleep").

[0042] At 01:00:00 on April 2, 2019, the living room status was "not home" and the refrigerator status was "open." The monitoring device 1 generated "count number = 1" due to the refrigerator status being "open." The count number did not reach a predetermined threshold. The monitoring device 1 generated a status message "off" and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state. The monitoring device 1 also generated "refrigerator opened once."

[0043] At 12:00:00 on April 2, 2019, the living room status was "Absent" and the refrigerator status was "Closed." The monitoring device 1 rewrote the previous status text "On vacation" to "Not in the living room," generated the status text "Not in the living room," and stored it in the status display field 105. At this time, the monitoring device 1 was in a request waiting state.

[0044] The record at 01:00:00 on April 2, 2019 is compared with the record at 12:00:00 on April 2, 2019. At 01:00:00 on April 2, 2019, the monitoring device 1 determines that the person being watched over 5 is asleep. At 12:00:00 on April 2, 2019, the monitoring device 1 determines that the person being watched over 5 is "not present." In this case, at 12:00:00 on April 2, 2019, the monitoring device 1 updates the status text of all records from 22:00:00 on April 1, 2019 onwards from "Resting" to "Not in the living room."

[0045] (Processing Procedure) The processing procedure will be described below. For convenience of explanation, the processing procedure is divided into two: a basic processing procedure and a nighttime processing procedure. In the nighttime processing procedure, the monitoring device 1 determines that "absent" means that the person being watched over 5 is asleep.

[0046] Fig. 7 is a flowchart of the basic processing procedure. The basic processing procedure corresponds to the state information 31a (Fig. 3) and the state information 31b (Fig. 4). Fig. 9 and Fig. 10 are referred to as appropriate during the flow chart. In step S201, the sensor information acquisition unit 21 of the monitoring device 1 receives "absent." Specifically, first, the sensor information acquisition unit 21 receives from the sensor 2 the living room state "absent." Secondly, the sensor information acquiring unit 21 creates a record of the status information 31. The record created at this time is, for example, a record of the status information 31a (FIG. 3) with the time being "20190401 18:00:00".

[0047] In step S202, the sensor information processing unit 22 of the monitoring device 1 judges whether or not "Absent" has been received continuously for a predetermined period of time. Specifically, if the timer value at the current point in time has reached a predetermined value (e.g., 24 hours) (step S201 "Yes"), the sensor information processing unit 22 proceeds to step S203, and otherwise (step S201 "No"), the sensor information processing unit 22 waits as is. Note that, although the present embodiment is configured to count the predetermined period using a timer, the sensor information processing unit 22 may count the number of consecutive "Absent" occurrences. When the predetermined period is 24 hours, the number of "Absent" occurrences is 288 (when the living room state is transmitted from the sensor 2 every 5 minutes).

[0048] In step S203, sensor information processing unit 22 determines whether or not "OPEN" has been received within a predetermined period. Specifically, if at least one record of status information 31 for the most recent 24 hours includes the refrigerator status "OPEN" ("Yes" in step S203), sensor information processing unit 22 proceeds to step S204. Otherwise ("No" in step S203), sensor information processing unit 22 proceeds to step S205.

[0049] In step S204, the sensor information processing unit 22 generates "I haven't seen you, but you have used the refrigerator" and waits for a request. Specifically, the sensor information processing unit 22 creates a record of the status information 31. The record created at this time is, for example, a record of the status information 31b (FIG. 4) with the time "20190402 18:00:00". Now, assume that the watcher presses the life rhythm display button (not shown) of the operation terminal 3. Then, the sensor information processing unit 22 causes the output device of the terminal device 3 to display a life rhythm screen (FIG. 8). We are in the middle of FIG. 7, but let's turn our attention to FIG. 8 for now.

[0050] Fig. 8 is an example of a life rhythm screen 41 displayed on the terminal device 3 in Fig. 4. The life rhythm screen 41 displays a status graph 42 and a refrigerator door open sign 43 "The refrigerator has been opened once". The status graph 42 displays "Absent", "Present" and "Sleeping" in chronological order using different colors. "Present" is further displayed using three different colors depending on the activity level of the person being watched over 5 ("Low", "Medium" and "High"). The screen 41 is an example where it is determined that the person is "Absent" at night.

[0051] The refrigerator door open sign 43 shows the message "The refrigerator has been opened once", indicating that the refrigerator status became "open" at around 03:00 on a certain day. The color of the living room status graph 42 at that time indicates "absent". Up to this point, the refrigerator door open sign 43 in FIG. 4 has been explained, but in the case of FIG. 5, for example, the refrigerator status became "open" three times at around 01:00 on a certain day, so the refrigerator door open sign 43 displays the message "The refrigerator has been opened three times". Return to FIG. 7.

[0052] In step S205, the sensor information processing unit 22 generates a status message "I haven't seen you for more than 24 hours" and displays it as a push notification on the terminal device. Specifically, first, the sensor information processing unit 22 creates a record of the status information 31. The record created at this time is, for example, a record of the status information 31a (FIG. 3) with the time "20190402 18:00:00". Secondly, the sensor information processing unit 22 transmits an instruction to the terminal device 3 to display a status message "I haven't seen you for more than 24 hours" as a push notification on the output device of the terminal device 3. Then, the output device of the terminal device 3 displays the status message. Please pay attention to FIG. 9.

[0053] 9 is an example of a push notification screen 51. Since the person being watched over 5 has been absent for more than 24 hours and the refrigerator has not been opened or closed, it is possible that something has happened to the person being watched over. Since this information is important to the watcher, by sending a push notification, it is possible to strongly convey only information of high urgency to the watcher. In the center of the screen, the status message "Not seen for more than 24 hours" is displayed prominently. In addition to this display, the terminal device 3 may generate an alarm sound, vibration, etc. After step S204 or S205, the basic processing procedure ends.

[0054] 10 is a flowchart of the nighttime processing procedure. The nighttime processing procedure corresponds to the status information 31c (FIG. 5) and the status information 31d (FIG. 6). In step S301, the sensor information acquisition unit 21 of the monitoring device 1 changes from "present" to "absent", and thereafter receives "absent" continuously. Specifically, the sensor information acquisition unit 21 receives from the sensor 2 the living room state change from "present" to "absent", and thereafter receives "absent" continuously 12 times (a timer may be used to count one hour).

[0055] In step S302, the sensor information processing unit 22 of the monitoring device 1 determines that the person being watched 5 is asleep. Specifically, first, the sensor information processing unit 22 determines that the consecutive "Absent" signals received during the nighttime operation period indicate that the person being watched 5 is asleep. Secondly, the sensor information processing unit 22 creates a record of the state information 31. The record created at this time is, for example, a record of the state information 31c (FIG. 5) with the time being "20190401 22:00:00".

[0056] In step S303, the sensor information acquisition unit 21 of the monitoring device 1 receives the "open" signal. Specifically, the sensor information acquisition unit 21 receives the refrigerator state "open" from the refrigerator 8.

[0057] In step S304, the sensor information processing unit 22 of the monitoring device 1 judges whether or not "Open" has been received a predetermined number of times or more. Specifically, if the number of records of status information 31 including the refrigerator status "Open" reaches a predetermined number during the period in which the sensor information processing unit 22 judges that "Absent" indicates that the watched over person 5 is asleep (step S304 "Yes"), the process proceeds to step S307. Otherwise (step S304 "No"), the sensor information processing unit 22 proceeds to step S305.

[0058] In step S305, the sensor information processing unit 22 generates "I'm taking a break" and waits for a request. Specifically, the sensor information processing unit 22 creates a record of the state information 31. The record created at this time is, for example, a record of the state information 31d (FIG. 6) with the time "20190402 01:00:00". Now, assume that the watcher opens this application on the operation terminal 3. Then, the sensor information processing unit 22 causes the output device of the terminal device 3 to display a life rhythm screen (FIG. 8). At this time, the refrigerator door open sign 43 is "The refrigerator has been opened once". After step S305, the process proceeds to step S306. If the refrigerator has only been used once or twice during the night, it can be assumed that, for example, the user drank water during sleep because he or she was thirsty. Therefore, in step S305, the sensor information processing unit 22 generates "I'm taking a break" and determines that sleep continues.

[0059] In step S306, the sensor information processing unit 22 judges whether or not it has reached 12:00 the next day while still in "Absent". Specifically, if the records of the status information 31 including the living room status "Absent" continue until a predetermined time during the period in which the sensor information processing unit 22 judges that "Absent" indicates that the watched person 5 is asleep (step S306 "Yes"), the sensor information processing unit 22 proceeds to step S310. Otherwise (step S306 "No"), the sensor information processing unit 22 returns to step S304. The "predetermined time" here is, for example, 12:00:00 the next day. Here, "continuous" means that there is no "Present" in between.

[0060] In step S307, the sensor information processing unit 22 generates "off" and waits for a request. Specifically, the sensor information processing unit 22 creates a record of the state information 31. The record created at this time is, for example, a record of the state information 31d (FIG. 5) with the time "20190402 01:10:00". Now, assume that the watcher opens this application on the terminal device 3. Then, the sensor information processing unit 22 causes the output device of the terminal device 3 to display the life rhythm screen 41 (FIG. 8). At this time, the refrigerator door open sign 43 is "refrigerator opened three times". After step S307, the process proceeds to step S308.

[0061] In step S308, the sensor information processing unit 22 generates a status statement "The overnight refrigerator has been used three or more times" and displays it on the terminal device. Here, "three times" is an arbitrarily determined number of times. Specifically, first, the sensor information processing unit 22 creates a record of the status information 31. The record created at this time is, for example, a record of the status information 31c (FIG. 5) with the time being "20190402 08:00:00". Secondly, the sensor information processing unit 22 transmits an instruction to the terminal device 3 to display the status message "The overnight refrigerator has been used three or more times" on the output device of the terminal device 3. Then, the output device of the terminal device 3 displays the status message.

[0062] In step S309, the sensor information processing unit 22 judges whether or not it has reached 12:00 the next day while the status remains "Absent". Specifically, if the sensor information processing unit 22 determines that "Absent" indicates that the watched person 5 is asleep, and if records of the status information 31 including the living room status "Absent" continue until a predetermined time (step S309 "Yes"), the process proceeds to step S310. Otherwise (step S309 "No"), the sensor information processing unit 22 ends the nighttime processing procedure. Here, the "predetermined time" is, for example, 12:00:00 the next day. Here, "continuous" means that there is no "Present" in between.

[0063] In step S310, the sensor information processing unit 22 reassesss the living room state from “asleep” to “absent”. Specifically, the sensor information processing unit 22 reassesss the determination in step S302, and retroactively determines again that the watched over person 5 was “absent”. Thereafter, the nighttime processing procedure is terminated.

[0064] It should be noted that a "display request" is a request from the terminal device 3 to the watching device 1, which is initiated when the watcher operates the terminal device 3 to launch an application. However, a "display request" may be a request from the watcher operating the terminal device 3, for example, a request made by the watcher pressing an update icon for an application, or any other similar request.

[0065] Next, a second embodiment will be described.

[0066] (Configuration of environment and monitoring device) Fig. 11 is a diagram for explaining the configuration of the environment and the monitoring device of the second embodiment. The differences between Fig. 11 and Fig. 1 are as follows. The monitoring device 1 includes an attention period management unit 23 as a program. The residence 6 has a front door 6d, and the front door 6d has a door 10 for entering and exiting from the outside. The kitchen 6 is equipped with a cooking appliance 9. The cooking appliance 9 here is a microwave oven with an opening and closing door or the like. The person being watched over 5 may be an elderly person living alone or a schoolchild (including junior and senior high school students) living with both working parents. The status information 31 includes status information 31e, 31f, 31g, and 31h, which will be described later.

[0067] The monitoring device 1 is connected to a cooking appliance 9 and a door 10 via a network 4. The cooking appliance 9 has a mechanism (e.g., a sensor) for recognizing the opening / closing operation and / or the opening / closing state of the door, and transmits the recognized opening / closing operation and / or the opening / closing state to the monitoring device 1 via the network 4 in real time. The door (entrance / exit management device) 10 also has a mechanism (e.g., a sensor) for recognizing its own opening / closing operation and / or the opening / closing state, and transmits the recognized opening / closing operation and / or the opening / closing state to the monitoring device 1 via the network 4 in real time. In other words, the sensor information acquisition unit 21 of the monitoring device 1 receives operations on the refrigerator 8 (first home appliance), the cooking appliance 9 (second home appliance), and the door 10 (third home appliance) by the watched person 5 from sensors installed in those appliances.

[0068] (Status information) 12 to 15 are examples of the status information 31. For ease of explanation, the four status information 31e to 31h will be explained in order below. The four status information 31e to 31h correspond to the following patterns 5 to 8, respectively.

[0069] <Pattern 5> This pattern occurs when the watched person opens the door of refrigerator 8 during the attention period specified by the watcher (details below). Pattern 6: The monitored person does not open the door of refrigerator 8 during the period of interest. Pattern 7: During the attention period, the person being watched opens the door of the refrigerator 8 and then the door of the cooking appliance 9 immediately after. <Pattern 8> A pattern in which the watched person opens the door of refrigerator 8 immediately after opening door 10 during the attention period.

[0070] In status information 31e (FIG. 12) corresponding to pattern 5 and status information 31f (FIG. 13) corresponding to pattern 6, the refrigerator status is stored in refrigerator status column 103, a status message is stored in status display column 105, and a notification category is stored in notification category column 106, in association with the time stored in time column 101. The explanation of each of these columns is the same as that described above in FIG. 3.

[0071] The configuration of status information 31g (FIG. 14) corresponding to pattern 7 is obtained by adding a cooking appliance status (column 103b) to the configuration of status information 31e. The cooking appliance status in cooking appliance status column 103b is either "open" indicating that the door of cooking appliance 9 is open, or "closed" indicating that the door of cooking appliance 9 is closed. The configuration of status information 31h (FIG. 15) corresponding to pattern 8 is obtained by adding a front door status (column 103c) to status information 31e. The front door status in front door status column 103c is either "open" indicating that the door 10 is open, or "closed" indicating that the door 10 is closed.

[0072] The following can be seen from Figure 12: The caregiver has specified the time from 7:00:00 to 8:00:00 every day as the attention period (within the thick frame above the double line). During the attention period, the caregiver is trying to make sure that the elderly person living alone gets up regularly every morning and eats breakfast. At 7:00:00 on April 2, 2019, the refrigerator status was "closed." The monitoring device 1 generated a status message "Refrigerator not in use" and stored it in the status display field 105. At this time, the monitoring device 1 was in a state where it could display the status message on the output device of the terminal device 3 if there was a display request.

[0073] At 7:05:00 on April 2, 2019, the refrigerator status was “open.” The monitoring device 1 generates a status message “The refrigerator was used during breakfast time,” stores the message in the status display field 105, and displays the message as a push notification on the output device of the terminal device 3. At 7:10:00 on April 2, 2019, the refrigerator status was "open." The monitoring device 1 generated a status message "The refrigerator was used during breakfast time" and stored it in the status display field 105. If the notification category was "push," the monitoring device 1 displayed the status message by push notification on the output device of the terminal device 3. If the notification category was "waiting for request," the monitoring device 1 was in a state in which it could display the status message on the output device of the terminal device 3 if there was a display request.

[0074] Incidentally, outside the attention period, even if the refrigerator status is "open", the monitoring device 1 does not generate a status message. Therefore, outside the attention period, the status display field 105 and the notification distinction field 106 are blank (the same applies to the example below the double line). This also applies to Figs. 13 to 15.

[0075] Below the double line, the watcher, the watched person and the residence 6 are different from those above the double line. The caregiver specifies the attention period to be from 12:00:00 to 16:00:00 every day (within the thick frame below the double line). During the attention period, the caregiver is trying to make sure that the child comes home from school and eats lunch alone while the caregiver is away. At 12:00:00 on April 2, 2019, the refrigerator status was "closed." The monitoring device 1 generated a status message "Refrigerator not in use" and stored it in the status display field 105. At this time, the monitoring device 1 was in a state where it could display the status message on the output device of the terminal device 3 if there was a display request.

[0076] At 12:05:00 on April 2, 2019, the refrigerator status was “open.” The monitoring device 1 generates a status message “The refrigerator was used during the time the user arrived home,” stores the message in the status display field 105, and causes the output device of the terminal device 3 to display the message as a push notification. At 12:10:00 on April 2, 2019, the refrigerator status was "open." The monitoring device 1 generated a status message "The refrigerator was used during the time when the user arrived home" and stored it in the status display field 105. If the notification category was "push," the monitoring device 1 displayed the status message by push notification on the output device of the terminal device 3. If the notification category was "waiting for request," the monitoring device 1 was in a state in which it could display the status message on the output device of the terminal device 3 if there was a display request.

[0077] The following can be seen from Fig. 13. The watcher, the person being watched, and the residence 6 on the double line in Fig. 13 are the same as those on the double line in Fig. 12 (the case of an elderly person living alone). As mentioned above, the watcher has specified the attention period to be from 7:00:00 to 8:00:00 every day (within the thick frame above the double line). During this attention period, the refrigerator status was "closed" continuously. At 8:05:00 on April 3, 2019, immediately after the end of the attention period, the monitoring device 1 generates a status message "The refrigerator was not used during breakfast time", stores this in the status display field 105, and displays it as a push notification on the output device of the terminal device 3.

[0078] The watcher, the watched person and the residence 6 under the double line in FIG. 13 are the same as those under the double line in FIG. 12 (in the case of school children). As mentioned above, the watcher has specified the attention period to be from 12:00:00 to 16:00:00 every day (within the thick frame below the double line). During this attention period, the refrigerator status was "closed" continuously. At 16:05:00 on April 3, 2019, immediately after the end of the attention period, the monitoring device 1 generates a status message "The refrigerator was not used during the time when the user arrived home", stores this in the status display field 105, and displays this as a push notification on the output device of the terminal device 3.

[0079] The following can be seen from Fig. 14. The watcher, the person being watched, and the residence 6 on the double line in Fig. 14 are the same as those on the double line in Fig. 12 (the case of an elderly person living alone). As mentioned above, the watcher specifies the attention period from 7:00:00 to 8:00:00 every day (within the thick frame above the double line).

[0080] At 7:00:00 on April 4, 2019, the refrigerator status was "closed" and the cooking appliance status was also "closed." The monitoring device 1 generated a status message "Refrigerator and cooking appliance are not in use" and stored it in the status display field 105. At this time, the monitoring device 1 was in a state where it could display the status message on the output device of the terminal device 3 if there was a display request.

[0081] At 7:05:00 on April 4, 2019, the refrigerator status was "open" and the cooking appliance status was "closed." The monitoring device 1 generated a status message "The refrigerator was used during breakfast time" and stored it in the status display field 105. At this time, the monitoring device 1 was in a state where it could display the status message on the output device of the terminal device 3 if there was a display request.

[0082] At 7:10:00 on April 4, 2019, the refrigerator status was "closed" and the cooking device status was "open." In this way, if the cooking device status becomes "open" within a predetermined period (e.g., 10 minutes) after the refrigerator status becomes "open," it is highly likely that the person being watched over took food out of the refrigerator and cooked it in the cooking device after waking up. Therefore, at this time, the watching device 1 generates a status statement "It appears that the person has had breakfast," stores this in the status display field 105, and displays it as a push notification on the output device of the terminal device 3.

[0083] The watcher, the watched person and the residence 6 under the double line in FIG. 14 are the same as those under the double line in FIG. 12 (in the case of school children). As mentioned above, the watcher specifies the attention period from 12:00:00 to 16:00:00 every day (within the thick frame below the double line).

[0084] At 12:00:00 on April 4, 2019, the refrigerator status was "closed" and the cooking appliance status was also "closed." The monitoring device 1 generated a status message "Refrigerator and cooking appliance are not in use" and stored it in the status display field 105. At this time, the monitoring device 1 was in a state where it could display the status message on the output device of the terminal device 3 if there was a display request.

[0085] At 12:05:00 on April 4, 2019, the refrigerator status was "open" and the cooking appliance status was "closed." The monitoring device 1 generated a status message "The refrigerator was used during the time when the user returned home" and stored it in the status display field 105. At this time, the monitoring device 1 was in a state where it could display the status message on the output device of the terminal device 3 if there was a display request.

[0086] At 12:10:00 on April 4, 2019, the refrigerator status was "closed" and the cooking device status was "open." In this way, if the cooking device status becomes "open" within a predetermined period (e.g., 10 minutes) after the refrigerator status becomes "open," it is highly likely that the person being watched over will have taken food out of the refrigerator and cooked it in the cooking device after returning home to an empty residence. Therefore, at this time, the watching device 1 generates a status statement "It appears that the person has had lunch," stores this in the status display field 105, and displays this as a push notification on the output device of the terminal device 3.

[0087] From Fig. 15, the following can be seen: The watcher, the watched person, and the residence 6 in Fig. 15 are the same as those under the double line in Fig. 12 (the case of school children). As mentioned above, the watcher specifies the attention period from 12:00:00 to 16:00:00 every day (within the thick frame below the double line). The watcher is paying attention to the return of the younger of the two school children, "Mr. A." Specifically, the watcher displays a status message on the output device of the terminal device 3 by push notification only when the door 10 detects that Mr. A has opened the door 10. The door 10 detects Mr. A from a card or the like that Mr. A holds up to the door 10.

[0088] At 12:00:00 on April 5, 2019, the refrigerator status was "closed" and the front door status was also "closed." The monitoring device 1 generated a status message "The front door is not open, the refrigerator is not in use" and stored it in the status display field 105. At this time, the monitoring device 1 was in a state where it could display the status message on the output device of the terminal device 3 if there was a display request.

[0089] At 12:05:00 on April 5, 2019, the refrigerator status was "closed" and the front door status was "open." Then, the door 10 detected that Person A opened the door. The monitoring device 1 generated a status message "It appears Person A has returned home" and stored it in the status display field 105. At this time, the monitoring device 1 was in a state where it could display the status message on the output device of the terminal device 3 if there was a display request.

[0090] At 12:10:00 on April 5, 2019, the refrigerator status was "open" and the front door status was "closed." In this way, if the refrigerator status changes to "open" within a predetermined period (e.g., 10 minutes) after the front door status changes to "open," it is highly likely that the person being watched over has taken food out of the refrigerator after returning home to an empty residence. Therefore, at this time, the watching device 1 generates a status statement "It appears that Mr. A had lunch after returning home," stores this in the status display field 105, and displays this as a push notification on the output device of the terminal device 3.

[0091] At 12:30:00 on April 5, 2019, the refrigerator status was "closed" and the front door status was "open." Then, the door 10 detected that Person B had opened the door. The monitoring device 1 generated a status message "It appears Person B has returned home" and stored it in the status display field 105. At this time, the monitoring device 1 was in a state in which it could display the status message on the output device of the terminal device 3 if there was a display request.

[0092] At 12:35:00 on April 5, 2019, the refrigerator status was "open" and the front door status was "closed." At this time, the monitoring device 1 generated a status message "It appears that B had lunch after returning home" and stored it in the status display field 105. Then, if there is a display request, the monitoring device 1 was in a state where it could display the status message on the output device of the terminal device 3. At this time, the monitoring device 1 does not display the status message by push notification on the output device of the terminal device 3. This is because the person watching over is not paying attention to B.

[0093] (Processing Procedure) 16 is a flowchart of the attention period processing procedure (part 1). The attention period processing procedure (part 1) corresponds to FIGS. In step S401, the attention period management unit 23 of the watching device 1 accepts an attention period. Specifically, the attention period management unit 23 accepts an attention period input by the watcher via the terminal device 3, such as "7:00:00 to 8:00:00 every day."

[0094] In step S402, the attention period management unit 23 accepts a notification category rule. Specifically, the attention period management unit 23 accepts an input of the following notification category rule by the watcher via the terminal device 3. If the refrigerator status becomes "open" during the period of interest, the monitoring device 1 displays a push notification to that effect each time this occurs, or displays a push notification to that effect only the first time. If the refrigerator state has never become “open” during the attention period, the monitoring device 1 displays a push notification to that effect immediately after the attention period ends. As is clear from the above, the notification classification rule is a rule by which the monitoring device 1 selectively uses "wait for request" and "push" during the attention period.

[0095] In step S403, the attention period management unit 23 judges whether the attention period has arrived. Specifically, if the attention period has started (step S403 "Yes"), the attention period management unit 23 proceeds to step S404, and otherwise (step S403 "No"), the attention period management unit 23 waits as it is.

[0096] In step S404, the sensor information processing unit 22 of the monitoring device 1 determines whether the refrigerator state has become "open" or not. Specifically, if the refrigerator state has become "open" (step S404 "Yes"), the sensor information processing unit 22 proceeds to step S405, and otherwise (step S404 "No"), proceeds to step S407.

[0097] In step S405, the sensor information processing unit 22 determines whether the notification category is "push". Specifically, if the notification category is "push" (step S405 "Yes"), the sensor information processing unit 22 proceeds to step S406, and otherwise (step S405 "No"), the sensor information processing unit 22 proceeds to step S407. The sensor information processing unit 22 refers to the notification category rule accepted in step S402 and determines whether the notification category at the relevant timing is "push" or "request waiting".

[0098] In step S406, the sensor information processing unit 22 generates "The refrigerator was used during XX time period" and displays it as a push notification on the terminal device 3. The display corresponds to, for example, the record of 7:05:00 in FIG.

[0099] In step S407, the attention period management unit 23 of the monitoring device 1 judges whether the attention period has ended. Specifically, if the attention period has ended (step S407 "Yes"), the attention period management unit 23 proceeds to step S408, and otherwise (step S407 "No"), returns to step S404.

[0100] In step S408, the sensor information processing unit 22 of the monitoring device 1 determines whether or not there has been an opportunity to display a push notification. After the attention period arrives, there are cases where the attention period ends without going through step S406 even once (the same applies to Figs. 17 and 18). Therefore, if the sensor information processing unit 22 has gone through step S406 at least once (step S408 "Yes"), the sensor information processing unit 22 proceeds to step S410. Otherwise (step S408 "No"), the sensor information processing unit 22 proceeds to step S409.

[0101] In step S409, the sensor information processing unit 22 generates "The refrigerator was not used during XX time period" and causes the terminal device 3 to display the message as a push notification. The message corresponds to, for example, the record for 8:05:00 in Fig. 13. Then, the attention period processing procedure (part 1) ends.

[0102] In step S410, the sensor information processing unit 22 causes the terminal device 3 to display the summary count by push notification. Specifically, the sensor information processing unit 22 divides the attention period into a plurality of segment periods having equal lengths. Then, the sensor information processing unit 22 causes the terminal device 3 to display, by push notification, the number of push displays for each segment period and / or the number of times the refrigerator status became "open" (see FIG. 19). Thereafter, the attention period processing procedure (part 1) ends.

[0103] Fig. 19 is an example of life rhythm screen 41. The attention period in this example is "8:00 to 11:00". Sensor information processing unit 22 divides the attention period into three 60-minute segments, and causes terminal device 3 to display the number of times the refrigerator status became "open" for each segment. Each time each segment ends, sensor information processing unit 22 may cause the number of times for that segment to be displayed.

[0104] 17 is a flowchart of the attention period processing procedure (part 2). The attention period processing procedure (part 2) corresponds to FIG. Step S421 is the same as step S401 in FIG. In step S422, the attention period management unit 23 of the watching device 1 accepts the notification category rule. Specifically, the attention period management unit 23 accepts the following notification category rule input by the watcher via the terminal device 3. If the cooking appliance state changes to "open" within a predetermined period (for example, 10 minutes) after the refrigerator state changes to "open" during the period of interest, the monitoring device 1 displays a push notification to that effect.

[0105] In step S423, the attention period management unit 23 judges whether the attention period has arrived. Specifically, if the attention period has started (step S423 "Yes"), the attention period management unit 23 proceeds to step S424, and otherwise (step S423 "No"), the attention period management unit 23 waits as it is.

[0106] In step S424, the sensor information processing unit 22 of the monitoring device 1 determines whether the refrigerator state has become "open" or not. Specifically, if the refrigerator state has become "open" (step S424 "Yes"), the sensor information processing unit 22 proceeds to step S425, and otherwise (step S424 "No"), proceeds to step S428.

[0107] In step S425, the sensor information processing unit 22 determines whether the cooking device state has become "open". Specifically, if the cooking device state has become "open" within a predetermined period (e.g., 10 minutes) after the refrigerator state has become "open" (step S425 "Yes"), the sensor information processing unit 22 proceeds to step S426. Otherwise (step S425 "No"), the sensor information processing unit 22 proceeds to step S428.

[0108] In step S426, the sensor information processing unit 22 determines whether the notification category is "push". Specifically, if the notification category is "push" (step S426 "Yes"), the sensor information processing unit 22 proceeds to step S427, and otherwise (step S426 "No"), the sensor information processing unit 22 proceeds to step S428. The sensor information processing unit 22 refers to the notification category rule accepted in step S422 and determines whether the notification category at the relevant timing is "push" or "request waiting".

[0109] In step S427, the sensor information processing unit 22 generates "It appears that you have had ○ meals" and causes the terminal device 3 to display the message as a push notification. The message corresponds to the record at 7:10:00 in Fig. 14, for example. The message indicates that the operation of opening the refrigerator 8 and the operation of opening the cooking appliance 9 have been performed consecutively. In step S428, the attention period management unit 23 of the watching device 1 judges whether the attention period has ended. Specifically, if the attention period has ended (step S428 "Yes"), the attention period management unit 23 proceeds to step S429, and otherwise (step S428 "No"), returns to step S424.

[0110] In step S429, the sensor information processing unit 22 of the monitoring device 1 determines whether or not there has been an opportunity to display a push notification. Specifically, if step S427 has been passed through at least once (step S429 "Yes"), the sensor information processing unit 22 ends the attention period processing procedure (part 2). Otherwise (step S429 "No"), the sensor information processing unit 22 proceeds to attention step S430.

[0111] In step S430, the sensor information processing unit 22 generates "It appears that you have not eaten ○ meals" and causes the terminal device 3 to display the message as a push notification. After that, the attention period processing procedure (part 2) ends.

[0112] 18 is a flowchart of the attention period processing procedure (part 3). The attention period processing procedure (part 3) corresponds to FIG. Step S441 is the same as step S401 in FIG. In step S442, the attention period management unit 23 of the watching device 1 accepts the notification category rule. Specifically, the attention period management unit 23 accepts the following notification category rule input by the watcher via the terminal device 3. If the refrigerator state becomes “open” within a predetermined period of time (e.g., 10 minutes) after the entrance state becomes “open” due to the action of a specific person being watched over (e.g., Mr. A), the watching device 1 will display a push notification to that effect.

[0113] In step S443, the attention period management unit 23 judges whether the attention period has arrived. Specifically, if the attention period has started (step S443 "Yes"), the attention period management unit 23 proceeds to step S444, and otherwise (step S443 "No"), the attention period management unit 23 waits as it is.

[0114] In step S444, the sensor information processing unit 22 of the monitoring device 1 judges whether the entrance state of the predetermined monitored person (e.g., Ms. A) has been changed to "open." Specifically, if the entrance state of the predetermined monitored person (e.g., Ms. A) has been changed to "open" (step S444 "Yes"), the sensor information processing unit 22 proceeds to step S445, and otherwise (step S444 "No"), the sensor information processing unit 22 proceeds to step S448.

[0115] In step S445, sensor information processing unit 22 determines whether the refrigerator state has become "open". Specifically, if the refrigerator state has become "open" within a predetermined period (e.g., 10 minutes) after the entrance state has become "open" (step S445 "Yes"), sensor information processing unit 22 proceeds to step S446. Otherwise (step S445 "No"), sensor information processing unit 22 proceeds to step S448.

[0116] In step S446, the sensor information processing unit 22 determines whether the notification category is "push". Specifically, if the notification category is "push" (step S446 "Yes"), the sensor information processing unit 22 proceeds to step S447, and otherwise (step S446 "No"), the sensor information processing unit 22 proceeds to step S448. The sensor information processing unit 22 refers to the notification category rule accepted in step S442 and determines whether the notification category at the relevant timing is "push" or "request waiting".

[0117] In step S447, the sensor information processing unit 22 generates "It seems that Mr. XX had XX meals after returning home" and causes the terminal device 3 to display the message as a push notification. The display corresponds to the record of 12:10:00 in Fig. 15, for example. The display indicates that the operation of opening the door 10 and the operation of opening the refrigerator 8 were performed consecutively. In step S448, the attention period management unit 23 of the watching device 1 judges whether the attention period has ended. Specifically, if the attention period has ended (step S448 "Yes"), the attention period management unit 23 proceeds to step S449, and otherwise (step S448 "No"), returns to step S444.

[0118] In step S449, the sensor information processing unit 22 of the monitoring device 1 determines whether or not there has been an opportunity to display a push notification. Specifically, if step S447 has been passed through at least once (step S449 "Yes"), the sensor information processing unit 22 ends the attention period processing procedure (part 3). Otherwise (step S449 "No"), the sensor information processing unit 22 proceeds to step S450.

[0119] In step S450, the sensor information processing unit 22 generates "It seems that Mr. XX has not had XX meals since returning home" and causes the terminal device 3 to display the message as a push notification. Thereafter, the attention period processing procedure (part 3) ends.

[0120] (Effects of this embodiment) The effects of the monitoring device of this embodiment are as follows. (1) The monitoring device can display a push notification to the watcher that the person being watched has used a home appliance only during a period of attention specified by the watcher. (2) The monitoring device can display to the watcher the number of times the person being watched has used a home appliance. (3) The monitoring device can display a push notification indicating that the person being watched did not use a home appliance during the period of interest. (4) If the person being watched over uses multiple home appliances during the period of interest, the monitoring device can display a push notification that the person being watched over has used a home appliance, only the first time. (5) The monitoring device can be applied when the person being monitored uses a refrigerator (which is always turned on).

[0121] (6) The monitoring device can display a push notification that the person being watched over has used another home appliance immediately after using the home appliance of interest during the period of interest (improving the sense of security). (7) The monitoring device can be applied when the person being monitored uses a cooking appliance immediately after using a refrigerator (detecting meal preparation). (8) The monitoring device can display a push notification that a home appliance of interest has been used immediately after another home appliance has been used (improving the sense of security). (9) The monitoring device can identify the person being monitored who uses other home appliances (limiting the people being monitored who should be paid attention to). (10) The monitoring device can be applied when the person being monitored uses an entrance / exit management device (utilizing the person recognition function of the entrance / exit management device as is).

[0122] The present invention is not limited to the above-described embodiment, but includes various modified examples. For example, the above-described embodiment has been described in detail to easily explain the present invention, and is not necessarily limited to those including all of the configurations described. It is also possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. It is also possible to add, delete, or replace a part of the configuration of each embodiment with another configuration. [Explanation of symbols]

[0123] 1. Monitoring Device 2 Sensors 3 Terminal Equipment 4. Network 5. The Watched 8. Refrigerator (No. 1 home appliance) 9. Cooking appliances (secondary home appliances) 10 Door (Third Appliance) 11 Central control unit 12 Input Devices 13 Output Devices 14 Main memory 15 Auxiliary storage 16 Communication equipment 21 Sensor information acquisition unit 22 Sensor information processing unit 23 Attention Period Management Department 31 Status Information

Claims

1. a sensor information acquisition unit that receives an operation of a first home appliance by a person being watched over from a sensor installed in the first home appliance in the person being watched over; an attention period management unit that accepts input of an attention period in one day by the watcher via a terminal device of the watcher; a sensor information processing unit that, when an operation for the first home electric appliance is received during the attention period, automatically displays on the terminal device a message indicating that the operation has been received; Equipped with The sensor information acquisition unit receiving an operation on a third home appliance from a sensor provided in the third home appliance in the residence, and receiving a subject of the operation; The sensor information processing unit includes: when an operation on the first home appliance is received within a predetermined period after an operation on the third home appliance performed by a predetermined person among the subjects is received during the attention period, automatically displaying on the terminal device that the person being watched over has eaten a meal after returning home; The first home appliance comprises: It is a refrigerator, The operation on the first home appliance includes: An operation of opening the door of the refrigerator, The third home appliance comprises: An entrance / exit management device that manages entry and exit to a residence, The operation on the third home appliance includes: The operation is performed on the entrance / exit management device. A monitoring device characterized by the above.

2. The sensor information processing unit includes: displaying the number of times of the operation on the terminal device; The monitoring device according to claim 1 .

3. The sensor information processing unit includes: when no operation on the first home electric appliance is received within the attention period, automatically displaying on the terminal device a message indicating that no operation has been received; The monitoring device according to claim 2 .

4. The sensor information processing unit includes: When an operation for the first home electric appliance is received multiple times during the attention period, automatically displaying on the terminal device that the operation has been received only for the first time; The monitoring device according to claim 3 .

5. The sensor information acquisition unit receiving an operation of a second home appliance by the person being watched over from a sensor installed in the second home appliance in the residence; The sensor information processing unit includes: when an operation for the second home appliance is received within a predetermined period after the operation for the first home appliance is received during the attention period, automatically displaying on the terminal device that the person being watched over has eaten a meal; The second home appliance includes: A heating cooker, The operation on the second home appliance includes: The operation is performed using the cooking device; The monitoring device according to claim 4 .

6. The sensor information acquisition unit of the monitoring device receiving an operation of a first home appliance by a person being watched over from a sensor installed in the first home appliance in the person being watched over; The attention period management unit of the monitoring device Accepting an input of a daily attention period by the watcher via a terminal device of the watcher, The sensor information processing unit of the monitoring device when an operation for the first home electric appliance is received during the attention period, automatically displaying on the terminal device that the operation has been received; The sensor information acquisition unit receiving an operation on a third home appliance from a sensor provided in the third home appliance in the residence, and receiving a subject of the operation; The sensor information processing unit includes: when an operation on the first home appliance is received within a predetermined period after an operation on the third home appliance performed by a predetermined person among the subjects is received during the attention period, automatically displaying on the terminal device that the person being watched over has eaten a meal after returning home; The first home appliance comprises: It is a refrigerator, The operation on the first home appliance includes: An operation of opening the door of the refrigerator, The third home appliance comprises: An entrance / exit management device that manages entry and exit to a residence, The operation on the third home appliance includes: The operation is performed on the entrance / exit management device. A monitoring method for a monitoring device comprising the steps of:

7. Computer, a sensor information acquisition unit that receives an operation of a first home appliance by a person being watched over from a sensor installed in the first home appliance in the person being watched over; an attention period management unit that accepts input of an attention period in one day by the watcher via a terminal device of the watcher; a sensor information processing unit that, when an operation for the first home electric appliance is received during the attention period, automatically displays on the terminal device a message indicating that the operation has been received; A monitoring program for making the system function as a The sensor information acquisition unit receiving an operation for a third home electric appliance from a sensor provided in the third home electric appliance in the residence and receiving a subject of the operation; The sensor information processing unit: executing a process of automatically displaying on the terminal device a message indicating that the person being watched over has eaten a meal after returning home, when an operation on the first home appliance is received within a predetermined period after an operation on the third home appliance performed by a predetermined person among the subjects is received during the attention period; The first home appliance comprises: It is a refrigerator, The operation on the first home appliance includes: An operation of opening the door of the refrigerator, The third home appliance comprises: An entrance / exit management device that manages entry and exit to a residence, The operation on the third home appliance includes: The operation is performed on the entrance / exit management device. A monitoring program that features the following:

Images