Monitoring device, monitoring method, computer program, and storage medium

Abstract

To provide a monitoring device for stably executing a predetermined action according to detected predetermined information.SOLUTION: A monitoring device includes: rule control means for executing a predetermined action in response to detection of predetermined information; determination means for determining whether or not the predetermined information has been detected; and notification control means for transmitting information to a display control device so as to display information to the effect that the predetermined information has been already detected when the determination means determines that the predetermined information has been already detected when a rule is set or changed in the rule control means.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to a monitoring device, a monitoring method, a computer program, a storage medium, and the like. [Background technology]

[0002] Surveillance devices that can be remotely controlled via a network or the like to monitor video and acquire audio have been known for some time. Surveillance devices can be used in conjunction with external devices that detect specific information and send notification commands. Specifically, rules can be set to trigger actions such as starting recording when a notification command is received from an external device.

[0003] Patent Document 1 discloses a control method for changing controls such as start / stop of recording and masking in response to notifications from external devices such as sensors or human detection results from video analysis. Patent document 2 discloses a control server that detects the occurrence of an event based on information received from an information providing service within a specified time period, and if the occurrence of multiple events is detected within the specified time period, causes an action execution service to execute an action. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2020-72456 [Patent Document 2] Japanese Patent Application Laid-Open No. 2017-102644 Summary of the Invention [Problem to be solved by the invention]

[0005] However, when setting or changing a rule that executes a predetermined action triggered by the reception of a notification command corresponding to predetermined information detected by an external device, there may be cases where the detection has already occurred. In such cases, an error may occur in which the detection is not notified and the set action is not executed without the user's knowledge unless a new notification command is sent from the external device.

[0006] The present invention has been made in consideration of the problems described above, and one of its objects is to provide a monitoring device that stably executes predetermined actions in response to detected predetermined information. [Means for solving the problem]

[0007] A monitoring device according to one aspect of the present invention comprises: a rule control means for controlling the setting of a rule for executing a predetermined action in response to detection of predetermined information; An external device that detects the predetermined information and transmits and receives predetermined commands to the external device. When communication is established with the external device, the external device detects whether the predetermined information has been detected. The detection information is acquired from the external device. a storage means for storing the a determination means for determining whether the predetermined information has been detected based on the detection information; a notification control means for transmitting information to a display control device to display that the predetermined information corresponding to the rule has been detected when the rule control means sets the rule or changes the rule from a rule different from the rule to the rule, if the determination means determines that the predetermined information corresponding to the rule has been detected; and and The rule is characterized by being composed of the predetermined information and the predetermined action. [Effects of the Invention]

[0008] According to the present invention, it is possible to realize a monitoring device that stably executes a predetermined action in response to detected predetermined information. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of the configuration of a monitoring system according to an embodiment of the present invention. [Figure 2] 1 is a functional block diagram of a monitoring device 1 according to a first embodiment. [Figure 3] FIG. 2 is a diagram showing an example of an event and an example of its configuration in the form of a table according to the first embodiment. [Figure 4] 10A and 10B are diagrams illustrating an example of the timing of occurrence of detection corresponding to a single event and rule setting according to the first embodiment. [Figure 5] FIG. 10 is a diagram showing a display screen for setting rules displayed on the client device 2 according to the first embodiment. [Figure 6] 10 is a diagram showing a display screen displayed on the client device 2 according to the first embodiment to notify the client device 2 of a detected state and to prompt the client device 2 to take action. FIG. [Figure 7] 3 is a flowchart showing the processing of the monitoring device 1 according to the first embodiment. [Figure 8] FIG. 10 is a diagram illustrating an example of a stateful event table according to the second embodiment. [Figure 9] 10A to 10C are diagrams illustrating an example of the timing of occurrence of detection corresponding to a stateful event and rule setting. [Figure 10] 10 is a flowchart showing the processing of the monitoring device 1 according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiment. In each drawing, the same members or elements are given the same reference numerals, and duplicated descriptions will be omitted or simplified.

[0011] (Embodiment 1) 1 is a diagram showing an example of the configuration of a monitoring system according to embodiment 1. The monitoring system of this embodiment includes a monitoring device 1, a client device 2, a detector 3, a network 4, and a network 5. The detector 3 is an example of an external device.

[0012] The monitoring device 1 is a device that has a function of monitoring the state of the detection device 3. For example, a network camera can be used as the monitoring device 1. The monitoring device 1 communicates with the client device 2 and the detection device 3.

[0013] The client device 2 controls the operation of the monitoring device 1. For example, an information processing device such as a PC (personal computer) can be used as the client device 2. The client device 2 has a display unit and functions as a display control device that controls the display unit.

[0014] The detector 3 includes detectors that detect situations, such as a PIR (Passive Infrared Ray) sensor or a door sensor. If the detector 3 is a PIR sensor, for example, upon detecting a moving object, the detector 3 transmits a notification command regarding the detection of the moving object to the monitoring device 1. Here, the detector 3 functions as an external device that detects predetermined information. Note that the predetermined information includes information indicating the status of the external device itself.

[0015] Furthermore, if the detection device 3 is moved or its detection direction is changed due to unauthorized operation, the detection device 3 can also transmit a notification command to notify the monitoring device 1 of the detection of that event. The detection device 3 may also have any number of other commands. A command is composed of, for example, a command class, a command name, and a field that is data included in the command, and is communication data used to transmit control and notification between devices.

[0016] Furthermore, since the detection device 3 is, for example, battery-powered and needs to reduce power consumption, it is in a sleep state except when a connection is established or immediately thereafter, and does not immediately return a reply even when the monitoring device 1 queries the detection device 3 about the current detection status. However, even in a sleep state, a notification command is transmitted from the detection device 3 to the monitoring device 1 unless the notification command is configured not to be transmitted immediately.

[0017] The monitoring device 1 and the client device 2 are connected so as to be able to communicate with each other via a network 4. The network 4 is made up of a plurality of routers, switches, cables, etc. that meet a communication standard such as Ethernet (registered trademark). However, as long as communication is possible between the monitoring device 1 and the client device 2, any communication standard, scale, and configuration may be used.

[0018] The client device 2 transmits various types of control information to the monitoring device 1. The control information includes, for example, rule settings (or changes) regarding trigger events and corresponding action rules, and information for controlling the monitoring device 1. The monitoring device 1 transmits a response to the received control information to the client device 2. The monitoring device 1 also transmits information including the content to be displayed on the display unit of the client device 2 to the client device 2.

[0019] The monitoring device 1 and the detection device 3 are connected to each other so that they can communicate with each other, for example, via a wired network 5. The network 5 may be, for example, Z-Wave, Zigbee (registered trademark), Bluetooth (registered trademark), WiFi (registered trademark), or other wireless personal area networks (PANs). Networks based on various communication standards, such as wireless local area networks (LANs), may also be used, and any communication standard, scale, or configuration may be used as long as communication between the monitoring device 1 and the detection device 3 is possible.

[0020] The monitoring device 1 first assigns a node number as a management number to each external device, registers it as a device on the network 5, and then begins monitoring and controlling each device. Furthermore, the monitoring device 1 and the detection device 3 send and receive control commands to establish, maintain, and terminate communication between the monitoring device 1 and the detection device 3 as necessary. There may be multiple detection devices on the network 5. Hereinafter, the explanation will be continued assuming that the monitoring device 1 and the detection device 3 are connected via Z-Wave.

[0021] After connecting the detection device 3 to the client device 2 in a state where they can communicate with each other, the monitoring device 1 receives a control command for setting rules from the client device 2 and sets rules consisting of events associated with notification commands received from the detection device 3 and predetermined actions.

[0022] Furthermore, the monitoring device 1 and the detection device 3 each have a product identification number. A product identification number is a unique identification number assigned to each product, and devices of the same product have the same identification number. Note that the product identification number may be defined as a combination of multiple identification numbers, such as a manufacturer identification number, a product type identification number assigned by the manufacturer, and a product identification number assigned by the manufacturer.

[0023] Next, a description will be given of the configuration of the monitoring device 1. Fig. 2 is a functional block diagram of the monitoring device 1 according to the first embodiment. 2 are realized by causing a computer (not shown) included in the monitoring device 1 to execute a computer program stored in a memory serving as a storage medium. However, some or all of these functions may be realized by hardware. Examples of hardware that can be used include a dedicated circuit (ASIC) and a processor (reconfigurable processor, DSP).

[0024] Furthermore, the functional blocks shown in FIG. 2 do not have to be housed in the same housing, and may be configured as separate devices connected to each other via signal paths. The monitoring device 1 includes functional blocks such as a control unit 11, a storage unit 12, an imaging unit 13, a compression encoding unit 14, a communication unit 15, and an imaging control unit 16. The functional blocks of the monitoring device 1 are connected via a bus 17.

[0025] The control unit 11 has, for example, a CPU (Central Processing Unit) as a computer, and has the function of controlling the monitoring device 1 as a whole. The storage unit 12 includes a memory for storing various data. The storage unit 12 mainly functions as a storage medium for storing various data such as a storage area for computer programs executed by the control unit 11, a work area during execution of the computer programs, and a storage area for image data generated by the imaging unit 13. Furthermore, rule settings created by the control unit 11 are stored in the storage unit 12 as a setting file, and the control unit 11 refers to and updates the settings as needed via the setting file.

[0026] The imaging unit 13 includes, for example, a CMOS image sensor for capturing an image of a subject formed by the imaging optical system of the monitoring device 1, and converts the captured analog image signal into digital image data. The imaging unit 13 also performs necessary image processing on the digital images and sequentially stores them as captured images in the storage unit 12, while receiving an image acquisition event. The control unit 11 receives the image acquisition event from the imaging unit 13 when the captured images are stored in the storage unit 12.

[0027] The compression encoding unit 14 performs compression encoding processing on the captured image stored by the imaging unit 13 based on a format such as JPEG (Joint Photographic Experts Group) or H.264 to generate image data, and stores the image data in the storage unit 12.

[0028] The communication unit 15 receives commands from external devices and transmits to the external devices responses to the commands generated by the control unit 11. The communication unit 15 functions as a communication means for transmitting and receiving predetermined commands to external devices that detect predetermined information, and when communication with an external device is established, the communication unit 15 obtains detection information indicating whether the external device has detected the predetermined information and stores the information in the storage unit 12 as storage means.

[0029] When the communication unit 15 receives a command from an external device, the control unit 11 acquires the content of the command. The communication unit 15 also transmits the control command generated by the control unit 11 to the external device. Furthermore, the communication unit 15 sequentially reads out the image data compressed and encoded by the compression encoding unit 14 from the storage unit 12 and transmits the image data to the client device 2 as a video stream.

[0030] The imaging control unit 16 changes the angle of view of the imaging unit 13 by panning, tilting, zooming, rotating or focusing the driving unit based on the pan, tilt, rotation, zoom or focus values instructed by the control unit 11. Note that the monitoring device 1 may not have a configuration that includes a driving unit.

[0031] If the action in the rule setting is one that does not require imaging, such as an email notification, the monitoring device 1 may be configured not to include the imaging unit 13, the compression encoding unit 14, and the imaging control unit 16.

[0032] Next, examples of events used for rule setting in the monitoring device 1 and their configurations will be described with reference to FIG. FIG. 3 is a diagram showing an example of an event and an example of its configuration in the form of a table according to the first embodiment. The first column in Figure 3 shows examples of various events used in rule settings, the second column shows the notification commands corresponding to the events in the first column, and the third column shows the fields in the notification commands that represent the notification content.

[0033] As shown in the table in Figure 3, each event is defined by a notification command corresponding to that event and a field that indicates the notification content included in the notification command. There may also be additional conditions for generating an event that are set when the rule is set.

[0034] 3, for example, for an unauthorized operation (movement) event indicating that the detector device 3 has been moved or its direction changed unauthorizedly, the notification command from the detector device 3 is a Notification Report command. In addition, the fields indicating the notification content include Notification Type as Home Security and Notification Event / State as Tampering, product moved.

[0035] 3, for a motion detection event indicating that a motion has been detected in the vicinity of the detector device 3, the notification command from the detector device 3 is a Notification Report command. In addition, the fields indicating the notification content have Notification Type as Home Security and Notification Event / State as Motion detection.

[0036] 3, for a no motion detection event indicating that the detector 3 has not detected a motion object, the Notification Type is Home Security. In addition, the fields indicating the notification content include Notification Event / State as State idle and Event / State Parameter as Motion detection.

[0037] The control unit 11 receives a notification command from the detecting device 3 via the communication unit 15 and generates an event corresponding to the received notification command. If an action is associated with the event as a rule setting, the control unit 11 executes the action or instructs an action execution unit to execute the action.

[0038] When establishing communication with the detector 3, the control unit 11 acquires information about the notification command possessed by the detector 3 and the corresponding notification content using an acquisition command, and stores the information in the storage unit 12. Events that can be used in rule settings are determined based on the information about the notification command of the detector 3, with reference to a table such as that shown in FIG.

[0039] It is also assumed that a table such as that shown in Fig. 3 is stored in advance in the storage unit 12. Note that Fig. 3 shows one example of fields representing events, notification commands, and notification contents, and the correspondence between events, notification commands, and fields representing notification contents is not limited to this.

[0040] Next, an example of rule settings in the monitoring device 1 and timing at which a notification command is transmitted when a detection corresponding to an event occurs in the detector 3 will be described with reference to FIG. 4A and 4B are diagrams showing an example of the timing of occurrence of detection corresponding to a single event and rule setting according to embodiment 1. Note that a single event is set in the rule setting of Fig. 4A and 4B. Note that a single event is an event corresponding to a detection that does not create multiple states.

[0041] 4(A) and (B), the monitoring device 1 establishes a connection with the detecting device 3 to enable mutual communication, and then receives a control instruction for rule setting from the client device 2. Then, the monitoring device 1 sets a rule consisting of an event and a predetermined action associated with the notification command received from the detecting device 3. Note that in FIGS. 4(A) and (B), an unauthorized operation (movement) event is set as an example of an event for rule setting.

[0042] 4(A), no unauthorized operation (movement) occurred before the rule was set, but an unauthorized operation (movement) occurred after the rule was set, and a notification command for the unauthorized operation (movement) was sent. In other words, when an unauthorized operation (movement) occurs after the rule was set, a notification command for the unauthorized operation (movement) is sent from the detecting device 3 to the monitoring device 1, and the action set in the rule is executed.

[0043] On the other hand, in the example of Figure 4(B), an unauthorized operation (movement) occurred before the rule was set, but no unauthorized operation (movement) occurred after the rule was set. Therefore, after the rule was set, a notification command for the unauthorized operation (movement) was not sent, and the action set in the rule was not activated. In other words, even though an unauthorized operation (movement) had already occurred, the action was not executed until another unauthorized operation (movement) occurred after the rule was set.

[0044] Next, the rule setting display screen displayed on the client device 2 will be described. 5 is a diagram showing a display screen for setting rules displayed on the client device 2 according to embodiment 1. That is, the diagram shows an example of the display screen 21 of the client device 2 for setting rules that define events in the monitoring device 1 and the actions associated with those events, among the settings in the monitoring device 1.

[0045] The display screen 21 is displayed by a control unit including a computer (not shown) in the client device 2 executing a computer program stored in the memory unit of the client device 2 based on instructions from the user to set events and actions.

[0046] The display screen 21 displays a selection list 211 for setting an event and a selection list 212 for setting an action to be executed when an event is generated. If necessary, the conditions for generating the event, the conditions for executing the action, a schedule, etc. may also be displayed. Furthermore, if the event is a stateful event, a selection list for specifying an action to be taken when the event ends may also be displayed.

[0047] The display screen 21 displays a save button 213 for saving the settings, a cancel button 214 for canceling the settings, etc. If multiple rule settings are possible, a number or name for identifying the rule setting is displayed. For example, in Figure 5, the identification number for rule #1 is displayed.

[0048] The user operates the client device 2 while viewing a display screen such as that shown in Fig. 5 to set (or change) rules in the monitoring device 1. In the selection list 211, an event is set as a trigger for executing an action specified in the selection list 212. For example, in Fig. 5, the trigger is set to be receipt of a notification command of an unauthorized operation (movement) from a device with node number 2 on the network 5.

[0049] Here, it is assumed that the detecting device 3 has been registered in advance as a device with node number 2 on the network 5. The options in the selection list 211 are obtained by the control unit 11 from the storage unit 12, which acquires the notification command and its field information of the detecting device 3, and transmits them to the client device 2 via the communication unit 15.

[0050] An action to be executed when an event is generated is set in the selection list 212. In the example of Fig. 5, start of recording is set as the action, and the image captured by the imaging unit 13 and compressed by the compression encoding unit 14 is stored in the storage unit 12, an external storage unit (not shown), or the like.

[0051] Note that any type of action can be used as long as it can be set by the monitoring device 1. The action may be, for example, image masking control, angle of view control, moving image transmission control, lighting control (not shown), image capture preset position control, or display information superimposed on an image. Furthermore, the action may not use a captured image, such as command transmission control to an external device, message transmission control via the network 4, contact output control (not shown), or audio output control (not shown). The options in the selection list 212 are sent by the control unit 11 to the client device 2 via the communication unit 15 based on action information that can be used in the monitoring device 1.

[0052] When the user presses the save button 213, the control unit of the client device 2 stores the rule setting information in the memory unit. If the cancel button 214 is pressed, the setting is not saved and no setting is made. The control unit of the client device 2 transmits the rule setting information input by the user to the monitoring device 1. The communication unit 15 of the monitoring device 1 receives the rule setting information, and the control unit 11 stores the rule setting information in the memory unit 12, for example, as a setting file.

[0053] Next, a display screen displayed on the client device 2 to notify the client device of the detected state and to prompt the client device to take action will be described with reference to FIG. Fig. 6 is a diagram showing a display screen that notifies the client device 2 of the detected state and prompts the client device 2 to take action according to the embodiment 1. In Fig. 6, after a rule is set or changed on the display screen 21 in Fig. 5, if the control unit 11 determines that a detection corresponding to the event set (changed) in the rule has already occurred before the rule was set or changed, a display such as that shown on the display screen 22 is displayed.

[0054] The display screen 22 is displayed when an instruction is sent from the control unit 11 of the monitoring device 1 to the client device 2 via the communication unit 15 and a program stored in the storage unit of the client device 2 is executed.

[0055] The display screen 22 has a display area 221 that indicates that a detection corresponding to an event set in a rule has already occurred, and indicates the time of detection (or the time the notification command was received). That is, information is sent to the display control device to display the time of detection or the time the notification command was received, which are included in the notification command. The display screen 22 also has a display area 222 that asks whether the action set in the rule should be executed immediately. The display screen 22 also displays a button 223 for deciding to execute the action, and a button 224 for deciding not to execute the action.

[0056] The user operates the client device 2 to decide whether or not to execute an action. Specifically, the user checks the contents of display area 221 and display area 222, and presses button 223 if the action set in rule setting #1 is to be executed. The control unit of the client device 2 then transmits an execution instruction indicating that the action will be executed to the monitoring device 1 via the network 4. The communication unit 15 of the monitoring device 1 then receives the execution instruction, and the control unit 11 controls the execution of the action. Note that by pressing button 224, a cancel instruction indicating that the action will not be executed is transmitted, or no instruction is transmitted.

[0057] In the example of display screen 22, display area 221 displays that an unauthorized operation (movement), which is an event in rule setting #1, was already detected before the rule was set or changed. It also displays that the detection occurred at 12:00 on 2020 / 01 / 01. If detection occurred multiple times, the most recent or oldest detection time may be displayed, or if multiple detections occurred, the times of each detection may be listed and displayed.

[0058] That is, information may be transmitted to the display control device so as to display the times at which multiple detections occurred in the past or the times at which notification commands were received. If the event occurred before the connection was established and the time is unknown, a message to that effect may be displayed. Then, the option to start recording is displayed in the display area 222.

[0059] Fig. 7 is a flowchart showing the processing of the monitoring device 1 according to embodiment 1. In the flowchart of Fig. 7, when the rules for a single event and an action are set or changed in the monitoring device 1 as shown in Fig. 5, the monitoring device 1 performs processing to notify the detection device 3 that a detection corresponding to the event has already occurred and to prompt the execution of an action. The flowchart of FIG. 7 is realized by the control unit 11 of the monitoring device 1 executing a computer program stored in the storage unit 12.

[0060] In step S11, the control unit 11 executes processing to register the detection device 3 on the network 5 and establish a connection with the monitoring device 1. That is, the control unit 11 transmits and receives commands to and from the detection device 3 via the communication unit 15 to exchange various information required to register the detection device 3 as a device on the network 5. The various types of information required include basic information for controlling the detection device 3, such as information on commands that can be used with the detection device 3, information for encrypting the communication channel, setting information for the operation time of the detection device 3, node number, product identification number, etc.

[0061] The control unit 11 stores the information acquired in step S11 in the storage unit 12, thereby completing the registration of the detecting device 3. In the following description, it is assumed that the node number of the detecting device 3 is "2." Note that the detecting device 3 returns the occurrence status of the detected event to the monitoring device 1 using a command such as Notification Report by receiving a command such as a Notification Get command. At that time, the monitoring device 1 may add a process of checking the detection status before the connection is established and storing the information in the storage unit 12, as in step S22 in FIG. 10, which will be described later.

[0062] In step S12, during the period from when the connection is established in step S11 until when the rule is set or changed in step S13, the control unit 11 of the monitoring device 1 stores and updates the detection status of the detecting device 3 corresponding to each event in the storage unit 12. Specifically, when the control unit 11 receives a notification command corresponding to a one-off event from the detecting device 3 via the communication unit 15, it stores information in the storage unit 12 that detection corresponding to that event has already occurred. In other words, when the control unit 11 receives a notification command from an external device and the detection information stored in the storage unit is not detected, it updates the detection information to detected.

[0063] For example, assume that the monitoring device 1 receives a Notification Report command corresponding to an unauthorized operation (movement) event from the detection device 3 as shown in Fig. 3. Note that among the fields indicating the notification content, the Notification Type is set to Home Security, and the Notification Event / State is set to Tampering, product moved.

[0064] In response to this, the monitoring device 1 stores in the storage unit 12 information that detection corresponding to the event has already occurred, together with the time of receipt of the command. Note that the detection status of a stateful event is also stored and updated in the same way, and this processing will be explained in step S23 of FIG. 10 of the second embodiment.

[0065] In step S13, the control unit 11 receives from the client device 2 the rule setting selected by the user via the display screen 21 shown in Fig. 5, and stores the rule setting in the storage unit 12. In the example displayed on the display screen 21 of Fig. 5, rule setting #1 is saved, which specifies that when a notification is received in the event that an unauthorized operation (movement) has occurred from node number 2, recording should be started as an action.

[0066] As a result, when an event occurs, the control unit 11 controls the execution of a specified action based on the rule settings stored in the storage unit 12. Here, step S13 functions as a rule control step (rule control means) that executes a predetermined action in response to detection of predetermined information.

[0067] In step S14, the control unit 11 determines whether or not a detection corresponding to the event set in step S13 has already occurred. Specifically, the control unit 11 refers to information on the detection state stored in the storage unit 12 and determines whether or not the event for which a rule has been set has already been detected. Here, step S14 functions as a determination step (determination means) that determines whether or not the external device has detected the predetermined information, based on detection information indicating whether or not the predetermined information has been detected.

[0068] For example, if the settings are made with the content displayed on the display screen 21, it is determined that detection has already occurred if information is stored indicating that detection of an unauthorized operation (movement) has already occurred, otherwise it is determined that detection has not already occurred. If it is determined that detection has already occurred, the process proceeds to step S15, and if not, the process of the flowchart in FIG. 7 ends.

[0069] In step S15, the control unit 11 instructs the client device 2 to display on the display unit information indicating that a detection corresponding to the event set in the rule has already occurred and a message prompting the user to decide whether to immediately execute an action. That is, the control unit 11 transmits information to the display control device to display a message asking whether to execute an action.

[0070] Specifically, the control unit 11 refers to the memory unit 12 to obtain the detection time and the action associated with the event, and issues an instruction to the client device 2 via the communication unit 15 to execute the display control as shown in FIG. 6.

[0071] Step S15 functions as a notification control step (notification control means) that, when a rule is set or changed, if the determination means determines that the specified information has been detected, sends information to the display control device to display that the information has been detected.

[0072] In step S16, the control unit 11 determines whether or not execution of the action prompted in step S15 has been selected. Specifically, the control unit 11 obtains information from the client device 2 via the communication unit 15 as to whether execution of the action has been selected, and makes this determination. If button 223 in Fig. 6 is pressed, the client device 2 transmits information that execution of the action has been selected, and if button 224 is pressed, the client device 2 transmits information that execution of the action has not been selected, or transmits nothing. If execution of the action has been selected, the process proceeds to step S17; if not, the process of the flowchart in Fig. 7 ends.

[0073] In step S17, the control unit 11 controls the execution of the action set by the rule. For example, in the example of the display screen 21, "start recording" is selected as the action, so the control unit 11 starts storing the video data captured by the imaging unit 13 and compressed by the compression encoding unit 14 in the storage unit 12 or a storage unit of an external storage device (not shown) as recorded data.

[0074] As described above, according to the first embodiment, the monitoring device 1 stores information on whether or not detection corresponding to each event has already occurred in the storage unit 12 when a connection is established with the detector device 3. Then, when a rule is set, the monitoring device 1 checks the information, and if it is determined that the detection of the one-off event set in the rule has already occurred, a message such as that shown in Fig. 6 is displayed on the display screen of the client device 2, indicating that the event has already been detected and urging the user to take an action. This makes it possible to prevent errors such as the user unintentionally not taking an action even though the one-off event set in the rule has already been detected.

[0075] (Embodiment 2) In the first embodiment, a case where a single event is set as a rule setting event is described, but in the second embodiment, a case where a stateful event having multiple states is set as a rule setting event is described. The configuration of the monitoring system according to this embodiment is the same as that of the first embodiment.

[0076] 8 is a diagram showing an example of a table of stateful events according to embodiment 2. The first column shows examples of events used in rule settings, the second column shows information on whether the event is a stateful event or a one-off event, and the third column shows examples of events that are paired with the event to create a state if the event is a stateful event.

[0077] 8, the unauthorized operation (movement) event set in the rules of embodiment 1 is a one-off event, so the value in the second column is NO. Also, it can be seen that the moving object detection event is a stateful event, and the paired event that generates the state is the no moving object detection event.

[0078] In other words, the state of a motion detection event can be considered to be "ON (active)" when motion detection occurs, and "OFF (inactive)" when a no motion detection event occurs. As another example, a door open event is a stateful event, and a door close event is its paired event.

[0079] Note that the events listed in the table shown in Figure 8 are just one example, and in reality, information about more events may be listed. Also, there may be two or more paired events, in which case multiple states may be generated. Also, it is assumed that a table like that shown in Figure 8 is stored in advance in the storage unit 12.

[0080] Next, an example of rule settings in the monitoring device 1 and timing at which a notification command is transmitted when a detection corresponding to an event occurs in the detector 3 will be described with reference to FIG. 9A to 9C are diagrams for explaining examples of the occurrence of detection corresponding to a stateful event and the timing of rule setting. In the rule setting of Fig. 9A to 9C, it is assumed that a stateful event is set.

[0081] 9(A) to 9(C), after establishing a connection that enables mutual communication with the detection device 3, the monitoring device 1 receives a control instruction for rule setting from the client device 2. In response to this, a rule is set that is composed of an event associated with a notification command received from the detection device 3 and a predetermined action. In FIG. 9, a moving object detection event is set as an example of the event for rule setting. FIG. 9(A) is a diagram showing an example of a moving object being detected after the rule was set, FIG. 9(B) is a diagram showing an example of a moving object being detected before the rule was set, and FIG. 9(C) is a diagram showing two examples of detection, one with moving object detection and one without moving object detection, before the rule was set.

[0082] 9(A) to 9(C), there are two states of motion detection in the detector 3: a motion detection state and a no motion detection state. If motion detection occurs in the detector 3 while in the no motion detection state, the state transitions to the motion detection state, and a motion detection notification command is sent from the detector 3 (however, if a connection with the monitoring device 1 has not yet been established, this will not be sent to the monitoring device 1). Also, if no motion detection occurs in the detector 3 while in the motion detection state, the state transitions to the no motion detection state, and a no motion detection notification command is sent from the detector 3 (however, if a connection with the monitoring device 1 has not yet been established, this will not be sent to the monitoring device 1).

[0083] 9(A), no motion detection occurs between the establishment of connection of the detector 3 and the setting of the rule, but motion detection occurs after the rule is set, resulting in the transmission of a motion detection notification command. In other words, the timing at which motion detection occurs after the rule is set causes the detector 3 to transmit a motion detection notification command to the monitoring device 1, and the action set in the rule is executed.

[0084] 9(B), motion detection occurs before the connection of the detector 3 is established, and the motion detection state continues after the rule is set. Therefore, after the rule is set, the motion detection notification command is not sent to the monitoring device 1, and the action set in the rule is not triggered. Therefore, even though motion detection has already occurred, the action set in the rule will not be executed until the state returns to no motion detection, then transitions to the motion detection state and the motion detection notification command is sent.

[0085] 9(C), a motion detection occurs before the connection of the detector 3 is established, resulting in a transition to the motion detection state, but then a no motion detection occurs, resulting in a no motion detection state again, after which a rule is set. Therefore, in this case, as in the example of FIG. 9(A), a motion detection notification command is sent from the detector 3 to the monitoring device 1 at the timing when motion detection occurs after the rule is set, and the action set in the rule is executed.

[0086] Next, the flow of the second embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the processing of the monitoring device 1 according to the second embodiment. The flowchart of Fig. 10 is realized by the control unit 11 of the monitoring device 1 executing a program stored in the storage unit 12.

[0087] 10, when a rule for a stateful event and an action is set or changed, the monitoring device 1 according to the second embodiment determines whether there is information indicating that a detection corresponding to the event has already occurred in the detecting device 3. If an event has already occurred, the user is notified of this and asked or prompted to take an action.

[0088] The process of step S21 is the same as that of step S11 in FIG. In step S22, immediately after the connection is established, the control unit 11 acquires and stores the occurrence state of detection corresponding to the stateful event in the detecting device 3. That is, it checks whether or not a detection has already occurred before the connection is established.

[0089] Here, when the connection is established, the control unit 11 acquires information about which notification commands and their fields the detector device 3 supports via the communication unit 15 and stores the information in the storage unit 12. Therefore, the control unit 11 refers to the tables of Fig. 3 and Fig. 8 stored in the storage unit 12, and to the information about the notification commands and their fields that the detector device 3 supports. Then, the control unit 11 acquires the detection status corresponding to each stateful event from the detector device 3 via the communication unit 15 and stores the status in the storage unit 12.

[0090] For example, if the events corresponding to the detection by the detector 3 are unauthorized operation (movement), moving object detection, and no moving object detection, it can be seen from Fig. 8 that the stateful event is moving object detection (and no moving object detection). The control unit 11 transmits a command to the detector 3 to check the detection status of moving object detection, and receives a notification command. That is, in this embodiment, a command to check whether the external device has detected specified information is transmitted to the external device, and detection information indicating that detection has occurred is obtained.

[0091] Specifically, the command to be checked is a Notification Get command, and the Notification Type field of the command is set to "Home Security." Also, the Notification Event / State is set to "Motion detection." Alternatively, the Notification Type may be set to 0xFF and the Notification Event / State to 0x00.

[0092] The notification command for motion detection is as explained in Figure 3 of the first embodiment. If a notification command indicating the notification content of motion detection is returned, it means that motion detection has already occurred, and if the notification command indicating the notification content of no motion detection is returned, it means that motion detection has not already occurred. The acquired state of motion detection is stored in the memory unit 12. If the detector 3 returns the detection occurrence status before connection establishment even for detection corresponding to a single event, the same processing may be executed. Also, if the detector 3 does not return a response to a command to check the detection status, the processing of this step may be omitted.

[0093] In step S23, from the time when the connection is established in step S11 until the time when the rule is set in step S13, the state of each detection of the detecting device 3 is stored and updated as needed, for example, at a predetermined interval. Specifically, when the control unit 11 receives a notification command corresponding to an event from the detecting device 3 via the communication unit 15, the control unit 11 stores information in the storage unit 12 that the detection corresponding to the event has already occurred. However, in the case of a stateful event, when the control unit 11 receives a notification command corresponding to a paired event, the state returns to a state in which the detection has not already occurred.

[0094] That is, when a notification command is received regarding other information that creates multiple states together with the specified information, and the detection information regarding the specified information is stored in the storage means as having been detected, the detection information is updated to not having been detected.

[0095] For example, as shown in Fig. 9(C), even if a moving object detection state is reached, if a notification command indicating no moving object detection is subsequently received, the moving object detection state will return to a state in which no detection has occurred. Note that the detection state is also stored and updated for a single event, and the processing is the same as step S12 in Fig. 7 described in the first embodiment.

[0096] The processing in steps S24 to S28 is the same as the processing in steps S13 to S17 in Fig. 7. However, in Fig. 10, it is assumed that a stateful event is set in step S24, and for example, an event is set to receive a notification when a moving object is detected from node number 2.

[0097] As described above, according to the second embodiment, the monitoring device 1 stores information on whether or not a detection corresponding to each event has already occurred in the storage unit 12 after establishing a connection with the detecting device 3. However, in the case of a detection corresponding to a stateful event, the state has a state, and when a detection of a paired event occurs, the state transitions to one in which the detection has not already occurred.

[0098] That is, when a rule is set, the information stored in the storage unit 12 is checked. Then, if it is determined that the stateful event set in the rule has already been detected, a message indicating that the event has been detected and a message prompting the user to take action are displayed on the display screen of the client device 2. This makes it possible to prevent errors such as the user not taking action unintentionally, even though the event set in the rule has already been detected.

[0099] (Other embodiments) Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to such specific embodiments, and modifications and the like are possible within the scope of the present invention. The above-described embodiments 1 and 2 may be combined as appropriate.

[0100] For example, the control unit 11 may transmit a Z-Wave Plus Info Get command via the communication unit 15 when establishing a connection with the detector 3, and may receive a Z-Wave Plus Info Report command as a reply. Alternatively, the value of the Role Type field included in the Z-Wave Plus Info Report command may be used to obtain information on whether the detector 3 will always immediately send a reply command without entering a sleep state.

[0101] In this case, when the detecting device 3 receives a command such as Notification Get, it may always immediately return the past detection occurrence status using a command such as Notification Report. In such a case, the control unit 11 may not execute the processes of step S12, step S22, and step S23, and may instead inquire of the detecting device 3 using a command such as Notification Get to confirm the detection occurrence status corresponding to the event when setting the rule.

[0102] Alternatively, an event set in a rule may be generated when, in addition to receiving a notification command, the value of an additional condition set in the event is also satisfied. In this case, the reception information of the notification command and the information on the value related to detection included in the notification command are all stored in the storage unit 12, and it is then possible to determine whether a detection corresponding to the set event has already occurred.

[0103] For example, the event set in the rule is a temperature change event, and the value of the additional condition is a change of 10°C or more. In this case, when setting the rule, the control unit 11 checks the information stored in the memory unit 12. Then, if a temperature change has occurred (a notification command corresponding to a temperature change has been received) before the rule was set, and the temperature value included in the notification command has changed by 10°C or more, it is determined that a temperature change of 10°C or more has already been detected.

[0104] Furthermore, with regard to the processing of step S23 in the second embodiment, even in the case of a stateful event, once a detected state has occurred, the state may not return to a state in which detection has not occurred even if a notification command corresponding to a paired event is received.

[0105] 7 and 10 may be events that indicate an abnormality in the detector 3 itself. For example, events such as unauthorized operation (movement), unauthorized operation (removing the cover), and low battery are unlikely to be detected again unless the user notices the abnormality and normalizes the state of the detector 3 itself. Therefore, if a detection occurs before the rule is set, there is a high possibility that the situation will continue without the user noticing the abnormality, so it is sufficient to detect events that indicate an abnormality in the detector 3 itself before the rule is set.

[0106] Furthermore, some or all of the functional configuration of the above-described monitoring system may be implemented as hardware in the monitoring device 1, the client device 2, and the detection device 3. Furthermore, at least a part of the configuration of the monitoring device 1 may be realized by hardware. In this case, for example, a specific compiler may be used to automatically generate a dedicated circuit on an FPGA (Field Programmable Gate Array) from a program for realizing each step.

[0107] Alternatively, a gate array circuit may be formed in the same manner as an FPGA, and the circuit may be realized as hardware, or may be realized by an ASIC (Application Specific Integrated Circuit). Furthermore, the configurations and processes of the above-described embodiments may be applied to computers and various devices other than the monitoring device 1, the client device 2, and the detector device 3.

[0108] The present invention has been described in detail above based on its preferred embodiments, but the present invention is not limited to the above embodiments, and various modifications are possible based on the gist of the present invention, and these modifications are not excluded from the scope of the present invention. Note that a computer program that realizes part or all of the control functions of the above-described embodiments may be supplied to a monitoring device, monitoring system, etc. via a network or various storage media. A computer (or a CPU, MPU, etc.) in the monitoring device, monitoring system, etc. may then read and execute the program. In this case, the program and the storage medium storing the program constitute the present invention. [Explanation of symbols]

[0109] 1...Monitoring device 2...Client device 3. Detection equipment 4,5…Network 11...Control unit 12...Storage section 13...imaging unit 14...Compression coding unit 15…Communications Department 16...Imaging control unit 17...Bus

Claims

1. a rule control means for controlling the setting of a rule for executing a predetermined action in response to detection of predetermined information; a storage means for transmitting and receiving a predetermined command to an external device that detects the predetermined information, acquiring detection information from the external device indicating whether the external device has detected the predetermined information when communication with the external device is established, and further storing the detection information; a determination means for determining whether the predetermined information has been detected based on the detection information; a notification control means for transmitting information to a display control device to display that the predetermined information corresponding to the rule has been detected when the rule control means sets the rule or changes the rule from a rule different from the rule to the rule, if the determination means determines that the predetermined information corresponding to the rule has been detected; and and The monitoring device is characterized in that the rule is composed of the predetermined information and the predetermined action.

2. 2. The monitoring device according to claim 1, wherein the determining means receives a notification command from the external device and determines whether the predetermined information has been detected based on the detection information.

3. The monitoring device according to claim 2, characterized in that the storage means receives a notification command from the external device and, if the detection information is stored in the storage means as not having been detected, updates the detection information to having been detected.

4. The monitoring device according to claim 2, characterized in that the storage means receives a notification command regarding other information that creates multiple states together with the specified information, and if the detection information regarding the specified information is stored in the storage means as having been detected, updates the detection information to not having been detected.

5. 2. The monitoring device according to claim 1, wherein the notification control means transmits information to a display control device to cause the display control device to display a message asking whether or not to execute the action.

6. The monitoring device according to claim 2, characterized in that the notification control means acquires the detection information by sending a command to the external device to confirm whether the external device has detected the specified information.

7. 2. The monitoring device according to claim 1, wherein the predetermined information is information indicating the state of the external device itself.

8. 3. The monitoring device according to claim 2, wherein the notification control means transmits information to a display control device so as to display the detection occurrence time or the reception time of the notification command included in the notification command.

9. 9. The monitoring device according to claim 8, wherein the notification control means transmits information to a display control device so as to display a plurality of times at which the detections occurred in the past or the time at which the notification command was received.

10. a rule control step for controlling the setting of a rule for executing a predetermined action in response to detection of predetermined information; a storage step of transmitting and receiving a predetermined command to an external device that detects the predetermined information, acquiring detection information from the external device indicating whether the external device has detected the predetermined information when communication with the external device is established, and further storing the detection information; a determination step of determining whether or not the predetermined information has been detected based on the detection information; a notification control step of transmitting information to a display control device to display that the predetermined information corresponding to the rule has been detected when the rule is set in the rule control step or when a rule different from the rule is changed to the rule in the rule control step and the predetermined information corresponding to the rule has been detected in the determination step, A monitoring method, wherein the rule is composed of the predetermined information and the predetermined action.

11. A program for causing a computer to function as each of the means of the monitoring device according to any one of claims 1 to 10.

12. A computer-readable storage medium storing the program according to claim 11.

Images