Surveillance equipment and surveillance systems

Abstract

To ensure that an attendant is able to immediately assess a situation of a person entering a detection area and quickly take appropriate action according to the person's situation.SOLUTION: A monitoring server 3 detects events to be reported based on camera images of a monitored area in a facility taken by a camera 1, and instructs a mobile terminal 5, an in-facility fixed terminal 6, and a fixed terminal 7 at a command station to perform a predetermined reporting operation. In particular, the monitoring server 3 detects a person from the camera image, recognizes the posture of the detected target person, detects an event to be reported based on the posture of the target person entering a detection area set within the monitoring area, and controls the reporting operation of multiple terminals of different types (the mobile terminal 5, the in-facility fixed terminal 6, and the fixed terminal 7 at the command station), following a predetermined reporting procedure according to the detected event.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a monitoring device and a monitoring system that detects an event that requires a notification based on camera images of a monitored area within a facility and instructs a notification device to perform a predetermined notification operation. [Background technology]

[0002] At railway stations, passengers sometimes fall from the platform onto the tracks, and it is desirable to detect such accidents early and quickly implement necessary measures such as operating an emergency stop and rescuing the passengers.

[0003] Therefore, a technology has been known in the past that uses camera images of the platform and the tracks to detect a person who has fallen from the platform onto the tracks and notify station staff of the fact that a person has fallen (see Patent Document 1). This technology also detects workers working on the tracks and identifies whether the person on the tracks is a worker or someone who has fallen. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-276605 Summary of the Invention [Problem to be solved by the invention]

[0005] Now, when a person falls from the platform onto the tracks, the response of the staff will differ depending on the situation of the person who fell. For example, if the person is unable to move on the tracks, it is a high urgency and staff must rush to the scene. On the other hand, if the person who fell immediately climbs back onto the platform on their own, it is less urgent and there may be no need to issue an alarm in the first place.

[0006] On the other hand, conventional technology only uses background subtraction to determine whether an object has newly appeared on the tracks and to uniformly notify station staff that a person has fallen by distinguishing between the person who fell and the worker. This poses a problem in that the staff cannot immediately grasp the situation of the person who fell.

[0007] Therefore, the main object of the present invention is to provide a monitoring device and a monitoring system that allows staff to instantly grasp the situation of a person who has entered a detection area and quickly take appropriate action according to the person's situation. [Means for solving the problem]

[0008] The monitoring device of the present invention is Cameras installed in each designated monitoring area a monitoring device equipped with a processor that acquires camera images taken by a camera, detects an event that should be reported for each camera, and instructs an alarm device to perform a predetermined alarm operation, wherein the processor, based on the operation of an administrator from a management terminal, sets, in advance, for each camera, information regarding the posture of a person entering a detection area set within the monitoring area, as well as at least one of the person's entry status into the detection area, status of stay in the detection area, and status of movement, as detection conditions for an event that should be reported; when a person entering the detection area is detected from the camera image, the processor determines whether the detected person matches the detection condition for an event that should be reported, and if it determines that the detected person matches the detection condition, it controls the alarm operation of multiple different types of alarm devices in accordance with a predetermined alarm procedure corresponding to the event that should be reported.

[0009] In addition, the surveillance system of the present invention is configured to include the surveillance device, a plurality of cameras that photograph the surveillance area, and a plurality of alarm devices that perform predetermined alarm operations in response to instructions from the surveillance device. [Effects of the Invention]

[0010] According to the present invention, In addition, information regarding at least one of the person's entry status into the detection area, the person's stay status in the detection area, and the person's movement status is included in the detection conditions for an event to be notified.Based on this, events that require an alert can be detected in a manner that allows the person's situation to be identified. Furthermore, alerts are issued by multiple different types of alert devices according to an alert procedure that corresponds to the detected event. This allows staff to immediately grasp the situation of a person who has entered the detection area and quickly take appropriate action according to the person's situation. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a diagram illustrating the overall configuration of a monitoring system according to an embodiment of the present invention. [Figure 2] An explanatory diagram showing an overview of the processing performed by the monitoring server [Figure 3] Block diagram showing the general configuration of the monitoring server [Figure 4] An explanatory diagram showing the settings screen displayed on the management terminal [Figure 5] FIG. 10 is an explanatory diagram showing a notification screen displayed on a mobile terminal; [Figure 6] FIG. 10 is an explanatory diagram showing a notification screen displayed on a fixed terminal in a facility. [Figure 7] An explanatory diagram showing a notification screen displayed on a fixed terminal in the control center. [Figure 8] Flow diagram showing the processing steps performed by the monitoring server DETAILED DESCRIPTION OF THE INVENTION

[0012] The first invention made to solve the above problem is a Cameras installed in each designated monitoring areaa monitoring device equipped with a processor that acquires camera images taken by a camera, detects an event that should be reported for each camera, and instructs an alarm device to perform a predetermined alarm operation, wherein the processor, based on the operation of an administrator from a management terminal, sets, in advance, for each camera, information regarding the posture of a person entering a detection area set within the monitoring area, as well as at least one of the person's entry status into the detection area, status of stay in the detection area, and status of movement, as detection conditions for an event that should be reported; when a person entering the detection area is detected from the camera image, the processor determines whether the detected person matches the detection condition for an event that should be reported, and if it determines that the detected person matches the detection condition, it controls the alarm operation of multiple different types of alarm devices in accordance with a predetermined alarm procedure corresponding to the event that should be reported.

[0013] According to this, the posture of the person In addition, information regarding at least one of the person's entry status into the detection area, the person's stay status in the detection area, and the person's movement status is included in the detection conditions for an event to be notified. Based on this, events that require an alert can be detected in a manner that allows the person's situation to be identified. Furthermore, alerts are issued by multiple different types of alert devices according to an alert procedure that corresponds to the detected event. This allows staff to immediately grasp the situation of a person who has entered the detection area and quickly take appropriate action according to the person's situation.

[0015] This allows for accurate detection of events that require an alert. The information on the entry status may be, for example, the direction from which the target person entered the detection area, the information on the stay status may be, for example, the time the target person stayed in the detection area, and the information on the movement status may be, for example, whether or not the target person moved.

[0016] Also, Second The invention further comprises the processor: The posture of the person included in the detection conditions The system is configured to recognize any of the following postures: standing, crouching, lying face down, and lying face up.

[0017] This allows for accurate detection of an event that requires a report to be issued based on the posture of the target person.

[0018] Also, Third The invention is characterized in that the processor uses an image recognition model constructed by machine learning using the camera images as training data, The posture of the person included in the detection conditions The configuration is to recognize the following.

[0019] This allows the posture of a person to be recognized with high accuracy using an image recognition model (classifier). Note that the process of detecting a person from a camera image may also be performed using an image recognition model. Furthermore, the process of detecting a person from a camera image and the process of recognizing the posture of a person may be performed together using an image recognition model.

[0020] Also, Fourth The invention is configured such that the processor causes the notification device to display an image that makes it possible to identify the occurrence status of an event for each camera.

[0021] This allows facility staff to immediately grasp the occurrence status of an event for each camera. In this case, for example, a notification screen that notifies facility staff that a predetermined event has occurred may display a status mark for each camera, whose form (color, etc.) changes depending on the occurrence status of the event, as an image that makes it possible to identify the occurrence status of the event for each camera.

[0022] Also, Fifth The invention is configured such that the processor causes the notification device to display an image that makes it possible to identify the occurrence status of an event for each facility.

[0023] This allows a staff member in the control department who oversees the facilities to immediately grasp the occurrence status of an event at each facility. In this case, for example, on a notification screen that notifies a staff member in the control department that a predetermined event has occurred, an operation unit (e.g., a tab) for selecting a facility may be displayed as an image that makes it possible to identify the occurrence status of the event at each facility, and the form (e.g., color) of the operation unit may change depending on the occurrence status of the event.

[0024] Also, SixthThe invention is configured such that the processor controls the notification operations of multiple different types of notification devices, including mobile terminal devices carried by staff, fixed terminal devices installed in the facility, and fixed terminal devices installed in a department that oversees multiple facilities.

[0025] According to this, if the detected event is highly urgent, the notification can be made by the mobile terminal device, allowing staff to rush to the scene and take appropriate action quickly.Also, if the detected event is not highly urgent, the notification can be made by the fixed terminal device, reducing unnecessary notifications.

[0026] A seventh aspect of the present invention is a system including the monitoring device; A camera that photographs the predetermined monitoring area and a plurality of alarm devices that perform a predetermined alarm operation in response to an instruction from the monitoring device.

[0027] This allows the staff member to instantly grasp the situation of the person who has entered the detection area, as in the first aspect of the invention, and can quickly take appropriate action according to the situation of the person.

[0028] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0029] FIG. 1 is a diagram showing the overall configuration of a monitoring system according to this embodiment.

[0030] This monitoring system detects events that require an alert, specifically, a person falling from the platform onto the tracks at a railway station (facility) or a person entering the tracks without permission (an intruder), and notifies staff of the event.

[0031] This monitoring system includes a camera 1, a recorder 2 (recording device), a monitoring server 3 (monitoring device), a management terminal 4, a mobile terminal 5 (alarm device, mobile terminal device), an in-facility fixed terminal 6 (alarm device, fixed terminal device), a command center fixed terminal 7 (alarm device, fixed terminal device), and a speaker 8. The camera 1, recorder 2, monitoring server 3, management terminal 4, mobile terminal 5, in-facility fixed terminal 6, command center fixed terminal 7, and speaker 8 are connected to each other via a network.

[0032] Camera 1 is installed in each designated monitoring area within the station. Camera 1 captures images of the platform and the tracks along the platform as its monitoring area. Camera 1 transmits the camera images of the monitoring area to recorder 2 and monitoring server 3 via the network.

[0033] Recorder 2 acquires and stores camera images from camera 1.

[0034] The monitoring server 3 is installed in an equipment room, a data center, or the like within the station. The monitoring server 3 acquires camera images from the camera 1 and detects events that warrant a report, specifically, a person falling from the platform onto the tracks (a fallen person) or a person entering the tracks without permission (an intruder). When the monitoring server 3 detects an event that warrants a report, it notifies a staff member. Specifically, it instructs the mobile terminal 5, the in-facility fixed terminal 6, the control center fixed terminal 7, and the speaker 8 to perform a predetermined report operation. Note that, in the example shown in FIG. 1, a monitoring server 3 is provided for each station (facility), but the functions of the monitoring server 3 may also be realized by a cloud computer.

[0035] The management terminal 4 is operated by an administrator and is configured by a PC, etc. The management terminal 4 displays a setting screen (see FIG. 4) on which the administrator can perform various setting operations.

[0036] The mobile terminal 5 is a mobile terminal such as a smartphone or tablet terminal. The mobile terminal 5 is carried by a staff member who rushes to the scene and takes the necessary measures. In response to instructions from the monitoring server 3, the mobile terminal 5 displays a notification screen (see FIG. 5) and outputs an alarm sound or vibration to notify the staff member that an event requiring a notification has occurred.

[0037] The in-facility fixed terminal 6 is installed in an office or the like within the station premises. The in-facility fixed terminal 6 can be realized by installing a notification application on a PC. In response to an instruction from the monitoring server 3, the in-facility fixed terminal 6 displays a notification screen (see FIG. 6) as a notification operation to notify station staff that a predetermined event has occurred.

[0038] The control center fixed terminal 7 is installed in a control center (management center). The control center is a department that oversees multiple stations (facilities) included in the line section under its jurisdiction. The control center fixed terminal 7 can be realized by installing a notification application on a PC. In response to instructions from the monitoring server 3, the control center fixed terminal 7 displays a notification screen (see Figure 7) as a notification operation to notify the control center staff that a specific event has occurred.

[0039] The speaker 8 is installed near the camera 1. In response to an instruction from the monitoring server 3, the speaker 8 outputs sounds such as an alarm or spoken voice as a notification operation to notify station staff that a predetermined event has occurred.

[0040] In this embodiment, an example has been described in which the facility to be monitored is a railway station, but the facility to be monitored is not limited to a railway station. The facility to be monitored may be, for example, an airport or a retail store.

[0041] Next, an outline of the processing performed by the monitoring server 3 will be explained. FIG.

[0042] In this embodiment, a detection area is set on the camera image, and the occurrence of an event that requires a notification (an alert event) is detected based on the state of a person entering this detection area. At this time, if a predetermined detection condition is satisfied for the person who entered the detection area, it is determined that an event that requires a notification has occurred, and a notification is issued.

[0043] Here, if a person falls from the platform onto the tracks and is unable to move on the tracks, the situation is highly urgent and staff must rush to the scene. On the other hand, if a person also falls onto the tracks but quickly climbs back up onto the platform on their own, the situation is less urgent and there may be no need to issue an alert in the first place. Also, if a worker is working on the tracks, there is no need for staff to rush to the scene, but it is desirable to issue an alert to alert staff in the office within the station. Also, in the case of an intruder entering the tracks without permission, staff must rush to the scene, but the urgency is lower than in the case of a person who has fallen.

[0044] Therefore, in this embodiment, the posture of the target person is set as a detection condition. Specifically, the detection condition is set to be a posture other than standing, that is, a posture of either crouching (squatting), lying face down, or lying on one's back. The detection condition is also set to be that the target person stays in the detection area for a predetermined period of time or more. The detection condition is also set to be that the target person does not move.

[0045] In the example shown in Fig. 2(A-1), the target person stays in the detection area in a posture other than standing for a predetermined time or more and does not move, so the detection conditions related to posture, stay time, and movement are met, it is determined that an event that requires an alert has occurred, and an alert is issued. On the other hand, in the example shown in Fig. 2(A-2), the target person changes from a posture other than standing to a standing posture, and does not continue in a posture other than standing for a predetermined time or more, so the detection conditions related to posture, stay time, and movement are not met, it is not determined that an event that requires an alert has occurred, and an alert is not issued.

[0046] Furthermore, the nature of the event that occurs will differ depending on the direction from which the person entered the detection area, i.e., depending on where the person was immediately before entering the detection area. For example, if a person falls from a platform onto the tracks, they will cross the boundary line between the platform and the tracks and enter the tracks, which are part of the detection area.

[0047] Therefore, in this embodiment, the direction in which a person is expected to enter the detection area when a predetermined event occurs is set as a detection condition. Specifically, as shown in Figures 2(B-1) and (B-2), a judgment line is set on the boundary line of the detection area (here, the vertical line on the left side) that a person is expected to cross when a predetermined event occurs, and only when a person crosses the judgment line when entering the detection area, it is determined that the predetermined event has occurred and an alert is issued.

[0048] In the example shown in Figure 2 (B-1), the target person crossed the judgment line to enter the detection area, so the detection conditions regarding the entry direction were met, it was determined that an event requiring an alert had occurred, and an alert was issued. On the other hand, in the example shown in Figure 2 (B-2), the target person entered the detection area without crossing the judgment line, so the detection conditions regarding the entry direction were not met, it was not determined that an event requiring an alert had occurred, and an alert was not issued.

[0049] Next, we will explain the general configuration of the monitoring server 3. Figure 3 is a block diagram showing the general configuration of the monitoring server 3.

[0050] The monitoring server 3 includes a communication unit 11, a memory 12, and a processor 13.

[0051] The communication unit 11 communicates with the camera 1, recorder 2, management terminal 4, mobile terminal 5, in-facility fixed terminal 6, command center fixed terminal 7, and speaker 8 via the network.

[0052] The memory 12 stores programs executed by the processor 13 and the like.

[0053] The processor 13 performs various processes by executing programs stored in the memory 12. In this embodiment, the processor 13 performs image acquisition processing, person detection processing, entry determination processing, posture determination processing, entry direction determination processing, stay determination processing, movement determination processing, event detection processing, alert procedure selection processing, and notification processing.

[0054] In the image acquisition process, the processor 13 acquires camera images received from each camera 1 via the communication unit 11. The camera 1 transmits camera images of the monitoring area taken at a predetermined frame rate (for example, 5 fps).

[0055] In the person detection process, processor 13 detects people from camera images. This person detection process can be performed using an image recognition model (machine learning model) constructed by machine learning such as deep learning using camera images as learning data. Here, processor 13 also performs a process of tracking people, that is, a process of matching the same people detected from camera images (frames) at each time (person tracking process).

[0056] In the entry determination process, it is determined whether or not the target person has entered the detection area based on the position of the target person detected in the person detection process.

[0057] In the posture determination process, the processor 13 recognizes the posture of the target person (standing, crouching, face down, face up, etc.) based on the person image extracted from the camera image (posture recognition process), and determines whether the recognized posture matches the detection conditions set for each event for which an alert should be issued. This posture recognition process can be performed using an image recognition model (machine learning model) constructed by machine learning such as deep learning using the camera image as learning data. Note that the person detection process and posture detection process may be performed at the same time using the same image recognition model.

[0058] In the approach direction determination process, based on the tracking information of the target person obtained in the person detection process, processor 13 identifies the determination line that the target person crossed when entering the detection area as the approach direction of the target person into the detection area, and determines whether the determination line matches the detection conditions set for each event for which an alert should be issued.

[0059] In the stay determination process, processor 13 obtains the time that the target person stays in the detection area (stay time), i.e., the elapsed time from the time entry into the detection area is detected to the current time, and determines whether the stay time of the target person matches the detection conditions set for each event for which an alert should be issued.

[0060] In the movement determination process, processor 13 determines whether the movement of the target person matches the detection conditions for an event that should trigger an alert. In this movement determination process, if the target person's position remains unchanged for a predetermined period of time or longer, it is determined that there is no movement. Also, if both the target person's position and posture remain unchanged for a predetermined period of time or longer, it is determined that there is no movement. It may also be determined that there is no movement if the change in the target person's position per predetermined period of time is extremely small (for example, less than 30 cm).

[0061] In the event detection process, the processor 13 detects that an event requiring an alert (such as a person falling, an intruder, or a worker) has occurred based on the results of the posture determination process, the approach direction determination process, the stay determination process, and the movement determination process.

[0062] In the notification procedure selection process, the processor 13 selects a notification procedure corresponding to the event detected in the event detection process. In this embodiment, a notification procedure is set for each event for which a notification should be issued.

[0063] In the notification process, the processor 13 instructs the mobile terminal 5, the in-facility fixed terminal 6, and the command center fixed terminal 7 to perform a notification operation to notify staff that a predetermined event has occurred. At this time, the processor 13 causes at least one of the mobile terminal 5, the in-facility fixed terminal 6, and the command center fixed terminal 7 to perform the notification operation in sequence, according to the notification procedure selected in the notification procedure selection process. As the notification operation, the mobile terminal 5, the in-facility fixed terminal 6, and the command center fixed terminal 7 display a predetermined notification screen (see FIGS. 5, 6, and 7).

[0064] Furthermore, in the notification process, the processor 13 instructs the speaker 8 to perform a notification operation to notify a staff member that a predetermined event has occurred. The speaker 8 outputs a sound such as an alarm sound or spoken voice as the notification operation. At this time, the processor 13 may appropriately select and execute a notification procedure from among a notification procedure in which only the speaker 8 installed near the location where the event occurred performs the notification operation, a notification procedure in which all the speakers 8 installed on the platform facing the location where the event occurred perform the notification operation, and a notification procedure in which all the speakers 8 installed within the station (facility) premises perform the notification operation.

[0065] Next, a description will be given of the setting screen 21 displayed on the management terminal 4. FIG.

[0066] A setting screen 21 is displayed on the management terminal 4. This setting screen 21 is displayed for each camera 1, and the administrator can perform operations relating to various setting items for each camera 1.

[0067] The setting screen 21 is provided with a camera image display section 22. The camera image display section 22 displays a camera image 31.

[0068] Furthermore, the camera image display unit 22 displays a detection area 32. Specifically, a frame image indicating the range of the detection area 32 is displayed in a predetermined color (e.g., blue) on the camera image 31. This detection area 32 is an area that is the target when detecting an event that requires an alert, and it is determined whether or not a predetermined event has occurred regarding a person who has entered this detection area 32. Furthermore, the camera image display unit 22 displays the names (L1 to L5) of the determination lines that form the boundary lines of the detection area 32.

[0069] Furthermore, a mask area 33 is displayed on the camera image display unit 22. Specifically, a frame image of the mask area 33 is displayed in a predetermined color (for example, red) on the camera image 31. This mask area 33 is an area in which human detection is not performed, and is set in a place where there is little possibility of a human being being present, such as on a roof, or on a wall where there is a high possibility of false detection of a human being, such as when a poster is posted.

[0070] The setting screen 21 also has an input field 23 for person detection. The input field 23 for person detection has an input field 41 for the range of the detection area, an input field 42 for the range of the mask area, and an input field 43 for the threshold value for the person detection process.

[0071] In the input field 41 for the range of the detection area, the administrator can specify the range of the detection area as a polygon. Specifically, the administrator can input the positions of multiple vertices of the polygonal detection area by specifying them on the camera image 31 of the camera image display unit 22 using a pointing device. The administrator can also directly input the coordinate values ​​of each vertex into the input unit 44 (input box) using a keyboard.

[0072] In the input field 42 for the range of the mask area, the administrator can specify the range of the mask area as a polygon, just like the detection area. Specifically, the administrator can input the positions of multiple vertices of the polygonal detection area by specifying them on the camera image 31 of the camera image display unit 22 using a pointing device. The administrator can also directly input the coordinate values ​​of each vertex into the input unit 45 using a keyboard.

[0073] In the input field 43 for the threshold value of the person detection process, the administrator can use the keyboard to directly input the threshold value of the person detection process into the input unit 46. The threshold value of the person detection process is a threshold value used when determining a person based on the score (a numerical value indicating the likelihood that the person is a person) obtained in the person detection process, and if the score is equal to or greater than the threshold value, it is determined to be a person.

[0074] The setting screen 21 also has an input field 24 for detection conditions. The input field 24 for detection conditions has an input field 51 for the person's posture, an input field 52 for the person's approach direction, an input field 53 for the person's stay time, and an input field 54 for the person's movement.

[0075] In this detection condition input field 24, the administrator can set multiple detection conditions for events to be reported by combining detection conditions related to the person's posture, entry direction, stay time, and movement. In the example shown in Fig. 4, detection conditions for two events, #1 and #2, are set. Event #1 is the case of a person falling, and event #2 is the case of a worker.

[0076] In the input field 51 for posture, the administrator can specify standing, crouching, prone, and supine as the posture of the person. The administrator can also specify crouching, prone, and supine together as postures other than standing. In the example shown in FIG. 4, the administrator can select the posture of the person using a pull-down menu in the input unit 55. In addition, a multiple selection button 56 is provided, and when the administrator operates this multiple selection button 56, a selection screen is displayed, and on this selection screen, multiple postures can be selected using check boxes.

[0077] In the example shown in Figure 4, event #1 is the case of a person who has fallen, and in this case, unless the person is able to immediately climb back up onto the platform by themselves, the person will be in a position other than standing and will not be moving, so "other than standing" is selected as the posture detection condition. On the other hand, event #2 is the case of a worker, and in this case, the person will be working in a standing position, so "standing" is selected. Note that if there is a possibility that the worker will be working while crouching, "standing" and "crouching" are selected.

[0078] The detection condition for a person's posture differs depending on the location to be monitored. For example, in locations such as roads and escalators where a posture other than standing is unusual, the detection condition for a person's posture can be set to "other than standing," as in the case of a person falling off a train track. On the other hand, there are also locations where a standing posture is unusual, such as waiting rooms with chairs, and in such locations the detection condition for a person's posture can be set to "standing."

[0079] In the entry field 52 for the entry direction, the administrator can specify the judgment line that the target person will cross when entering the detection area as the entry direction of the target person into the detection area. In the example shown in Fig. 4, the administrator can select the judgment line using a pull-down menu in the input unit 57. In addition, a multiple selection button 58 is provided, and when the administrator operates this multiple selection button 58, a selection screen is displayed on which multiple judgment lines can be selected using check boxes.

[0080] 4, the range of the detection area 32 is specified as a pentagon on the camera image 31 of the camera image display unit 22, and five judgment lines L1 to L5 are set on the boundary line of the detection area 32. Furthermore, the event #1 is the case of a person who has fallen, and in this case, the person crosses the judgment line L3 located on the boundary line between the platform and the tracks in the camera image to enter the detection area, and does not cross any other judgment lines to enter the detection area, so "L3" is selected. On the other hand, the event #2 is the case of a worker, and in this case, the person may cross all judgment lines to enter the detection area, so "all" is selected.

[0081] In the input field 53 for stay time, the administrator can specify a threshold value for determining the length of time that a target person stays in the detection area (stay time). If a person stays in the detection area for only a short time, there is no need to issue an alert, so a threshold value for determining the stay time is set, and the detection condition is that the target person's stay time is equal to or longer than the threshold value. In the example shown in FIG. 4, the administrator can select the threshold value for determining the stay time using a pull-down menu in the input unit 59. Note that it is also possible to directly input a value into the input unit 59 using a keyboard or the like.

[0082] In the example shown in FIG. 4, the event #1 is a case where a person falls, and the event #2 is a case where a worker falls, and in either case, "10 seconds or more" is selected.

[0083] In the movement input field 54, the administrator can specify whether or not the target person is moving as a detection condition. In the example shown in Fig. 4, the administrator can select whether or not the target person is moving using a pull-down menu in the input unit 60.

[0084] In the example shown in Figure 4, the event #1 is a case of a person falling, and in this case, the person will remain motionless in a posture other than standing unless they are able to immediately climb back up onto the platform by themselves, so "none" is selected as the detection condition for movement. On the other hand, the event #2 is a case of a worker, and in this case, the person may move or stand still while working, so "none / yes" is selected.

[0085] The setting screen 21 also has an input field 25 for the alert procedure. In this input field 25 for the alert procedure, the administrator can specify a priority terminal, that is, a terminal (alarm device) that will be given priority in issuing an alert, as the alert procedure. When the mobile terminal 5 is selected as the priority terminal, alerts are issued in the order of the mobile terminal 5, the in-facility fixed terminal 6, and the command center fixed terminal 7. When the in-facility fixed terminal 6 is selected as the priority terminal, alerting by the mobile terminal 5 is omitted, and alerts are issued in the order of the in-facility fixed terminal 6 and the command center fixed terminal 7.

[0086] In this embodiment, the terminals are ranked in descending order of proximity to the site, i.e., the mobile terminal 5, the in-facility fixed terminal 6, and the command center fixed terminal 7, and alerts are issued in stages starting from the terminal with the highest priority. If the terminal that issued the alert does not respond within a predetermined time with confirmation or completion of response, the terminal with the next highest priority will issue an alert. Note that the administrator may be able to specify the priority of the terminals.

[0087] In the example shown in Fig. 4, event #1 is the case of a person falling, and in this case, station staff need to rush to the scene and take the necessary measures as soon as possible, so mobile terminal 5 is selected as the priority terminal. The same applies to the case of an intruder. On the other hand, event #2 is the case of a worker, and in this case, station staff do not need to go to the scene, but it is desirable to alert staff in the office within the station, so in-facility fixed terminal 6 is selected as the priority terminal.

[0088] The setting screen 21 also has a registration button 26. After the administrator has completed inputting information into the input field 23 for person detection, the input field 24 for detection conditions, and the input field 25 for alarm procedures, the administrator operates the registration button 26. This causes the input information to be registered as setting information.

[0089] Next, a description will be given of the notification screen 71 displayed on the mobile terminal 5. FIG.

[0090] In response to an instruction from the monitoring server 3, the mobile terminal 5 displays a notification screen 71 as a notification operation to notify station staff that a predetermined event has occurred.

[0091] The notification screen 71 is provided with a notification section 72 and a camera image display section 73. The notification section 72 displays text notifying the staff of the details of the detected event. The camera image display section 73 displays a camera image at the time the event occurred. A frame image 77 surrounding the target person is displayed on the camera image on the camera image display section 73. The shape (color, etc.) of the frame image 77 may change depending on the detected event.

[0092] The camera images displayed on the camera image display unit 73 are recorded on the recorder 2, and are obtained from the recorder 2 by the monitoring server 3 and provided to the mobile terminal 5, or are obtained directly from the recorder 2 by the mobile terminal 5.

[0093] 5(A) shows an example where an incident requiring an alert is when a person falls, and notification unit 72 displays text indicating that a person has fallen and where that person has fallen, while camera image display unit 73 displays a camera image showing the person who has fallen. The example shown in Fig. 5(B) shows an example where an incident requiring an alert is when an intruder has occurred, and notification unit 72 displays text indicating that an intruder has occurred and where that person has fallen, while camera image display unit 73 displays a camera image showing the intruder.

[0094] The notification screen 71 is also provided with a confirmation button 75 and a response completion button 76. When the staff member looks at the notification screen and confirms that a predetermined event has occurred, he or she operates the confirmation button 75. When the staff member completes necessary response measures, such as rescue, he or she operates the response completion button 76. Here, when a notification is sent to each of the mobile terminals 5 carried by multiple staff members via the notification screen 71, if one staff member performs necessary response measures, such as rescue, and operates the response completion button 76, display control may be performed thereafter on the mobile terminals 5 carried by the other staff members, such as graying out (disabling) the display of the confirmation button 75 and the response completion button 76 on the notification screen 71, so that the staff members can recognize that the need for response measures has disappeared.

[0095] Next, a description will be given of the notification screen 81 displayed on the in-facility fixed terminal 6. FIG.

[0096] In response to an instruction from the monitoring server 3, the in-facility fixed terminal 6 displays a notification screen 81 as a notification operation for notifying station staff that a predetermined event has occurred.

[0097] The notification screen 81 displays a status mark 82 and camera name 83 for each camera 1. The status mark changes color depending on the status level (warning, caution, normal) for each camera 1. The status level indicates the urgency (importance) of the current situation in the detection area, and is set depending on the occurrence status of an event in the detection area of ​​each camera 1.

[0098] In the example shown in FIG. 6, in the detection area of ​​camera 1 #1, a person has fallen, which is an event that requires a report. In this case, a station attendant needs to rush to the scene, and since the urgency is high, the status mark 82 is displayed in a predetermined color (e.g., red) at a warning level. In addition, in the detection area of ​​camera 1 #2, an intruder has occurred, which is an event that requires a report. In this case, a station attendant needs to rush to the scene, but since the urgency is lower than in the case of a person falling, the status mark 82 is displayed in a predetermined color (e.g., orange) at a caution level. In addition, in the detection areas of the other cameras 1, no event that requires a report has occurred, and so the status mark 82 is displayed in a predetermined color (e.g., green) at a normal level. This allows station attendants to immediately grasp the status of events occurring in the detection areas of each camera 1.

[0099] The notification screen 81 is also provided with a first camera image display section 84 and a second camera image display section 85. The first camera image display section 84 displays a camera image taken at the time when an event requiring a report occurred. The second camera image display section 85 displays camera images taken for a predetermined period of time (e.g., 10 seconds) before and after the event requiring a report occurred. The first camera image display section 84 displays the camera image as a still image. Meanwhile, the second camera image display section 85 displays the camera image as a video when the staff member operates the operation section 86. This allows the staff member to check the situation at the time when the event requiring a report occurred on the first camera image display section 84. The staff member can also check the situation before and after the event requiring a report occurred on the second camera image display section 85. A frame image 89 surrounding the target person is displayed on the camera image displayed on the camera image display sections 84 and 85. The shape (color, etc.) of the frame image 89 may change depending on the detected event.

[0100] The camera images displayed on the first camera image display unit 84 and the second camera image display unit 85 are recorded on the recorder 2, and are obtained from the recorder 2 by the monitoring server 3 and provided to the fixed terminal 6 within the facility, or are obtained directly from the recorder 2 by the fixed terminal 6 within the facility.

[0101] The notification screen 81 also has a log display section 87. The log display section 87 displays a list of events for which a report has been issued in the past. Specifically, the date and time of the report for each event, the name of the camera 1, and the current status are displayed. The log display section 87 also displays a status mark 88 for each event. Like the status mark 82, the color of this status mark 88 changes depending on the status level (warning, caution, normal). When one of the events displayed in the log display section 35 is selected, camera images related to the selected event are displayed in the first camera image display section 84 and the second camera image display section 85.

[0102] This allows an attendant to select an event for which an alert was issued in the past and check the status of that event using camera images. Alternatively, an attendant may input search criteria from a log search input screen (not shown), select an event from the logs that match the search criteria, and check the status of that event using camera images. Alternatively, filtering may be set so that only the selected status level is displayed in response to an operation to select the desired status level to be displayed.

[0103] Next, a description will be given of the notification screen 91 displayed on the command center fixed terminal 7. FIG.

[0104] In response to an instruction from the monitoring server 3, the command center fixed terminal 7 displays a notification screen 91 as a notification operation to notify the command center staff that a predetermined event has occurred.

[0105] The notification screen 91 is provided with a plurality of station selection tabs 92 (facility selection sections) for each station (facility) included in the line section under the control of the control center. When the manager operates the station selection tab 92, the notification screen 91 is switched to correspond to the corresponding station.

[0106] The color of the station selection tab 92 changes depending on the status level of each camera 1 within the corresponding station premises. Specifically, the station selection tab 92 is displayed in a color corresponding to the highest status level (urgency) among the status levels (warning, caution, normal) of each camera 1 within the station premises. This allows the staff at the control center to immediately understand the alert status for each station (facility).

[0107] In addition, the notification screen 91 has a log display section 87, similar to the notification screen displayed on the fixed terminal 6 within the facility (see Figure 6), but here the log display section 87 displays the name of the facility in addition to the date and time of the alert for each event, the name of the camera 1, and the current situation.

[0108] Other than this, the notification screen is the same as that displayed on the in-facility fixed terminal 6 (see FIG. 6).

[0109] Next, a description will be given of the procedure of the process carried out by the monitoring server 3. FIG.

[0110] In the monitoring server 3, first, the processor 13 acquires the camera image received from the camera 1 via the communication unit 11 (image acquisition process) (ST101).

[0111] Next, the processor 13 detects a person from the camera image (person detection process) (ST102).

[0112] Next, the processor 13 determines whether or not the target person has entered the detection area based on the position of the target person detected in the person detection process (entry determination process) (ST103).

[0113] Here, if the target person enters the detection area (Yes in ST103), a loop (ST104 to ST110) is entered in which it is determined whether the detection conditions set for each event for which an alert should be issued are met, and the process of detecting the event for which an alert should be issued is repeated for all events for which an alert should be issued.

[0114] Here, first, processor 13 recognizes the posture of the target person based on the person image extracted from the camera image (posture recognition processing), and determines whether the posture of the target person matches the detection conditions for the event for which an alert should be issued (posture determination processing) (ST105).

[0115] Here, if the posture of the target person matches the detection conditions (Yes in ST105), then processor 13 determines whether the direction of entry of the target person into the detection area, specifically, the judgment line crossed by the target person when entering the detection area, matches the detection conditions for an event that should be reported (entry direction determination process) (ST106).

[0116] Here, if the judgment line crossed by the target person when entering the detection area matches the detection conditions (Yes in ST106), then processor 13 determines whether the target person's stay time matches the detection conditions for an event that should be reported (stay judgment process) (ST107).

[0117] Here, if the target person's stay time matches the detection condition (Yes in ST107), then processor 13 determines whether the target person's movement matches the detection condition for an event that should be reported (movement determination process) (ST108).

[0118] If the movement of the target person matches the detection condition (Yes in ST108), it is determined that an event requiring notification has occurred (event detection process) (ST109). If the processing of the loop (ST104 to ST110) has not been completed for all events requiring notification, the process returns to ST105 and proceeds to the determination of the next event requiring notification.

[0119] On the other hand, when the processing of the loop (ST104 to ST110) is completed for all events that should be notified, processor 13 then selects an alert procedure corresponding to the detected event (alert procedure selection processing) (ST111). Then, processor 13 instructs mobile terminal 5, in-facility fixed terminal 6, and command center fixed terminal 7 to perform an alert operation to notify staff that a predetermined event has occurred (alert processing) (ST112) according to the selected alert procedure.

[0120] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments. [Industrial Applicability]

[0121] The monitoring device and monitoring system of the present invention have the effect of enabling staff to immediately grasp the situation of a person who has entered a detection area and to quickly take appropriate action according to the person's situation, and are useful as monitoring devices and monitoring systems that detect events that require an alert based on camera images of the monitored area within a facility and instruct an alarm device to perform a specified alert operation. [Explanation of symbols]

[0122] 1 camera 2 Recorder 3 Monitoring server (monitoring device) 4 Management terminal 5. Mobile terminal (alarm device, mobile terminal device) 6 Fixed terminals within the facility (alarm devices, fixed terminal devices) 7. Fixed terminals at the control center (alarm devices, fixed terminal devices) 13 processors

Claims

1. A monitoring device comprising a processor that acquires camera images taken by cameras installed in each predetermined monitoring area within a facility, detects an event that should be reported for each camera, and instructs a notification device to perform a predetermined notification operation, The processor: In advance, based on an operation of an administrator from a management terminal, information on at least one of the posture of a person entering a detection area set within the monitoring area, the person's entry status into the detection area, the person's stay status in the detection area, and the person's movement status is set for each of the cameras as a detection condition for an event to be reported; When a person entering the detection area is detected from the camera image, it is determined whether the detected person satisfies the detection condition for an event for which an alert should be issued; When it is determined that the detection conditions are met, the monitoring device controls the alarm operations of the plurality of different types of alarm devices in accordance with a predetermined alarm procedure corresponding to the event for which an alarm should be issued.

2. The processor:

2. The monitoring device according to claim 1, wherein the detection conditions include recognizing any one of a standing position, a crouching position, a face-down position, and a face-up position as a posture of a person.

3. The processor: The monitoring device according to claim 1, wherein the posture of a person included in the detection conditions is recognized using an image recognition model constructed by machine learning using the camera images as learning data.

4. The processor:

2. The monitoring device according to claim 1, wherein the notification device displays an image that allows the occurrence of an event for each of the cameras to be identified.

5. The processor:

2. The monitoring device according to claim 1, wherein the notification device displays an image that allows identification of an occurrence status of an event for each facility.

6. The processor: The monitoring device described in claim 1, characterized in that the multiple different types of alarm devices are mobile terminal devices carried by staff, fixed terminal devices installed in the facility, and fixed terminal devices installed in a department that oversees multiple facilities.

7. A monitoring device according to any one of claims 1 to 6; a camera that photographs the predetermined monitoring area; a plurality of alarm devices that perform predetermined alarm operations in response to instructions from the monitoring device; A monitoring system with.

Images