Monitoring system, monitoring method, and program

Abstract

One objective of the present invention is to provide a monitoring system and the like that are capable of assisting in the appropriate handling of an event that has occurred. A monitoring system according to one embodiment of the present disclosure comprises: an acquisition means for acquiring a photographic image; a detection means for detecting, from the photographic image, an occurrence of an event; an identification means for identifying a tool corresponding to the event; and an output control unit for making a communication terminal output information about the tool.

Description

[Technical Field]

[0001] The present disclosure relates to a technique for dealing with an event that has occurred. [Background technology]

[0002] There is a technology for monitoring public facilities using surveillance cameras. Patent Document 1 discloses a system that detects multiple events in a monitored area using video footage of the monitored area. Specifically, the system detects the occurrence of an event based on features detected from the video, and determines who should be alerted about the event based on the type of the detected event, etc. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-132267 Summary of the Invention [Problem to be solved by the invention]

[0004] When an incident, accident, or other event occurs in a public area, it is necessary to respond to the event quickly. Therefore, the occurrence of the event may be notified to security guards located near the public area and to administrators of the public area. However, there is a risk that the person who is notified of the occurrence of the event will not know how to respond appropriately to the event that has occurred.

[0005] The present disclosure has been made in consideration of the above-mentioned problems, and one of its objectives is to provide a monitoring system or the like that can support appropriate responses to events that occur. [Means for solving the problem]

[0006] A monitoring system according to one aspect of the present disclosure includes an acquisition means for acquiring captured images, a detection means for detecting the occurrence of an event from the captured images, an identification means for identifying a tool corresponding to the event, and an output control means for outputting information regarding the tool to a communication terminal.

[0007] A monitoring method according to one aspect of the present disclosure includes acquiring a captured image, detecting the occurrence of an event from the captured image, identifying a tool corresponding to the event, and outputting information about the tool to a communication terminal.

[0008] A computer-readable storage medium according to one aspect of the present disclosure stores a program that causes a computer to execute the following processes: acquiring a captured image; detecting the occurrence of an event from the captured image; identifying equipment corresponding to the event; and outputting information about the equipment to a communication terminal. [Effects of the Invention]

[0009] According to the present disclosure, it is possible to support appropriate responses to events that have occurred. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram illustrating an example of a functional configuration of a monitoring system according to a first embodiment of the present disclosure. [Figure 2] 4 is a flowchart illustrating an example of the operation of the monitoring system according to the first embodiment of the present disclosure. [Figure 3] FIG. 10 is a diagram schematically illustrating an example of the configuration of a monitoring system according to a second embodiment of the present disclosure. [Figure 4] FIG. 10 is a block diagram illustrating an example of a functional configuration of a monitoring system according to a second embodiment of the present disclosure. [Figure 5] FIG. 10 is a diagram illustrating an example of correspondence information according to the second embodiment of the present disclosure. [Figure 6] FIG. 10 is a diagram illustrating an example of output information according to the second embodiment of the present disclosure. [Figure 7]FIG. 10 is a sequence diagram illustrating an example of the operation of the monitoring system according to the second embodiment of the present disclosure. [Figure 8] FIG. 10 is a block diagram illustrating an example of a functional configuration of a monitoring system according to a third embodiment of the present disclosure. [Figure 9] FIG. 11 is a diagram illustrating an example of output information according to the third embodiment of the present disclosure. [Figure 10] FIG. 11 is a diagram illustrating another example of output information according to the third embodiment of the present disclosure. [Figure 11] 10 is a flowchart illustrating an example of the operation of the monitoring system according to the third embodiment of the present disclosure. [Figure 12] FIG. 10 is a block diagram illustrating an example of a functional configuration of a monitoring system according to a fourth embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram illustrating an example of output information according to the fourth embodiment of the present disclosure. [Figure 14] FIG. 10 is a diagram illustrating an example of a situation in which evacuation information is output according to the fourth embodiment of the present disclosure. [Figure 15] 10 is a flowchart illustrating an example of the operation of the monitoring system according to the fourth embodiment of the present disclosure. [Figure 16] FIG. 2 is a block diagram showing an example of a hardware configuration of a computer device that realizes the monitoring systems of the first, second, third, and fourth embodiments of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0012] First Embodiment An overview of the monitoring system of the present disclosure will be described.

[0013] 1 is a block diagram showing an example of the functional configuration of a monitoring system 1000. As shown in FIG.

[0014] The acquisition unit 110 acquires captured images. For example, the acquisition unit 110 acquires captured images from at least one or more image capture devices. The captured images include still images and moving images. The image capture device may be, for example, a surveillance camera installed in a public area. That is, the acquisition unit 110 acquires captured images of a public area. The acquisition unit 110 is an example of an acquisition means.

[0015] The detection unit 120 detects the occurrence of an event from the captured image. An event refers to an object that needs to be detected in a public area, such as a specific phenomenon in an object or a specific behavior of a person. An event may be an abnormality that occurs in a public area. An event may be, for example, a fire, the appearance of a suspicious person, equipment failure, or a traffic accident. The detection unit 120 may detect an event from the captured image using an existing image processing method. The detection unit 120 is an example of a detection means.

[0016] The identification unit 130 identifies a tool corresponding to the event. A tool is a tool used to deal with the event. The identification unit 130 identifies a tool corresponding to the detected event, for example, based on response information. The response information is information indicating a tool corresponding to each event. For example, if the event is a fire, an example of the tool is a fire extinguisher. Also, for example, if the event is the appearance of a suspicious person, an example of the tool is a baton and a police truncheon. In this way, the response information includes information that associates the event with the corresponding tool. The response information is stored, for example, in a storage device (not shown) included in the monitoring system 1000. For example, if a fire is detected by the detection unit 120, the identification unit 130 identifies a fire extinguisher corresponding to the fire from the response information. The identification unit 130 is an example of an identification means.

[0017] The output control unit 140 causes the communication terminal to output information about the tool. The communication terminal is, for example, a mobile phone, a smartphone, a tablet terminal, or a personal computer. The communication terminal may also be a device consisting solely of a display and a speaker capable of communication. The output control unit 140 controls the communication terminal to output information about the tool identified by the identification unit 130. For example, if the identification unit 130 identifies a fire extinguisher, the output control unit 140 may cause the communication terminal to output information indicating that a fire extinguisher is prepared as information about the tool. At this time, the output control unit 140 may cause the communication terminal to output the information about the tool in the form of at least one of voice, text, and image. The output control unit 140 is an example of an output control means.

[0018] Next, an example of the operation of the monitoring system 1000 will be described with reference to Fig. 2. In this disclosure, each step in a flowchart will be represented by a number assigned to the step, such as "S1".

[0019] 2 is a flowchart illustrating an example of the operation of the monitoring system 1000. The acquisition unit 110 acquires a captured image (S1). The detection unit 120 detects the occurrence of an event from the captured image (S2). The identification unit 130 identifies a tool corresponding to the event (S3). The output control unit 140 causes information related to the tool to be output to the communication terminal (S4).

[0020] In this way, the monitoring system 1000 of the first embodiment acquires captured images and detects the occurrence of an event from the captured images. The monitoring system 1000 then identifies a tool corresponding to the event and causes the communication terminal to output information about the tool. This allows the monitoring system 1000 to, for example, prompt a person who checks the communication terminal to use the tool to deal with the event. In other words, the monitoring system 1000 can support an appropriate response to the event that has occurred.

[0021] <Second embodiment> Next, a monitoring system according to a second embodiment will be described. In the second embodiment, the monitoring system 1000 described in the first embodiment will be described in more detail. Note that some of the content that overlaps with the content described in the first embodiment will not be described again.

[0022] FIG. 3 is a diagram schematically illustrating an example of the configuration of a monitoring system 1000. As shown in FIG. 3, the monitoring system 1000 includes a monitoring device 100, communication terminals 200-1, 200-2, ..., 200-n (n is a natural number), and image capturing devices 300-1, 300-2, ..., 300-m (m is a natural number). Here, when the communication terminals 200-1, 200-2, ..., 200-n are not distinguished from one another, the communication terminals 200-1, 200-2, ..., 200-n are collectively referred to as communication terminals 200. In other words, there is one or more communication terminals 200. Furthermore, when the image capturing devices 300-1, 300-2, ..., 300-m are not distinguished from one another, the image capturing devices 300-1, 300-2, ..., 300-m are collectively referred to as image capturing devices 300. That is, there is one or more image capturing devices 300.

[0023] The monitoring device 100 is communicably connected to the communication terminal 200 and the image capturing device 300 via a wired or wireless network. The monitoring device 100 may be, for example, a server device.

[0024] The communication terminal 200 is a device used by a person to check information. The communication terminal 200 includes a display or a speaker for outputting information. The person checks the communication terminal 200 and understands various pieces of information output by the communication terminal 200. In the present disclosure, a person who can check the communication terminal 200 is referred to as a member. In addition, in the present embodiment, an example will be described in which one or more members each own one communication terminal 200.

[0025] The camera device 300 is installed, for example, in various locations within a specific facility. For example, the camera device 300 is installed in a public facility such as a train station, an airport, or a shopping mall. Public facilities also include vehicles such as cars, taxis, buses, trains, and airplanes. In this case, the people who own the communication terminal 200, i.e., the members, are security guards, facility employees, facility users, etc. The camera device 300 may also be installed outdoors, such as at an intersection or a highway. In this case, the members are road managers, passersby, etc.

[0026] [Details of Monitoring System 1000] 4 is a block diagram showing the functional configuration of the monitoring system 1000. The monitoring device 100 is connected to an image capturing device 300 and a communication terminal 200 so as to be able to communicate with each other.

[0027] The image capturing device 300 includes an image capturing unit 310. The image capturing unit 310 captures images and generates captured images. The image capturing unit 310 then transmits the captured images to the monitoring device 100. The image capturing unit 310 may periodically transmit the captured images to the monitoring device 100, or may continuously transmit the captured images to the monitoring device 100. The image capturing unit 310 may also transmit identification information for identifying the image capturing device 300 to the monitoring device 100 in addition to the captured images. The identification information is information that can identify each image capturing device 300. The identification information may be a code assigned to each image capturing device 300, or may be information indicating the location where the image capturing device 300 is installed.

[0028] The monitoring device 100 includes an acquisition unit 110, a detection unit 120, an identification unit 130, and an output control unit 140. The acquisition unit 110 acquires captured images from the image capturing devices 300. More specifically, the acquisition unit 110 acquires captured images transmitted from the image capturing units 310 of the image capturing devices 300. The acquisition unit 110 also acquires, along with the captured images, identification information of the image capturing devices 300 that generated the captured images.

[0029] The detection unit 120 detects the occurrence of an event from a captured image using a predetermined image processing technique. For example, the detection unit 120 extracts features from the captured image. The features may be image features derived using HOG (Histograms of Oriented Gradients), SIFT (Scaled Invariance Feature Transform), machine learning, or the like. The detection unit 120 may then detect the occurrence of an event using a detection model that inputs the extracted features. The detection model is a model that has learned the relationship between the features extracted from the captured image and the event. The detection unit 120 may input the extracted features to the detection model and detect information output from the detection model as the occurred event.

[0030] Furthermore, the detection unit 120 may detect an event from the behavior of an object or person detected from feature amounts extracted from a captured image. For example, the detection unit 120 may detect the occurrence of a fire by detecting flames from a captured image. For example, the detection unit 120 may detect the occurrence of a suspicious person by detecting a person carrying a knife, a firearm, or the like from a captured image. For example, the detection unit 120 may detect the occurrence of a person who has suddenly become ill by detecting a person who is crouching from a captured image.

[0031] It should be noted that the events detected by the detection unit 120 are not limited to the above examples. For example, the detection unit 120 may detect traffic accidents, terrorism, equipment failure, abandoned objects, objects falling from a station platform onto the tracks, and children left unattended in cars.

[0032] Furthermore, when the detection unit 120 detects the occurrence of an event, it may identify the location of the event. For example, the detection unit 120 identifies the location of the event based on the identification information of the camera device 300 that captured the captured image in which the occurrence of the event is detected. If the identification information indicates the installation location of the camera device 300, the detection unit 120 may identify the location of the event as the installation location of the camera device 300. If the identification information is a code that identifies the camera device 300, the detection unit 120 may identify the location of the event by acquiring information on the installation location of the camera device 300 that corresponds to the code. In this case, the detection unit 120 identifies the installation location of the camera device 300 based on camera device information that includes information associating the code with the installation location. The camera device information may be stored in a storage device (not shown) included in the monitoring device 100 or in another device that can communicate with the monitoring device 100.

[0033] The identification unit 130 identifies a tool corresponding to the detected event. For example, the identification unit 130 identifies the tool based on correspondence information stored in a storage device (not shown) of the monitoring device 100. Note that the correspondence information may be stored in another device that can communicate with the monitoring device 100.

[0034] FIG. 5 is a diagram showing an example of response information. In FIG. 5, for example, when the event is "fire," a "fire extinguisher" is associated as the necessary equipment. Furthermore, "(x1, y1)" is shown as the storage location of the fire extinguisher. In this way, the response information may include information indicating the storage location of the necessary equipment. That is, the identification unit 130 may identify the storage location of the necessary equipment. Furthermore, in FIG. 5, when the event is "someone suddenly falls ill," a "first aid kit" and an "AED (Automated External Defibrillator)" are associated as the necessary equipment. In this way, multiple tools may be associated with one event.

[0035] The output control unit 140 causes the communication terminal 200 to output various types of information. Various types of information output by the communication terminal 200 are referred to as output information. For example, the output control unit 140 generates output information and transmits the output information to the communication terminal 200. The transmitted output information is then output by the communication terminal 200. The output control unit 140 controls the output information to be output by the communication terminal 200.

[0036] FIG. 6 is a diagram illustrating an example of output information. More specifically, FIG. 6 illustrates an example of information output to the communication terminal 200 when a fire breaks out. The example of FIG. 6 indicates that a fire has broken out, the location of the fire, and that a fire extinguisher will be used to respond. In this way, the output control unit 140 may output information indicating that an event has occurred and information indicating the location of the event, in addition to information about the equipment. Furthermore, in the example of FIG. 6, a diagram is output in which markers indicating the location of the fire and the storage location of the fire extinguisher are superimposed on a map. In this way, the output control unit 140 may output information about the equipment, including information indicating the storage location of the equipment. Furthermore, the output control unit 140 may output information to the communication terminal 200 in which information indicating the location of the event and the storage location of the equipment are superimposed on a map.

[0037] The communication terminal 200 includes an output unit 210. The output unit 210 outputs output information transmitted from the monitoring device 100. The output unit 210 has the functions of a display and a speaker. The output unit 210 may be controlled by the output control unit 140. That is, the output control unit 140 may output the output information to the screen of the communication terminal 200, or the output unit 210 may receive the output information and output the output information to the screen of the communication terminal 200.

[0038] [Example of operation of monitoring system 1000] Next, an example of the operation of the monitoring system 1000 will be described with reference to FIG.

[0039] 7 is a sequence diagram illustrating an example of the operation of the monitoring system 1000. The photographing unit 310 of the photographing device 300 photographs images (S101). The acquisition unit 110 of the monitoring device 100 acquires photographed images from each of the photographing devices 300 (S102). The detection unit 120 detects the occurrence of an event from the acquired photographed images (S103). Then, the detection unit 120 identifies the location where the event occurred (S104).

[0040] The identification unit 130 identifies the tool corresponding to the event that has occurred (S105). At this time, the identification unit 130 may also identify the storage location of the tool. The output control unit 140 generates output information including information about the identified tool (S106). The information about the tool includes, for example, information indicating the tool and information indicating the storage location of the tool. The output information may also include information indicating the occurrence of the event, including the location where the event occurred. Then, the output unit 210 of the communication terminal 200 outputs the output information (S107).

[0041] Note that the operation of the monitoring system 1000 is not limited to this example. For example, if the detection unit 120 does not detect the occurrence of an event in S103, the monitoring system 1000 may not perform the processes from S104 onwards.

[0042] In this way, the monitoring system 1000 of the second embodiment acquires captured images and detects the occurrence of an event from the captured images. The monitoring system 1000 then identifies a tool corresponding to the event and causes the communication terminal to output information about the tool. This allows the monitoring system 1000 to prompt, for example, a member who has checked the communication terminal 200 to use the tool to deal with the event. In other words, the monitoring system 1000 can support appropriate responses to the event.

[0043] Furthermore, the monitoring system 1000 of the second embodiment may identify the storage location of the equipment and output information about the equipment, including information indicating the storage location of the equipment. This allows the monitoring system 1000 to show the members the storage location of the equipment. Therefore, the monitoring system 1000 can prompt the members to quickly take out the equipment.

[0044] [Variation 1] The functional configuration of the monitoring system 1000 is not limited to the above example. For example, the acquisition unit 110 and the detection unit 120 may be included in the image capturing device 300. In this case, the acquisition unit 110 acquires images captured by the image capturing unit 310. The detection unit 120 detects an event from the acquired images. The detection unit 120 transmits information indicating the detected event to the monitoring device 100. At this time, the detection unit 120 transmits identification information of the image capturing device to the monitoring device 100 along with the information indicating the detected event. The identification unit 130 of the monitoring device 100 then acquires the information indicating the detected event and identifies the tool corresponding to the event.

[0045] <Third embodiment> Next, a monitoring system according to a third embodiment will be described. In the third embodiment, route generation to the location where an event has occurred will be described. Note that some of the content that overlaps with the content described in the first and second embodiments will not be described.

[0046] [Details of Monitoring System 1001] Fig. 8 is a block diagram showing the functional configuration of a monitoring system 1001. The monitoring system 1001 includes a monitoring device 101 instead of the monitoring device 100 of the monitoring system 1000 shown in Fig. 3, and a communication terminal 201 instead of the communication terminal 200. That is, the monitoring system 1001 includes the monitoring device 101, the communication terminal 201, and the image capturing device 300. The monitoring system 1001 may perform the processing described in this embodiment in addition to the processing of the monitoring system 1000.

[0047] In this embodiment, communication terminals 201-1, 201-2, ..., 201-n are collectively referred to as communication terminal 201. That is, there is one or more communication terminals 201. In this embodiment, an example will be described in which a plurality of members each own one communication terminal 201.

[0048] The communication terminal 201 includes an output unit 210 and a location information control unit 220. The location information control unit 220 performs control for transmitting location information to the monitoring device 101. The location information is information indicating the location where the communication terminal 201 is located. For example, the location information control unit 220 may acquire, as location information, information measured by a global navigation satellite system (GNSS) such as a global positioning system (GPS). In this case, the location information control unit 220 transmits, for example, the location information acquired using the GNSS to the monitoring device 101. At this time, the location information control unit 220 transmits identification information for identifying the communication terminal 201 together with the location information.

[0049] Without being limited to this example, the location information control unit 220 may transmit location information to the monitoring device 101 using a beacon. For example, the location information control unit 220 transmits a predetermined signal including identification information of the communication terminal 201. Then, a receiver near the communication terminal 201 receives the signal. In response to receiving the signal, the receiver identifies location information of the communication terminal 201. Then, the receiver may transmit the location information of the communication terminal 201 together with the identification information of the communication terminal 201 to the monitoring device 101.

[0050] The monitoring device 101 includes an acquisition unit 110 , a detection unit 120 , an identification unit 130 , an output control unit 141 , a location information acquisition unit 150 , a route information generation unit 160 , and a removal detection unit 170 .

[0051] The location information acquisition unit 150 acquires the location information of the communication terminal 201. Specifically, the location information acquisition unit 150 acquires the location information and the identification information of the communication terminal 201 transmitted under the control of the location information control unit 220. In this embodiment, the communication terminal 201 is owned by a member. Therefore, for example, the communication terminal information is stored in advance in a storage device (not shown) included in the monitoring device 101 or in another device capable of communicating with the monitoring device 101. The communication terminal information is information in which the identification information of the communication terminal 201 is associated with the identification information of the member who owns the communication terminal 201. The member's identification information may be a code that identifies the member, or personal information such as the member's name and contact information. The location information acquisition unit 150 identifies the member who owns the communication terminal 201 based on the acquired identification information of the communication terminal 201. Then, the location information acquisition unit 150 acquires the location information of the communication terminal 201 as the location information of the member who owns the communication terminal 201. That is, the location information acquisition unit 150 acquires the member's location information. The location information acquisition unit 150 is an example of a location information acquisition means.

[0052] The route information generation unit 160 generates route information. The route information indicates a route from the position of a member to the location where an event occurred. The route information generation unit 160 calculates a route from the position of a member to the location where an event occurred based on the position information of the member and the location where the event occurred. The route information generation unit 160 generates route information indicating the calculated route. If there are multiple members, the route information generation unit 160 generates route information for each member. In this way, the route information generation unit 160 generates route information indicating a route from the position of a member to the location where the event occurred. The route information generation unit 160 is an example of a route information generation means.

[0053] Furthermore, the route information generating unit 160 may calculate a route from the position of the member to the storage location of the equipment. At this time, the route information generating unit 160 calculates a route from the storage location of the equipment to the location where the event occurred. Then, the route information generating unit 160 may generate route information indicating the calculated route. In other words, the route information generating unit 160 may generate route information indicating a route from the position of the member to the location where the event occurred via the storage location of the equipment.

[0054] The removal detection unit 170 detects that the tool identified by the identification unit 130 has been taken out. For example, a sensor is installed in a storage location for the tool. The sensor emits a signal when the tool is taken out. The removal detection unit 170 may detect that the tool has been taken out, for example, by acquiring the signal emitted by such a sensor. Furthermore, for example, the removal detection unit 170 may detect that the tool has been taken out from a captured image. In this case, one or more image capture devices 300 are installed in a storage location for the tool. Then, when a scene of a person taking out the tool is captured, the removal detection unit 170 detects that the tool has been taken out. In this way, the removal detection unit 170 detects that the tool has been taken out. The removal detection unit 170 is an example of a removal detection means.

[0055] The removal detection unit 170 may also identify a member who has removed the equipment. For example, when detecting that the equipment has been removed, the removal detection unit 170 may identify a member who is within a predetermined distance from the storage location of the equipment as the member who has removed the equipment. The removal detection unit 170 may also identify a member who has removed the equipment based on a captured image. For example, if a scene in which a person removes the equipment is captured, the removal detection unit 170 may identify the member included in the captured image using facial recognition. In this case, the monitoring device 100 has a database in which facial features of members are previously associated with identification information of the members. The removal detection unit 170 may then identify the member by comparing the facial features of the person extracted from the captured image with the features included in the database.

[0056] The output control unit 141 may change the communication terminal 201 to which output information is to be output based on the location information. For example, the location information acquisition unit 150 determines whether the member is within a predetermined range from the location where the event occurred, based on the acquired location information. "Within the predetermined range" may indicate a location within a predetermined distance from the location where the event occurred. Furthermore, if the event occurred within a predetermined facility, the predetermined range may indicate the location within the predetermined facility. If the member is within the predetermined range from the location where the event occurred, the output control unit 141 may cause the communication terminal 201 of the member located within the predetermined distance from the location where the event occurred to output output information including information indicating the occurrence of the event and information about the tool. That is, the output control unit 141 may output output information to a limited number of members among multiple members. Here, the member to whom output information is to be output is also referred to as a target member. In this way, the output control unit 141 may cause the communication terminal of the target member, who is a member within a first range from the location where the event occurred, to output information indicating the occurrence of the event and information about the tool, based on the location information.

[0057] Furthermore, the output control unit 141 may output different output information for each member. For example, the location information acquisition unit 150 determines whether or not a member is within a predetermined range from the location where the event occurred, based on the acquired location information. Furthermore, the location information acquisition unit 150 determines whether or not a member within the predetermined range is within a second predetermined range from the storage location of the equipment. The output control unit 141 may output information indicating that an event has occurred to the communication terminals 201 of members within the predetermined range from the location where the event occurred. Then, the output control unit 141 may output output information including information indicating that the event has occurred and information about the equipment to the communication terminals of members within the second predetermined range. That is, the output control unit 141 may output information about the equipment to members who are close to the storage location of the equipment. In this case, the members who are close to the storage location of the equipment are referred to as target members. In this way, the output control unit 141 may cause the communication terminals of members within a first range to output information indicating that an event has occurred based on the location information, and may cause the communication terminals of target members who are within the first range and within a second range from the storage location of the equipment to output information regarding the equipment.

[0058] Furthermore, the output control unit 141 may cause the communication terminal 201 to output output information including the route information. At this time, the output control unit 141 outputs, to each member, route information indicating the route from the position of the member to the location where the event occurred. That is, the output control unit 141 may cause the communication terminal 201 of each member to output route information corresponding to each member.

[0059] FIG. 9 is a diagram illustrating an example of output information. In FIG. 9, the output information includes information indicating the occurrence of an event, information about equipment, and route information. In this example, the route information indicates a route from the member's current location to the location where the event occurred, passing through the equipment storage location, using an arrow on a map. The location of another member, member B, is also shown in this example. In this manner, the output control unit 141 may cause each member's communication terminal 201 to output information indicating the locations of members within a predetermined range and the member's identification information. This allows each member to know which member is where. Furthermore, if the identification information includes the member's contact information, the member can contact the other member. For example, a member can cooperate with other members while checking the location information of the other members.

[0060] When it is detected that the equipment has been taken out, the output control unit 141 may cause the communication terminal 201 to output information indicating that the equipment has been taken out. At this time, the output control unit 141 may cause the communication terminal 201 to output identification information of the member who has taken out the equipment. FIG. 10 is a diagram showing another example of output information. In the example of FIG. 10, the output information includes information indicating that an event has occurred, information about the equipment, and route information. Furthermore, information indicating that the equipment has been taken out is superimposed on the map. In this example, it is shown that the equipment has been taken out by another member, member C. In this way, the output control unit 141 may cause the communication terminal 201 to output information indicating that the equipment has been taken out and identification information of the member who has taken out the equipment.

[0061] The output control unit 141 may superimpose the identification information of the member who took the tool on the location on the map that indicates the storage location. There may be multiple storage locations. In this case, the output control unit 141 can indicate who took the tool from which storage location.

[0062] Note that if it is detected that the tool has been removed, the tool is not present at the storage location. Therefore, the route information generation unit 160 may recalculate the shortest route from the member's location to the location where the incident occurred. The route information generation unit 160 may then regenerate the route information. The output control unit 141 may cause the communication terminal 201 to output the regenerated route information. A route that passes through the tool storage location may be a long detour for the member to the location where the incident occurred. If the tool is not present at the storage location, the member does not need to pass through the storage location. Therefore, the monitoring system 1001 can quickly guide the member to the location where the incident occurred.

[0063] [Example of operation of monitoring system 1001] Next, an example of the operation of the monitoring system 1001 will be described with reference to Fig. 11. In this operation example, an example will be described in which output information is output to one member who is within a predetermined range from the location where the event occurred.

[0064] FIG. 11 is a flowchart illustrating an example of the operation of the monitoring system 1001. First, the photographing unit 310 of the photographing device 300 photographs an image (S201). The acquisition unit 110 of the monitoring device 101 acquires photographed images from each of the photographing devices 300 (S202). The detection unit 120 detects the occurrence of an event from the acquired photographed images (S203). Then, the detection unit 120 identifies the location where the event occurred (S204). The identification unit 130 identifies the tool corresponding to the event that occurred (S205). At this time, the identification unit 130 may also identify the storage location of the tool.

[0065] The location information acquisition unit 150 acquires location information from the member's communication terminal 201 (S206). The location information acquisition unit 150 determines whether the member is within a predetermined range from the location where the event occurred. If the member is within the predetermined range from the location where the event occurred ("Yes" in S207), the route information generation unit 160 generates route information (S208). For example, the route information generation unit 160 generates route information based on the location information, indicating a route from the member's location to the location where the event occurred, via a tool storage location. If the member is not within the predetermined range from the location where the event occurred ("No" in S207), the monitoring system 1001 does not need to perform subsequent processing on the member.

[0066] The output control unit 141 generates output information (S209). For example, the output control unit 141 generates output information including information indicating that an event has occurred, information related to the tool, and route information. The output unit 210 of the communication terminal 201 outputs the output information (S210).

[0067] If the taking-out detection unit 170 detects that the tool has been taken out ("Yes" in S211), the output control unit 141 generates information indicating that the tool has been taken out (S212). Then, the output unit 210 of the communication terminal 201 outputs information indicating that the tool has been taken out (S213). Note that if the taking-out detection unit 170 does not detect that the tool has been taken out ("No" in S211), the monitoring system 1001 does not need to perform the processes from S212 onwards.

[0068] In this way, the monitoring system 1001 of the third embodiment may acquire location information of members and, based on the location information, output information indicating that an event has occurred and information about the tool to the communication terminal of a target member who is a member within a first range from the location where the event has occurred. In this way, when an event occurs, the monitoring system 1001 can quickly provide information to members related to the event.

[0069] Furthermore, the monitoring system 1001 of the third embodiment may acquire location information of members, and based on the location information, output information indicating the occurrence of an event to the communication terminals of members within a first range, and output information about the equipment to the communication terminals of target members who are within the first range and within a second range from the equipment storage location. For example, if the number of equipment is limited, even if information about the equipment is provided to more members than the number of equipment, not all members will be able to retrieve the equipment. In this case, members who are unable to retrieve the equipment will be delayed in arriving at the location where the event occurred by the time it takes to travel to the equipment storage location. The monitoring system 1001 can provide information about the equipment to members who are particularly close to the equipment, thereby efficiently guiding multiple members.

[0070] Furthermore, the monitoring system 1001 of the third embodiment may generate route information indicating a route from the location of a member to the location where an event occurred based on the location information, and output the route information corresponding to each member to each communication terminal of the member. This allows the monitoring system 1001 to assist the members in quickly reaching the location where an event occurred. In addition, the monitoring system 1001 may generate route information indicating a route from the location of the target member to the location where the event occurred via a storage location for equipment, and output information about the equipment including the route information to the communication terminal of the target member. This allows the monitoring system 1001 to provide the target member with a route that takes into account the removal of equipment.

[0071] Furthermore, the monitoring system 1001 of the third embodiment may detect that the equipment has been taken out and output information indicating that the equipment has been taken out to the communication terminal of the member. If the equipment has already been taken out, other members who have not taken the equipment do not need to go to the storage location. The monitoring system 1001 can notify other members that the equipment has been taken out, so that the other members can go directly to the location where the incident occurred. Furthermore, at this time, the monitoring system 1001 may identify the member who has taken out the equipment and output the identification information of the member who has taken out the equipment to the communication terminal of the member. In this way, the monitoring system 1001 can inform other members who has the equipment.

[0072] <Fourth embodiment> Next, a monitoring system according to a fourth embodiment will be described. In the fourth embodiment, further functions of the monitoring system will be described. Note that some of the content that overlaps with the content described in the first, second, and third embodiments will not be described.

[0073] [Monitoring System 1002] Fig. 12 is a block diagram showing the functional configuration of a monitoring system 1002. The monitoring system 1002 includes a monitoring device 102 instead of the monitoring device 100 of the monitoring system 1000 shown in Fig. 3, and a communication terminal 201 instead of the communication terminal 200. The monitoring system 1002 also includes a sensor 400. That is, the monitoring system 1002 includes the monitoring device 102, the communication terminal 201, the image capturing device 300, and the sensor 400. The monitoring system 1002 may perform the processing described in this embodiment in addition to the processing of the monitoring system 1000 or the monitoring system 1001.

[0074] In this embodiment, the communication terminal 201 includes devices owned by each of the members and a display installed in a public area.

[0075] The sensor 400 may be, for example, a sound sensor, a motion sensor, a distance sensor, or any of various other sensors. The sensor 400 may be a fire alarm. That is, the sensor 400 may be a sensor that detects at least one of gas, heat, smoke, and fire. A plurality of sensors 400 may be provided. For example, a sensor 400 may be installed together with each of the image capture devices 300. In this case, one or more sensors 400 may be installed for one image capture device 300. The sensor 400 may be installed regardless of the image capture device 300. For example, when the image capture device 300 is installed in a predetermined facility, the sensor 400 may be installed at multiple locations within the facility. The sensor 400 transmits detected information to the monitoring device 102 as sensor data. The sensor data may include identification information of the sensor 400. The identification information of the sensor 400 may be a code assigned to each sensor 400 or information indicating the location where the sensor 400 is installed.

[0076] The monitoring device 102 includes an acquisition unit 111 , a detection unit 121 , an identification unit 130 , an output control unit 142 , a location information acquisition unit 150 , a route information generation unit 161 , and a removal detection unit 170 .

[0077] The acquisition unit 111 includes a captured image acquisition unit 1101 and a sensor data acquisition unit 1102. The captured image acquisition unit 1101 acquires captured images from each of the image capture devices 300. The sensor data acquisition unit 1102 acquires sensor data from each of the sensors 400. For example, if the sensor 400 is a distance sensor, the sensor data acquisition unit 1102 acquires sensor data including information on the distance to objects around the sensor 400. If the sensor is a human presence sensor, the sensor data acquisition unit 1102 acquires sensor data indicating that a person has been detected within a predetermined range around the sensor 400. If the sensor 400 is a sound sensor, the sensor data acquisition unit 1102 acquires sensor data indicating sound generated within a predetermined range around the sensor 400. If the sensor 400 is a sensor such as a fire alarm, the sensor data acquisition unit 1102 acquires sensor data indicating at least one of gas, heat, smoke, and fire detected by the sensor 400. The sensor data acquisition unit 1102 may acquire the sensor data periodically or continuously, or may acquire the sensor data when a captured image is acquired.

[0078] The detection unit 121 detects the occurrence of an event based on the captured image and the sensor data. For example, the detection unit 121 estimates the occurrence of an event from the captured image. At this time, the detection unit 121 uses the sensor data to determine whether the estimated event has occurred. If the detection unit 121 determines that the estimated event has occurred, it detects the occurrence of the event. For example, the detection unit 121 detects a flame from the captured image and estimates that a fire has occurred. Furthermore, the detection unit 121 identifies the image capture device 300 that captured the captured image in which the flame was detected, and analyzes sensor data from the sensor 400 in the vicinity of the identified image capture device 300. For example, if the sensor data indicates that the sensor 400 has detected at least one of gas, heat, smoke, and flame, the detection unit 121 determines that a fire has occurred. Then, the detection unit 121 detects the occurrence of a fire based on this determination. In this way, the detection unit 121 may detect a fire as an event based on the captured image and the sensor data.

[0079] Furthermore, for example, the detection unit 121 detects a person carrying a bladed weapon from a captured image and estimates the presence of a suspicious person. The detection unit 121 identifies the image capture device 300 that captured the captured image in which the person carrying the bladed weapon was detected, and analyzes sensor data from the sensors 400 in the vicinity of the identified image capture device 300. For example, if the sensor data includes a sound such as a person shouting, the detection unit 121 determines that a suspicious person has appeared. Then, the detection unit 121 detects the presence of a suspicious person based on this determination.

[0080] In this way, the detection unit 121 can improve the accuracy of detecting the occurrence of an event by using the sensor data. Note that the way in which the sensor data is used is not limited to the above example. The detection unit 121 can use the sensor data in various ways to detect the occurrence of an event.

[0081] The route information generation unit 161 may generate route information indicating different routes for different members. For example, when a suspicious person is detected, the route information generation unit 161 may calculate routes such that multiple members head to the location of the suspicious person from different directions. That is, the route information generation unit 161 can cause multiple members to sandwich the suspicious person. FIG. 13 is a diagram illustrating an example of output information. FIG. 13 is an example of output information output to a communication terminal 201 of one member. In this example, the current location of the one member and the location of member D are shown. The route of the one member is indicated by a solid arrow, and the route of member D is indicated by a dotted line. Here, the route of the one member is a route heading from the bottom of the diagram toward the location where the event occurred. On the other hand, the route of member D is a route heading from the top of the diagram toward the location where the event occurred. That is, this example illustrates routes of multiple members entering the location where the event occurred from different directions. In this way, the route information generating unit 161 may generate route information that indicates routes that multiple members will take to approach the location where the event has occurred from different directions.

[0082] The output control unit 142 may cause the communication terminal 201 to output output information including the route information generated as described above. Furthermore, the output control unit 142 may output evacuation information indicating to evacuate from the location where the incident has occurred. For example, suppose that a suspicious person has appeared on a train stopped at a station platform. In this case, the output control unit 142 causes the communication terminals 201 carried by station staff and security guards to output output information including information indicating the occurrence of the incident and information regarding necessary tools. On the other hand, the output control unit 142 may cause the communication terminals 201 carried by station users and the communication terminals 201 that are displays installed in the station to output evacuation information.

[0083] FIG. 14 is a diagram showing an example of a situation in which evacuation information is output. In the example of FIG. 14, evacuation information is output to communication terminal 201, which is a display installed inside a train. The evacuation information includes information indicating the evacuation direction. In the example of FIG. 14, the evacuation information indicates that evacuation should be made toward the lead car, and an arrow indicates the direction of the lead car. The information indicating the evacuation direction may be generated by, for example, route information generation unit 161. For example, route information generation unit 161 calculates the evacuation direction based on the position of communication terminal 201 and the location of the incident. Then, route information generation unit 161 generates information indicating the evacuation direction. Output control unit 142 causes evacuation information including information indicating the evacuation direction to be output.

[0084] [Example of operation of monitoring system 1002] Next, an example of the operation of the monitoring system 1002 will be described with reference to Fig. 15. In this operation example, an example will be described in which output information is output to the communication terminal 201 of a security guard who is within a predetermined range from the location where the event occurred, or to the communication terminal 201 that is a display installed within the predetermined range.

[0085] 15 is a flowchart illustrating an example of the operation of the monitoring system 1002. First, the imaging unit 310 of the imaging device 300 captures an image (S301). The captured image acquisition unit 1101 of the monitoring device 101 acquires captured images from each of the imaging devices 300 (S302). The sensor data acquisition unit 1102 acquires sensor data from each of the sensors 400 (S303). Then, the detection unit 121 detects the occurrence of an event based on the captured images and sensor data (S304).

[0086] The processes in S305 to S308 are the same as those in S204 to S207 in FIG. 11, and therefore will not be described here.

[0087] If the communication terminal 201 is within a predetermined range from the location where the event occurred ("Yes" in S308) and the member who owns the communication terminal 201 is a security guard ("Yes" in S309), the monitoring system 1002 performs the processes from S310 onwards. The determination of whether the member who owns the communication terminal 201 is a security guard may be made by the route information generation unit 161. For example, the route information generation unit 161 may make the determination based on the identification information of the communication terminal 201. The processes of S310 to S315 are the same as S208 to S213 in FIG. 11 and therefore will not be described again.

[0088] If the communication terminal 201 is within a predetermined range from the location where the event occurred ("Yes" in S308) and the member who owns the communication terminal 201 is not a security guard ("No" in S309), the monitoring system 1002 performs the processes from S316 onwards. That is, the route information generation unit 161 generates information indicating the evacuation direction (S316). The output control unit 142 generates evacuation information including information indicating the evacuation direction (S317). Then, the output unit 210 of the communication terminal 201 outputs the evacuation information (S318).

[0089] In this way, the monitoring system 1002 of the fourth embodiment may generate information indicating the evacuation direction based on the location of the event and the positions of the members, and output evacuation information including the information indicating the evacuation direction to the communication terminal 201. In this way, the monitoring system 1002 can urge ordinary people to evacuate.

[0090] Furthermore, the monitoring system 1002 of the fourth embodiment may acquire sensor data indicating at least one of gas, heat, smoke, and flame detected by a sensor, and detect a fire as an event based on the captured image and the sensor data. The monitoring system 1002 may also acquire sensor data indicating sound detected by a sensor, and detect the occurrence of an event based on the captured image and the sensor data. In this way, the monitoring system 1002 can use the sensor data as an auxiliary means when detecting the occurrence of an event from the captured image. This allows the monitoring system 1002 to improve the accuracy of detecting the occurrence of an event.

[0091] <Example of monitoring system hardware configuration> The hardware constituting the monitoring systems of the first, second, third, and fourth embodiments described above will now be described. Fig. 16 is a block diagram showing an example of the hardware configuration of a computer device that realizes the monitoring systems of each embodiment. The monitoring systems and monitoring methods described in each embodiment and each modified example are realized in a computer device 90. More specifically, the monitoring devices, imaging devices, and communication terminals, as well as methods using these devices, described in each embodiment and each modified example, are realized in the computer device 90.

[0092] 16, a computer device 90 includes a processor 91, a RAM (Random Access Memory) 92, a ROM (Read Only Memory) 93, a storage device 94, an input / output interface 95, a bus 96, and a drive device 97. The monitoring system may be realized by a plurality of electric circuits.

[0093] The storage device 94 stores a program (computer program) 98. The processor 91 executes the program 98 of the present monitoring system using the RAM 92. Specifically, for example, the program 98 includes a program that causes a computer to execute the processes shown in FIGS. 2, 7, 11, and 15. The processor 91 executes the program 98 to realize the functions of each component of the present monitoring system. The program 98 may be stored in the ROM 93. Alternatively, the program 98 may be recorded on the storage medium 80 and read out using the drive device 97, or may be transmitted to the computer device 90 from an external device (not shown) via a network (not shown).

[0094] The input / output interface 95 exchanges data with peripheral devices (such as a keyboard, a mouse, and a display device) 99. The input / output interface 95 functions as a means for acquiring or outputting data. The bus 96 connects the components.

[0095] There are various variations in the way a monitoring system can be implemented. For example, a monitoring system can be implemented as a dedicated device. Alternatively, a monitoring system can be implemented based on a combination of multiple devices.

[0096] The scope of each embodiment also includes a processing method for recording a program for realizing each component of the function of each embodiment on a storage medium, reading the program recorded on the storage medium as code, and executing it on a computer. That is, a computer-readable storage medium is also included in the scope of each embodiment. Furthermore, the storage medium on which the above-mentioned program is recorded and the program itself are also included in each embodiment.

[0097] The storage medium may be, but is not limited to, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disc)-ROM, a magnetic tape, a non-volatile memory card, or a ROM. The programs recorded on the storage medium are not limited to standalone programs that execute processes, but also include programs that run on an OS (Operating System) in cooperation with other software and functions of an expansion board.

[0098] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0099] The above-described embodiments and modifications can be combined as appropriate.

[0100] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0101] <Additional Notes> [Appendix 1] an acquisition means for acquiring a photographed image; a detection means for detecting the occurrence of an event from the captured image; An identification means for identifying a tool corresponding to the event; and an output control means for outputting information about the tool to a communication terminal. Surveillance system.

[0102] [Appendix 2] The identification means identifies a storage location of the tool, The output control means outputs information about the tool including information indicating a storage location of the tool. 1. A monitoring system as described in Appendix 1.

[0103] [Appendix 3] a location information acquisition means for acquiring location information of members; The output control means causes a communication terminal of a target member who is a member within a first range from a location where the event occurred to output information indicating that the event occurred and information about the tool, based on the location information. 1. A monitoring system as described in Appendix 2.

[0104] [Appendix 4] a location information acquisition means for acquiring location information of members; The output control means causes the communication terminals of the members within a first range to output information indicating that the event has occurred based on the location information, and causes the communication terminals of the target members who are within the first range and within a second range from the storage location of the equipment to output information about the equipment. 1. A monitoring system as described in Appendix 2.

[0105] [Appendix 5] a route information generating means for generating route information indicating a route from the position of the member to the location where the event occurred based on the position information; the output control means causes the communication terminals of the members to output route information corresponding to each member; 10. A monitoring system as described in appendix 3 or 4.

[0106] [Appendix 6] the route information generating means generates the route information indicating a route from the position of the target member to a location where the event occurred via a storage location of the equipment; the output control means causes the communication terminal of the target member to output information about the tool including the route information; 1. A monitoring system as described in Appendix 5.

[0107] [Appendix 7] the route information generating means generates the route information indicating routes along which a plurality of members will approach the location of the occurrence of the event from different directions; 10. A monitoring system as described in clause 5 or 6.

[0108] [Appendix 8] A take-out detection means is provided for detecting that the tool has been taken out, The output control means causes the communication terminal of the member to output information indicating that the tool has been taken out. 8. A monitoring system according to any one of claims 3 to 7.

[0109] [Appendix 9] The taking-out detection means identifies the member who took out the tool, The output control means outputs the identification information of the member who brought out the tool to the communication terminal of the member. 10. A monitoring system as described in Appendix 8.

[0110] [Appendix 10] the output control means causes each communication terminal of the member to output information indicating the position of the member within the first range and the member's identification information; 10. A monitoring system according to any one of appendices 3 to 9.

[0111] [Appendix 11] the route information generating means generates information indicating a direction to evacuate based on the location of the incident and the positions of the members; the output control means causes a communication terminal to output evacuation information including information indicating the evacuation direction. 8. A monitoring system according to any one of appendices 5 to 7.

[0112] [Appendix 12] the acquiring means acquires sensor data indicating at least one of gas, heat, smoke, and flame detected by a sensor; the detection means detects a fire as the event based on the captured image and sensor data; 12. A monitoring system according to any one of claims 1 to 11.

[0113] [Appendix 13] the acquiring means acquires sensor data indicating a sound detected by a sensor; the detection means detects the occurrence of the event based on the captured image and sensor data; 13. A monitoring system according to any one of claims 1 to 12.

[0114] [Appendix 14] Acquire the captured image, Detecting the occurrence of an event from the captured image Identifying a tool corresponding to the event; outputting information about the tool to a communication terminal; Monitoring method.

[0115] [Appendix 15] A process of acquiring a captured image; A process of detecting the occurrence of an event from the captured image; A process of identifying a tool corresponding to the event; and a process of outputting information about the tool to a communication terminal. A computer-readable storage medium. [Explanation of symbols]

[0116] 100, 101, 102 Monitoring equipment 110, 111 Acquisition Department 120, 121 Detection unit 130 Specific section 140, 141, 142 Output control section 150 Location information acquisition section 160, 161 Route information generation unit 170 Removal detection unit 200, 201 Communication terminal 300 Imaging Device 400 sensors 1000, 1001, 1002 Monitoring Systems

Claims

1. an acquisition means for acquiring a photographed image; a detection means for detecting the occurrence of an event from the captured image; An identification means for identifying a tool corresponding to the event; a location information acquisition means for acquiring location information of members; and an output control means for outputting information about the tool to a communication terminal, The identification means identifies a storage location of the tool, The output control means causes the communication terminals of the members within a first range to output information indicating that the event has occurred based on the location information, and causes the communication terminals of the target members who are within the first range and within a second range from the storage location of the equipment to output information about the equipment. Surveillance system.

2. a route information generating means for generating route information indicating a route from the position of the member to the location where the event occurred based on the position information; the output control means causes the communication terminals of the members to output route information corresponding to each member; The monitoring system of claim 1 .

3. the route information generating means generates the route information indicating a route from the position of the target member to the location where the event occurred via a storage location of the equipment; the output control means causes the communication terminal of the target member to output information about the tool including the route information; The monitoring system of claim 2 .

4. the route information generating means generates the route information indicating routes along which a plurality of members will approach the location of the occurrence of the event from different directions; 4. A monitoring system according to claim 2 or 3.

5. A take-out detection means is provided for detecting that the tool has been taken out, The output control means causes the communication terminal of the member to output information indicating that the tool has been taken out. A monitoring system according to any one of claims 1 to 4.

6. Acquire the captured image, Detecting the occurrence of an event from the captured image; Identifying a tool corresponding to the event; Obtaining the location information of the members, outputting information about the tool to a communication terminal; In the step of specifying, a storage location of the tool is specified; In the output step, information indicating that the event has occurred is output to the communication terminals of the members within a first range based on the location information, and information about the equipment is output to the communication terminals of target members who are members within the first range and within a second range from a storage location of the equipment. Monitoring method.

7. A process of acquiring a captured image; A process of detecting the occurrence of an event from the captured image; A process of identifying a tool corresponding to the event; A process of acquiring location information of members; and outputting information about the tool to a communication terminal. In the identifying process, a storage location of the tool is identified, In the output process, information indicating that the event has occurred is output to the communication terminals of members within a first range based on the location information, and information about the equipment is output to the communication terminals of target members who are members within the first range and within a second range from a storage location of the equipment. program.

Images