Evacuation Status Display System

Abstract

To make it easier to grasp positions of persons who have difficulty in evacuating.SOLUTION: A display system identifies whether or not there is a person having difficulty in evacuating based on a camera image obtained by photographing an area for each of a plurality of areas constituting a building. Next, the display system displays a map image which is a map image of the building and in which each of the plurality of areas is associated with information indicating whether or not there is a person having difficulty in evacuating identified for the area on a display unit.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention relates to an evacuation situation display system.

Background Art

[0002] Conventionally, a system for grasping the evacuation situation of people in a building during a fire has been known. For example, Patent Document 1 describes a monitoring system including cameras and receivers arranged in each room, where the receiver identifies an approximate number of occupants in each room based on images captured by the cameras and displays the identified approximate number on a floor plan of the building.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Generally, in evacuation guidance, it is necessary to prioritize the evacuation of persons with difficulty in evacuation such as disabled persons. For this purpose, it is important for rescuers such as firefighters to quickly grasp the positions of persons with difficulty in evacuation.

[0005] The present invention has been made in view of such circumstances, and an object thereof is to facilitate grasping the positions of persons with difficulty in evacuation.

Means for Solving the Problems

[0006] To solve the above problems, the evacuation status display system according to the present invention comprises an identification unit that identifies the presence or absence of persons with difficulty in evacuation for each of a plurality of areas constituting a building, based on a camera image taken of the area or entry / exit data recorded for the area, and a display control unit that displays a map image of the building, in which information indicating the presence or absence of persons with difficulty in evacuation identified for each of the plurality of areas is associated with the area.

[0007] In a preferred embodiment, the identifying unit identifies the number of persons who have difficulty evacuating, and the information is information indicating the number of persons who have difficulty evacuating.

[0008] In a more preferred embodiment, the information is represented by color. [Effects of the Invention]

[0009] According to the present invention, it becomes easier to determine the location of people who have difficulty evacuating. [Brief explanation of the drawing]

[0010] [Figure 1] Diagram showing a fire monitoring system [Figure 2] Block diagram showing the configuration of display system 5 [Figure 3] A diagram showing an example of Table 522, which shows the number of people remaining. [Figure 4] Flowchart showing the process for identifying the number of remaining individuals. [Figure 5] Flowchart showing the map screen generation process [Figure 6] A diagram showing an example of a map screen. [Figure 7] Flowchart showing the process for generating the detailed screen. [Figure 8] A diagram showing an example of the details screen. [Figure 9] Flowchart showing the email notification process [Figure 10] A diagram showing an example of an email. [Modes for carrying out the invention]

[0011] 1. Embodiment A fire monitoring system according to an embodiment of the present invention will be described with reference to the drawings. 1-1. Configuration FIG. 1 is a diagram showing a fire monitoring system installed in building B. The fire monitoring system shown in the figure includes a plurality of fire detectors 1, a fire receiver 2, a plurality of IP cameras 3, a plurality of smartphones 4, and a display system 5.

[0012] Among these, the fire detectors 1 are arranged at various locations in building B and are connected to the fire receiver 2 via signal lines. When the fire detector 1 senses the occurrence of a fire, it outputs a fire signal to the fire receiver 2.

[0013] The fire receiver 2 is installed in the disaster prevention center or the central control room of building B and is connected to the display system 5 by wire. The fire receiver 2 makes a fire determination based on the fire signal output from the fire detector 1, and when it determines that a fire has occurred, it outputs fire information to the display system 5.

[0014] The IP camera 3 is a network camera. The IP camera 3 is arranged at various locations in building B and is connected to the display system 5 via a LAN cable.

[0015] The smartphone 4 is carried by the members of the self-defense fire brigade organized in building B. The smartphone 4 is connected to the display system 5 via a wireless LAN.

[0016] The display system 5 is a system for displaying the evacuation status of the people in the building and assisting the evacuation of the people in the building when a fire occurs. The display system 5 is installed in the disaster prevention center or the central control room of building B.

[0017] FIG. 2 is a block diagram showing the configuration of this display system 5. The display system 5 shown in the figure includes a control unit 51, a storage unit 52, an input unit 53, a display unit 54, and a communication unit 55.

[0018] Among these, the control unit 51 is a processor such as a CPU. The storage unit 52 is a storage device such as a ROM, a RAM, or an HDD. The input unit 53 is an input device such as a keyboard or a mouse. The display unit 54 is a display device such as a liquid crystal display. The communication unit 55 is a communication module for communicating with the fire receiver 2 and the smartphone 4.

[0019] The above storage unit 52 stores an image data group 521, a remaining person number table 522, a camera position table 523, a map data group 524, and team member data 525.

[0020] The image data group 521 is a set of image data representing still images captured by the IP camera 3.

[0021] The remaining person number table 522 is a table for recording the number of people remaining in Building B at the time of a fire. FIG. 3 is a diagram showing an example of this remaining person number table 522. In the remaining person number table 522 shown in the figure, the number of remaining people and the number of people having difficulty evacuating are stored in association with the address of the IP camera 3.

[0022] The camera position table 523 is a table in which the address, which is the identification information of the IP camera 3, and its installation location are associated.

[0023] The map data group 524 is a set of image data representing floor plans of each floor of Building B.

[0024] The team member data 525 is a table in which the role and email address of the team member are associated with the ID of the self-defense fire fighter.

[0025] The above storage unit 52 also stores an evacuation support program. When the control unit 51 executes this evacuation support program, functions such as a remaining person number specifying unit 511, a map screen generating unit 512, a detailed screen generating unit 513, a camera control unit 514, and an email notification unit 515 are realized.

[0026] The remaining persons identification unit 511 identifies the number of remaining persons in each of the multiple areas that make up building B, based on camera images taken of that area. It also identifies the number of persons who are unable to evacuate. Here, persons unable to evacuate are those remaining who have fallen and are lying on the floor. The remaining persons identification unit 511 performs the remaining persons identification process described later in order to identify the number of remaining persons and the number of persons unable to evacuate in each area.

[0027] The map screen generation unit 512 generates a map screen of building B (see Figure 6) and displays it on the display unit 54. In this map screen, each of the multiple areas of building B is associated with information indicating the number of people remaining in that area and information indicating the presence or absence of people who have difficulty evacuating. Here, the information indicating the presence or absence of people who have difficulty evacuating is represented by color. In order to generate this map screen, the map screen generation unit 512 executes the map screen generation process described later.

[0028] When a user selects one of the multiple areas that make up building B on the map screen, the detail screen generation unit 513 displays a detail screen (see Figure 8) on the display unit 54, which includes a camera image of the selected area and a notification button. To generate this detail screen, the detail screen generation unit 513 executes the detail screen generation process described later.

[0029] The camera control unit 514 controls the orientation and / or field of view of the IP camera 3 in accordance with the operation input by the user.

[0030] When the notification button is selected by the user, the email notification unit 515 sends an email regarding the selected area to the smartphone 4. Specifically, it sends an email to the smartphone 4 requesting assistance in evacuating any remaining persons in the selected area. The email sent by the email notification unit 515 includes information indicating the number of remaining persons or whether there are any persons who have difficulty evacuating. The email also includes a camera image taken of the selected area. To generate this email, the email notification unit 515 performs the email notification process described later.

[0031] 1-2.Operation This section explains the operation of the fire monitoring system. Specifically, it describes the process of identifying the number of people remaining in the fire, generating a map screen, generating a detailed screen, and sending email notifications.

[0032] 1-2-1. Identification process for the number of remaining individuals Figure 4 is a flowchart illustrating the process for identifying the number of people remaining in the fire. This process is performed by the display system 5. The display system 5 starts this process when it receives fire information from the fire alarm receiver 2.

[0033] The remaining persons identification unit 511 of the display system 5 first sends a shooting request to each IP camera 3. Upon receiving this shooting request, the IP camera 3 takes a picture of its monitoring area and sends image data representing the captured still image to the display system 5. This image data includes attribute information such as the address of the IP camera 3 and the date and time of shooting. When the remaining persons identification unit 511 acquires the image data sent from each IP camera 3, it stores it in the storage unit 52 (step Sa1). Once the image data is stored in the storage unit 52, it applies known image recognition technology to each image data to identify the number of people in the image (in other words, the number of remaining persons) (step Sa2). After identifying the number of remaining persons, it associates it with the address of the IP camera 3 that generated the image data and stores it in the remaining persons table 522. The remaining persons identification unit 511 also applies an evacuation difficulty identification model to each image data to identify the number of people who have difficulty evacuating in the image (step Sa3). Here, the model for identifying people who have difficulty evacuating is a pre-trained model generated by training a statistical model with image features representing people lying on the floor.

[0034] The remaining person identification unit 511 identifies the number of people who have difficulty evacuating, associates it with the address of the IP camera 3 that generated the image data, and stores it in the remaining person table 522. The above is an explanation of the process for determining the number of people remaining in the country.

[0035] The remaining person identification unit 511 periodically executes this process to maintain the remaining person table 522 in an up-to-date state. When a user inputs a command to stop this process, it terminates the process.

[0036] 1-2-2. Map screen generation process Figure 5 is a flowchart illustrating the map screen generation process. The map screen generation process shown in this figure is executed by the display system 5. The display system 5 starts this process when a user inputs a command to display the map screen. The display system 5 also executes this process when a different floor is selected as the display target in the vertical section diagram M2, which will be described later.

[0037] The map screen generation unit 512 of the display system 5 first refers to the camera position table 523 to identify the IP cameras 3 installed on the selected floor (step Sb1). Note that the floor selected when the map screen is first displayed is the fire floor. Once the map screen generation unit 512 has identified the IP cameras 3, it refers to the number of remaining persons table 522 to identify the number of remaining persons and the number of persons unable to evacuate corresponding to each identified IP camera 3 (step Sb2). Once the number of remaining persons, etc. has been identified, the display color for the number of remaining persons corresponding to each IP camera 3 is determined based on the identified number of remaining persons, etc. (step Sb3). Specifically, if the number of persons unable to evacuate is "1" or more, the display color is set to yellow; if the number of persons unable to evacuate is "0" and the number of remaining persons is "3" or more, the display color is set to red; and if the number of persons unable to evacuate is "0" and the number of remaining persons is less than "3", the display color is set to white. Through steps Sb1 to Sb3 described above, the corresponding number of remaining persons and their display color are identified for each IP camera 3 installed on the selected floor.

[0038] Next, the map screen generation unit 512 identifies the number of people remaining on each floor and the display color for each. Specifically, it first refers to the camera position table 523 to identify the IP cameras 3 installed on the floors targeted for this process (step Sb4). Once the IP cameras 3 are identified, it refers to the number of people remaining on each identified IP camera 3 in the remaining person table 522 (step Sb5). Once the number of people remaining is identified, it sums up the identified numbers of people remaining to determine the total number of people remaining on the floors targeted for processing (step Sb6). Once the total number of people remaining on the floors targeted for processing is determined, it then refers to the number of people remaining on each IP camera 3 identified in step Sb4 to identify the number of people who have difficulty evacuating (step Sb7). Once the number of people who have difficulty evacuating is identified, it sums up the identified numbers of people who have difficulty evacuating to determine the total number of people who have difficulty evacuating on the floors targeted for processing (step Sb8). Once the total number of people who have difficulty evacuating on the floors targeted for processing is determined, it then identifies the display color for that number of people remaining based on the number of people remaining identified in step Sb6 and the number of people who have difficulty evacuating identified in step Sb8 (step Sb9). Specifically, if the number of people unable to evacuate is "1" or more, the display color is set to yellow; if the number of people unable to evacuate is "0" and the number of people remaining is "3" or more, the display color is set to red; and if the number of people unable to evacuate is "0" and the number of people remaining is less than "3", the display color is set to white. After the map screen generation unit 512 has executed steps Sb4 to Sb9 for all floors (the NO of step Sb10), it proceeds to step Sb11. Based on steps Sb4 to Sb10 described above, the number of people remaining on each floor and the display color for each floor are determined.

[0039] In step Sb11, the map screen generation unit 512 generates a map screen based on the number of remaining persons and display color specified for the selected floor, and the number of remaining persons and display color specified for each floor. Then, the generated map screen is displayed on the display unit 54 (step Sb12). Figure 6 shows an example of this map screen. The map screen SR1 shown in the figure includes a plan view area AR1 and a cross-sectional view area AR2.

[0040] The floor plan area AR1 displays the floor plan MP1 of the selected floor. This floor plan MP1 contains a fire source symbol SB1 indicating the source of the fire and a camera symbol SB2 indicating IP camera 3. Of these, camera symbol SB2 is a selectable button. In addition, the number of people remaining in the vicinity of camera symbol SB2 is indicated by a circled number CN1 corresponding to the IP camera 3 represented by that symbol. The circle of this circled number CN1 is drawn in a color specified for that number of people remaining. For example, if the specified color is yellow, it will be drawn in yellow. By looking at the number in this circled number CN1, the user can find out the number of people remaining in the vicinity of that IP camera 3. Furthermore, by looking at the color of this circled number CN1, the user can find out whether there are people who have difficulty evacuating and how many people remain. In other words, the user can find out the priority of evacuation.

[0041] Meanwhile, the cross-sectional view area AR2 shows the vertical cross-sectional view MP2 of building B. Each floor in this vertical cross-sectional view MP2 is represented by a selectable button. Furthermore, the floor where the fire occurred is depicted with shading. In addition, each floor in this vertical cross-sectional view MP2 is associated with a circled number CN2 indicating the number of people remaining on that floor. The circle in this circled number CN2 is drawn in a color specified for that number of people remaining. For example, if the specified color is red, it will be drawn in red. By looking at the number in this circled number CN2, users can find out the number of people remaining on each floor. Furthermore, by looking at the color of the circle in this circled number CN2, users can find out whether there are people who have difficulty evacuating on each floor and how many people remain. In other words, they can find out the priority of evacuation. The above is an explanation of the map screen generation process.

[0042] The map screen generation unit 512 periodically executes steps Sb2 to Sb12 to maintain the map screen in its most up-to-date state. When the user instructs the system to hide the map screen, the system terminates.

[0043] 1-2-3. Process for generating the detailed screen Figure 7 is a flowchart illustrating the detailed screen generation process. The detailed screen generation process shown in this figure is executed by the display system 5. The display system 5 starts this process when the camera symbol is selected by the user on the displayed map screen.

[0044] The detail screen generation unit 513 of the display system 5 identifies the IP camera 3 represented by the camera symbol selected by the user and extracts the latest image data generated by the identified IP camera 3 from the image data group 521 (step Sc1). After extracting the image data, it generates a detail screen based on the extracted image data (step Sc2). Then, it displays the generated detail screen overlaid on the map screen (step Sc3). Figure 8 shows an example of this detail screen. The detail screen SR2 shown in the figure is placed overlaid on the map screen SR1. This detail screen SR2 includes a camera image PC1, a camera control button BT1, a notification button BT2, and an explanatory message MS1. Of these, the camera image PC1 is the camera image represented by the image data extracted in step Sc1. By viewing this camera image PC1, the user can visually confirm the situation around the selected IP camera 3. Next, the camera control button BT1 is a button for adjusting the orientation and field of view of the selected IP camera 3. When the camera control button BT1 is operated by the user, the camera control unit 514 transmits a control signal corresponding to the operation to the selected IP camera 3, thereby controlling the orientation and / or field of view of the IP camera 3. Next, the notification button BT2 is a button for notifying the self-defense fire brigade members of the situation near the selected IP camera 3. The above is an explanation of the process for generating the detailed screen.

[0045] The detail screen generation unit 513 periodically executes steps Sc1 to Sc3 to maintain the detail screen in its most up-to-date state. When the user instructs the system to hide the detail screen, the system terminates.

[0046] 1-2-4. Email notification processing Figure 9 is a flowchart illustrating the email notification process. The email notification process shown in this figure is executed by the display system 5. The display system 5 starts this process when the notification button is selected by the user on the displayed details screen.

[0047] The email notification unit 515 of the display system 5 first refers to the camera location table 523 to identify the installation location of the selected IP camera 3 (step Sd1). Once the installation location is identified, it refers to the number of remaining persons table 522 to identify the number of remaining persons and the number of persons unable to evacuate corresponding to each identified IP camera 3 (step Sd2). Once the number of remaining persons, etc. is identified, a message is created based on the identified number of remaining persons, etc. (step Sd3). Specifically, if the number of persons unable to evacuate is "1" or more, a message is created notifying that there are persons unable to evacuate and requesting their rescue. On the other hand, if the number of persons unable to evacuate is "0", a message is created notifying the number of remaining persons and requesting the evacuation guidance of those remaining persons. Once the message is created, the latest image data generated by the selected IP camera 3 is extracted from the image data group 521 (step Sd4). Once the image data is extracted, the email addresses of the evacuation guidance officer and headquarters unit members responsible for the installation location identified in step Sd1 are identified by referring to the personnel data 525 (step Sd5). Once the email address is identified, an email is created based on the information obtained in steps Sd3 to Sd5 (step Sd6). Then, the created email is sent to the recipient's smartphone 4 (step Sd7). Figure 10 shows an example of this email. The email shown in the figure notifies the recipient that a person unable to evacuate is located in front of the elevator on the second floor and requests their rescue. This email includes camera image PC2. This camera image PC2 is a camera image represented by the image data extracted in step Sd4. By viewing this camera image PC2, the recipient can visually confirm the situation near the selected IP camera 3. The above is an explanation of the email notification process.

[0048] This email notification system allows users to request assistance from the self-defense fire brigade to evacuate any remaining individuals near the selected IP camera 3 with a simple click of a notification button. In addition, it can notify users of the situation near the selected IP camera 3 with images.

[0049] 2. Variations The above embodiment may be modified as follows. The following modifications may be combined with each other.

[0050] 2-1. Variation 1 In step Sa3 of the above-described process for identifying the number of remaining persons, the remaining persons identification unit 511 identifies a person who has fallen and is lying on the floor as a person with difficulty evacuating. Alternatively, wheelchair users may be identified as persons with difficulty evacuating. In that case, the remaining persons identification unit 511 applies a wheelchair user identification model to each image data acquired in step Sa1 to identify the number of wheelchair users in the image. Here, this wheelchair user identification model is a trained model generated by training a statistical model with the feature quantities of the wheelchair user images.

[0051] 2-2. Variation 2 The remaining person identification unit 511 may, instead of using camera images, identify the number of people remaining in each area of ​​Building B based on entry and exit data recorded in the Building B access control system. Here, the entry and exit data recorded in the access control system is data that associates each area of ​​Building B with whether it is an entry or exit, the ID of the person entering or exiting, and the time of entry or exit. In addition, the remaining person identification unit 511 may also identify the number of people who have difficulty evacuating in each area of ​​Building B based on attribute data of occupants managed in Building B, in addition to the entry and exit data. Here, the attribute data of occupants in Building B is data that associates each occupant's ID with information indicating at least whether or not they have a disability.

[0052] 2-3. Variation 3 The remaining person identification unit 511 may, in step Sa1 of the remaining person identification process described above, acquire image data representing a video of several seconds to tens of seconds from each IP camera 3 instead of a still image. In that case, the camera images included in the detailed screen and email described above will be video.

[0053] 2-4. Variation 4 The unit 511 for identifying the number of remaining persons may start the above-mentioned process for identifying the number of remaining persons not only when it receives fire information from the fire alarm receiver 2, but also when an earthquake occurs.

[0054] 2-5. Variation 5 The thresholds referenced in steps Sb3 and Sb9 of the map screen generation process described above are merely examples. These thresholds may be changed as appropriate depending on the circumstances of the fire-protected building.

[0055] 2-6. Variation 6 In the map screen shown above, the number of people who have difficulty evacuating may be displayed in addition to the number of people remaining behind. To explain using Figure 6 as an example, numbers enclosed in parentheses indicating the number of people who have difficulty evacuating may be placed near the circled numbers CN1 and CN2.

[0056] 2-7. Variation 7 In the map screen shown above, information indicating the number of people remaining behind and the presence or absence of people who have difficulty evacuating may be represented by means other than color. For example, they may be represented by icons. Using Figure 6 as an example, icons indicating the number of people remaining behind and icons indicating the presence or absence of people who have difficulty evacuating may be placed near the circled numbers CN1 and CN2.

[0057] 2-8. Variation 8 The notification buttons included in the details screen described above may be divided into two types: a first notification button for sending still camera images and a second notification button for sending video camera images. If the first notification button is selected by the user, the email notification unit 515 executes the email notification process described above. On the other hand, if the second notification button is selected by the user, the email notification unit 515 acquires video image data instead of still image data in step Sd4 of the email notification process described above. Specifically, it sends a shooting request to the selected IP camera 3 and acquires image data representing a video of several seconds to several tens of seconds from the IP camera 3. By dividing the notification buttons into two types in this way, users can use still images and videos depending on the situation they want to be notified about.

[0058] 2-9. Variation 9 The notification button included in the details screen described above does not necessarily have to be included in the details screen. For example, it may be included in the map screen described above. As explained using Figure 6 as an example, it may be placed in association with each camera symbol SB2. Alternatively, only one notification button may be placed in the cross-section area AR2, and when that notification button is selected by the user, the email notification process described above will be executed for each of the floors.

[0059] 2-10. Variation 10 Smartphone 4 is an example of a device carried by a member of a self-defense fire brigade. Instead of Smartphone 4, a tablet or wearable device may be carried by a member of the self-defense fire brigade.

[0060] 2-11. Variation 11 In step Sd7 of the above email notification process, the email notification unit 515 may send an email to a smartphone carried by a public firefighter, in addition to or instead of the smartphone 4 carried by a self-defense firefighter.

[0061] 2-12. Variation 12 The email sent by the email notification unit 515 does not necessarily have to include information indicating the number of people remaining behind or information indicating whether or not there are people who have difficulty evacuating. In other words, it may only include camera images. Or, conversely, it may not include camera images at all. [Explanation of Symbols]

[0062] 1...Fire detector, 2...Fire detector receiver, 3...IP camera, 4...Smartphone, 5...Display system, 51...Control unit, 52...Storage unit, 53...Input unit, 54...Display unit, 55...Communication unit, 511...Number of remaining persons identification unit, 512...Map screen generation unit, 513...Detail screen generation unit, 514...Camera control unit, 515...Email notification unit, 521...Image data group, 522...Number of remaining persons table, 523...Camera position table, 524...Map data group, 525...Personnel data, AR1...Plan view area, AR2...Cross-section area, B...Building, BT1...Camera control button, BT2...Notification button, CN1, CN2...Circled numbers, MS1...Explanation message, PC1, PC2...Camera image, SB1...Fire source symbol, SB2...Camera symbol, SR1...Map screen, SR2...Detail screen

Claims

1. For each of the multiple areas that make up the building, an identification unit identifies the number of people remaining or the number of people who have difficulty evacuating based on camera images taken of that area or entry / exit data recorded for that area, The system includes a display control unit that displays a map screen on the display unit, which includes a floor plan of the selected floor of the building and a longitudinal section of the building. On the aforementioned floor plan, a first symbol is placed corresponding to each area of ​​the selected floor, indicating the number of people remaining in that area or the number of people who have difficulty evacuating. On the aforementioned vertical cross-sectional view, a second symbol is placed corresponding to each floor of the building, indicating the total number of people remaining on that floor or the total number of people who have difficulty evacuating on that floor. Evacuation status display system.

2. The first symbol indicates the number of remaining persons and the number of persons who have difficulty evacuating, as identified for each area of ​​the selected floor. The second symbol indicates the total number of people remaining on each floor of the building and the total number of people who have difficulty evacuating. The evacuation status display system according to feature 1.

Images