Evacuation status display system

Abstract

To make it easier to grasp positions of persons who have difficulty in evacuating.SOLUTION: A display system identifies whether or not there is a person having difficulty in evacuating based on a camera image obtained by photographing an area for each of a plurality of areas constituting a building. Next, the display system displays a map image which is a map image of the building and in which each of the plurality of areas is associated with information indicating whether or not there is a person having difficulty in evacuating identified for the area on a display unit.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to an evacuation situation display system. [Background technology]

[0002] Conventionally, systems for grasping the evacuation status of people in a building in the event of a fire have been known. For example, Patent Document 1 describes a monitoring system equipped with a camera and a receiver placed in each room, in which the receiver determines the approximate number of people in each room based on images captured by the camera and displays the determined approximate number of people on a drawing of the building. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-133938 Summary of the Invention [Problem to be solved by the invention]

[0004] Generally, when guiding an evacuation, priority must be given to those who have difficulty evacuating, such as people with disabilities. To achieve this, it is important for rescuers, such as firefighters, to quickly determine the location of those who have difficulty evacuating.

[0005] The present invention has been made in consideration of the above circumstances, and aims to make it easier to determine the locations of people who have difficulty evacuating. [Means for solving the problem]

[0006] In order to solve the above problems, the evacuation situation display system of the present invention comprises an identification unit that identifies, for each of a plurality of areas that make up a building, whether or not there are people who have difficulty evacuating based on camera images of the area or entry / exit data recorded for the area, and a display control unit that causes a display unit to display a map image of the building, in which information indicating whether or not there are people who have difficulty evacuating in each of the plurality of areas is associated with the map image.

[0007] In a preferred aspect, the identification unit identifies the number of people who have difficulty evacuating, and the information indicates the number of people who have difficulty evacuating.

[0008] In a further preferred embodiment, the information is expressed in color. [Effects of the Invention]

[0009] According to the present invention, it becomes easier to determine the location of people who are having difficulty evacuating. [Brief explanation of the drawings]

[0010] [Figure 1] Diagram showing a fire monitoring system [Figure 2] Block diagram showing the configuration of the display system 5 [Figure 3] FIG. 10 is a diagram showing an example of a remainder number table 522. [Figure 4] Flow diagram showing the process of identifying the number of remaining people [Figure 5] Flow diagram showing map screen generation processing [Figure 6] A diagram showing an example of a map screen [Figure 7] Flow diagram showing detailed screen generation processing [Figure 8] A diagram showing an example of a details screen [Figure 9] Flow diagram showing email notification processing [Figure 10] An example of an email DETAILED DESCRIPTION OF THE INVENTION

[0011] 1. Embodiment A fire monitoring system according to an embodiment of the present invention will be described with reference to the drawings. 1-1.Configuration 1 is a diagram showing a fire monitoring system installed in a building B. The fire monitoring system shown in the figure includes a plurality of fire detectors 1, a fire receiver 2, a plurality of IP cameras 3, a plurality of smartphones 4, and a display system 5.

[0012] Of these, fire detectors 1 are placed in various locations in building B and are connected to fire receiver 2 via signal lines. When fire detector 1 detects the occurrence of a fire, it outputs a fire signal to fire receiver 2.

[0013] The fire receiver 2 is installed in the disaster prevention center or central control room of building B and is connected by wire to the display system 5. This fire receiver 2 judges whether a fire has occurred based on the fire signal output from the fire detector 1, and outputs fire information to the display system 5 when it judges that a fire has occurred.

[0014] The IP cameras 3 are network cameras. The IP cameras 3 are installed in various locations in building B and connected to the display system 5 via LAN cables.

[0015] The smartphone 4 is carried by a member of the private fire brigade organized in building B. The smartphone 4 is connected to the display system 5 via a wireless LAN.

[0016] The display system 5 is a system for displaying the evacuation status of people in the building in the event of a fire and for supporting the evacuation of people in the building. This display system 5 is installed in the disaster prevention center or central control room of building B.

[0017] 2 is a block diagram showing the configuration of the display system 5. The display system 5 shown in the figure includes a control unit 51, a storage unit 52, an input unit 53, a display unit 54, and a communication unit 55.

[0018] Of these, the control unit 51 is a processor such as a CPU. The memory unit 52 is a storage device such as a ROM, RAM, or HDD. The input unit 53 is an input device such as a keyboard or mouse. The display unit 54 is a display device such as a liquid crystal display. The communication unit 55 is a communication module for communicating with the fire control device 2 and the smartphone 4.

[0019] The storage unit 52 stores an image data group 521 , a remaining personnel number table 522 , a camera position table 523 , a map data group 524 , and team member data 525 .

[0020] The image data group 521 is a collection of image data representing still images captured by the IP camera 3.

[0021] The number of remaining people table 522 is a table for recording the number of people remaining in building B when a fire breaks out. Fig. 3 is a diagram showing an example of this number of remaining people table 522. The number of remaining people table 522 shown in the figure stores the number of remaining people and the number of people who are unable to evacuate, in association with the addresses of the IP cameras 3.

[0022] The camera location table 523 is a table in which addresses, which are identification information of the IP cameras 3, are associated with their installation locations.

[0023] The map data group 524 is a collection of image data representing floor plans of each floor of the building B.

[0024] The firefighter data 525 is a table in which the role and email address of the firefighter are associated with the ID of the firefighter.

[0025] The storage unit 52 also stores an evacuation support program. When the control unit 51 executes this evacuation support program, the following functions are realized: a number-of-remainers specifying unit 511, a map screen generating unit 512, a detailed screen generating unit 513, a camera control unit 514, and an email notification unit 515.

[0026] The remaining person number determination unit 511 determines the number of remaining people for each of the multiple areas that make up building B based on camera images of that area. It also determines the number of people who have difficulty evacuating. Here, people who have difficulty evacuating are those who have fallen and are lying on the floor among the remaining people. The remaining person number determination unit 511 executes a remaining person number determination process, which will be described later, to determine the number of remaining people and the number of people who have difficulty evacuating for each area.

[0027] The map screen generation unit 512 generates a map screen of building B (see FIG. 6) and displays it on the display unit 54. On this map screen, for each of the multiple areas of building B, information indicating the number of remaining people identified for that area and information indicating the presence or absence of people who have difficulty evacuating are associated. Here, the information indicating the presence or absence of people who have difficulty evacuating is expressed by color. In order to generate this map screen, the map screen generation unit 512 executes a map screen generation process, which will be described later.

[0028] When the user selects one of the areas that make up building B on the map screen, the detail screen generation unit 513 displays a detail screen (see FIG. 8) including a camera image of the selected area and a notification button on the display unit 54. In order to generate this detail screen, the detail screen generation unit 513 executes a detail screen generation process, which will be described later.

[0029] The camera control unit 514 controls the direction and / or angle of view of the IP camera 3 in response to an operation input by the user.

[0030] When the notification button is selected by the user, the email notification unit 515 sends an email regarding the selected area to the smartphone 4. Specifically, it sends an email to the smartphone 4 requesting assistance in evacuating those remaining in the selected area. The email sent by the email notification unit 515 includes information indicating the number of those remaining or information indicating whether or not there are people who are having difficulty evacuating. The email also includes a camera image of the selected area. To generate this email, the email notification unit 515 executes email notification processing, which will be described later.

[0031] 1-2.Operation The operation of the fire monitoring system will be described below. Specifically, the remaining person number determination process, map screen generation process, detailed screen generation process, and email notification process will be described.

[0032] 1-2-1. Identifying the number of remaining employees 4 is a flow diagram showing the process of identifying the number of remaining people. The process of identifying the number of remaining people shown in the figure is executed by the display system 5. When the display system 5 receives fire information from the fire receiver 2, it starts this process.

[0033] The remaining-person number determining unit 511 of the display system 5 first transmits a request to each IP camera 3 to capture an image. The IP camera 3 that receives this request captures an image of its monitoring area and transmits image data representing the captured still image to the display system 5. This image data includes, as attribute information, the address of the IP camera 3 and information on the date and time of capture. When the remaining-person number determining unit 511 acquires the image data transmitted from each IP camera 3, it stores the image data in the storage unit 52 (step Sa1). After storing the image data in the storage unit 52, it applies a well-known image recognition technique to each image data to determine the number of people appearing in the image (in other words, the number of remaining people) (step Sa2). After determining the number of remaining people, it associates the image data with the address of the IP camera 3 that generated it and stores the determined number of remaining people in the remaining-person number table 522. Furthermore, the remaining-person number determining unit 511 applies a model for identifying people who are unable to evacuate to each image data to determine the number of people who are unable to evacuate appearing in the image (step Sa3). Here, the model for identifying people with difficulty in evacuating is a trained model generated by training a statistical model on the features of an image showing a person lying on the floor.

[0034] When the remaining person number specifying unit 511 specifies the number of people who are unable to evacuate, the remaining person number specifying unit 511 stores the image data in the remaining person number table 522 in association with the address of the IP camera 3 that generated the image data. This concludes the description of the remaining user number determination process.

[0035] The remainder number specifying unit 511 periodically executes this process to keep the remainder number table 522 up to date. Then, when the user inputs an instruction to stop this process, this process ends.

[0036] 1-2-2.Map screen generation process 5 is a flow diagram showing the map screen generation process. The map screen generation process shown in the figure is executed by the display system 5. The display system 5 starts this process when a command to display a map screen is input by a user. The display system 5 also executes this process when another floor is selected as the display target in a longitudinal section view M2, which will be described later.

[0037] The map screen generation unit 512 of the display system 5 first identifies the IP cameras 3 installed on the selected floor by referring to the camera position table 523 (step Sb1). Note that the selected floor when the map screen is initially displayed is the fire floor. After identifying the IP cameras 3, the map screen generation unit 512 identifies the number of remaining people and the number of people who are unable to evacuate corresponding to each identified IP camera 3 by referring to the number of remaining people table 522 (step Sb2). After identifying the number of remaining people, etc., the display color of the number of remaining people corresponding to each IP camera 3 is identified based on the identified number of remaining people, etc. (step Sb3). Specifically, if the number of people who are unable to evacuate is "1" or more, the display color is yellow. If the number of people who are unable to evacuate is "0" and the number of remaining people is "3" or more, the display color is red. If the number of people who are unable to evacuate is "0" and the number of remaining people is less than "3," the display color is white. By steps Sb1 to Sb3 described above, the number of remaining people and their display color corresponding to each IP camera 3 installed on the selected floor are identified.

[0038] Next, the map screen generation unit 512 identifies the number of remaining persons and their display color for each floor. Specifically, first, the camera location table 523 is referenced to identify the IP cameras 3 installed on the floor targeted for this processing (step Sb4). After identifying the IP cameras 3, the remaining person number table 522 is referenced to identify the number of remaining persons corresponding to each identified IP camera 3 (step Sb5). After identifying the number of remaining persons, the identified remaining persons are summed up to identify the total number of remaining persons on the floor targeted for processing (step Sb6). After identifying the total number of remaining persons on the floor targeted for processing, the remaining person number table 522 is referenced to identify the number of persons who have difficulty evacuating corresponding to each IP camera 3 identified in step Sb4 (step Sb7). After identifying the number of persons who have difficulty evacuating, the identified numbers are summed up to identify the total number of persons who have difficulty evacuating on the floor targeted for processing (step Sb8). After identifying the total number of persons who have difficulty evacuating on the floor targeted for processing, the display color for the number of remaining persons is determined based on the number of remaining persons identified in step Sb6 and the number of persons who have difficulty evacuating identified in step Sb8 (step Sb9). Specifically, if the number of people who have difficulty evacuating is "1" or more, the display color is yellow, if the number of people who have difficulty evacuating is "0" and the number of people remaining is "3" or more, the display color is red, and if the number of people who have difficulty evacuating is "0" and the number of people remaining is less than "3", the display color is white. After executing steps Sb4 to Sb9 for all floors (NO in step Sb10), the map screen generation unit 512 proceeds to step Sb11. The number of people remaining on each floor and its display color are identified by steps Sb4 to Sb10 described above.

[0039] In step Sb11, the map screen generation unit 512 generates a map screen based on the number of remaining passengers and the display color specified for the selected floor and the number of remaining passengers and the display color specified for each floor. Then, the generated map screen is displayed on the display unit 54 (step Sb12). Figure 6 is a diagram showing an example of this map screen. The map screen SR1 shown in the figure includes a floor plan area AR1 and a cross-sectional view area AR2.

[0040] The floor plan area AR1 displays the floor plan MP1 of the selected floor. This floor plan MP1 has a fire source symbol SB1 indicating the source of the fire and a camera symbol SB2 indicating an IP camera 3. Of these, the camera symbol SB2 is a selectable button. Near the camera symbol SB2, the number of remaining people corresponding to the IP camera 3 represented by that symbol is displayed as a circled number CN1. The circle of this circled number CN1 is drawn in a color specified for that number of remaining people. For example, if the specified color is yellow, it is drawn in yellow. By looking at the number of this circled number CN1, the user can know the number of remaining people near that IP camera 3. Furthermore, by looking at the color of the circle of this circled number CN1, the user can know whether or not there are people who will have difficulty evacuating and the number of remaining people. In other words, the evacuation priority can be determined.

[0041] Meanwhile, the cross-sectional view area AR2 shows a longitudinal section MP2 of Building B. Each floor of this longitudinal section MP2 is represented by a selectable button. Furthermore, the fire floors among the floors are shaded. Furthermore, each floor of this longitudinal section MP2 is associated with a circled number CN2 indicating the number of remaining people on that floor. The circle of this circled number CN2 is drawn in a display color specified for that number of remaining people. For example, if the specified display color is red, it is drawn in red. By looking at the number of this circled number CN2, the user can know the number of remaining people on each floor. Furthermore, by looking at the color of the circle of this circled number CN2, the user can know whether or not there are people on each floor who will have difficulty evacuating and the number of remaining people. In other words, the evacuation priority can be known. This concludes the explanation of the map screen generation process.

[0042] The map screen generating unit 512 periodically executes steps Sb2 to Sb12 to keep the map screen up to date, and when the user instructs not to display the map screen, ends this process.

[0043] 1-2-3.Detail screen generation process 7 is a flow diagram showing the detailed screen generation process. The detailed screen generation process shown in the figure is executed by the display system 5. The display system 5 starts this process when the user selects a camera symbol on the displayed map screen.

[0044] The detail screen generating unit 513 of the display system 5 identifies the IP camera 3 represented by the camera symbol selected by the user and extracts the latest image data generated by the identified IP camera 3 from the image data group 521 (step Sc1). After extracting the image data, the unit generates a detail screen based on the extracted image data (step Sc2). The generated detail screen is then displayed superimposed on the map screen (step Sc3). FIG. 8 shows an example of this detail screen. The detail screen SR2 shown in FIG. 8 is superimposed on the map screen SR1. This detail screen SR2 includes a camera image PC1, a camera control button BT1, a notification button BT2, and an explanatory message MS1. Of these, the camera image PC1 is a camera image represented by the image data extracted in step Sc1. By viewing this camera image PC1, the user can check the situation around the selected IP camera 3 in an image. The camera control button BT1 is a button for adjusting the orientation and angle of view of the selected IP camera 3. When the camera control button BT1 is operated by a user, the camera control unit 514 transmits a control signal corresponding to the operation to the selected IP camera 3, thereby controlling the orientation and / or angle of view of the IP camera 3. Next, the notification button BT2 is a button for notifying the private fire brigade personnel of the situation around the selected IP camera 3. This concludes the description of the detailed screen generation process.

[0045] The detail screen generating unit 513 periodically executes steps Sc1 to Sc3 to keep the detail screen up to date. Then, when the user instructs to hide the detail screen, this process ends.

[0046] 1-2-4. Email notification processing 9 is a flow diagram showing the email notification process. The email notification process shown in the figure is executed by the display system 5. The display system 5 starts this process when the user selects the notification button on the displayed details screen.

[0047] The email notification unit 515 of the display system 5 first identifies the installation location of the selected IP camera 3 by referring to the camera location table 523 (step Sd1). After identifying the installation location, the email notification unit 515 identifies the number of remaining people and the number of people who are unable to evacuate corresponding to each identified IP camera 3 by referring to the remaining people number table 522 (step Sd2). After identifying the number of remaining people, etc., a message is created based on the identified number of remaining people, etc. (step Sd3). Specifically, if the number of people who are unable to evacuate is "1" or more, a message is created notifying the presence of people who are unable to evacuate and requesting rescue. On the other hand, if the number of people who are unable to evacuate is "0," a message is created notifying the number of people who are unable to evacuate and requesting evacuation guidance for those people. After creating the message, the email notification unit 515 extracts the latest image data generated by the selected IP camera 3 from the image data group 521 (step Sd4). After extracting the image data, the email addresses of the evacuation guidance officer and the main team member in charge of the installation location identified in step Sd1 are identified by referring to the team member data 525 (step Sd5). Once the email address has been identified, an email is created based on the information acquired in steps Sd3 to Sd5 (step Sd6). The created email is then sent to the recipient's smartphone 4 (step Sd7). FIG. 10 shows an example of this email. The email shown in the figure notifies the recipient that a person with difficulty evacuating is in front of the elevator on the second floor and requests rescue. This email includes a camera image PC2. This camera image PC2 is a camera image represented by the image data extracted in step Sd4. By viewing this camera image PC2, the recipient can check the situation around the selected IP camera 3 in an image. This concludes the explanation of the email notification process.

[0048] With this email notification process, the user can simply select the notification button to request the in-house fire brigade to assist in the evacuation of remaining people near the selected IP camera 3. In addition, the user can be notified of the situation near the selected IP camera 3 via an image.

[0049] 2. Variations The above embodiment may be modified as follows: The modifications described below may be combined with each other.

[0050] 2-1. Variation 1 In step Sa3 of the above-described remaining person number determination process, the remaining person number determination unit 511 identifies people who have fallen and are lying on the floor as people who will have difficulty evacuating. Alternatively, wheelchair users may be identified as people who will have difficulty evacuating. In this case, the remaining person number determination unit 511 applies a wheelchair user identification model to each image data acquired in step Sa1 to determine the number of wheelchair users appearing in the image. Here, this wheelchair user identification model is a trained model generated by training a statistical model on the feature quantities of images of wheelchair users.

[0051] 2-2. Variation 2 The remaining person number identifying unit 511 may identify the number of remaining people in each area of ​​building B based on entry / exit data recorded in the entry / exit management system of building B instead of camera images. Here, the entry / exit data recorded in the entry / exit management system is data in which each area of ​​building B is associated with the type of entry / exit, the IDs of the people entering and leaving, and the time of entry and exit. In addition, the remaining person number identifying unit 511 may identify the number of people who are unable to evacuate in each area of ​​building B based on attribute data of people present in building B managed in building B in addition to the entry / exit data. Here, the attribute data of people present in building B is data in which each ID of a person present in building is associated with information indicating at least whether or not they are disabled.

[0052] 2-3. Variation 3 In step Sa1 of the above-described process for determining the number of remaining users, the remainder number specifying unit 511 may acquire image data representing a video of several seconds to several tens of seconds, instead of a still image, from each IP camera 3. In this case, the camera image included in the above-described detailed screen and email will be a video.

[0053] 2-4. Variation 4 The number-of-remainers specifying unit 511 may start the above-described number-of-remainers specifying process when an earthquake occurs, in addition to when fire information is received from the fire receiver 2.

[0054] 2-5. Variation 5 The thresholds referred to in steps Sb3 and Sb9 of the map screen generation process are merely examples, and may be changed as appropriate depending on the circumstances of the fire prevention object.

[0055] 2-6. Variation 6 The map screen may also show the number of people who are unable to evacuate in addition to the number of people who remain behind. For example, in the example shown in Figure 6, numbers in parentheses indicating the number of people who are unable to evacuate may be placed near the circled numbers CN1 and CN2.

[0056] 2-7. Variation 7 On the map screen, the information indicating the number of remaining people and the information indicating whether or not people have difficulty evacuating may be expressed by a method other than color. For example, they may be expressed by icons. Taking FIG. 6 as an example, an icon indicating the number of remaining people and an icon indicating whether or not people have difficulty evacuating may be placed near the circled numbers CN1 and CN2.

[0057] 2-8. Variation 8 The notification buttons included in the details screen may be divided into two types: a first notification button for sending still camera images and a second notification button for sending video camera images. When the first notification button is selected by the user, the email notification unit 515 executes the email notification process. On the other hand, when the second notification button is selected by the user, the email notification unit 515 acquires video image data instead of still image data in step Sd4 of the email notification process. Specifically, a shooting request is sent to the selected IP camera 3, and image data representing video of several seconds to several tens of seconds is acquired from the selected IP camera 3. By dividing the notification buttons into two types in this way, the user can use still images and videos depending on the situation for which they want to be notified.

[0058] 2-9. Variation 9 The notification button included in the above-mentioned details screen does not necessarily have to be included in the details screen. For example, it may be included in the above-mentioned map screen. Using FIG. 6 as an example, it may be arranged in association with each camera symbol SB2. Alternatively, only one notification button may be arranged in the cross-sectional view area AR2, and when the user selects that notification button, the above-mentioned email notification process may be executed for each of all floors.

[0059] 2-10. Variation 10 The smartphone 4 is an example of a terminal carried by a private firefighter. Instead of the smartphone 4, a tablet terminal or a wearable terminal may be carried by a private firefighter.

[0060] 2-11. Variation 11 In step Sd7 of the above email notification processing, the email notification unit 515 may send an email to a smartphone carried by a public firefighter in addition to or instead of the smartphone 4 carried by the private firefighter.

[0061] 2-12. Variation 12 The email sent by the email notification unit 515 does not necessarily have to include information indicating the number of remaining people or information indicating whether or not there are people who are unable to evacuate. That is, the email may include only camera images. Or, conversely, the email may not include camera images. [Explanation of symbols]

[0062] 1...fire detector, 2...fire receiver, 3...IP camera, 4...smartphone, 5...display system, 51...control unit, 52...storage unit, 53...input unit, 54...display unit, 55...communication unit, 511...remaining person number determination unit, 512...map screen generation unit, 513...detail screen generation unit, 514...camera control unit, 515...email notification unit, 521...image data group, 522...remaining person number table, 523...camera position table, 524...map data group, 525...team member data, AR1...floor plan area, AR2...cross-section area, B...building, BT1...camera control button, BT2...notification button, CN1, CN2...circled numbers, MS1...explanatory message, PC1, PC2...camera image, SB1...fire source symbol, SB2...camera symbol, SR1...map screen, SR2...detail screen

Claims

1. an identification unit that identifies the number of remaining people or the number of people who have difficulty evacuating for each of a plurality of areas constituting the building based on a camera image of the area or entry / exit data recorded for the area; a display control unit that causes a map screen including a floor plan of the selected floor of the building and a vertical cross-sectional view of the building to be displayed on a display unit; On the floor plan, a first symbol indicating the number of the remaining people or the number of people who are difficult to evacuate identified for each area of ​​the selected floor is arranged in correspondence with the area, On the longitudinal cross-sectional view, a second symbol indicating the total number of the remaining people on each floor of the building or the total number of the people who are unable to evacuate on each floor is arranged in association with each floor of the building. Evacuation status display system.

2. The first symbol indicates the number of the remaining people and the number of people who are difficult to evacuate identified for each area of ​​the selected floor, The second symbol indicates the total number of the remaining people on each floor of the building and the total number of the people who are unable to evacuate.

2. The evacuation situation display system according to claim 1.

Images