Urban subway pipe network flood emergency response system based on augmented reality

Abstract

The invention provides an urban subway pipe network flood emergency response system based on augmented reality, and the system is characterized in that the system comprises a sensor network which is used for collecting real-time data; the augmented reality terminal is used for collecting field data around the emergency response personnel and displaying route guidance data and risk avoidance data to the emergency response personnel; the edge calculation end is used for generating route guidance data and risk avoidance data according to the real-time data and the field data and guiding emergency response personnel to a designated position, and the edge calculation end comprises a risk prediction module which comprises a trained time sequence model and is used for generating the risk avoidance data according to the real-time data; and the path generation module stores the subway tunnel image and is used for generating route guidance data according to the subway tunnel image and the field image data, and the risk avoidance data comprises a risk prediction result around the emergency response personnel. In a word, the method can feed back emergency response information in time, and the safety of emergency response personnel is improved.

Description

Technical Field

[0001] The invention relates to a disaster response system, and in particular to an urban subway pipe network flood emergency response system based on augmented reality. Background Art

[0002] With the acceleration of urbanization, urban infrastructure is facing more and more challenges, especially urban subway systems. Due to the dense population and buildings in cities, once floods and waterlogging disasters occur, the subway system is easily affected, posing a huge threat to people's lives and property. Therefore, how to effectively monitor and respond to floods in subway systems has become an important issue in urban management.

[0003] In urban subway systems, traditional flood emergency response mainly relies on centralized data processing centers, which may cause delays when processing large amounts of real-time data, resulting in untimely emergency response. In addition, on-site staff usually need to rely on paper maps or other traditional means to make decisions, which may affect their work efficiency and safety.

[0004] Therefore, the existing subway flood emergency response system still has the problem of insufficient emergency response speed and efficiency, and cannot guarantee the personal safety of emergency personnel. Summary of the invention

[0005] The present invention is made to solve the above-mentioned problems, and aims to provide an urban subway pipeline network flood emergency response system based on augmented reality.

[0006] The present invention provides an urban subway pipeline flood emergency response system based on augmented reality, which is used to assist emergency response personnel to go to a designated location and has the following characteristics, including: a sensor network, including multiple sensors arranged at designated locations in subway stations and surrounding areas, for collecting real-time data; an augmented reality end, worn by emergency response personnel, for collecting on-site data around emergency response personnel, and displaying route guidance data and risk avoidance data to emergency response personnel; an edge computing end, which is respectively communicated with the sensor network and the augmented reality end, for generating route guidance data and risk avoidance data based on real-time data and on-site data, and guiding emergency response personnel to the designated location, wherein the real-time data includes water level depth, water flow and subway internal structure damage data, and the on-site data includes on-site image data, and the edge computing end includes: a risk prediction module, including a trained time series model, for generating risk avoidance data based on real-time data; a path generation module, which stores subway tunnel images, for generating route guidance data based on subway tunnel images and on-site image data, and the risk avoidance data includes danger prediction results around emergency response personnel.

[0007] In the urban subway pipeline flood emergency response system based on augmented reality provided by the present invention, it can also have the following features: wherein, the path generation module includes: a data preprocessing unit, used to preprocess the on-site image data to obtain a preprocessed image frame; a feature extraction unit, used to perform feature extraction and target recognition on the preprocessed image frame to obtain feature data; a matching unit, used to match the subway tunnel image with the preprocessed image frame according to the feature data to obtain the current position information of the emergency response personnel; a guidance generation unit, used to generate guidance information according to the current position information and the information of the designated position; a mapping unit, used to generate virtual scene data as route guidance data according to the guidance information.

[0008] The urban subway pipe network flood emergency response system based on augmented reality provided by the present invention may also have the following features: wherein the feature data includes building structure outlines, building corners and building edges.

[0009] The urban subway pipe network flood emergency response system based on augmented reality provided by the present invention may also have the following features: wherein the time series model is trained according to historical real-time data to obtain a trained time series model.

[0010] In the urban subway pipeline flood emergency response system based on augmented reality provided by the present invention, it can also have the following features: wherein the augmented reality end includes: an augmented reality side data transmission module, which is used to send field data to the edge computing end, and receive route guidance data and risk avoidance data sent by the edge computing end; a data acquisition module, which is used to collect field data; a display module, which is used to display the risk avoidance data to the emergency response personnel in the form of chart data, and display the route guidance data to the emergency response personnel in the form of virtual identification.

[0011] In the urban subway pipeline flood emergency response system based on augmented reality provided by the present invention, it can also have such features, including: a command center end, which is communicatively connected to the augmented reality end and is held by the emergency command center personnel, and is used for video interaction with the emergency response personnel to provide remote technical support. The augmented reality end also includes an audio module for collecting audio data of the emergency response personnel and playing the voice data of the emergency command center personnel to the emergency response personnel. The data transmission module on the augmented reality side is also used to send field data and audio data to the command center end, and receive video interaction data sent by the command center end, and the video interaction data includes voice data.

[0012] The urban subway pipeline flood emergency response system based on augmented reality provided by the present invention may also have the following features: wherein the display module is used to display risk avoidance data above the perspective of the emergency response personnel, display virtual identification in the middle of the perspective of the emergency response personnel, and display video interaction data below the perspective of the emergency response personnel.

[0013] The urban subway pipeline flood emergency response system based on augmented reality provided by the present invention may also have the following features: wherein the data acquisition module is also used to collect gesture data of emergency response personnel, and the augmented reality end also includes an interactive response module, which is used to control the display module to display corresponding content according to the gesture data.

[0014] The urban subway pipeline flood emergency response system based on augmented reality provided by the present invention may also have the following features: wherein the edge computing end is a micro server or temporary equipment set up in a subway station or around a subway station, and the temporary equipment includes an advanced router, a laptop computer and a smart phone.

[0015] Functions and Effects of the Invention

[0016] According to the urban subway pipeline network flood emergency response system based on augmented reality involved in the present invention, because, on the one hand, through the edge computing terminal deployed in the subway station and its surroundings, timely response processing of a large amount of real-time data is achieved, the accuracy of route guidance data and risk avoidance data is improved, and then the effectiveness of risk prediction and path guidance is improved; on the other hand, the latest on-site data is obtained in real time through the augmented reality terminal, and the route guidance data and risk avoidance data are provided to emergency response personnel through augmented reality technology, so that emergency response personnel can more conveniently and intuitively understand the subway pipeline network flood situation and auxiliary prompts, so as to arrive at the designated location more safely and quickly. Therefore, the urban subway pipeline network flood emergency response system based on augmented reality of the present invention can timely feedback emergency response information and improve the safety of emergency response personnel. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a schematic diagram of the working principle of the urban subway pipe network flood emergency response system based on augmented reality in an embodiment of the present invention;

[0018] Figure 2 is a block diagram of an augmented reality terminal in an embodiment of the present invention;

[0019] Figure 3 is a schematic diagram of a system main interface stored in a display module in an embodiment of the present invention;

[0020] Figure 4 is a block diagram of an edge computing terminal in an embodiment of the present invention;

[0021] Figure 5 It is a flow chart of using an augmented reality-based urban subway pipe network flood emergency response system to assist emergency response personnel in going to a designated location in an embodiment of the present invention. DETAILED DESCRIPTION

[0022] In order to make the technical means, creative features, objectives and effects achieved by the present invention easy to understand, the following embodiments and the accompanying drawings specifically illustrate the urban subway pipeline flood emergency response system based on augmented reality of the present invention.

[0023] This embodiment provides an urban subway pipeline flood emergency response system based on augmented reality, which is used to assist emergency response personnel to reach a designated location.

[0024] Figure 1 It is a schematic diagram of the working principle of the urban subway pipe network flood emergency response system based on augmented reality in an embodiment of the present invention.

[0025] like Figure 1 As shown, the urban subway pipeline flood emergency response system 100 based on augmented reality includes a sensor network 10, an augmented reality terminal 20, an edge computing terminal 30 and a command center terminal 40.

[0026] When a flood occurs in the subway network, the specific working process of the urban subway network flood emergency response system 100 based on augmented reality is as follows: the emergency responders carry the augmented reality terminal 20 to enter the subway and go to the designated location for emergency rescue operations. The augmented reality terminal 20 collects real images of the on-site environment and the information requests of the emergency responders, and sends them to the edge computing terminal 30 in the form of task offloading. At the same time, the sensor network 10 sends the collected data to the edge computing terminal 30 through data transmission. The edge computing terminal 30 processes the received data and outputs the results to the augmented reality terminal 20. The augmented reality terminal 20 enhances the display of the received data and then presents it to the emergency responders, thereby assisting the emergency responders to go to the designated location. In this process, the emergency responders also share information with the command center terminal 40 through the augmented reality terminal 20, and receive remote decisions from the command center terminal 40, so as to better complete the emergency rescue operations.

[0027] The following describes in detail the various components of the urban subway pipeline network flood emergency response system 100 based on augmented reality.

[0028] The sensor network 10 includes a plurality of sensors arranged at designated locations in and around the subway station, and is used to collect real-time data, including water level depth, water flow, and subway internal structure damage data.

[0029] The augmented reality terminal 20 is worn by emergency response personnel to collect on-site data around the emergency response personnel and display route guidance data and risk avoidance data to the emergency response personnel. The on-site data includes on-site image data.

[0030] Figure 2 It is a block diagram of an augmented reality terminal in an embodiment of the present invention.

[0031] like Figure 2 As shown, the augmented reality terminal 20 includes an augmented reality side data transmission module 201, a data acquisition module 202, a display module 203, an audio module 204, an interactive response module 205 and an augmented reality side control module 206 for controlling the operation of the above modules.

[0032] The data transmission module 201 on the augmented reality side is used to send field data to the edge computing terminal 30, and receive route guidance data and risk avoidance data sent by the edge computing terminal 30. The data transmission module 201 on the augmented reality side is also used to send field data and audio data to the command center terminal 40, and receive video interaction data sent by the command center terminal 40. Among them, the video interaction data includes voice data. In this embodiment, the data transmission module 201 on the augmented reality side transmits information through the WiFi network provided by the on-site self-organizing network, that is, the wireless router.

[0033] The data collection module 202 includes an external camera and an interactive camera. The external camera is used to collect on-site data. The interactive camera is used to collect gesture data of emergency response personnel.

[0034] In this embodiment, the data acquisition module 202 compresses the collected field data in a standard coding format, and sends the compressed data to the edge computing end 30 via the augmented reality side data transmission module 201.

[0035] The display module 203 is used to display the risk avoidance data to the emergency response personnel in the form of chart data, and to display the route guidance data to the emergency response personnel in the form of virtual signs.

[0036] Figure 3 It is a schematic diagram of a system main interface stored in a display module in an embodiment of the present invention.

[0037] like Figure 3 As shown, the display module 203 displays the system main interface 2031 to the emergency response personnel. The emergency response personnel can trigger the risk information button 20311 through gestures to display the risk avoidance data; trigger the route guidance button 20312 to display the virtual logo; trigger the remote video button 20313 to display the video interaction data; trigger the exit button 20314 so that the display module 203 does not display the system main interface 2031.

[0038] In this embodiment, the display module 203 displays risk avoidance data above the perspective of the emergency responder, specifically displaying the future risk trend of indicators such as the water level depth around the emergency responder and the damage state of the subway tunnel structure within the set distance and time range in text or icons. For example, within 100m ahead, after 30s, the water level will increase from 0.2m to 1m, and the risk will increase.

[0039] In this embodiment, the display module 203 displays a virtual mark in the middle of the emergency response personnel's perspective, specifically, arrow symbols of "←", "↑" or "→" are alternately displayed as virtual marks according to the planned path to guide the user to the designated location.

[0040] Video interaction data is displayed below the emergency responder's perspective.

[0041] The audio module 204 includes a microphone and a speaker.

[0042] Microphones are used to capture audio data from emergency responders.

[0043] The loudspeaker is used to play the voice data of the emergency command center personnel to the emergency response personnel.

[0044] The interactive response module 205 is used to control the display module 203 to display corresponding content according to the gesture data.

[0045] The augmented reality side control module 206 stores a control program for controlling the operation of each module.

[0046] The edge computing end 30 is respectively connected to the sensor network 10 and the augmented reality end 20 for communication, and is used to generate route guidance data and risk avoidance data based on real-time data and on-site data, so as to guide emergency response personnel to a designated location.

[0047] The edge computing terminal 30 is a micro server or temporary device set up in or around a subway station. The temporary device includes an advanced router, a laptop computer, and a smart phone.

[0048] Figure 4 It is a block diagram of an edge computing terminal in an embodiment of the present invention.

[0049] like Figure 4 As shown, the edge computing end 30 includes a risk prediction module 1, a path generation module 302, and an edge computing side control module 303 for controlling the above modules.

[0050] The risk prediction module 301 includes a trained time series model for generating risk avoidance data based on real-time data.

[0051] The time series model is trained according to the historical real-time data to obtain the trained time series model. The risk avoidance data includes the danger prediction results around the emergency response personnel.

[0052] The path generation module 302 stores the subway tunnel image and is used to generate route guidance data according to the subway tunnel image and on-site image data.

[0053] The path generation module 302 includes a data preprocessing unit 3021 , a feature extraction unit 3022 , a matching unit 3023 , a guide generation unit 3024 and a mapping unit 3025 .

[0054] The data preprocessing unit 3021 is used to preprocess the scene image data to obtain preprocessed image frames. In this embodiment, the scene image data is a video, and after preprocessing by the data preprocessing unit 3021, a plurality of preprocessed image frames are obtained.

[0055] The feature extraction unit 3022 is used to perform feature extraction and target recognition on the pre-processed image frame to obtain feature data, wherein the feature data includes the building structure outline, building corner points and building edges.

[0056] The matching unit 3023 is used to match the subway tunnel image with the pre-processed image frame according to the feature data to obtain the current location information of the emergency response personnel.

[0057] The guidance generating unit 3024 is used to generate guidance information according to the current position information and the information of the designated position. In this embodiment, the guidance information is a three-dimensional guidance model, that is, an arrow symbol, which guides the emergency response personnel to move along the correct path.

[0058] The mapping unit 3025 is used to generate virtual scene data as route guidance data according to the guidance information.

[0059] In this embodiment, the mapping unit 3025 places the three-dimensional guidance model at the correct position in the three-dimensional world through posture calculation, and then places the three-dimensional guidance model at the corresponding position in the real environment through coordinate transformation, that is, it is displayed at the correct position from the perspective of the emergency responders.

[0060] The edge computing side control module 303 stores a control program for controlling the operation of each module.

[0061] The command center terminal 40 is connected to the augmented reality terminal 20 for communication and is held by emergency command center personnel for video interaction with emergency response personnel and for providing remote technical support.

[0062] The following, in conjunction with the accompanying drawings, describes a process of using the urban subway pipe network flood emergency response system 100 based on augmented reality to assist emergency response personnel in reaching a designated location.

[0063] Figure 5 It is a flow chart of using an augmented reality-based urban subway pipe network flood emergency response system to assist emergency response personnel in going to a designated location in an embodiment of the present invention.

[0064] like Figure 5 As shown, the process of using the urban subway pipe network flood emergency response system 100 based on augmented reality to assist emergency response personnel to go to a designated location includes the following steps:

[0065] Step S1, using the sensor network 10 to collect real-time data.

[0066] Step S2, using the augmented reality terminal 20 to collect on-site data around the emergency response personnel.

[0067] Step S3, using the edge computing terminal 30 to generate route guidance data and risk avoidance data based on real-time data and on-site data.

[0068] Step S4, using the augmented reality terminal 20 to display route guidance data and risk avoidance data to emergency response personnel, to guide the emergency response personnel to the designated location.

[0069] Functions and Effects of the Embodiments

[0070] According to the urban subway pipe network flood emergency response system based on augmented reality involved in this embodiment, on the one hand, by deploying edge computing terminals in subway stations and their surroundings, timely response processing of a large amount of real-time data is achieved, the accuracy of route guidance data and risk avoidance data is improved, and the effectiveness of risk prediction and path guidance is improved; on the other hand, the latest on-site data is obtained in real time through the augmented reality terminal, and the route guidance data and risk avoidance data are provided to emergency response personnel through augmented reality technology, so that emergency response personnel can more conveniently and intuitively understand the subway pipe network flood situation and auxiliary prompts, so as to reach the designated location more safely and quickly. In short, this method can timely feedback emergency response information and improve the safety of emergency response personnel.

[0071] Those skilled in the art should understand that the present invention is not limited to the above embodiments, and the above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, and these changes and improvements fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. An urban subway network flood emergency response system based on augmented reality, used to assist emergency response personnel to go to a designated location, characterized in that: include: A sensor network, including multiple sensors installed at designated locations in and around the subway station, is used to collect real-time data; An augmented reality terminal, worn by the emergency responder, for collecting on-site data around the emergency responder and displaying route guidance data and risk avoidance data to the emergency responder; The edge computing end is respectively connected to the sensor network and the augmented reality end for generating the route guidance data and the risk avoidance data according to the real-time data and the on-site data, so as to guide the emergency response personnel to the designated location. The real-time data include water level depth, water flow and subway internal structure damage data. The on-site data includes on-site image data, The edge computing end includes: A risk prediction module, including a trained time series model, for generating the risk avoidance data according to the real-time data; A path generation module stores a subway tunnel image and is used to generate the route guidance data according to the subway tunnel image and the on-site image data. The risk avoidance data includes danger prediction results around the emergency response personnel.

2. The urban subway pipeline network flood emergency response system based on augmented reality according to claim 1, Features: in, The path generation module comprises: A data preprocessing unit, used for preprocessing the on-site image data to obtain a preprocessed image frame; A feature extraction unit, used to perform feature extraction and target recognition on the preprocessed image frame to obtain feature data; A matching unit, configured to match the subway tunnel image with the pre-processed image frame according to the feature data to obtain current location information of the emergency response personnel; A guidance generating unit, configured to generate guidance information according to the current position information and the information of the designated position; A mapping unit is used to generate virtual scene data as the route guidance data according to the guidance information.

3. The urban subway network flood emergency response system based on augmented reality according to claim 2 is characterized by: in, The feature data includes building structure outlines, building corners and building edges.

4. The urban subway network flood emergency response system based on augmented reality according to claim 1 is characterized by: in, The time series model is trained according to the historical real-time data to obtain the trained time series model.

5. The urban subway pipeline network flood emergency response system based on augmented reality according to claim 1, Features: in, The augmented reality end includes: an augmented reality side data transmission module, used to send the on-site data to the edge computing end, and receive the route guidance data and the risk avoidance data sent by the edge computing end; A data acquisition module, used for collecting the field data; The display module is used to display the risk avoidance data to the emergency response personnel in the form of chart data, and to display the route guidance data to the emergency response personnel in the form of a virtual logo.

6. The urban subway network flood emergency response system based on augmented reality according to claim 5 is characterized in that: Also includes: The command center terminal is connected to the augmented reality terminal and is held by the emergency command center personnel for video interaction with the emergency response personnel to provide remote technical support. The augmented reality terminal also includes an audio module for collecting audio data of the emergency response personnel and playing the voice data of the emergency command center personnel to the emergency response personnel. The augmented reality side data transmission module is also used to send the on-site data and the audio data to the command center end, and receive the video interaction data sent by the command center end. The video interaction data includes the voice data.

7. The urban subway network flood emergency response system based on augmented reality according to claim 6 is characterized by: in, The display module is used to display the risk avoidance data above the perspective of the emergency responder, display the virtual logo in the middle of the perspective of the emergency responder, and display the video interaction data below the perspective of the emergency responder.

8. The urban subway network flood emergency response system based on augmented reality according to claim 5 is characterized by: in, The data collection module is also used to collect the gesture data of the emergency response personnel. The augmented reality terminal also includes an interactive response module. The interactive response module is used to control the display module to display corresponding content according to the gesture data.

9. The urban subway network flood emergency response system based on augmented reality according to claim 1, characterized in that: in, The edge computing end is a micro server or temporary equipment set up at or around the subway station. The temporary equipment includes advanced routers, laptops and smartphones.

Images