Industrial complex disaster monitoring system using drones

Abstract

An industrial complex disaster monitoring system using drones is launched. The industrial complex disaster monitoring system using drones includes an Unmanned Aerial Vehicle (UAV) that flies within the industrial complex, performs sensing, and transmits sensor data when a monitoring event occurs in the sensor data generated from the sensing; and an Unmanned Aerial System (UAS) application server that communicates with the UAV through a 5G network system, controls the UAV remotely according to a preset algorithm, and receives sensor data from the UAV.

Description

Technology Field

[0001] The present invention relates to an industrial complex disaster monitoring system using drones. Background Technology

[0002] An industrial complex is a concept of a parcel of land designated and developed under a comprehensive plan for the collective installation of factories, facilities related to knowledge industries, cultural industries, information and communication industries, recycling industries, resource stockpiling facilities, logistics facilities, and other facilities prescribed by Presidential Decree; related educational facilities, research facilities, office facilities, support facilities, information processing facilities, and distribution facilities; as well as residential facilities, cultural facilities, environmental facilities, park and green space facilities, medical facilities, tourism facilities, sports facilities, and welfare facilities to enhance the functions of these facilities. Industrial complexes include national industrial complexes designed to foster key national industries or high-tech industries; general industrial complexes designed to promote the appropriate regional decentralization of industries and revitalize the local economy; urban high-tech industrial complexes designed to foster and promote the development of knowledge industries, cultural industries, information and communication industries, and other high-tech industries; and agricultural and industrial complexes designed to attract and foster industries in rural areas to increase the income of farmers and fishermen.

[0003] Within these industrial complexes, various facilities are installed according to their purpose, and personnel are stationed to carry out work. However, due to the nature of the work, industrial sites are subject to various risk factors, such as hazardous gas leaks, explosions, fires, and building collapses. Therefore, it is of paramount importance to detect these accident risks in advance, and if an accident occurs, it is necessary to quickly assess the situation and take rapid measures, such as rescuing lives.

[0004] However, industrial complexes have a wide variety of facilities, making it difficult to detect accident risks in advance. Even when an accident occurs, it is difficult to quickly and accurately assess the situation, which leads to problems in responding appropriately. In particular, if the accident situation at the industrial complex site is not accurately assessed, it is difficult to immediately and quickly deploy rescue personnel due to the risk of secondary accidents. Prior art literature

[0005] Korean Patent Publication No. 10-1591958 (2016.01.29) The problem to be solved

[0006] The present invention aims to provide an industrial complex disaster monitoring system using a drone, wherein an Unmanned Aerial Vehicle (UAV) flies within an industrial complex and monitors on-site conditions within the complex using various equipped sensors, and transmits the corresponding sensor data to an Unmanned Aerial System (UAS) application server when a monitoring event occurs in the sensor data. means of solving the problem

[0007] According to one aspect of the present invention, an industrial complex disaster monitoring system using a drone is disclosed.

[0008] An industrial complex disaster monitoring system using a drone according to an embodiment of the present invention includes an Unmanned Aerial Vehicle (UAV) that flies within an industrial complex, performs sensing, and transmits sensor data when a monitoring event occurs in the sensor data generated from the sensing, and an Unmanned Aerial System (UAS) application server that communicates with the UAV through a 5G network system, controls the UAV remotely according to a preset algorithm, and receives sensor data from the UAV.

[0009] The industrial complex disaster monitoring system further includes a monitoring server that communicates with the UAV through the 5G network system and receives video captured by the UAV and outputs it through a display device, an administrator terminal that receives sensor data received from the UAV from the UAS application server and outputs the received sensor data, and a UAV controller that provides the function of an operator controlling the UAV (100) on the ground within the industrial complex and has a display device that receives and outputs video captured by a wireless camera mounted on the UAV.

[0010] The above UAV includes a UAS application-specific client module that provides client-side functions corresponding to a UAS application, a UAE (UAS Application Enabler) client module that supports interaction with a specific client of the UAS application, and a SEAL (Service Enabler Architecture Layer) client module that performs group management, configuration management, identity management, key management, and network resource management.

[0011] The above UAV is equipped with a GPS (Global Positioning System), a temperature sensor, a hazardous gas detection sensor, a human body detection sensor, a LiDAR sensor, and a wireless camera.

[0012] The above UAS application server includes a UAS application specific server module that provides server-side functions corresponding to a UAS application, a UAE server module that performs functions such as registration and operation of the lidar sensor, wireless camera, temperature sensor, hazardous gas detection sensor, and human body detection sensor mounted on the UAV, trigger signal processing, processing when an event occurs, GPS automatic navigation support of the UAV, map monitoring of a specific location, industrial complex support app integration, and industrial complex support web integration, and a SEAL server module that performs group management, configuration management, identity management, key management, and network resource management.

[0013] When a preset fire hazard temperature, hazardous gas, or human body is detected through the temperature sensor, the hazardous gas detection sensor, or the human body detection sensor, the above UAV processes the wireless camera to perform shooting and transmit the generated video data to the UAS application server in order to track the source, and in response to a request from the UAS application server, processes the transmission of LiDAR data mapped to GPS data to the UAS application server, or the transmission of the wireless camera to perform shooting and transmit the generated video data to the UAS application server.

[0014] The above UAV displays the location where the monitoring event acquired using the above GPS occurred on a map and transmits it to the UAS application server through the above 5G network system. Effects of the invention

[0015] An industrial complex disaster monitoring system using a drone according to an embodiment of the present invention monitors the on-site conditions within the industrial complex using various sensors equipped with a UAV (Unmanned Aerial Vehicle) while flying in the industrial complex, and transmits the corresponding sensor data to an UAS (Unmanned Aerial System) application server when a monitoring event occurs in the sensor data, thereby enabling the manager of the industrial complex to quickly and accurately identify the accident situation at the industrial complex site to take prompt action and secure legal evidence regarding the accident within the industrial complex. Brief explanation of the drawing

[0016] FIG. 1 is a diagram schematically illustrating the configuration of an industrial complex disaster monitoring system using a drone according to an embodiment of the present invention. FIG. 2 is a diagram schematically illustrating the configuration of an Unmanned Aerial Vehicle (UAV) of an industrial complex disaster monitoring system using a drone according to an embodiment of the present invention of FIG. 1. FIG. 3 is a diagram schematically illustrating the configuration of a UAV controller of an industrial complex disaster monitoring system using a drone according to an embodiment of the present invention of FIG. 1. FIG. 4 is a diagram schematically illustrating the configuration of an Unmanned Aerial System (UAS) application server of an industrial complex disaster monitoring system using a drone according to an embodiment of the present invention of FIG. 1. FIGS. 5 to 8 are drawings for explaining an industrial complex disaster monitoring system using a drone according to an embodiment of the present invention of FIG. 1. Specific details for implementing the invention

[0017] As used in this specification, singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "composed" or "comprising" should not be interpreted as necessarily including all of the various components or steps described in the specification, and should be interpreted as meaning that some of the components or steps may be excluded, or that additional components or steps may be included. Furthermore, terms such as "...part," "module," etc., as used in the specification refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.

[0018] Hereinafter, various embodiments of the present invention will be described in detail with reference to the attached drawings.

[0019] FIG. 1 is a diagram schematically illustrating the configuration of an industrial complex disaster monitoring system using a drone according to an embodiment of the present invention; FIG. 2 is a diagram schematically illustrating the configuration of an Unmanned Aerial Vehicle (UAV) of the industrial complex disaster monitoring system using a drone according to an embodiment of the present invention of FIG. 1; FIG. 3 is a diagram schematically illustrating the configuration of a UAV controller of the industrial complex disaster monitoring system using a drone according to an embodiment of the present invention of FIG. 1; FIG. 4 is a diagram schematically illustrating the configuration of an Unmanned Aerial System (UAS) application server of the industrial complex disaster monitoring system using a drone according to an embodiment of the present invention of FIG. 1; and FIG. 5 to 8 are diagrams for explaining the industrial complex disaster monitoring system using a drone according to an embodiment of the present invention of FIG. 1. Hereinafter, the industrial complex disaster monitoring system using a drone according to an embodiment of the present invention will be described with reference to FIG. 2 to 8.

[0020] Referring to FIG. 1, an industrial complex disaster monitoring system using a drone according to an embodiment of the present invention may be configured to include an Unmanned Aerial Vehicle (UAV) (100), an Unmanned Aerial System (UAS) application server (200), a monitoring server (300), an administrator terminal (400), and a UAV controller (500).

[0021] The UAV (100) performs sensing while flying within the industrial complex, and when a monitoring event occurs in the sensor data generated according to the sensing, it transmits the sensor data to the UAS application server (200) and the monitoring server (300) through the 5G network system (10).

[0022] That is, the UAV (10) can be equipped with a GPS (Global Positioning System), a temperature sensor, a hazardous gas detection sensor, a human body detection sensor, a lidar sensor, and a wireless camera, and can use this to obtain the location, temperature, presence of hazardous gas, presence of a human body, lidar data, and images of the UAV (10).

[0023] Referring to FIG. 2, the UAV (100) may include a UAS application-specific client module (110), a UAE (UAS Application Enabler) client module (120), and a SEAL (Service Enabler Architecture Layer) client module (130).

[0024] Here, the UAS application-specific client module (110) provides client-side functions corresponding to the UAS application.

[0025] And, the UAE client module (120) supports interaction with a specific client of the UAS application.

[0026] And, the SEAL client module (130) is a location management client that performs group management, configuration management, identity management, key management, and network resource management.

[0027] The UAS application server (200) communicates with the UAV (100) through the 5G network system (10), controls the UAV (100) remotely according to a preset algorithm, and receives sensor data from the UAV (100).

[0028] Referring to FIG. 3, the UAS application server (200) may include a UAS application specific server module (210), a UAE (UAS Application Enabler) server module (220), and a SEAL (Service Enabler Architecture Layer) server module (230).

[0029] The monitoring server (300) is connected to the UAV (100) via a 5G network system (10) and receives video captured by the UAV (100) and outputs it through a display device (not shown). Here, the received video may be video captured by the UAV (100) in the event of an emergency, and may be monitored by an administrator through the display device.

[0030] The administrator terminal (400) receives sensor data received from the UAV (100) from the UAS application server (200) and outputs the received sensor data.

[0031] For example, the administrator terminal (400) can output sensor data received through an industrial complex monitoring application or the web.

[0032] The UAV controller (500) provides the function of an operator controlling the UAV (100) from the ground within the industrial complex.

[0033] Additionally, the UAV controller (500) may be equipped with a display device that receives and outputs images captured by a wireless camera mounted on the UAV (100). Thus, the operator can use the UAV controller (500) to control the flight and sensing of the UAV (100) within the industrial complex and perform monitoring by checking the received sensor data.

[0034] Referring to FIG. 4, the UAV controller (500) may include a UAS application-specific client module (510), a UAE (UAS Application Enabler) client module (520), and a SEAL (Service Enabler Architecture Layer) client module (530), just like the UAV (100).

[0035] Here, the UAS application-specific client module (510) provides client-side functions corresponding to the UAS application.

[0036] And, the UAE client module (520) supports interaction with a specific client of the UAS application.

[0037] And, the SEAL client module (530) is a location management client that performs group management, configuration management, identity management, key management, and network resource management.

[0038] Meanwhile, the 5G network system (10) linked with the UAV (100) can store registration information and operation information of multiple sensors of the UAV (100) in the form of a resource tree as shown in FIG. 5, and transmit the stored information to the UAS application server (200) through the Open API of the application service layer.

[0039] Hereinafter, with reference to FIGS. 5 to 8, the operation of the UAV (100) and the UAS application server (200) will be described in more detail.

[0040] The UAS application server (200) registers and manages sensor devices mounted on the UAV (100) and can perform operations such as actual service functions, management functions, and control functions by analyzing sensor data acquired by the UAV (100). To perform these operations, the control program installed in the control unit of the UAS application server (200) may include a UAS application specific server module (210), a UAE server module (220), and a SEAL server module (230), as described above.

[0041] The UAS application specific server module (210) provides server-side functions corresponding to UAS applications and utilizes the UAE server module (220) for UAS application layer support functions. For example, UAS applications include USS (UAS Service Supplier) and UTM (UAS Traffic Management).

[0042] If the Common API Framework for northbound APIs (CAPIF) is supported, the UAS application-specific server module (210) can also perform the role of an API caller of CAPIF with a functional architecture and specified information flow to support the 3GPP Common API Framework for northbound APIs.

[0043] Here, the 3GPP network system supporting CAPIF is a network system that supports interface with independent individual devices through reference points that can be interfaced in the 5G network system (10) existing between the UAS application server (200) and the UAV (100).

[0044] If CAPIF is supported, the UAE server module (220) may operate as an API exposure function of CAPIF that provides a service API to a specified UAS application specific server module (210) or another UAE server module (220), or may act as an API caller of CAPIF.

[0045] Additionally, the UAE server module (220) can use the service API provided by another UAE server module (220) and provide the following server-side UAS application layer support functions.

[0046] 1) Perform group-based QoS management for UAS (a pair of UAVs (100) and UAV controllers (500)) using SEAL API

[0047] 2) Receive C2 operation mode configuration from the UAS application specific server module (210) and additionally configure the UAS UE (UAV (100), UAV controller (500)).

[0048] 3) Trigger the switch in communication mode between UAS UE and C2

[0049] 4) Receive and store the C2 communication mode selected from the UAS UE

[0050] 5) Support real-time status monitoring of UAS UEs and communication of UAV application messages between UAVs using SEAL API

[0051] This UAE server module (220) can perform functions such as registering and operating a lidar sensor mounted on the UAV (100), registering and operating a wireless camera, registering and operating a temperature sensor, registering and operating a hazardous gas detection sensor, registering and operating a human body detection sensor, registering and operating various other devices, processing trigger signals, processing when an event occurs, supporting GPS automatic navigation of the UAV (100), map monitoring of a specific location, linking with an industrial complex support app, linking with an industrial complex support web, etc.

[0052] The SEAL server module (230) performs group management, configuration management, identity management, key management, and network resource management.

[0053] Based on information stored in the form of a resource tree as shown in FIG. 5, which is registered in the 5G network system (10) and transmitted to the UAS application server (200), the operator domain can be arbitrarily designated according to the operator. The unique identifier assigned as a service is a number received from the operator, and the device registration of the UAV (10) can be processed through operator domain registration, Node and RemoteCSE registration, drone operation data transmission cycle command, and drone operation data transmission.

[0054] Here, the registration of a business domain can be achieved by the UAV (10) transmitting resource information in the form of " / business domain / [unique identifier assigned to the service] / lastest HTTP / 1.1" to the 5G network system (10) through the Common Libs module, the 5G network system (10) verifying the received resource information and storing it in a resource tree, and subsequently, when the 5G network system (10) receives a business domain request from the UAS application server (200) through the AE (Application Enabler), transmitting the business domain information stored in the resource tree to the UAS application server (200).

[0055] In addition, Node and RemoteCSE registration can be carried out in the same or similar way as the business domain registration process.

[0056] And, the drone operation data transmission cycle command can be registered by the UAS application server (200) transmitting drone operation data transmission cycle information according to the drone operation ID to the 5G network system (10) in the form of "mgmtCmd-[Drone Operation ID] / cycle / lastest HTTP / 1.1", the 5G network system (10) checking the received drone operation data transmission cycle information and storing it in a resource tree, and transmitting the stored drone operation data transmission cycle information to the UAV (10).

[0057] In addition, the transmission of drone operation data can be achieved by the UAV (10) transmitting drone operation data acquired according to a set period to a 5G network system (10) in the form of " / node1111 / remoteCSE001 / Container-Drone / Contentinstance-[R|Lider(GPS)] / lastest HTTP / 1.1", and the 5G network system (10) verifying the received drone operation data, storing it in a resource tree, and transmitting the stored drone operation data to a UAS application server (200). Here, the GPS data received at each period can be used to display the moving UAV (10) on a map.

[0058] FIG. 6 shows an example of registration and operation resource information for a wireless camera mounted on a UAV (10), and the process of registering and operating the wireless camera is as follows.

[0059] First, wireless camera registration is performed, and after the wireless camera session is set up, wireless camera data transmission is performed, and the session is terminated by the release processing of the wireless camera.

[0060] Here, wireless camera registration can be achieved by the wireless camera mounted on the UAV (10) transmitting wireless camera information in the form of " / Node-[ID] / Container-Drone External Session / lastest HTTP / 1.1" to the 5G network system (10) through the Common Libs module, the 5G network system (10) verifying the received wireless camera information and storing it in a resource tree, and when the UAS application server (200) receives a request for wireless camera information through the AE (Application Enabler), transmitting the wireless camera information stored in the resource tree to the UAS application server (200).

[0061] And, the wireless camera session setup process is performed by the UAS application server (200) transmitting wireless camera session setup information to the wireless camera mounted on the UAV (10) through the 5G network system (10).

[0062] And, wireless camera data transmission is performed through direct data exchange between the wireless camera where the wireless camera session setup is performed and the UAS application server (200).

[0063] And, the wireless camera session data release process is achieved by registering release information in the resource tree of the 5G network system (10) in response to a release request from the wireless camera, transmitting the release information to the UAS application server (200), and releasing a data session between the wireless camera and the UAS application server (200).

[0064] FIG. 7 shows an example of registration and operation resource information for a human body detection sensor mounted on a UAV (10), and the process of registering and operating the human body detection sensor is as follows.

[0065] Registration of the human body detection sensor can be achieved by the UAV (10) equipped with the human body detection sensor transmitting human body detection sensor information in the form of " / node-[ID] / RemoteCSE-[Id] / Container-Drone / Contentinstance-[R|Human Body Detection] / lastest HTTP / 1.1" to the 5G network system (10) through the Common Libs module, the 5G network system (10) verifying the received human body detection sensor information and storing it in a resource tree, and when the UAS application server (200) receives a request for human body detection sensor information through the AE (Application Enabler), transmitting the human body detection sensor information stored in the resource tree to the UAS application server (200).

[0066] And, the process of transmitting sensor data of the human body detection sensor can be achieved by the UAV (10) transmitting sensor data acquired by the human body detection sensor to the 5G network system (10), the 5G network system (10) verifying the received sensor data and storing it in a resource tree, and transmitting the stored sensor data to the UAS application server (200).

[0067] When a dangerous situation is detected through a temperature sensor, a hazardous gas detection sensor, a human body detection sensor, a lidar sensor, and a wireless camera, the UAV (10) generates a trigger signal and performs the corresponding function.

[0068] FIG. 8 illustrates an example of trigger processing of a UAV (10) in response to the occurrence of a monitoring event in sensor data. Here, the monitoring event may include a preset fire hazard temperature, detection of hazardous gas or a human body, a request for lidar data or image data from a UAS application server (200), etc.

[0069] Referring to FIG. 8, when a preset fire hazard temperature, hazardous gas, or human body is detected through a temperature sensor, a hazardous gas detection sensor, or a human body detection sensor, the UAV (10) can process the wireless camera to take a picture to track the source and transmit the generated image data to the UAS application server (200).

[0070] Additionally, the UAV (10) can transmit lidar data mapped to GPS data to the UAS application server (200) in response to a request from the UAS application server (200), or process the wireless camera to perform shooting and transmit the generated image data to the UAS application server (200).

[0071] At this time, the UAV (10) can display the location where the monitoring event occurred, acquired using GPS, on a map and transmit it to the UAS application server (200) and monitoring server (300) through the 5G network system (10). Through this, the administrator can easily identify the location where the monitoring event occurred on the map.

[0072] The embodiments of the present invention described above are disclosed for illustrative purposes only, and those skilled in the art with ordinary knowledge of the present invention may make various modifications, changes, and additions within the spirit and scope of the present invention, and such modifications, changes, and additions should be considered to fall within the scope of the following claims. Explanation of the symbols

[0073] 10: 5G Network System 100: Unmanned Aerial Vehicle (UAV) 110: UAS Application Specific Client Module 120: UAE (UAS Application Enabler) Client Module 130: SEAL (Service Enabler Architecture Layer) Client Module 200: UAS (Unmanned Aerial System) Application Server 210: UAS Application Specific Server Module 220: UAE Server Module 230: SEAL Server Module 300: Monitoring Server 400: Administrator Terminal 500: UAV Controller 510: UAS Application Specific Client Module 520: UAE Client Module 530: SEAL client module

Claims

Claim 1 In an industrial complex disaster monitoring system using a drone, the system comprises: an Unmanned Aerial Vehicle (UAV) that flies within the industrial complex, performs sensing, and transmits sensor data when a monitoring event occurs in the sensor data generated from the sensing; an Unmanned Aerial System (UAS) application server that communicates with the UAV via a 5G network system, controls the UAV remotely according to a preset algorithm, and receives sensor data from the UAV; a monitoring server that communicates with the UAV via the 5G network system, receives video captured by the UAV, and outputs it through a display device; and an administrator terminal that receives sensor data received from the UAV via the UAS application server and outputs the received sensor data. The system includes a UAV controller that provides a function for an operator to control the UAV from the ground within the industrial complex and is equipped with a display device that receives and outputs images captured by a wireless camera mounted on the UAV, wherein the UAV comprises: a UAS Application Specific Client Module that provides client-side functions corresponding to a UAS application; a UAE (UAS Application Enabler) Client Module that supports interaction with a specific client of the UAS application; and a SEAL (Service Enabler Architecture Layer) Client Module that performs group management, configuration management, identity management, key management, and network resource management, and the UAV is equipped with a GPS (Global Positioning System), a temperature sensor, a hazardous gas detection sensor, a human body detection sensor, a LiDAR sensor, and a wireless camera, and the 5G network system stores registration information and operation information of a plurality of sensors mounted on the UAV in the form of a resource tree,The stored information is transmitted to the UAS application server via an Open API of the Application Service Layer, and the UAS application server comprises: a UAS application specific server module that provides server-side functions corresponding to a UAS application; and a UAS server module that performs functions such as registration and operation of the LiDAR sensor, the wireless camera, the temperature sensor, the hazardous gas detection sensor, and the human body detection sensor mounted on the UAV, trigger signal processing, processing when an event occurs, support for GPS automatic navigation of the UAV, map monitoring of a specific location, integration with an industrial complex support app, and integration with an industrial complex support web. It includes a SEAL server module that performs group management, configuration management, identity management, key management, and network resource management; the UAE server module performs group-based QoS management for a pair of the UAV and the UAV controller using the SEAL API; configures the UAV and the UAV controller by receiving a C2 operation mode configuration from the UAS application-specific server module; triggers a C2 communication mode switch with the UAV and the UAV controller; receives and stores a selected C2 communication mode from the UAV and the UAV controller; supports real-time status monitoring and UAV application message communication of the UAV and the UAV controller using the SEAL API; the UAS application server registers and manages sensor devices mounted on the UAV and performs service functions, management functions, and control functions by analyzing sensor data acquired by the UAV; the UAS application server transmits drone operation data transmission cycle information to the 5G network system; and the 5G network system stores the drone operation data transmission cycle information in the resource tree and then transmits it to the UAV.The above UAV transmits drone operation data acquired at a set period according to the drone operation data transmission period information to the 5G network system, and the 5G network system stores the drone operation data in the resource tree and transmits it to the UAS application server, wherein the GPS data received at each period is used to display the UAV moving on a map, and the wireless camera is registered through the 5G network system, and a wireless camera session is set up by the UAS application server transmitting wireless camera session setup information to the wireless camera through the 5G network system, and after the wireless camera session is set up, wireless camera data transmission is performed through direct data exchange between the wireless camera and the UAS application server, and the UAV processes that when a preset fire risk temperature, hazardous gas, or human body is detected through the temperature sensor, the hazardous gas detection sensor, or the human body detection sensor, the wireless camera performs shooting to track the source and transmits the generated video data to the UAS application server, and in accordance with a request from the UAS application server, transmits LiDAR data mapped to GPS data to the UAS application server, or the An industrial complex disaster monitoring system using a drone, characterized in that a wireless camera performs shooting and processes the generated video data to transmit it to the UAS application server, and the UAV displays the location where a monitoring event acquired using the GPS occurred on a map and transmits it to the UAS application server via the 5G network system. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 delete Claim 6 delete Claim 7 delete

Images