Inspection system with danger identification function

Abstract

An inspection system with a danger identification function relates to the technical field of inspection systems and comprises an information acquisition module used for acquiring real-time data of various environmental information in a mine; the data processing module is used for receiving the real-time data, acquiring the category of each group of real-time data and generating a corresponding data change graph; the server cloud platform is used for receiving and storing the data change diagram and sending an alarm signal to the AR glasses; wherein when the data in the data change diagram exceeds an environmental data security threshold value input by a user, the server cloud platform sends an alarm signal to the AR glasses; the AR glasses are used for generating a map model of a mine and receiving a field environment, a data change graph and an alarm signal; after the map model and the field environment are combined, an image of an alarm position is marked; the system can automatically identify dangerous areas and remind workers in advance.

Description

Technical Field

[0001] The utility model relates to the technical field of patrol inspection systems, in particular to a patrol inspection system with a danger identification function. Background Art

[0002] Production operations in coal mines require not only efficient production capacity, but also full consideration of dangerous factors in coal mine operation scenes, such as coal dust, toxic gases, high temperatures and other environmental issues. In the existing technology, the environment in coal mines is complex and changeable. When workers enter coal mines to maintain and repair underground equipment, they need to pay attention to dangerous factors such as coal dust, toxic gases and high temperatures in the scene at all times. At the same time, workers also need to concentrate on dealing with failures in underground equipment and implement corresponding maintenance plans for equipment failures, which consumes a lot of workers' energy.

[0003] Traditionally, the underground environment is monitored in a ground control room. When dangerous factors such as coal dust, toxic gas or high temperature appear, the staff in the control room use walkie-talkies to remind the patrol personnel of the dangerous factors. However, this method requires that there should be staff on duty in the control room 24 hours a day, resulting in high labor costs. In addition, because the staff cannot obtain the specific location of the patrol personnel in the mine, the staff can only verbally tell the patrol personnel where the alarm location is, and the patrol personnel go there by themselves. However, this largely depends on the experience and judgment of the patrol personnel. In addition, the routes underground in the mine are complicated, and the patrol personnel may also take detours, affecting the inspection efficiency.

[0004] A Chinese patent (CN220526358U) discloses an intelligent operation guidance and monitoring system for coal mines based on AR glasses. With AR glasses as a carrier, combined with a map navigation module, an equipment maintenance module and an environmental monitoring module, the navigation path can be displayed on the screen of the AR glasses, which is convenient for workers to quickly reach the destination. It can also monitor the environmental conditions in real time, and can achieve the purpose of improving the protection of workers' personal safety; however, the monitoring of the environment in this system is completed by AR glasses. In this way, if an emergency occurs, even if the environmental conditions can be monitored, the workers will still be in a dangerous situation, so there are still hidden dangers to the workers' personal safety;

[0005] Therefore, we propose an inspection system that can automatically identify dangerous areas and alert workers in advance. Utility Model Content

[0006] In order to overcome the deficiencies in the background technology, the utility model discloses a patrol inspection system with a danger identification function.

[0007] In order to achieve the above-mentioned invention object, the utility model adopts the following technical solutions:

[0008] A patrol inspection system with a hazard identification function, comprising:

[0009] Information collection module, used to collect real-time data of various environmental information in the mine;

[0010] A data processing module is used to receive real-time data, obtain the category of each group of real-time data, and generate a corresponding data change graph;

[0011] The server cloud platform is used to receive and store data change graphs and send alarm signals to the AR glasses;

[0012] Among them, when the data in the data change graph exceeds the environmental data safety threshold input by the user, the server cloud platform will send an alarm signal to the AR glasses;

[0013] AR glasses are used to generate a map model of the mine, as well as receive on-site environment, data change graphs and alarm signals; and display on their own screen an image that combines the map model with the on-site environment and is marked with the alarm location.

[0014] Preferably, the information collection module includes a plurality of collection nodes, the plurality of collection nodes are distributed in the mine, and the collection nodes include an air humidity sensor, a hot air sensor, a methane concentration sensor and a CO concentration sensor.

[0015] Preferably, the plurality of acquisition nodes are connected to the server cloud platform using ZigBee communication.

[0016] Preferably, each of the acquisition nodes is connected to a ZigBee coordinator, multiple ZigBee coordinators are connected to a master control node, and the master control node is signal-connected to the server cloud platform.

[0017] Preferably, the server cloud platform includes a server for receiving a data change graph and issuing an alarm signal;

[0018] Database, used to store data change graphs.

[0019] Preferably, the AR glasses include:

[0020] A camera unit, used to shoot the scene environment in front of the user;

[0021] A processing unit, for generating a map model of the mine according to the terrain parameters pre-input by the user, and after receiving the data change graph and the alarm signal, generating an image combining the map model and the on-site environment and marking the alarm location;

[0022] A display unit is used to display the scene environment photographed by the camera unit; and after the processing unit receives the alarm signal, the image generated by the processing unit is displayed;

[0023] The sound unit is used to generate a sound to alert the user after the processing unit receives the alarm signal;

[0024] The power supply unit is used to supply power to the camera unit, the processing unit, the display unit and the sound unit.

[0025] Preferably, the server cloud platform uses UBW to communicate with the AR glasses.

[0026] Due to the adoption of the above-mentioned technical solution, the utility model has the following beneficial effects:

[0027] The utility model discloses an inspection system with a danger identification function. 1. The environmental information in the mine is collected in advance through an information collection module. When the environment in the mine becomes bad, the remote server cloud platform first obtains the location of the dangerous area in time, and then issues an early warning to the user, so that the user can avoid the dangerous area during the inspection process, thereby improving the safety of the user during operation;

[0028] 2. AR glasses can also mark the evacuation routes and the locations of dangerous areas, so that users can have clear inspection directions and further improve user safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 A structural schematic diagram of the utility model;

[0030] Figure 2 It is a structural diagram of the information acquisition module;

[0031] Figure 3 This is a schematic diagram of the structure of AR glasses.

[0032] In the figure: 1. Information acquisition module; 11. Acquisition node; 12. ZigBee coordinator; 13. Master control node; 2. Data processing module; 3. Server cloud platform; 4. AR glasses; 41. Camera unit; 42. Processing unit; 43. Display unit; 44. Sound unit; 45. Power supply unit. DETAILED DESCRIPTION

[0033] The technical solution of the present invention will be described below in conjunction with the drawings in the embodiments of the present invention. In the description, it should be understood that if there are terms such as "upper", "lower", "front", "rear", "left", "right" and the like indicating directions or positional relationships, they are only corresponding to the drawings of the present invention, for the convenience of describing the present invention, and do not indicate or imply that the device or element referred to must have a specific direction:

[0034] Embodiment 1 of the present utility model is:

[0035] Combined with Figure 1The inspection system with danger identification function comprises:

[0036] Information collection module 1 is used to collect real-time data of various environmental information in the mine, including temperature, humidity, CO concentration, methane concentration and other environmental information that may cause mine accidents or endanger the safety of workers;

[0037] Data processing module 2, used to receive real-time data, obtain the category of each group of real-time data, and generate a corresponding data change graph;

[0038] This module mainly uses computer technology to automatically analyze and comprehensively process environmental information data obtained in time series under certain criteria to complete the required decision-making and estimation tasks.

[0039] The result of the processing is to display the changes of environmental indicators such as the concentration of harmful gases (methane, CO), air temperature and air humidity over a period of time in the form of a dynamic line graph, and each broken line in the dynamic line graph represents a parameter of environmental data;

[0040] The server cloud platform 3 is used to receive and store data change graphs, and send alarm signals to the AR glasses 4;

[0041] Among them, when the data in the data change graph exceeds the environmental data safety threshold input by the user, the server cloud platform 3 will send an alarm signal to the AR glasses 4;

[0042] The AR glasses 4 are used to generate a map model of the mine, and receive the on-site environment, data change diagram and alarm signal; and display on their own screen an image that combines the map model and the on-site environment and is marked with the alarm location.

[0043] Embodiment 2 of the present utility model is:

[0044] Based on Example 1, Figure 2 The information collection module 1 includes multiple collection nodes 11, which are distributed in the mine, and the collection nodes 11 include air humidity sensors, hot air sensors, methane concentration sensors and CO concentration sensors; the use of multiple collection nodes 11 can fully cover the space in the mine, so that the subsequent identification of dangerous areas in the mine can be more accurately positioned.

[0045] Embodiment 3 of the present utility model is:

[0046] On the basis of Example 2, the plurality of acquisition nodes 11 are connected to the server cloud platform 3 using ZigBee communication;

[0047] Among them, ZigBee is an emerging short-distance, low-power, low-cost, low-complexity wireless network transmission technology, which mainly uses the 2.4G free frequency band, and the wireless transmission bandwidth can reach 250Kb / s. The transmission distance of the ZigBee device with increased power in an open area can reach 2 kilometers, which is suitable for distributed sensor data collection and control data transmission;

[0048] Thus, the wireless sensor network based on ZigBee is a peer-to-peer, self-organizing, multi-hop routing, dynamic network, with scalability, robustness, real-time and other characteristics of transmission, supporting the construction of diversified network topologies, including star networks and mesh networks, and using a large number of redundant channels to transmit data in a multi-hop manner among network nodes;

[0049] Therefore, the wireless transmission method based on ZigBee can be used as a supplement to conventional fixed monitoring, or as an independent mobile emergency monitoring method. It can be quickly deployed in the accident impact range or potential dangerous areas. It is the best choice for accident disaster emergency rescue applications. It is suitable for the characteristics of regional risk concentration, rapidly changing accident scene situation, and potential expansion of accidents from point to surface.

[0050] In addition, each of the collection nodes 11 is connected to a ZigBee coordinator 12, and multiple ZigBee coordinators 12 are connected to a master control node 13, and the master control node 13 is connected to the server cloud platform 3 by signal; the master control node 13 can integrate the output data of multiple collection nodes 11, and multiple ZigBee coordinators 12 ensure that the signal can be stably transmitted between the collection node 11 and the master control node 13; it should be noted that the master control node 13 is only a transmission relay unit, which itself does not have the ability to store or process data.

[0051] Embodiment 4 of the present utility model is:

[0052] On the basis of embodiment 1, the server cloud platform 3 includes a server for receiving a data change graph and issuing an alarm signal;

[0053] It should be noted that the environmental data security threshold input by the user is also in the server. The server itself has a simple data processing function and can still complete the size comparison between data. Therefore, the comparison between the data in the data change graph and the environmental data security threshold can be completed through the server, thereby generating and issuing an alarm signal;

[0054] The database is used to store data change graphs. In addition, subsequent users can call or read data in the database through peripherals such as keyboards, mice or USB flash drives. After ensuring the safety of workers in the mine, remote personnel can also make preliminary judgments on the occurrence of danger by retrieving these data.

[0055] Embodiment 5 of the present utility model is:

[0056] Based on Example 1, Figure 3 , the AR glasses 4 include,

[0057] A camera unit 41 is used to capture the scene environment in front of the user;

[0058] Furthermore, the live images captured by the camera unit 41 can also be transmitted to the backend terminal.

[0059] The processing unit 42 is used to generate a map model of the mine according to the terrain parameters pre-input by the user, and after receiving the data change map and the alarm signal, generate an image combining the map model and the on-site environment and marking the alarm location;

[0060] Specifically, this unit is equipped with a Snapdragon XR2 model CPU, which can provide industry-leading performance and energy efficiency by virtue of its efficient architecture advantage, and is mainly responsible for data processing of the AR glasses 4 and as a hardware carrier of the software algorithm, while the software algorithm part of the processing unit 42 is a visualization system that uses a combination of AR technology, BIM model and GIS technology, namely;

[0061] Combine the BIM model that carries data information with AR technology and GIS technology, and use AR technology's real-time tracking and three-dimensional registration technology to "mix and superimpose" the virtual BIM model with the real world to achieve real-time interactive query on the same screen; at the same time, combine GPS and GIS technology, introduce spatial information, match the BIM model with the real coordinates of the real world, and ensure the accuracy and precision of AR tracking and positioning, so as to achieve good results in auxiliary construction work.

[0062] Among them, 1. AR technology

[0063] Augmented Reality (AR) technology is a real-time human-computer interaction technology that integrates virtual information and the real world. AR technology mainly includes three major features: virtual reality fusion, real-time interaction, and three-dimensional registration. Among them, three-dimensional registration is the most important. Three-dimensional registration emphasizes the correspondence between virtual objects and the real world, also called three-dimensional matching, which is the tracking and positioning of the real environment space.

[0064] 2. BIM Model

[0065] Use the PARameterization and LOD methods in software such as Revit and 3Dmax to achieve the result of lightweight BIM model; first, use the data iteration tool in Revit software to iterate the data of the parametric model; then import the iterated model into 3Dmax for meshing, and use the max script of skyline to clear the discrete points and empty objects in the model to reduce some redundant information generated after the BIM model is meshed. Through the model optimization tool of 3Dmax, the mesh model can be optimized by reducing the surface according to the set percentage without destroying the UV structure. The tool can export several model files with different LOD (Levels of Detail) precision in the background according to the settings. This method will have a certain degree of loss of model details, but the model optimization degree is high, and it supports the export and conversion of almost all formats. At the same time, saving the complete UV structure also provides convenient conditions for the editing of model texture materials in the later stage;

[0066] 3.GIS technology

[0067] The GIS platform adopts the WebGIS data publishing technology design based on Geoserver, which lays a technical foundation for the subsequent multifunctional integrated display of "one map".

[0068] Geoserver supports multiple geographic data sources and has rich functions on the server side. It supports multiple OGC standard data publishing interfaces such as wmts, wms, wfs, etc. Its outstanding advantages include: supporting the modification of map styles using the slg style language and supporting data queries using SQL; WebGIS uses an Openlayers-based front end, which can realize basic operations such as browsing and zooming maps in a Web browser, as well as feature selection, line selection, surface selection, layer overlay and other operations; Openlayers provides vector operation controls, and the drawing and editing functions of GIS vector elements are mainly implemented through the Openlayers platform.

[0069] The display unit 43 is used to display the scene environment photographed by the camera unit 41; and after the processing unit 42 receives the alarm signal, the image generated by the processing unit 42 is displayed;

[0070] Specifically, the display unit 43 can use a 4K display screen equipped with two FAST-LCDs, with a field of view of 105°, so that the wearer can maintain a good field of view even in a mine; and the computational holographic near-eye display technology using a metasurface grating waveguide breaks through key design and processing technologies such as metasurface grating waveguide optical system design, wide-spectrum metasurface structure design, computational holography, and high-precision micro-nano structure preparation, and can effectively solve the problems of complex structure, large volume and weight, strong angle and wavelength sensitivity, large multi-order diffraction energy loss, and visual convergence conflict;

[0071] When no dangerous situation occurs, the display unit 43 displays the image of the on-site environment in front of the user taken by the camera unit 41; when a dangerous situation occurs, the display unit 43 will display the image generated by the processing unit 42, which is a combination of the map model and the on-site environment and marked with the alarm location, so that the user can choose to go to the alarm location for inspection or avoid the alarm location during the inspection process;

[0072] In addition, the display unit 43 will also display the environmental parameter values ​​of the alarm location, so that the user can accurately judge the current situation and then choose whether to go to the alarm location for inspection or to evacuate the mine in time. If the user needs to go to the alarm location, the processing unit 42 can also calculate the path from the user's current location to the alarm location and display it on the display unit 43 to guide the user to go there;

[0073] If the user needs to leave the mine, the processing unit 42 can also mark the evacuation path on the processed image to guide the user to leave. Since there are generally many workers underground in the mine and ordinary workers do not need to be equipped with AR glasses, when leaving, the inspectors wearing AR glasses act as guides to guide ordinary workers to leave together.

[0074] The sound unit 44 is used to generate a sound to remind the user to pay attention after the processing unit 42 receives the alarm signal;

[0075] Specifically, the unit uses dual stereo speakers, and the sound unit 44 is the necessary hardware for remote command; in the mine, the camera unit 41 and the display unit 43 will transmit the images to the background terminal, and the remote expert can have multi-party real-time voice calls with the front-end staff.

[0076] A power supply unit 45, used to supply power to the camera unit 41, the processing unit 42, the display unit 43 and the sound unit 44;

[0077] This unit is the "power" output of the entire glasses 4, and can use a 7300mAh graphene battery to reduce the size. Due to underground mining operations, the AR glasses 4 may need to operate for more than 10 hours. At this time, the requirements for the battery are fast charging, long standby time, small size and light weight. Therefore, graphene is a better choice than lithium batteries at this stage.

[0078] In particular, the server cloud platform 3 is connected to the AR glasses 4 by using UBW;

[0079] Among them, UWB technology is a communication technology based on broadband signals, which has the characteristics of high bandwidth, short pulse duration, low power density, anti-multipath effect, high anti-interference, etc. It has broad application prospects in the fields of wireless communication, positioning and radar, especially in underground sheltered places and confined space positioning. UWB technology can achieve high-precision distance measurement and positioning, providing important support for work safety and production efficiency;

[0080] During the specific application implementation, a UWB positioning chip with low energy consumption and strong anti-interference ability is deployed inside the AR glasses 4 to collect the positioning information of the wearer, and the positioning chip information is transmitted back to the background computing platform through the wireless sensor network, and the positioning information is solved and stored on the background computing platform; in places where UWB positioning technology has been deployed, this solution can not only utilize the low power consumption and anti-interference characteristics of UWB technology, but also utilize the large network capacity and good network topology capabilities of ZigBee technology to meet the requirements of real-time positioning and unique identification of patrol personnel.

[0081] The parts of the present invention that are not described in detail are prior art. It is obvious to those skilled in the art that the present invention is not limited to the details of the above-mentioned exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or basic features of the present invention. Therefore, no matter from which point of view, the embodiments should be regarded as exemplary and non-restrictive. The scope of the present invention is limited by the attached claims rather than the above description. Therefore, it is intended to include all changes within the meaning and scope of the equivalent elements of the claims in the present invention, and any figure marks in the claims should not be regarded as limiting the claims involved.

Claims

1. A patrol inspection system with a hazard identification function, characterized by: include, An information collection module (1) is used to collect real-time data of various environmental information in the mine; A data processing module (2) is used to receive real-time data, obtain the category of each group of real-time data, and generate a corresponding data change graph; A server cloud platform (3) is used to receive and store data change graphs, and send alarm signals to the AR glasses (4); The AR glasses (4) are used to generate a map model of the mine, and receive the on-site environment, data change diagram and alarm signal; and display on the screen thereof an image combining the map model and the on-site environment and marked with the alarm location.

2. The inspection system with danger identification function as claimed in claim 1, characterized in that: The information collection module (1) comprises a plurality of collection nodes (11), the plurality of collection nodes (11) are distributed in the mine, and the collection nodes (11) include an air humidity sensor, a hot air sensor, a methane concentration sensor and a CO concentration sensor.

3. The inspection system with danger identification function as claimed in claim 2, characterized in that: The plurality of collection nodes (11) are connected to the server cloud platform (3) using ZigBee communication.

4. The inspection system with danger identification function as claimed in claim 3 is characterized in that: Each of the acquisition nodes (11) is connected to a ZigBee coordinator (12), a plurality of ZigBee coordinators (12) are connected to a master control node (13), and the master control node (13) is signal-connected to a server cloud platform (3).

5. The inspection system with danger identification function as claimed in claim 1, characterized in that: The server cloud platform (3) comprises a server, which is used to receive a data change graph and send out an alarm signal; Database, used to store data change graphs.

6. The inspection system with danger identification function as claimed in claim 1, characterized in that: The AR glasses (4) include: A camera unit (41), used for photographing the scene environment in front of the user; A processing unit (42) is used to generate a map model of the mine according to the terrain parameters pre-input by the user, and after receiving the data change map and the alarm signal, generate an image combining the map model and the on-site environment and marking the alarm location; A display unit (43) is used to display the scene environment photographed by the camera unit (41); and after the processing unit (42) receives the alarm signal, the display unit (43) displays the image generated by the processing unit (42); A sound unit (44) is used to generate a sound to alert the user after the processing unit (42) receives the alarm signal; A power supply unit (45) is used to supply power to the camera unit (41), the processing unit (42), the display unit (43) and the sound unit (44).

7. The inspection system with danger identification function as claimed in claim 1, characterized in that: The server cloud platform (3) is connected to the AR glasses (4) by using UBW for communication.

Images