A coal mine scene visual management and control system based on internet of things and light-weight digital twinning

Abstract

The application discloses a coal mine scene visual management and control system based on Internet of Things and lightweight digital twinning, and relates to the technical fields of intelligent management and control of coal mines, data interaction of Internet of Things, digital twinning modeling and lightweight visualization. The system comprises a global data acquisition unit, a lightweight model construction unit, a data twinning mapping unit, an edge rendering unit, a visual interactive management and control unit and a cloud storage supervision unit. The global data acquisition unit is used for unified access to multi-source monitoring data of coal mines, the lightweight model construction unit is used for completing lightweight modeling and optimization of a three-dimensional model of a coal mine scene, the data twinning mapping unit is used for realizing real-time binding and synchronization of physical data and a virtual model, the edge rendering unit is used for completing local lightweight rendering to ensure smooth display in a weak network environment, the visual interactive management and control unit is used for providing three-dimensional scene interaction and remote device control functions, and the cloud storage supervision unit is used for realizing management and supervision display of models and data. The application solves the technical problems of a traditional coal mine digital twinning system, such as high deployment cost, poor data fusion, poor weak network operation experience, separation of display and control, and has the advantages of lightweight, low cost, easy deployment, strong compatibility, integration of viewing, management and control, and is suitable for intelligent visual upgrading and reconstruction of various coal mines, and can significantly improve the intelligent level of safety management and production scheduling of coal mines.

Description

Technical Field

[0001] This invention relates to the fields of intelligent management and control of coal mines, Internet of Things (IoT) data interaction, digital twin modeling, and lightweight visualization technology. Specifically, it is a coal mine scene visualization management and control system based on IoT and lightweight digital twin, which is applicable to integrated visualization monitoring, intelligent alarm, and remote management scenarios both above and below ground in coal mines. Background Technology

[0002] In the process of intelligent coal mine construction, visual management and control has become a core means to improve the efficiency of coal mine production management and the level of on-site safety control. However, the various monitoring systems currently used in coal mines still have many technical defects and application problems, specifically reflected in: 1. Limited display format: Traditional monitoring systems primarily display data lists and video feeds, lacking the ability to provide a three-dimensional, real-world view of the entire coal mine. This prevents managers from intuitively and comprehensively understanding the equipment distribution, environmental conditions, and spatial relationships at the mine site, leading to potential errors in their judgments of the situation. 2. Digital twin systems have high deployment costs. Conventional coal mine digital twin systems pursue high-precision modeling, resulting in large model sizes. This places extremely high demands on the running servers, graphics cards, and network bandwidth, making deployment and maintenance costs expensive. Small and medium-sized coal mining enterprises cannot afford this and cannot achieve large-scale application. 3. Poor data integration: The sources of data such as environmental monitoring, equipment operation, personnel positioning, and video surveillance at the coal mine site are independent of each other. There is no data interaction channel between the systems, and they cannot be integrated and presented in a unified visualization interface, forming multiple "visual islands" and failing to fully realize the value of the data. 4. Lack of control functions: Most coal mine visualization systems only have the function of displaying data and scenes, but lack the ability to control data in reverse. They cannot directly operate the field equipment from the visualization interface to achieve integrated "viewing-management-control" management, resulting in low efficiency of on-site emergency response. 5. Poor network adaptability: Traditional coal mine visualization platforms rely on high-computing-power cloud for centralized rendering, but the network transmission conditions in underground coal mines and remote mining areas are poor, which easily leads to problems such as screen lag and severe data delay, greatly reducing the system's usability.

[0003] Currently, the industry lacks a digital twin visualization system that can adapt to the low-cost, lightweight deployment needs of coal mines, support multi-source data fusion processing, and have real-time linkage control capabilities. There is a significant technological gap, which cannot meet the practical application needs of various coal mines to quickly carry out intelligent transformation. Summary of the Invention

[0004] To address the technical problems of existing coal mine visualization and control methods, such as limited options, high deployment costs of traditional digital twin systems, inability to integrate multi-source data, separation of display and control, and poor network adaptability, this invention provides a coal mine scene visualization and control system based on the Internet of Things and lightweight digital twins. Through lightweight 3D modeling, multi-source data fusion, real-scene visualization display, edge collaborative rendering, and remote linkage control, this system improves the overall visualization management level of coal mines in a low-cost, fast-deployment, and highly compatible manner.

[0005] To achieve the above-mentioned objectives, the present invention is implemented through the following technical solution: a coal mine scene visualization and control system based on the Internet of Things and lightweight digital twins, including a full-domain data acquisition unit, a lightweight model construction unit, a data twin mapping unit, an edge rendering unit, a visualization and interactive control unit, and a cloud storage and monitoring unit.

[0006] Preferably, the full-domain data acquisition unit is used to uniformly access the monitoring and operation data of environmental monitoring sensors, electromechanical operating equipment, personnel positioning terminals, video surveillance equipment, and safety monitoring instruments at the coal mine site, forming a full-element data acquisition system for the coal mine, and can directly connect to the existing Internet of Things system of the coal mine to achieve seamless data compatibility.

[0007] Preferably, the lightweight model building unit is used to perform lightweight 3D modeling of physical scenes such as coal mine industrial squares, roadways, equipment, and pipelines. It uses model compression and face number optimization algorithms to process the 3D model, reducing the rendering resource consumption of the model and supporting smooth operation on low-configuration hardware.

[0008] Preferably, the data twin mapping unit is used to dynamically bind the physical data collected in real time by the full-domain data acquisition unit with the three-dimensional model generated by the lightweight model construction unit, so as to realize the real-time synchronization and visualization of environmental data, equipment operating status and personnel location information in the virtual scene; and the unit has an abnormal alarm highlight linkage mechanism. When abnormal situations such as excessive gas, abnormal water level, and equipment failure occur in the coal mine, the corresponding position of the virtual three-dimensional model is automatically highlighted and detailed alarm information pops up, so as to realize the rapid location of the risk position.

[0009] Preferably, the edge rendering unit is used to perform local lightweight rendering calculations on the mining edge gateway, adopting a cloud + edge collaborative rendering mode to reduce the data transmission pressure on the cloud, so that the system can still maintain smooth and stable images under weak network conditions in underground coal mines and remote mining areas.

[0010] Preferably, the visual interactive control unit is used to provide users with functions such as free browsing of the three-dimensional scene of the coal mine, layer switching, real-time data viewing, abnormal alarm location, remote equipment control, and personnel path simulation. It supports both mouse and touch screen interaction modes and can directly perform remote start and stop operations on field equipment such as fans, water pumps, valves, and alarms from the three-dimensional scene interface, realizing integrated closed-loop management of viewing, management, and control.

[0011] Preferably, the cloud storage monitoring unit is used to complete the unified management of the coal mine's 3D model, persistent storage of monitoring historical data, classification and archiving of alarm records, and remote large-screen monitoring and display. It is also configured with multi-level account permission management function, which allocates different system operation and data viewing permissions according to the coal mine management level, so as to realize the hierarchical supervision of the coal mine.

[0012] Preferably, the system adopts a hierarchical rendering mechanism, with ordinary terminals using a two-dimensional + lightweight three-dimensional display mode and high-performance terminals using a full three-dimensional display mode, taking into account both the system's terminal compatibility and scene display effect; at the same time, the three-dimensional model output by the lightweight model building unit supports offline loading function, and the three-dimensional scene of the coal mine can still be displayed normally when the network is disconnected at the coal mine site, and the latest monitoring and operation data will be automatically synchronized after the network is connected.

[0013] Beneficial effects The coal mine scene visualization and control system based on the Internet of Things and lightweight digital twin provided by this invention has the following advantages compared with the prior art: 1. This invention adopts lightweight digital twin modeling technology, which reduces the model's requirements for hardware and network bandwidth through model compression and surface number optimization algorithms. The system deployment and operation and maintenance costs are far lower than those of traditional digital twin systems, making it suitable for the large-scale application needs of large and small coal mines. 2. This invention achieves unified access and integrated display of multi-source data from coal mine environment, equipment, personnel, and video through a full-domain data acquisition unit, completely eliminating the "visual silo" problem in the industry, enabling managers to intuitively and comprehensively grasp the status of the entire coal mine and improve management efficiency; 3. This invention adopts an edge rendering + cloud collaboration rendering mode, in which the local core rendering calculation is completed by the mining edge gateway, effectively reducing the cloud transmission pressure and solving the technical problems of screen lag and data delay in traditional visualization systems in the weak network environment of coal mines, thus ensuring the stable operation of the system; 4. The visual interactive control unit of the present invention supports direct execution of remote control operations of equipment from the three-dimensional scene interface, realizing integrated closed-loop control of coal mine scene viewing, management and control, which can greatly improve the emergency response efficiency of abnormal situations in coal mine; 5. This invention features lightweight deployment and minimal engineering work. The full-domain data acquisition unit can directly connect to the existing IoT system in the coal mine without rebuilding the acquisition system, effectively protecting the original investment of coal mining enterprises and lowering the threshold for intelligent transformation. 6. This invention supports lightweight model offline loading, abnormal alarm highlighting linkage, and historical data and alarm log playback functions, which can fully meet the actual needs of daily safety supervision and abnormal event review and analysis in coal mines, and provide data and technical support for coal mine safety management. 7. This invention adopts a hierarchical rendering mechanism and supports both mouse and touch screen interaction methods, adapting to the different usage needs of ordinary terminals and high-performance terminals. The system has strong compatibility and can meet the usage requirements of different management positions and different operating terminals in coal mines. Attached Figure Description

[0014] Figure 1 This is a schematic diagram of the overall system architecture of the present invention; Figure 2 This is a schematic diagram of the lightweight model construction and data twin mapping process of the present invention; Figure 3 This is a schematic diagram of the edge rendering + cloud collaboration rendering mechanism of the present invention.

[0015] In the diagram, 1. Full-domain data acquisition unit; 2. Lightweight model construction unit; 3. Data twin mapping unit; 4. Edge rendering unit; 5. Visual interactive control unit; 6. Cloud storage monitoring unit; 7. Mining edge gateway; 8. Coal mine on-site monitoring equipment; 9. Ordinary display terminal; 10. High-performance display terminal. Detailed Implementation

[0016] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0017] Example: Please see Figures 1-3 This invention provides a coal mine scene visualization control system based on the Internet of Things and lightweight digital twins, including a full-domain data acquisition unit 1, a lightweight model construction unit 2, a data twin mapping unit 3, an edge rendering unit 4, a visualization interaction control unit 5, and a cloud storage monitoring unit 6. The full-domain data acquisition unit 1 establishes a data connection with the coal mine on-site monitoring equipment 8, and uniformly accesses multi-source data from environmental monitoring sensors, electromechanical operating equipment, personnel positioning terminals, video surveillance equipment, and safety monitoring instruments to form a unified data base for all elements of the coal mine. Moreover, this unit can directly connect to the existing Internet of Things system of the coal mine, achieving compatibility and adaptation with the existing system without the need to rebuild the data acquisition system. The lightweight model building unit 2 performs 3D modeling of industrial squares, tunnels, equipment, and pipelines based on the actual physical scene of the coal mine. At the same time, it uses model compression and face number optimization algorithms to process the initial 3D model, eliminate redundant faces, compress the model volume, reduce the consumption of model rendering resources, and enable the model to run smoothly on low-configuration hardware. The generated lightweight 3D model also supports offline loading and can still be displayed normally when the network is disconnected. The data twin mapping unit 3 receives real-time physical data transmitted by the global data acquisition unit 1 and dynamically binds it with the three-dimensional model generated by the lightweight model construction unit 2 to realize real-time synchronization and visualization of environmental data, equipment operating status, and personnel location information in the virtual scene. When abnormal data such as excessive gas, abnormal water level, and equipment failure are collected, the unit triggers an alarm highlighting linkage mechanism, which automatically highlights the corresponding position in the virtual three-dimensional model and pops up alarm information containing the abnormality type, occurrence location, and data value to achieve rapid location of risk. The edge rendering unit 4 is deployed on the mining edge gateway 7. The mining edge gateway 7 performs local lightweight rendering calculations and adopts a cloud + edge collaborative rendering mode. Only a small amount of synchronous data is transmitted to the cloud storage monitoring unit 6, which greatly reduces the cloud data transmission pressure and ensures that the display terminal can still maintain smoothness and stability in weak network environments such as underground coal mines and remote mining areas. The visual interactive control unit 5 provides an operating interface for coal mine managers, supporting functions such as free browsing of 3D scenes, layer switching, real-time data viewing, abnormal alarm location, and personnel path simulation. It is also compatible with both mouse and touch screen interaction methods and can achieve hierarchical rendering display in different modes on ordinary display terminals 9 and high-performance display terminals 10. At the same time, managers can directly perform remote start and stop control operations on equipment such as fans, water pumps, valves, and alarms at the coal mine through the operating interface of this unit, realizing integrated closed-loop management from "seeing" to "managing" to "controlling". The cloud storage monitoring unit 6 completes the unified management of the lightweight 3D model of the coal mine, the persistent storage of historical data transmitted by the full-domain data acquisition unit 1, and the classification and archiving of alarm logs by the data twin mapping unit 3. It also supports remote large-screen monitoring and display, and is configured with multi-level account permission management function. According to different management levels such as coal mine manager, work area manager, and on-site safety officer, corresponding system operation and data viewing permissions are assigned to realize the hierarchical and refined supervision of the coal mine.

[0018] The working principle of this invention is as follows: First, the full-domain data acquisition unit 1 completes the unified access of multi-source data from the coal mine site, forming a full-element data foundation; then, the lightweight model construction unit 2 completes the lightweight 3D modeling of the coal mine physical scene, reducing rendering resource consumption; subsequently, the data twin mapping unit 3 realizes real-time binding and synchronization between physical data and virtual models, triggering alarm highlighting linkage in abnormal situations; the edge rendering unit 4 performs local rendering on the mine edge gateway 7, ensuring smooth display in weak network environments; management personnel view the 3D scene and real-time data through the visual interactive control unit 5, and perform remote control operations on abnormal equipment; finally, the cloud storage monitoring unit 6 completes the management and storage of models, data, and logs, realizing visualized and intelligent control of the entire coal mine.

[0019] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A visual management and control system for coal mine scenarios based on the Internet of Things and lightweight digital twins, characterized in that, It includes a full-domain data acquisition unit, a lightweight model building unit, a data twin mapping unit, an edge rendering unit, a visual interactive management and control unit, and a cloud storage monitoring unit; The full-domain data acquisition unit is used to uniformly access multi-source monitoring data of coal mine environment, equipment, personnel, and video, forming a unified data foundation for all elements of the coal mine; The lightweight model building unit is used to perform lightweight 3D modeling of the coal mine scene and to complete the compression and optimization of the model. The data twin mapping unit is used to bind real-time acquired data from the physical coal mine to the virtual 3D model in real time, so as to achieve dynamic synchronization between physical data and virtual model. The edge rendering unit is used to perform local lightweight rendering calculations on the mining edge gateway to reduce the data transmission pressure on the cloud. The visual interactive control unit is used for three-dimensional scene display of coal mine, real-time data browsing, abnormal alarm prompts and remote equipment control. The cloud storage monitoring unit is used for coal mine 3D model management, monitoring historical data storage, alarm log archiving, and remote large-screen monitoring and display.

2. The coal mine scene visualization and control system based on the Internet of Things and lightweight digital twin as described in claim 1, characterized in that, The lightweight model building unit uses model compression and polygon optimization algorithms to process the 3D models of coal mine industrial squares, roadways, equipment, and pipelines, reducing model rendering resource consumption and supporting smooth operation on low-configuration hardware.

3. The coal mine scene visualization and control system based on the Internet of Things and lightweight digital twin as described in claim 1, characterized in that, The data twin mapping unit has an abnormal alarm highlighting linkage mechanism. When problems such as excessive gas, abnormal water level, or equipment failure occur in the coal mine, the corresponding position in the virtual 3D model will be automatically highlighted and an alarm message will pop up, enabling rapid location of the risk location.

4. The coal mine scene visualization and control system based on the Internet of Things and lightweight digital twin as described in claim 1, characterized in that, The visual interactive control unit supports remote start-stop control of fans, pumps, valves, and alarms directly from the coal mine 3D scene interface, realizing integrated closed-loop management of coal mine scene viewing, management, and control.

5. The coal mine scene visualization and control system based on the Internet of Things and lightweight digital twin as described in claim 1, characterized in that, The edge rendering unit adopts a cloud + edge collaborative rendering mode. The mining edge gateway completes the local core rendering calculation, while the cloud only performs auxiliary data synchronization, which improves the stability and smoothness of the image display in the weak network environment of underground coal mines and remote mining areas.

6. The coal mine scene visualization and control system based on the Internet of Things and lightweight digital twin as described in claim 1, characterized in that, The system adopts a hierarchical rendering mechanism, with ordinary terminals using a two-dimensional + lightweight three-dimensional display mode, and high-performance terminals using a full three-dimensional display mode, taking into account both the system's terminal compatibility and scene display effects.

7. The coal mine scene visualization and control system based on the Internet of Things and lightweight digital twin as described in claim 1, characterized in that, The 3D model output by the lightweight model building unit supports offline loading. Even when the coal mine is offline, the 3D scene of the coal mine can still be displayed normally. After connecting to the network, the latest monitoring and operation data will be automatically synchronized.

8. The coal mine scene visualization and control system based on the Internet of Things and lightweight digital twin as described in claim 1, characterized in that, The visual interactive control unit provides functions such as free browsing of 3D scenes, layer switching, abnormal alarm location, and personnel path simulation. It also supports both mouse and touch screen interaction methods and is compatible with different operating terminals.

9. The coal mine scene visualization and control system based on the Internet of Things and lightweight digital twin as described in claim 1, characterized in that, The cloud storage monitoring unit is equipped with multi-level account permission management, which allocates different system operation and data viewing permissions according to the coal mine management level to achieve hierarchical supervision.

10. The coal mine scene visualization and control system based on the Internet of Things and lightweight digital twin as described in claim 1, characterized in that, The full-domain data acquisition unit can be directly connected to the existing Internet of Things system in the coal mine without rebuilding the acquisition system, thus achieving compatibility and adaptation with the existing system.

Images