Slope geological disaster monitoring information system based on 3DWebGIS
Through 3D WebGIS technology and multi-dimensional data fusion, three-dimensional models are updated in real time, and combined with holographic interaction and VR technology, the problems of real-time updates and practical drills in slope geological disaster monitoring are solved, and emergency response capabilities and system coordination are improved.
Patent Information
- Application Number
- CN202411139885.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-20
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2044-08-20
AI Technical Summary
In the monitoring of slope geological disasters in the existing technology, the three-dimensional model cannot be updated in real time, the operators lack practical drill opportunities, and the system is poor operability and coordination, resulting in insufficient emergency response capabilities.
采用基于3DWebGIS的边坡地质灾害监测信息系统,包括多维度数据融合系统、实时三维模型搭建系统、全息交互控制系统和VR交互式应急演练系统,通过物联网传感器、遥感卫星和无人机数据融合 , update three-dimensional models in real time, and provide a platform for holographic interaction and VR emergency drills.
Real-time update of three-dimensional models is realized, the timeliness and accuracy of monitoring data is improved, the emergency response capabilities of monitoring personnel and the operability and coordination of the system are enhanced, and the practical drill platform is provided, which improves the efficiency of monitoring work and flexibility.
Smart Images

Figure CN118656997B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of geological monitoring, and in particular to a slope geological disaster monitoring information system based on 3D WebGIS. Background Art
[0002] According to a geological disaster monitoring method disclosed in China with the publication number "CN118072198A", the geological disaster monitoring method involves the technical field of geological disaster monitoring. The geological disaster monitoring method includes: photographing image data of the monitored area by an unmanned aerial vehicle; preprocessing the image data to obtain a standard image; extracting a high-precision three-dimensional model based on the standard image; analyzing the three-dimensional model to evaluate the geological disaster situation in the monitored area and obtain an evaluation result; generating a report based on the evaluation result. The unmanned aerial vehicle obtains image data of the monitored area by oblique shooting. The geological disaster monitoring method provided in this application can quickly evaluate the geological disaster situation through unmanned aerial vehicle aerial inspection, which solves the problem that artificial geological disaster inspection has certain dangers and the detection results cannot fully reflect the real situation of landslides.
[0003] The above documents and prior art have the following technical problems when used:
[0004] Problem 1: When monitoring slope geological disasters, the above-mentioned three-dimensional model is obtained after automatic detection by machines for evaluation, but the three-dimensional model cannot be updated in real time according to the changes in geological parameters, resulting in the three-dimensional model being out of sync with the actual geological conditions, affecting the timeliness of emergency response to geological conditions;
[0005] Problem 2: The three-dimensional model established in the above document cannot be used for actual combat drills by operators, resulting in operators’ understanding of geological disasters remaining at the theoretical level and being unable to carry out actual operations, which leads to insufficient emergency response and handling capabilities of operators when geological disasters occur;
[0006] Problem three: Users are unable to monitor the entire monitoring system. The entire system has poor operability and coordination for operators, making monitoring work difficult to carry out. Summary of the invention
[0007] Technical issues solved
[0008] In view of the shortcomings of the prior art, the present invention provides a slope geological disaster monitoring information system based on 3D WebGIS, which solves the following problems:
[0009] 1. The 3D model of geological disasters cannot be updated and the 3D model is out of sync with the actual geological conditions;
[0010] 2. The operators’ understanding of geological hazards is limited to theoretical knowledge and they are unable to carry out actual operations;
[0011] 3. Users are unable to monitor the monitoring system. The entire system has poor operability and coordination for operators, making monitoring work difficult to carry out.
[0012] Technical Solution
[0013] To achieve the above objectives, the present invention is implemented through the following technical solutions: a slope geological disaster monitoring information system based on 3DWebGIS, the system includes a multi-dimensional data fusion system, a real-time three-dimensional model building system, a holographic interactive control system, a VR interactive emergency drill system and a user demand and function interaction system, wherein:
[0014] The multi-dimensional data fusion system includes a data source management unit, a data fusion unit and a data storage and management unit. The data source management unit accesses real-time data from Internet of Things sensors, including slope displacement, stress change, rainfall, etc., high-resolution images provided by remote sensing satellites, oblique photogrammetry data taken regularly by drones, and historical data provided by geological survey departments. The data fusion unit processes the accessed data and fuses data from different sources using a data fusion algorithm to form a comprehensive slope geological environment data set. The data sources in the data source management unit include Internet of Things sensors, remote sensing satellites and oblique photography by drones, wherein:
[0015] The IoT sensor includes a high-precision displacement sensor, a stress sensor, and a soil moisture sensor deployed on the slope. The IoT sensor sends the collected data to the data source management center at fixed intervals, and the collected data is transmitted through one or more wireless communication technologies such as LoRa, NB-IoT, or 5G;
[0016] The remote sensing satellite regularly receives high-resolution satellite images, which are geometrically corrected, radiometrically corrected and enhanced by ENVI or ERDAS to extract the surface change information of the slope;
[0017] The drone carries a high-resolution camera and performs oblique photography of the slope according to a preset route to obtain multi-angle image data. The obtained image data is 3D reconstructed by the Structure-from-Motion algorithm to generate a 3D point cloud and texture model of the slope. The 3D model construction formula is as follows:
[0018] The construction of the three-dimensional model M(t) is expressed as:
[0019] M(t)=f(D terrain ,Dvegetation ,D buildings ,D roads )
[0020] Among them, M(t) is the three-dimensional model at time t, D terrain is the terrain data, D vegetation is the vegetation data, D buildings For building data, D roads For road data;
[0021] WebGIS display formula:
[0022] Assume that the coordinates of the three-dimensional model M(t) are (x, y, z), and use WebGIS technology to display it on a three-dimensional map. The display function g is expressed as:
[0023] Display = g(M(t))
[0024] Function g converts the three-dimensional model M(t) into a visual display form;
[0025] The real-time three-dimensional model building system includes a three-dimensional model engine building unit and a dynamic update unit. The three-dimensional model engine building unit uses a three-dimensional modeling engine to build a three-dimensional model of the slope according to the fused data set, and the model at least includes terrain, vegetation, buildings, and road elements, and can accurately reflect the geometric shape and geological structure of the slope. The dynamic update unit monitors the changes in sensor data in real time, and transmits the changed data to the three-dimensional model engine building unit, driving the three-dimensional model engine building unit to update the three-dimensional model;
[0026] The holographic interactive control system includes a holographic projection device control unit and an interactive gesture recognition unit. The holographic projection device control unit is used to control the holographic projection device connected to the system and present the three-dimensional model and its monitoring data to the user in the form of a holographic image. The user can see the three-dimensional model suspended in the air and interact with it without wearing any equipment. The interactive gesture recognition unit recognizes the interactive gesture set by the user and controls the gesture operation to interact with the holographic image.
[0027] The VR interactive emergency drill system includes a VR device control unit, a scene simulation and task setting unit, and a feedback evaluation unit. The VR device control unit is used to control the VR device and interact with the virtual environment. The scene simulation and task setting unit builds an interactive emergency drill platform based on holographic projection and VR technology, which is used to simulate and set geological disaster scenes of different levels, set drill tasks related to disaster scenes, and cooperate with the VR device control unit to perform emergency drill simulation. The feedback evaluation unit is used to provide real-time feedback and guidance on user operation behaviors during the drill, and generate a detailed evaluation report after the drill.
[0028] The user demand and function interaction system is used for the operation control and interaction of the multi-dimensional data fusion system, the real-time three-dimensional model building system, the holographic interactive control system and the VR interactive emergency drill system in the system, and monitors and warns geological information. The user demand and function interaction system includes a system homepage unit and a project management unit. The system homepage unit displays a GIS map, a list of monitoring projects related to the logged-in user, and reports and over-standard warning items waiting to be processed by the logged-in user. The project management unit displays a three-dimensional model of the project. The three-dimensional model displays the monitoring point layout, risk warning content, equipment anomalies to be processed, and monitoring data changes to be processed of the project. After the user logs in, the data of each subsystem is interacted and processed through each unit.
[0029] Preferably, the data fusion unit in the multi-dimensional data fusion system uses a Kalman filter to smooth the sensor data in the data source management unit, performs feature extraction and weight assignment through a deep learning network, and generates a comprehensive slope stability assessment index.
[0030] Preferably, the data storage and management unit in the multi-dimensional data fusion system uses a distributed database or cloud database service to store massive data, and accesses OLAP online analysis technology to quickly query data and automatically generate reports, and provides an API interface to connect with other systems for data access and transmission.
[0031] Preferably, the real-time three-dimensional model building system further includes the following contents:
[0032] The three-dimensional model engine building unit uses Unity3D or UnrealEngine game engine as a three-dimensional visualization platform, processes the implementation technical bureau received by the multi-dimensional data fusion system through plug-ins and scripts, and converts it into dynamic parameters in the three-dimensional model;
[0033] The dynamic update unit provides data monitoring services and continuously monitors the real-time data sent by the multi-dimensional data fusion system. When the dynamic update unit receives new data, it triggers the update function of the three-dimensional model, adjusts the corresponding part of the model according to the data changes, and introduces timestamp and version control mechanisms to ensure data consistency and model accuracy.
[0034] Preferably, the holographic interactive control system further includes the following contents:
[0035] The holographic projection equipment control unit includes control over the holographic screen, holographic projection box, and holographic projection table, including opening and closing control, contrast, and viewing angle control and adjustment;
[0036] The interactive gesture recognition unit integrates LeapMotion, Kinect or other gesture recognition devices to capture the user's hand movements mechanically and convert them into computer instructions, develop gesture recognition algorithms or use ready-made SDKs to recognize specific gestures such as rotation, scaling, clicking, etc., and map them to operations on the three-dimensional model.
[0037] Preferably, the VR interactive emergency drill system further includes the following contents:
[0038] The VR device control unit includes interactive control of VR devices, including VR helmets, VR glasses, and VR treadmills;
[0039] The scene simulation and task equipment unit simulates the disaster scene that may occur in the scene, such as landslide, collapse, and mud-rock flow, according to the real-time scene given by the real-time three-dimensional model building system, and customizes the parameters of the scene, such as the scale of the disaster, the time of occurrence, and the scope of impact, and sets a variety of drill tasks according to the scene parameters, such as evacuation drills, rescue operations, and resource allocation, and sets corresponding goals and scoring standards, builds a scene simulation platform, and waits for users to wear VR equipment and conduct emergency drills after opening and closing it through the VR equipment control unit;
[0040] During the drill, the feedback evaluation unit will give real-time feedback based on the user's operating behavior. For example, when the user chooses the wrong evacuation route, the system will issue an alarm and prompt the correct route. When the user successfully completes a task, the system will give rewards and affirmation. After the drill, the system will generate a detailed evaluation report, including indicators such as the user's reaction time, decision-making accuracy, and resource utilization efficiency, to help users understand their own emergency response capabilities and put forward improvement suggestions.
[0041] Preferably, after the user logs in, the user demand and function interaction system, in addition to the display system homepage unit and the project management unit, also includes a my work unit. The my work unit includes sub-modules such as data import, report information, over-standard processing, automatic acquisition equipment exception processing, and monitoring data change. After the user logs in to the system, the daily work of slope monitoring such as data, reports, over-standard, equipment exceptions, and changes in monitoring data can be centrally processed in this module. After the user demand and function interaction system imports or enters the slope monitoring data into the system, after automatic calculation, if the data of a certain monitoring point exceeds the standard, the over-standard warning processing flow is started. The over-standard warning of the slope monitoring project is divided into three types: red warning, orange warning, and yellow warning, in order from high to low levels.
[0042] Preferably, the monitoring and exercise process of the system is as follows:
[0043] Sp1: Data source collection, the multi-dimensional data fusion system receives data collected on the slope position from multiple internally connected data sources, and integrates the data;
[0044] Sp2: Construction of geological three-dimensional model. The real-time three-dimensional model construction system constructs a three-dimensional model of the slope based on the data collected by Sp1, and autonomously adjusts the three-dimensional model in real time according to the changes in the real-time monitoring data source;
[0045] Sp3: geological monitoring and early warning, the user demand and function interaction system monitors the data collected by Sp1 in real time, and when the data at the monitoring point exceeds the standard, it is classified and early warning is processed according to the processing flow of the corresponding level of early warning;
[0046] Sp4: Configuration of interactive devices. The holographic interactive control system and VR interactive emergency drill system test the holographic interactive devices and VR recognition to ensure that the device connection is normal, the software configuration is correct, and normal interaction can be completed;
[0047] Sp5: Construction of drill scenarios. Based on the geological 3D model constructed in Sp2, a group of model scenarios are selected to analyze the most likely geological disasters due to the influence of terrain, environment, and morphology, and one or several are selected for simulation. Environmental parameters and drill tasks are set, and the interactive devices in Sp3 are connected, waiting for the drill.
[0048] Sp6: Emergency response and coordinated combat drills. Users wear the interactive device in Sp3 and access the scene in Sp4. Drills are conducted according to the scene and tasks. During the drill, the feedback evaluation unit records real-time data and provides guidance.
[0049] Sp7: Evaluation summary. After the user drill is completed, the feedback evaluation unit in the VR interactive emergency drill platform will give an evaluation report based on the drill data. The report content shall at least include the achievement of the drill objectives, the performance of the participants, existing problems and improvement suggestions. Users shall discuss and analyze based on the report content.
[0050] Beneficial Effects
[0051] The present invention provides a slope geological disaster monitoring information system based on 3D WebGIS. It has the following beneficial effects:
[0052] 1. The present invention uses a multi-dimensional data fusion system within the system to monitor various data of the slope position in real time, and uses a real-time three-dimensional model building system to build a three-dimensional model of the collected data, and updates the three-dimensional model in real time according to changes in the data. The three-dimensional model constructed by 3DWebGIS technology can highly restore the true situation of the slope terrain, including terrain undulations, vegetation distribution, geological structure and other details, so that monitoring personnel can more intuitively understand and analyze the geological characteristics of the slope. Compared with the limitations of the traditional two-dimensional left side, through the three-dimensional model, monitoring personnel can accurately locate the specific position of the slope, provide accurate geographic coordinates for subsequent monitoring, early warning and emergency response, and more accurately evaluate the stability of the slope, providing a scientific basis for formulating disaster prevention and mitigation measures.
[0053] 2. The present invention uses an internal multi-dimensional data fusion system to monitor various data of the slope position in real time, and displays it through a demand and function interaction system, so that the system can receive data from various monitoring sensors in real time, such as displacement sensors, stress sensors, rain gauges, etc., to ensure the timeliness and accuracy of the monitoring data. Through dynamic analysis of real-time monitoring data, the system can promptly detect abnormal changes in the slope and provide strong support for early warning. The system has built-in geological disaster early warning models and algorithms, which can quickly evaluate the stability of the slope based on monitoring data and issue early warning signals. According to the different levels of slope stability, the system sets different early warning levels to provide targeted early warning information for decision makers at different levels.
[0054] 3. The present invention adopts user demand and functional interaction system to display interaction and control and adjust the entire system. The system can display corresponding engineering information according to the user identity, so that users can directly monitor, modify, issue tasks, receive instructions and other operations on slope conditions through the system, so that the system can support multi-person online collaboration and remote control, greatly improving the efficiency and coordination of monitoring work. At the same time, this interactive operation control also enhances the interactivity between monitoring personnel and the system, making monitoring work more flexible and efficient.
[0055] 4. The system uses the geological three-dimensional real-time model built by the real-time three-dimensional model building system to set the scene, so that the VR interactive emergency drill system can perform holographic interaction and build a VR interactive drill platform, so that users can simulate slope geological disasters and set scene parameters based on the real-time geological model. Combined with VR technology and holographic interactive technology for drills, it can simulate real slope geological disaster scenes and various influencing factors, and provide a platform for actual combat drills for monitoring personnel and emergency rescue teams. Through drill simulation, it not only improves the emergency response capability, but also exposes the deficiencies in the emergency plan, providing an important basis for subsequent improvement and perfection. BRIEF DESCRIPTION OF THE DRAWINGS
[0056] Figure 1 is a system structure diagram of the present invention;
[0057] Figure 2 It is the system monitoring and early warning flow chart of the present invention;
[0058] Figure 3 This is the yellow warning processing flow of the present invention;
[0059] Figure 4 This is the orange warning processing flow of the present invention;
[0060] Figure 5 This is the red warning processing flow of the present invention. DETAILED DESCRIPTION
[0061] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. Specific embodiment one:
[0063] like Figure 1-5 As shown in the figure, the slope geological disaster monitoring information system based on 3DWebGIS includes a multi-dimensional data fusion system, a real-time three-dimensional model building system, a holographic interactive control system, a VR interactive emergency drill system and a user demand and function interaction system, among which:
[0064] The multi-dimensional data fusion system includes a data source management unit, a data fusion unit, and a data storage and management unit. The data source management unit accesses real-time data from IoT sensors, including slope displacement, stress change, rainfall, etc., high-resolution images provided by remote sensing satellites, oblique photogrammetry data taken regularly by drones, and historical data provided by geological survey departments. The data fusion unit processes the accessed data and uses data fusion algorithms to fuse data from different sources to form a comprehensive slope geological environment data set, so that the system can receive data from various monitoring sensors in real time, such as displacement sensors, stress sensors, rain gauges, etc., to ensure the timeliness and accuracy of monitoring data. Through dynamic analysis of real-time monitoring data, the system can promptly detect abnormal changes in slopes and provide strong support for early warning. The system has built-in geological disaster early warning models and algorithms, which can quickly evaluate the stability of slopes based on monitoring data and issue early warning signals. According to different levels of slope stability, the system sets different early warning levels to provide targeted early warning information for decision makers at different levels.
[0065] The data source management unit is responsible for accessing and managing data from different sources, including real-time data from IoT sensors, high-resolution images provided by remote sensing satellites, oblique photogrammetry data taken regularly by drones, and historical data provided by geological survey departments.
[0066] The data source formula indicates:
[0067] Setting D i represents the i-th data source, where:
[0068] D sensors : Data from IoT sensors, including slope displacement (d displacement ), stress change (d stress ), rainfall (d rain );
[0069] D satellite : High-resolution image data provided by remote sensing satellites;
[0070] D drone : UAV oblique photogrammetry data;
[0071] D historical : Historical data provided by geological survey departments;
[0072] The data fusion unit processes the accessed data and uses the data fusion algorithm to fuse the data from different sources to form a comprehensive slope geological environment data set.
[0073] Data fusion mainly adopts weighted fusion algorithm (Weighted Fusion Algorithm) and Bayesian fusion algorithm (Bayesian Fusion Algorithm).
[0074] Weighted fusion algorithm:
[0075]
[0076] Among them, w i is the weight of the i-th data source, satisfying
[0077] The Bayesian fusion algorithm assumes that we have different data sources D1, D2, ..., D n and the prior probability P(H) (i.e. the probability of assuming the slope is stable), are fused through Bayes’ theorem:
[0078]
[0079] The data storage and management unit is responsible for storing and managing the fused data to ensure the integrity and accessibility of the data.
[0080] The real-time monitoring and early warning system can receive data from various monitoring sensors in real time, and detect abnormal changes in the slope in a timely manner through dynamic analysis, providing early warning support.
[0081] The dynamic analysis of real-time monitoring data is achieved by comparing the change rate and threshold, where T is set as the current time and Δt is the time interval.
[0082] Displacement change rate:
[0083]
[0084] Stress change rate:
[0085]
[0086] Rainfall change rate:
[0087]
[0088] The warning model is based on the above change rate and the preset threshold. When the change rate exceeds the threshold, the warning is triggered:
[0089]
[0090] θ displacement ,θ stress ,θ rain are the warning thresholds for displacement, stress and rainfall respectively.
[0091] Warning level setting According to the different levels of slope stability, the system sets different warning levels (such as yellow warning, orange warning, red warning), and provides targeted warning information for decision makers at different levels. Warning level formula Warning level is set based on the relative size of the change rate and threshold:
[0092]
[0093] The real-time three-dimensional model building system includes a three-dimensional model engine building unit and a dynamic update unit. The three-dimensional model engine building unit uses a three-dimensional modeling engine to build a three-dimensional model of the slope according to the fused data set, and the model includes at least terrain, vegetation, buildings, and road elements, and can accurately reflect the geometric shape and geological structure of the slope. The dynamic update unit monitors the changes in sensor data in real time, and transmits the changed data to the three-dimensional model engine building unit, driving the three-dimensional model engine building unit to update the three-dimensional model. The real-time three-dimensional model building system builds a three-dimensional model for the collected data, and updates the three-dimensional model in real time according to the changes in the data. The three-dimensional model built by 3DWebGIS technology can highly restore the real situation of the slope terrain, including details such as terrain undulations, vegetation distribution, and geological structure, so that monitoring personnel can more intuitively understand and analyze the geological characteristics of the slope. Compared with the limitations of the traditional two-dimensional left side, through the three-dimensional model, the monitoring personnel can accurately locate the specific position of the slope, provide accurate geographic coordinates for subsequent monitoring, early warning and emergency response, and more accurately evaluate the stability of the slope, providing a scientific basis for the formulation of disaster prevention and mitigation measures;
[0094] The 3D model engine building unit uses a 3D modeling engine to build a 3D model of the slope based on the fused data set. The model includes terrain, vegetation, buildings, and road elements, and can accurately reflect the geometric shape and geological structure of the slope.
[0095] Three-dimensional model construction formula:
[0096] M(t) is the three-dimensional model at time t. The construction of the three-dimensional model M(t) is expressed as:
[0097] M(t)=f(D terrain ,D vegetation ,D buildings ,D roads )
[0098] Dataset D includes terrain data D terrain , vegetation data D vegetation , building data D buildings , Road data D roads ;
[0099] Function f is a 3D modeling engine that integrates various data into a complete 3D model. Terrain modeling formula Terrain modeling usually uses a digital elevation model (DEM). Let DEM (x, y) be the terrain elevation value at position (x, y). The 3D terrain model T (x, y, z) is expressed as:
[0100] T(x,y,z)=DEM(x,y)
[0101] Vegetation, buildings and roads modeling formula Vegetation, buildings and roads are modeled by attaching auxiliary elements to the terrain. Set V(x, y) as the vegetation distribution density, B(x, y) as the building outline, R(x, y) as the road network, and the vegetation model V m :
[0102] V m (x,y,z)=V(x,y)·h v
[0103] h v is the height of vegetation;
[0104] Building Model B m :
[0105] B m (x,y,z)=B(x,y)·h b
[0106] h b is the height of the building;
[0107] Road Model R m :
[0108] R m (x,y,z)=R(x,y)
[0109] The dynamic update unit monitors the changes of sensor data in real time, and transmits the changed data to the 3D model engine building unit, driving the 3D model engine building unit to update the 3D model. The dynamic update formula assumes that the change of sensor data at time t is ΔD(t), then at time t, the update of the 3D model is expressed as:
[0110] M(t)=M(t-1)+ΔD(t)
[0111] Among them, M(t-1) is the three-dimensional model at the previous moment, and ΔD(t) is the change caused by the new sensor data.
[0112] Real-time update formula: Let ΔDEM(x,y,t) be the terrain change at time t, ΔV(x,y,t) be the vegetation change, ΔB(x,y,y) be the building change, and ΔR(x,y,t) be the road change. The three-dimensional model after real-time update is expressed as:
[0113] T(x,y,z,t)=T(x,y,z,t-1)+ΔDEM(x,y,t)
[0114] V m (x,y,z,t)=V m (x,y,z,t-1)+ΔV(x,y,t)
[0115] B m (x,y,z,t)=B m (x,y,z,t-1)+ΔB(x,y,t)
[0116] R m (x,y,z,t)=R m (x,y,z,t-1)+ΔR(x,y,t)
[0117] The three-dimensional model constructed using 3DWebGIS technology can highly restore the true conditions of the slope terrain, including details such as terrain undulations, vegetation distribution, and geological structure, enabling monitoring personnel to more intuitively understand and analyze the geological characteristics of the slope.
[0118] WebGIS display formula:
[0119] Assume that the coordinates of the three-dimensional model M(t) are (x, y, z), and use WebGIS technology to display it on a three-dimensional map. The display function g is expressed as:
[0120] Display = g(M(t))
[0121] Function g converts the three-dimensional model M(t) into a visual display form.
[0122] Through the above formulas and explanations, the real-time 3D model building system effectively realizes the construction and dynamic update of the 3D model, and displays it through 3D Web GIS technology, so that monitoring personnel can more intuitively understand and analyze the geological characteristics of the slope, providing a scientific basis for subsequent monitoring, early warning and emergency response.
[0123] A holographic interactive control system, including a holographic projection device control unit and an interactive gesture recognition unit. The holographic projection device control unit is used to control the holographic projection device connected to the system and present the three-dimensional model and its monitoring data to the user in the form of a holographic image. The user can see the three-dimensional model suspended in the air and interact with it without wearing any equipment. The interactive gesture recognition unit recognizes the interactive gestures set by the user and controls the gesture operation to interact with the holographic image.
[0124] Projection of 3D model data of the holographic projection device control unit: The data of the 3D model is usually composed of multiple triangular facets, each facet is represented by vertex coordinates. Assuming that the vertex coordinates of a triangle are v1, v2, v3, the vertex coordinate transformation formula is:
[0125] v ′ =TRv+t
[0126] T is the projection transformation matrix, R is the rotation matrix, t is the translation vector, -Projection imaging formula: For holographic projection, optical interference and diffraction are used to create three-dimensional images, which are usually explained by the hologram recording and reproduction process. The recording process formula is as follows:
[0127] I(x,y)=|O(x,y)+R(x,y)| 2
[0128] I(x,y) is the recorded hologram, O(x,y) is the object light wave, and R(x,y) is the reference light wave;
[0129] The reproduction process formula is as follows:
[0130]
[0131] H(x,y) is the reconstructed holographic image, represents Fourier transform, R * (x,y) is the complex conjugate of the reference light wave.
[0132] Holographic image presentation:
[0133] The final holographic image is presented to the user, who can see the three-dimensional model suspended in the air without wearing any equipment. The binocular vision principle of the human eye is used here to achieve the three-dimensional effect through the interference and diffraction of light.
[0134] Gesture recognition algorithm:
[0135] Computer vision technology is usually used to recognize gestures, which involves image processing and machine learning algorithms.
[0136] Image preprocessing: extract gesture contours by filtering and binarizing the image;
[0137]
[0138] T is the binarization threshold, I binary (x,y) is the processed binary image;
[0139] Feature extraction: extracting the characteristic points or key points of gestures, fingertips and joint positions;
[0140] f={(x1,y1),(x2,y2),…,(x n ,y n )}
[0141] f is a set of feature points, and the machine learning model (convolutional neural network CNN) is used to classify gestures;
[0142]
[0143] is the predicted gesture category, and P(y=c|f) is the probability that the feature point set f corresponds to category c.
[0144] The VR interactive emergency drill system includes a VR device control unit, a scene simulation and task setting unit, and a feedback evaluation unit. The VR device control unit is used to control the VR device and interact with the virtual environment. The scene simulation and task setting unit builds an interactive emergency drill platform based on holographic projection and VR technology, which is used to simulate and set geological disaster scenes of different levels, and set drill tasks related to disaster scenes, and cooperate with the VR device control unit to simulate emergency drills. The feedback evaluation unit is used to provide real-time feedback and guidance on user operation behaviors during the drill, and generate a detailed evaluation report after the drill, so that users can simulate slope geological disasters and set scene parameters based on the real-time geological model. The drill is combined with VR technology and holographic interactive technology to simulate real slope geological disaster scenes and multiple influencing factors, providing a platform for actual combat drills for monitoring personnel and emergency rescue teams. Through drill simulation, not only the emergency response capability is improved, but also the deficiencies in the emergency plan are exposed, providing an important basis for subsequent improvement and perfection;
[0145] The VR device control unit is used to control the VR device and interact with the virtual environment. The unit is responsible for sensor data collection, user input capture, device status monitoring, and interaction with the virtual scene. The interaction formula sets the user's operation behavior at time t as U(t), the state of the virtual environment as E(t), and the output of the VR device control unit as V(t). The interaction process is expressed as:
[0146]
[0147] Function f represents the mapping relationship between user operations and virtual environment states.
[0148] The scene simulation and task setting unit builds an interactive emergency drill platform based on holographic projection and VR technology, which is used to simulate and set geological disaster scenes of different levels, and set drill tasks related to disaster scenes, scene simulation formulas, etc. The scene simulation is expressed as:
[0149] E(t)=g(S)
[0150] Function g represents the process of converting the parameter set S into the virtual environment state E(t).
[0151] The task setting formula sets the task set to T, which includes the task target T goal 、Task Step T steps and task condition T conditions , the task setting is expressed as:
[0152] T(t)=h(T goal ,T steps ,T conditions )
[0153] Function h represents the setting process of task set T;
[0154] The feedback evaluation unit is used to provide real-time feedback and guidance on the user's operation behavior during the drill, and generate a detailed evaluation report after the drill. The real-time feedback formula sets the user's operation behavior at time t as U(t) and the system feedback as F(t). The real-time feedback process is expressed as:
[0155] F(t)=k(U(t),E(t),T(t))
[0156] Among them, function k represents the process of feedback generation.
[0157] Evaluation report formula The evaluation report is based on user operation behavior and drill results. Assuming the set of user operation behavior is {U(t)}, and the drill result is R, the evaluation report generation is expressed as:
[0158] Report=m({U(t)},R)
[0159] Among them, function m represents the process of generating the evaluation report.
[0160] The user demand and function interaction system is used for the operation control and interaction of the multi-dimensional data fusion system, real-time three-dimensional model building system, holographic interactive control system and VR interactive emergency drill system in the system, and monitors and warns geological information. The user demand and function interaction system includes a system homepage unit and a project management unit. The system homepage unit displays the GIS map, a list of monitoring projects related to the logged-in user, and reports and over-standard warning items waiting to be processed by the logged-in user. The project management unit mainly displays the three-dimensional model of the project. The three-dimensional model displays the monitoring point layout, risk warning content, pending equipment anomalies, and pending monitoring data changes of the project. After the user logs in, the data of each subsystem is interacted and processed through each unit. The system can display the corresponding project information according to the user identity, so that the user can directly monitor, modify, issue tasks, receive instructions and other operations on the slope conditions through the system, so that the system can support multi-person online collaboration and remote control, greatly improving the efficiency and coordination of monitoring work. At the same time, this interactive operation control also enhances the interactivity between the monitoring personnel and the system, making the monitoring work more flexible and efficient.
[0161] The user demand and function interaction system is used for the operation control and interaction of the multi-dimensional data fusion system, real-time three-dimensional model building system, holographic interactive control system and VR interactive emergency drill system, and monitors and warns geological information. The system consists of two main units: the system homepage unit and the engineering management unit.
[0162] System Home Unit The system home unit displays the GIS map, a list of monitoring projects related to the logged-in user, and reports and over-standard warning items waiting for the logged-in user to process.
[0163] User-related project list formula sets the related project set of user U as Eu, and the project list displayed in the system home page unit is:
[0164] E U ={E1,E2,…,E n}
[0165] Exceeding standard warning formula setting for a certain project E i The monitoring data is D i , the warning threshold is θ, and the exceeding warning condition is:
[0166] D i >θ
[0167] The display content of the TriggerWarning system home page formula system home page unit SH is expressed as:
[0168] SH={GISMap,E U,PendingReports,Warnings}
[0169] The project management unit mainly displays the three-dimensional model of the project, the arrangement of monitoring points, risk warning content, pending equipment anomalies and pending monitoring data changes. The three-dimensional model display formula sets the three-dimensional model of project Ei as Mi, and the three-dimensional model display content is:
[0170] M i =f(D i )
[0171] Function f represents the monitoring data D i The process of building a two-dimensional model;
[0172] The monitoring point arrangement formula assumes that the monitoring point set is P, where each monitoring point p j Contains position (x j ,y j ,z j ) and monitoring parameters d j :
[0173] P={(x j ,y j ,z j ,d j )|j=1,2,…,m}
[0174] Risk Warning Formula
[0175] Set the risk warning content to Ri, including warnings for abnormal monitoring data and abnormal equipment:
[0176] R i ={DataAnomalies,DeviceFaults}
[0177] Project Management Unit Exhibition Content EH i Expressed as:
[0178] EH i ={M i ,P,R i ,PendingDataChanges,PendingDeviceFaults}
[0179] User interaction and operation control After logging in, the user interacts and processes the data of each subsystem through each unit. The system can display the corresponding engineering information according to the user identity, and supports multi-person online collaboration and remote control. The user identity formula sets the user identity as ID, and the user-related operation permission set is A:
[0180] A=g(ID)
[0181] Function g represents the process of obtaining operation permissions based on user identity;
[0182] The interactive operation formula assumes that the user's operation at time t is U(t) and the system's response is R(t):
[0183] R(t)=h(U(t),A)
[0184] Among them, function h represents the process of the system responding to user operations; Specific embodiment 2:
[0186] like Figure 1-5 As shown, according to the contents in the above specific embodiments, the following technical contents are further disclosed:
[0187] The data source management unit in the multi-dimensional data fusion system further includes the following contents:
[0188] The data sources in the data source management unit include IoT sensors, remote sensing satellites, and drone oblique photography, among which:
[0189] IoT sensors, including high-precision displacement sensors, stress sensors, and soil moisture sensors deployed on the slopes, send data to the data source management center every few seconds or minutes. The data collected by the IoT sensors are transmitted through one or more wireless communication technologies such as LoRa, NB-IoT, or 5G;
[0190] Remote sensing satellites regularly receive high-resolution satellite images, which are geometrically corrected, radiometrically corrected, and enhanced by ENVI or ERDAS to extract information on slope surface changes;
[0191] Drone oblique photography: The drone carries a high-resolution camera and takes oblique photography of the slope according to the preset route to obtain multi-angle image data. The acquired image data is reconstructed in three dimensions through the Structure-from-Motion algorithm to generate a three-dimensional point cloud and texture model of the slope;
[0192] The data fusion unit in the multi-dimensional data fusion system uses a Kalman filter to smooth the sensor data in the data source management unit, extracts features and assigns weights through a deep learning network, and generates a comprehensive slope stability assessment index.
[0193] The data fusion algorithm aims to integrate data from different sources, such as IoT sensor data, remote sensing satellite images, drone oblique photography data, etc., into a unified, accurate and comprehensive data set. This usually involves four steps: data alignment, data calibration, data association and data fusion. Data alignment aligns data from different sources through timestamps or spatial location information. Data calibration eliminates data deviations caused by sensor differences, environmental factors, etc. Data association establishes the correspondence between data points from different data sources. Data fusion uses a deep learning model to fuse data. The weighted fusion method is often used in data fusion, and its basic formula is:
[0194]
[0195] in:
[0196] FusionData i is the i-th fused data point;
[0197] N is the number of data sources;
[0198] w i is the weight of the jth data source, satisfying
[0199] Data ij is the i-th data point of the j-th data source.
[0200] For the Kalman filter, the formula content in the prior art is used with the data processing of this application to estimate the state of the linear dynamic system. In slope monitoring, it is used to smooth the noise and outliers in the sensor data. The formula content is as follows:
[0201] Forecast Update:
[0202]
[0203] P k∣k-1 =AP k-1∣k-1 A T +Q
[0204] Measurement Update:
[0205] K k =P k∣k-1 H T (HP k∣k-1 H T +R)
[0206]
[0207] P k∣k =(IK k H)P k∣k-1
[0208] in:
[0209] is the predicted value of state estimation, which means the prediction of system state at time k based on the information at time k-1, including measured values and estimated values;
[0210] A is the state transition matrix, which describes how the system state is transferred from the previous moment to the current moment;
[0211] is the state estimate at the previous moment, that is, the best estimate of the system state at time k-1, obtained through the previous round of prediction and update steps;
[0212] B is the control input matrix, which describes how the control input affects the state of the system. If there is a control input, such as an external force, an operating instruction, etc., this matrix needs to be constructed according to the control equation of the system. In some cases, if the system is not under external control, this matrix may not exist or be a zero matrix.
[0213] u k-1 The external force or operation instruction applied to the system at time k-1, which usually comes from the control part of the system and is determined according to the control strategy and objectives of the system;
[0214] P k∣k-1 is the prediction error covariance, which represents the uncertainty of the system state prediction at time k based on the information at time k-1;
[0215] Q-process noise covariance, which represents the uncertainty or error in the system dynamics model, which is usually estimated based on factors such as the accuracy of the system model, the strength and frequency of external disturbances, etc.
[0216] K k represents the Kalman gain, which represents the weight of the measured value relative to the predicted value in the update step. This equation balances the prediction error covariance and the measurement noise covariance to determine the contribution of the measured value in updating the state estimate;
[0217] H represents the observation matrix, which describes how the system state is mapped to the measurement value. It depends on the measurement method of the system and the characteristics of the measurement equipment, and needs to be constructed according to the specific measurement model;
[0218] R represents the measurement noise covariance, which represents the uncertainty or error in the measurement process and is estimated based on factors such as the accuracy of the measurement equipment, the stability of the measurement environment, and interference;
[0219] z k represents the measurement value, which is the observation data obtained from outside the system at time k, coming from the system's sensors or other measurement devices, and is used to provide direct information about the system state;
[0220] represents the updated state estimate, which is the best estimate of the system state at time k, combining the predicted value and the measured value. This equation combines the predicted value and the measurement residual weighted by the Kalman gain;
[0221] P k∣k represents the updated error covariance, which represents the uncertainty of the updated state estimate at time k, and is calculated by the updated error covariance equation, which takes into account the Kalman gain and the prediction error covariance.
[0222] The Kalman filter continuously iterates and updates the system state estimate through two steps: prediction and update, while minimizing the estimation error.
[0223] The data storage and management unit in the multi-dimensional data fusion system uses distributed databases or cloud database services to store massive data, and accesses OLAP online analysis technology to quickly query data and automatically generate reports. It also provides an API interface to connect with other systems for data access and transmission. The following contents are further improved in the data storage and management unit:
[0224] For distributed databases or cloud databases, use distributed databases such as Hadoop HDFS, Cassandra, MongoDB, or cloud database services such as Amazon RDS, Google Cloud SQL, to achieve reliable storage and efficient access to massive data;
[0225] For OLAP online analysis technology: use tools such as Apache Kylin and Tableau to quickly query, aggregate and generate reports on stored data;
[0226] For API interfaces: provide RESTfulAPI, GraphQL and other interfaces for data exchange and integration with other systems.
[0227] The data fusion algorithm fuses data from different sources through content to form a comprehensive slope geological environment data set, enabling the system to receive data from various monitoring sensors in real time, providing a data basis for three-dimensional modeling and data support for system monitoring. Specific embodiment three:
[0229] like Figure 1-5 As shown, according to the contents in the above specific embodiments, the following technical contents are further disclosed:
[0230] The real-time 3D model building system further includes the following contents:
[0231] The 3D model engine building unit uses Unity3D or UnrealEngine game engine as a 3D visualization platform, processes the implementation technical bureau received by the multi-dimensional data fusion system through plug-ins and scripts, and converts it into dynamic parameters in the 3D model. For the construction of the 3D model by the 3D model engine building unit, the engine's scene editor is used to build a 3D scene by dragging, dropping, etc. Scripts and plug-ins are written in programming languages such as C# and C++ to achieve functions such as data fusion and dynamic model update. The plug-ins provided by the engine or third-party plug-ins are used to process special effects or data formats, and the engine's rendering engine is used to achieve high-quality 3D rendering effects, including lighting, shadows, texture mapping, etc. The processing content for the 3D model construction is as follows:
[0232] Input: fused data set, including terrain data, vegetation data, building data, road data, etc.;
[0233] Processing flow:
[0234] Sp1: Data preprocessing: clean, format convert and normalize the input data to ensure data consistency and availability;
[0235] Sp2: Terrain model construction: Use digital elevation model DEM to build a three-dimensional terrain model based on terrain data;
[0236] Sp3: Adding vegetation, buildings, roads and other elements: According to the corresponding data set, vegetation, buildings, roads and other elements are added to the model in three-dimensional form, and the visual effect is enhanced by using texture mapping, lighting model, etc.;
[0237] Sp4: Expression of geometric form and geological structure: Based on geological exploration data, the geometric form and geological structure of the slope are accurately expressed through interpolation, simulation and other technologies;
[0238] Output: The completed three-dimensional slope model.
[0239] During the model building process, WebGL technology is used to directly render the three-dimensional model in the Web browser, realizing the three-dimensional scene display without installing additional plug-ins. Through Ajax, WebSocket and other technologies, data interaction between the front end and the server is realized, and the three-dimensional model is updated in real time. GIS technology is used to perform geographic coordinate correction and spatial analysis on the three-dimensional model to improve the geographic accuracy and application value of the model.
[0240] The dynamic update unit provides data monitoring services and continuously monitors the real-time data sent by the multi-dimensional data fusion system. When the dynamic update unit receives new data, it triggers the update function of the 3D model and adjusts the corresponding part of the model according to the data changes. Through event monitoring, callback function and other technologies, real-time data monitoring and dynamic update of the 3D model are realized. Timestamp and version control mechanisms are introduced to ensure data consistency and model accuracy. The processed data content for the dynamic update unit is as follows:
[0241] Input: real-time sensor data such as displacement, stress, rainfall, etc.;
[0242] Processing flow:
[0243] Sp1: Data monitoring: Continuously monitor the real-time data from the multi-dimensional data fusion system;
[0244] Sp2: Data analysis: Analyze the received data and extract key information, such as location, change, etc.
[0245] Sp3: Model update trigger: trigger the update function of the 3D model according to data changes;
[0246] Sp4: Model adjustment: According to the analyzed data, adjust the parameters of the corresponding parts in the model, such as position, shape, color, etc., to reflect the changes in the actual situation;
[0247] Sp5: Timestamp and version control: Record the timestamp of each update and introduce a version control mechanism to ensure data consistency and model accuracy;
[0248] Output: Updated slope 3D model.
[0249] By building a real-time 3D model system and updating the 3D model in real time according to data changes, the 3D model constructed using 3DWebGIS technology can highly restore the true situation of the slope terrain, including terrain undulations, vegetation distribution, geological structure and other details, enabling monitoring personnel to more intuitively understand and analyze the geological characteristics of the slope. Specific embodiment four:
[0251] like Figure 1-5 As shown, according to the contents in the above specific embodiments, the following technical contents are further disclosed:
[0252] The holographic interactive control system further includes the following:
[0253] The holographic projection equipment control unit includes the control of the holographic screen, holographic projection box, and holographic projection table, including the control and adjustment of opening and closing, contrast, and viewing angle;
[0254] The interactive gesture recognition unit integrates LeapMotion, Kinect or other gesture recognition devices to capture the user's hand movements mechanically and convert them into computer instructions. It develops gesture recognition algorithms or uses ready-made SDKs to recognize specific gestures, such as rotation, scaling, clicking, etc., and maps them to the operation of the 3D model. LeapMotion: LeapMotion is a small USB device that captures hand movements through infrared light and a camera and converts them into high-precision 3D hand position and direction data. Kinect: Kinect is a device that combines a camera, a microphone and an infrared sensor. It can capture the user's whole body movements and voice. Through the depth sensor, Kinect obtains the three-dimensional image of the human body and recognizes the hand movements. These gesture recognition devices capture the images of the hands or body, use computer vision and machine learning algorithms to analyze and process the images, recognize specific gestures or movements, and convert them into computer instructions. Through API or SDK, the holographic projection equipment, gesture recognition equipment and 3D model rendering engine are integrated to realize data transmission and instruction interaction. By developing gesture recognition algorithms or using ready-made SDKs, the user's gesture operations are mapped to operation instructions for the 3D model, thereby realizing the interaction between the user and the holographic image. Specific embodiment five:
[0256] like Figure 1-5 As shown, according to the contents in the above specific embodiments, the following technical contents are further disclosed:
[0257] The VR interactive emergency drill system further includes the following:
[0258] The VR device control unit includes interactive control of VR devices, including but not limited to VR helmets, VR glasses, and VR treadmills, providing an immersive virtual environment experience, and combining holographic projection technology to enhance the realism and three-dimensionality of the scene;
[0259] The scene simulation and task equipment unit builds the real-time scene given by the real-time 3D model system. By simulating the real slope geological disaster scene, users can conduct actual combat drills in a safe environment, improve the speed and accuracy of emergency response, and simulate the disaster scenes that may occur in the scene, such as landslides, collapses, and mudslides. The parameters of the scene are customized, such as the scale of the disaster, the time of occurrence, and the scope of impact. A variety of drill tasks are set according to the scene parameters, such as evacuation drills, rescue operations, and resource allocation. The corresponding goals and scoring standards are set, and a scene simulation platform is built, waiting for users to wear VR equipment and conduct emergency drills after opening and closing the VR equipment control unit. Compared with traditional field drills, the VR interactive emergency drill system can greatly reduce training costs and time.
[0260] Feedback evaluation unit. During the drill, the system will give real-time feedback based on the user's operating behavior. For example, when the user chooses the wrong evacuation route, the system will issue an alarm and prompt the correct route. When the user successfully completes a task, the system will give rewards and affirmation. After the drill, the system will generate a detailed evaluation report, including indicators such as the user's reaction time, decision-making accuracy, and resource utilization efficiency, to help users understand their own emergency response capabilities and make suggestions for improvement. Specific embodiment six:
[0262] like Figure 1-5 As shown, according to the contents in the above specific embodiments, the following technical contents are further disclosed:
[0263] The system home page unit further includes the following contents:
[0264] GIS map: After the user logs in to the system, the GIS map on the system homepage will display the location of the slope monitoring project related to the user in the form of dot icons on the map. Slope monitoring projects not related to the user will not be displayed. After the user clicks on a certain project location, it will jump to the homepage interface of the project. According to the user's role and authority in the project, the corresponding function menu will be dynamically loaded, and the user can perform various operations;
[0265] Slope monitoring project list: The slope monitoring project list on the system homepage lists the slope monitoring projects related to the currently logged-in user. When the user clicks a project in the list, the project is located on the GIS map and displayed in the center of the map with the icon flashing for a short time.
[0266] To-do items: The system homepage lists the relevant items and their quantities that should be handled by the current user, as well as all projects related to the currently logged-in user, including pending reports, pending over-standard warnings, etc. The numbers of pending reports, over-standard warnings, etc. are displayed in the form of hyperlinks. After the user clicks the link, he will jump to the report processing and over-standard processing flow page and perform different operations for the project management unit.
[0267] For the engineering management unit, the following contents are further included:
[0268] 3D model: When the user clicks and selects a project on the system homepage and enters the project homepage, a 3D model reflecting the arrangement of the project's measuring points is displayed;
[0269] Risk warning: Based on the types of exceeding standard measurement points currently generated by the project, the risk warning content related to each type of exceeding standard measurement point will be displayed on the home page;
[0270] Device exceptions to be processed: Displays the number of device exceptions to be processed in the form of hyperlinks. After the user clicks the link, the page for handling device exceptions is displayed.
[0271] Pending monitoring data changes: Displays the number of pending monitoring data changes in the form of hyperlinks. When the user clicks the link, they will be redirected to the monitoring data change page.
[0272] After the user logs in, the user demand and function interaction system includes not only the display system homepage unit and the project management unit, but also the my work unit. My work unit includes sub-modules such as data import, report information, over-standard processing, automatic collection equipment abnormality processing, and monitoring data change. After the user logs in to the system, the daily work of slope monitoring such as data, report, over-standard, equipment abnormality, and change of monitoring data can be centralized in this module. After the user demand and function interaction system imports or enters the slope monitoring data into the system, after automatic calculation, if the data of a certain monitoring point exceeds the standard, the over-standard warning processing flow will be started. The over-standard warning of the slope monitoring project is divided into three types: red warning, orange warning and yellow warning in order from high to low levels. The deadline and overtime information should be reflected in the over-standard processing process. The deadline information means that the over-standard should be processed within the specified time. The overtime information means that the over-standard processing time exceeds the deadline, whether it exceeds the deadline, the number of overtime days, etc. Figure 3 As shown in the figure, it is the processing flow of yellow warning. Figure 4 The following is the process of handling orange warnings: Figure 5 The following figure shows the process of handling red warning.
[0273] The entire system mainly uses two methods to enter slope geological disaster detection information data. One is automatic entry after monitoring through various units of the data multi-dimensional data fusion system. The other is manual entry by the project leader based on the data monitored by the manual machine by logging into the user needs and functional interaction system. The manually entered data category is data outside the monitoring category of the multi-dimensional data fusion system, realizing two data entry methods. Specific embodiment seven:
[0275] like Figure 1-5 As shown, according to the contents in the above specific embodiments, the following technical contents are further disclosed:
[0276] The system monitoring and drill process is as follows:
[0277] Sp1: Data source collection, the multi-dimensional data fusion system receives data collected on the slope position from multiple internally connected data sources and integrates and processes the data;
[0278] Sp2: Construction of geological 3D model. The real-time 3D model construction system constructs a 3D model of the slope based on the data collected by Sp1, and independently adjusts the 3D model in real time according to the changes in the real-time monitoring data source;
[0279] Sp3: Geological monitoring and early warning, user demand and function interaction system monitors the data collected by Sp1 in real time, and classifies the data at the monitoring point when it exceeds the standard, and performs early warning processing according to the processing flow of the corresponding level of early warning;
[0280] Sp4: Configuration of interactive devices, holographic interactive control system and VR interactive emergency drill system to test holographic interactive devices and VR recognition to ensure that the device connection is normal, the software configuration is correct, and normal interaction can be completed;
[0281] Sp5: Construction of drill scenarios. Based on the geological 3D model constructed in Sp2, a group of model scenarios are selected to analyze the most likely geological disasters due to the influence of terrain, environment, and morphology, and one or several are selected for simulation. Environmental parameters and drill tasks are set, and the interactive devices in Sp3 are connected, waiting for the drill.
[0282] Sp6: Emergency response and coordinated combat drills. Users wear the interactive device in Sp3 and access the scene in Sp4. Drills are conducted according to the scene and tasks. During the drill, the feedback evaluation unit records real-time data and provides guidance.
[0283] Sp7: Evaluation summary. After the user drill is completed, the feedback evaluation unit in the VR interactive emergency drill platform will give an evaluation report based on the drill data. The report content shall at least include the achievement of the drill objectives, the performance of the participants, existing problems and improvement suggestions. Users shall discuss and analyze based on the report content.
[0284] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprising a reference structure" do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0285] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and alterations may be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.
Claims
1. The slope geological disaster monitoring information system based on 3DWebGIS is characterized by: The system includes a multi-dimensional data fusion system, a real-time three-dimensional model building system, a holographic interactive control system, a VR interactive emergency drill system, and a user demand and function interaction system, wherein: The multi-dimensional data fusion system includes a data source management unit, a data fusion unit and a data storage and management unit. The data source management unit accesses real-time data from the Internet of Things sensor. The data fusion unit processes the real-time data accessed from the Internet of Things sensor and fuses data from different sources using a data fusion algorithm to form a comprehensive slope geological environment data set. The data sources in the data source management unit include Internet of Things sensors, remote sensing satellites and drone oblique photography, wherein: The IoT sensor includes a high-precision displacement sensor, a stress sensor, and a soil moisture sensor deployed on the slope. The IoT sensor sends the collected data to the data source management center at fixed intervals, and the collected data is transmitted through one or more wireless communication technologies such as LoRa, NB-IoT, or 5G; The remote sensing satellite regularly receives high-resolution satellite images, which are geometrically corrected, radiometrically corrected and enhanced by ENVI or ERDAS to extract the surface change information of the slope; The drone carries a high-resolution camera and performs oblique photography of the slope according to a preset route to obtain multi-angle image data. The obtained image data is 3D reconstructed by the Structure-from-Motion algorithm to generate a 3D point cloud and texture model of the slope. The 3D model construction formula is as follows: The construction of the three-dimensional model M(t) is expressed as: M(t)=f(D terrain ,D vegetation ,D buildings ,D roads ) Among them, M(t) is the three-dimensional model at time t, D terrain is the terrain data, D vegetation is the vegetation data, D buildings is the building data, D roads For road data; WebGIS display formula: Assume that the coordinates of the three-dimensional model M(t) are (x, y, z), and use WebGIS technology to display it on a three-dimensional map. The display function g is expressed as: Display = g(M(t)) Function g converts the three-dimensional model M(t) into a visual display form; The real-time three-dimensional model building system includes a three-dimensional model engine building unit and a dynamic update unit. The three-dimensional model engine building unit uses a three-dimensional modeling engine to build a three-dimensional model of the slope according to the fused data set. The dynamic update unit monitors the changes of real-time data from the Internet of Things sensor in real time, and transmits the changed real-time data to the three-dimensional model engine building unit, driving the three-dimensional model engine building unit to update the three-dimensional model. The holographic interactive control system includes a holographic projection device control unit and an interactive gesture recognition unit. The holographic projection device control unit is used to control the holographic projection device connected to the system. The interactive gesture recognition unit recognizes the interactive gesture set by the user and controls the gesture operation to interact with the holographic image. The VR interactive emergency drill system includes a VR device control unit, a scene simulation and task setting unit, and a feedback evaluation unit. The VR device control unit is used to control the VR device and interact with the virtual environment. The scene simulation and task setting unit builds an interactive emergency drill platform based on holographic projection and VR technology, which is used to simulate and set geological disaster scenes of different levels, set drill tasks related to disaster scenes, and cooperate with the VR device control unit to perform emergency drill simulation. The feedback evaluation unit is used to provide real-time feedback and guidance on user operation behaviors during the drill, and generate a detailed evaluation report after the drill. The user demand and function interaction system is used for the operation control and interaction of each system in the system, and for monitoring and early warning of geological information. The user demand and function interaction system includes a system homepage unit and an engineering management unit.
2. The 3D WebGIS-based slope geological disaster monitoring information system according to claim 1 is characterized in that: The data fusion unit in the multi-dimensional data fusion system uses a Kalman filter to smooth the sensor data in the data source management unit, extracts features and assigns weights through a deep learning network, and generates a comprehensive slope stability evaluation index.
3. The slope geological disaster monitoring information system based on 3D WebGIS according to claim 1 is characterized in that: The data storage and management unit in the multi-dimensional data fusion system uses a distributed database or cloud database service to store massive data, and accesses OLAP online analysis technology to quickly query data and automatically generate reports. An API interface is provided internally to connect with other systems for data access and transmission.
4. The slope geological disaster monitoring information system based on 3D WebGIS according to claim 1 is characterized in that: The real-time three-dimensional model building system further includes the following contents: The 3D model engine building unit uses Unity3D or UnrealEngine game engine as a 3D visualization platform, processes the real-time data received by the multi-dimensional data fusion system through plug-ins and scripts, and converts it into dynamic parameters in the 3D model; The dynamic update unit provides data monitoring services and continuously monitors the real-time data sent by the multi-dimensional data fusion system. When the dynamic update unit receives new data, it triggers the update function of the three-dimensional model, adjusts the corresponding part of the model according to the data changes, and introduces timestamp and version control mechanisms to ensure data consistency and model accuracy.
5. The slope geological disaster monitoring information system based on 3D WebGIS according to claim 1 is characterized in that: The holographic interactive control system further includes the following contents: The holographic projection equipment control unit includes control over the holographic screen, holographic projection box, and holographic projection table, including opening and closing control, contrast, and viewing angle control and adjustment; The interactive gesture recognition unit integrates a gesture recognition device, which includes LeapMotion and Kinect. The gesture recognition device can capture the user's hand movements mechanically and convert them into computer instructions, develop gesture recognition algorithms or use ready-made SDKs to recognize specific gestures and map them to operations on the three-dimensional model.
6. The slope geological disaster monitoring information system based on 3D WebGIS according to claim 1 is characterized in that: The VR interactive emergency drill system further includes the following contents: The VR device control unit includes interactive control of VR devices, including VR helmets, VR glasses, and VR treadmills; The scenario simulation and task equipment unit simulates the disaster scenario predicted by the scenario according to the real-time scenario given by the real-time three-dimensional model building system, sets corresponding goals and scoring standards, builds a scenario simulation platform, and waits for users to wear VR equipment and conduct emergency drills after opening and closing it through the VR equipment control unit; During the drill, the feedback evaluation unit will give real-time feedback based on the user's operating behavior. When the user chooses the wrong evacuation route, the system will issue an alarm and prompt the correct route. When the user successfully completes a task, the system will give rewards and affirmation. After the drill, the system will generate a detailed evaluation report, including the user's reaction time, decision accuracy, and resource utilization efficiency indicators, to help users understand their own emergency response capabilities and put forward improvement suggestions.
7. The slope geological disaster monitoring information system based on 3D WebGIS according to claim 1 is characterized in that: The system homepage unit displays the GIS map, a list of monitoring projects related to the logged-in user, and reports and over-standard warning items waiting to be processed by the logged-in user. The project management unit displays a three-dimensional model of the project. The three-dimensional model displays the monitoring point layout, risk warning content, equipment anomalies to be processed, and monitoring data changes to be processed of the project. After the user demand and function interaction system imports or enters the slope monitoring data into the system, it automatically calculates and starts the over-standard warning processing flow if the data of a certain monitoring point exceeds the standard. The over-standard warning of the slope monitoring project is divided into three levels: red warning, orange warning and yellow warning, in order from high to low levels.
8. The 3D WebGIS-based slope geological disaster monitoring information system according to claim 1 is characterized by: The monitoring and drill process of the system is as follows: Sp1: Data source collection, the multi-dimensional data fusion system receives data collected on the slope position from multiple internally connected data sources, and integrates the data; Sp2: Construction of geological three-dimensional model. The real-time three-dimensional model construction system constructs a three-dimensional model of the slope based on the data collected by Sp1, and autonomously adjusts the three-dimensional model in real time according to the changes in the real-time monitoring data source; Sp3: geological monitoring and early warning, the user demand and function interaction system monitors the data collected by Sp1 in real time, and when the data at the monitoring point exceeds the standard, it is classified and early warning is processed according to the processing flow of the corresponding level of early warning; Sp4: Configuration of interactive devices. The holographic interactive control system and VR interactive emergency drill system test the holographic interactive devices and VR recognition to ensure that the device connection is normal, the software configuration is correct, and normal interaction can be completed; Sp5: Construction of drill scenarios. Based on the geological 3D model built in Sp2, select a group of model scenarios to analyze the geological disasters caused by the influence of terrain, environment, and morphology, and select one or several to simulate, set environmental parameters and drill tasks, connect the interactive equipment in Sp3, and wait for the drill; Sp6: Emergency response and coordinated combat drills. Users wear the interactive device in Sp3 and access the scene in Sp4. Drills are conducted according to the scene and tasks. During the drill, the feedback evaluation unit records real-time data and provides guidance. Sp7: Evaluation summary. After the user drill is completed, the feedback evaluation unit in the VR interactive emergency drill platform will give an evaluation report based on the drill data. The report content shall at least include the achievement of the drill objectives, the performance of the participants, existing problems and improvement suggestions. Users shall discuss and analyze based on the report content.
