Hydropower station slope deformation online monitoring method and device based on image recognition

Abstract

The invention discloses a hydropower station slope deformation online monitoring method and device based on image recognition, and relates to the field of hydropower engineering. The hydropower station slope deformation online monitoring method based on image recognition comprises the following steps: determining a first vector coordinate value of a hydropower station slope in a first slope picture captured at a first moment through an image recognition technology; under the condition that a second vector coordinate value of the hydropower station slope acquired by the sensor is consistent with the first vector coordinate value, determining whether the first slope picture is consistent with a second slope picture captured at the initial moment or not; when it is determined that the first side slope picture and the second side slope picture are inconsistent, whether the first vector coordinate value exceeds a preset threshold value or not is determined; and when the first vector coordinate value exceeds a preset threshold value, starting an alarm device of the hydropower station slope.

Description

Technical Field

[0001] The present application relates to the field of hydropower engineering, and more specifically, to an online monitoring method and device for slope deformation of a hydropower station based on image recognition. Background Art

[0002] Traditional monitoring of slope deformation in hydropower stations mainly relies on sensor technology, such as displacement meters, strain meters, inclinometers, etc. However, the monitoring range of sensors is usually small, and they can only monitor local areas near their installation locations, which means that it is difficult for sensors to accurately monitor a wide area of ​​the entire slope, resulting in inaccurate monitoring.

[0003] Regarding the related technologies, since the monitoring range of the sensors is small, determining whether the slope of the hydropower station is deformed only by sensors can easily lead to inaccurate monitoring. Currently, no effective solution has been proposed.

[0004] Therefore, it is necessary to improve the related technology to overcome the above-mentioned defects in the related technology. Summary of the invention

[0005] The embodiments of the present application provide a method and device for online monitoring of slope deformation of a hydropower station based on image recognition, so as to at least solve the problem in the related art that, due to the small monitoring range of the sensor, only the sensor is used to determine whether the slope of the hydropower station is deformed, which easily leads to inaccurate monitoring.

[0006] According to one aspect of an embodiment of the present application, there is provided an online monitoring method for deformation of a hydropower station slope based on image recognition, comprising: determining a first vector coordinate value of a hydropower station slope in a first slope picture captured at a first moment by image recognition technology, wherein the first moment is the moment closest to a current moment, the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, the first slope picture is periodically acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope; when a second vector coordinate value of the hydropower station slope acquired by a sensor is consistent with the first vector coordinate value, determining whether the first slope picture is consistent with a second slope picture captured at an initial moment, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to characterize the position of the hydropower station slope at the current moment; when it is determined that the first slope picture and the second slope picture are inconsistent, determining whether the first vector coordinate value exceeds a preset threshold; when the first vector coordinate value exceeds the preset threshold, activating an alarm device of the hydropower station slope.

[0007] In an exemplary embodiment, after determining whether the first slope image is consistent with the second slope image captured at the initial moment, the method further includes: if the first slope image is consistent with the second slope image, determining that the hydropower station slope has not been deformed.

[0008] In an exemplary embodiment, after determining the first vector coordinate value of the slope of the hydropower station in the first slope picture captured at the first moment by image recognition technology, the method further includes: performing data cleaning on the first vector coordinate value, wherein the data cleaning includes: removing abnormal values ​​in the first vector coordinate value; removing duplicate values ​​in the first vector coordinate value; converting the data format of the first vector coordinate value into a target format.

[0009] In an exemplary embodiment, after activating the alarm device of the hydropower station slope, the method further includes: generating a warning report based on the first vector coordinate value; encrypting the warning report, and transmitting the encrypted warning report to a mobile device of a first target object that maintains the hydropower station slope through a secure transmission protocol to instruct the first target object to inspect the hydropower station slope.

[0010] In an exemplary embodiment, after the alarm device of the hydropower station slope is activated, the method further includes: obtaining the maximum deformation area, deformation speed and deformation trend of the hydropower station slope; determining an evacuation path according to the maximum deformation area, the deformation speed and the deformation trend; and sending the evacuation path to a mobile device of a second target object to instruct the second target object to stay away from the hydropower station slope, wherein the second target object is a target object located at the hydropower station slope.

[0011] In an exemplary embodiment, before determining the first vector coordinate value of the slope of the hydropower station in the first slope picture captured at the first moment through image recognition technology, the method also includes: obtaining the current light intensity of the slope of the hydropower station; and starting the lighting device embedded in the image acquisition device when the current light intensity is lower than a preset value.

[0012] In an exemplary embodiment, after determining whether the first vector coordinate value exceeds a preset threshold, the method further includes: if the first vector coordinate value does not exceed the preset threshold, determining that the deformation of the hydropower station slope is within a normal range.

[0013] According to another aspect of the embodiment of the present application, there is also provided an online monitoring device for deformation of a hydropower station slope based on image recognition, comprising: a first determination module, used to determine a first vector coordinate value of a hydropower station slope in a first slope picture captured at a first moment by image recognition technology, wherein the first moment is the moment closest to the current moment, and the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, and the first slope picture is regularly acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope; a second determination module, used to determine whether the first slope picture and the second slope picture captured at an initial moment are consistent when a second vector coordinate value of the hydropower station slope acquired by a sensor is consistent with the first vector coordinate value, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to characterize the position of the hydropower station slope at the current moment; a third determination module, used to determine whether the first vector coordinate value exceeds a preset threshold when it is determined that the first slope picture and the second slope picture are inconsistent; and a start module, used to start the alarm device of the hydropower station slope when the first vector coordinate value exceeds the preset threshold.

[0014] According to another aspect of the embodiment of the present application, a computer-readable storage medium is also provided, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned online monitoring method for slope deformation of a hydropower station based on image recognition when running.

[0015] According to another aspect of an embodiment of the present application, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the above-mentioned online monitoring method for slope deformation of a hydropower station based on image recognition through the computer program.

[0016] According to another aspect of the embodiments of the present application, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps of the method described in each embodiment of the present application are implemented.

[0017] Through the present application, the first vector coordinate value of the hydropower station slope in the first slope picture captured at the first moment is determined by image recognition technology; when the second vector coordinate value of the hydropower station slope obtained by the sensor is consistent with the first vector coordinate value, it is determined whether the first slope picture is consistent with the second slope picture captured at the initial moment; when it is determined that the first slope picture and the second slope picture are inconsistent, it is determined whether the first vector coordinate value exceeds a preset threshold; when the first vector coordinate value exceeds the preset threshold, the alarm device of the hydropower station slope is activated. This solves the problem in the related art that due to the small monitoring range of the sensor, only the sensor is used to determine whether the hydropower station slope is deformed, which easily leads to inaccurate monitoring. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0020] Figure 1 It is a hardware structure block diagram of a computer terminal of an online monitoring method for slope deformation of a hydropower station based on image recognition according to an embodiment of the present application;

[0021] Figure 2 is a flow chart of an online monitoring method for slope deformation of a hydropower station based on image recognition according to an embodiment of the present application;

[0022] Figure 3 It is a schematic diagram of the device layout of an online monitoring method for slope deformation of a hydropower station based on image recognition according to an embodiment of the present application;

[0023] Figure 4 It is a flow chart of an online monitoring method for slope deformation of a hydropower station based on image recognition according to an embodiment of the present application;

[0024] Figure 5 is a schematic diagram of slope deformation of an online monitoring method for slope deformation of a hydropower station based on image recognition according to an embodiment of the present application;

[0025] Figure 6 It is a structural block diagram of an online monitoring device for slope deformation of a hydropower station based on image recognition according to an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] The method embodiments provided in the embodiments of the present application can be executed in a computer terminal or a similar computing device. Taking running on a computer terminal as an example, Figure 1 1 is a hardware structure block diagram of a computer terminal of an online monitoring method for slope deformation of a hydropower station based on image recognition in an embodiment of the present application. Figure 1 As shown, the computer terminal may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor (Central Processing Unit, MCU) or a programmable logic device (Field Programmable Gate Array, FPGA)) and a memory 104 for storing data, wherein the above-mentioned computer terminal may also include a transmission device 106 and an input and output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above-mentioned computer terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0029] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the online monitoring method for slope deformation of a hydropower station based on image recognition in the embodiment of the present application. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the computer terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0030] A wireless network provided by a communication provider of a computer terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (Radio Frequency, referred to as RF) module, which is used to communicate with the Internet wirelessly.

[0031] In this embodiment, a method for online monitoring of slope deformation of a hydropower station based on image recognition is provided, which is applied to the above-mentioned computer terminal. Figure 2 is a flow chart of an online monitoring method for slope deformation of a hydropower station based on image recognition according to an embodiment of the present application. Figure 2 As shown, the process includes the following steps:

[0032] Step S202, determining a first vector coordinate value of the hydropower station slope in a first slope picture captured at a first moment by image recognition technology, wherein the first moment is the moment closest to the current moment, the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, and the first slope picture is regularly acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope;

[0033] Step S204, when the second vector coordinate value of the hydropower station slope obtained by the sensor is consistent with the first vector coordinate value, determining whether the first slope image and the second slope image captured at the initial moment are consistent, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to represent the position of the hydropower station slope at the current moment;

[0034] Step S206, when it is determined that the first slope image and the second slope image are inconsistent, determining whether the first vector coordinate value exceeds a preset threshold;

[0035] Step S208: when the first vector coordinate value exceeds the preset threshold, start the alarm device of the hydropower station slope.

[0036] Through the above steps, the first vector coordinate value of the hydropower station slope in the first slope picture captured at the first moment is determined by image recognition technology, wherein the first moment is the moment closest to the current moment, the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, and the first slope picture is regularly acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope; when the second vector coordinate value of the hydropower station slope acquired by the sensor is consistent with the first vector coordinate value, it is determined whether the first slope picture is consistent with the second slope picture captured at the initial moment, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to characterize the position of the hydropower station slope at the current moment; when it is determined that the first slope picture and the second slope picture are inconsistent, it is determined whether the first vector coordinate value exceeds a preset threshold; when the first vector coordinate value exceeds the preset threshold, the alarm device of the hydropower station slope is activated. Thus, the problem in the related art that, due to the small monitoring range of the sensor, only the sensor is used to determine whether the hydropower station slope is deformed, which easily leads to inaccurate monitoring.

[0037] Optionally, assuming that the current time is 10:50, the image acquisition device starts at 9:00 (i.e., the initial time), and regularly (e.g., 30 minutes) captures the slope picture of the hydropower station slope, then captures the slope pictures at 9:00, 9:30, 10:00, and 10:30, and obtains the first slope picture at the first time (i.e., 10:30) closest to the current time from the above slope pictures. Determine the first vector coordinate value of the hydropower station slope in the first slope picture by image recognition technology, compare the first vector coordinate value and the second vector coordinate value, and determine that the position of the image acquisition device is correctly placed when the first vector coordinate value and the second vector coordinate value are consistent. Further determine whether the first slope picture and the second slope picture captured at the initial time are consistent. If the first slope picture and the second slope picture are inconsistent, it means that the hydropower station slope has deformed, and at this time, the change trend of the first vector coordinate value is monitored in real time. If the first vector coordinate value is greater than the preset threshold, the alarm device is activated to notify the target object maintaining the hydropower station slope to take emergency measures.

[0038] In an exemplary embodiment, after determining whether the first slope image is consistent with the second slope image captured at the initial moment, the method further includes: if the first slope image is consistent with the second slope image, determining that the hydropower station slope has not been deformed.

[0039] The first slope image is a slope image obtained by the image acquisition device at a certain time point (i.e., the first moment) in the current monitoring cycle. The image acquisition device regularly captures photos of the slope, for example, once every 30 minutes, and then analyzes the images through image recognition technology to extract vector coordinate values ​​of the slope surface, which can accurately reflect the position information of the slope surface points. The second slope image is a slope image captured during the initial operation of the image acquisition device, which is used as a comparison benchmark for the slope state in all subsequent monitoring cycles. The image at the initial moment provides the state of the slope without any known deformation and is a reference point for deformation detection. During the monitoring process, the first slope image is compared with the second slope image. This comparison process includes, but is not limited to, image processing technologies such as image feature point matching, structural similarity index calculation, and edge detection algorithm, which are used to identify the differences between the two images. If it is found in the comparative analysis that the first slope image and the second slope image are highly consistent in visual features and structure, that is, no significant changes in the appearance of the slope are detected, then it can be preliminarily determined that the slope has not deformed between the two time points.

[0040] In an exemplary embodiment, after determining the first vector coordinate value of the slope of the hydropower station in the first slope picture captured at the first moment by image recognition technology, the method further includes: performing data cleaning on the first vector coordinate value, wherein the data cleaning includes: removing abnormal values ​​in the first vector coordinate value; removing duplicate values ​​in the first vector coordinate value; converting the data format of the first vector coordinate value into a target format.

[0041] Alternatively, assume that the original first vector coordinate value data is as follows: [(500,300), (500,300), (600,400), (-1000,-1200), (10000,10000), (450,320), (480,310)]. Set a reasonable range and threshold. For example, the slope coordinates are usually in the range of (0,0) to (1000,1000). Remove the coordinates that are obviously not in this range, and get: [(500,300), (500,300), (600,400), (450,320), (480,310)]. Through the data deduplication algorithm, for example, using a set or list in Python, ensure that each coordinate appears only once, and get: [(500,300), (600,400), (450,320), (480,310)]. The cleaned coordinate values ​​are converted into a format supported by the system, such as CSV format, in which each coordinate value is converted into a line separated by commas.

[0042] In an exemplary embodiment, after activating the alarm device of the hydropower station slope, the method further includes: generating a warning report based on the first vector coordinate value; encrypting the warning report, and transmitting the encrypted warning report to a mobile device of a first target object that maintains the hydropower station slope through a secure transmission protocol to instruct the first target object to inspect the hydropower station slope.

[0043] The current first vector coordinate value is compared with the preset threshold to detect the deformation of the slope. When the analysis results show that the deformation amount, deformation rate or other key parameters of the slope exceed the preset threshold, the computer terminal generates an early warning report. The early warning report contains detailed monitoring data, deformation analysis results, potential risk assessment, and recommended inspection and countermeasures. In order to protect the sensitive information in the early warning report and prevent the data from being intercepted or tampered with during transmission, the early warning report needs to be encrypted before transmission. The encryption process usually involves converting the early warning report into ciphertext and encrypting it with an encryption key. Only the recipient holding the corresponding decryption key can decrypt and read the report. After the early warning report is encrypted, it is transmitted to the mobile device of the first target object who maintains the slope of the hydropower station through a secure transmission protocol. After the first target object receives the encrypted early warning report, it uses the corresponding decryption key to decrypt the report content to understand the current condition and potential risks of the slope. This will instruct the first target object to immediately conduct an on-site inspection of the slope, assess the actual situation, and take emergency measures if necessary, such as reinforcing the slope, evacuating personnel, or suspending construction, to ensure the safe operation of the hydropower station.

[0044] In an exemplary embodiment, after the alarm device of the hydropower station slope is activated, the method further includes: obtaining the maximum deformation area, deformation speed and deformation trend of the hydropower station slope; determining an evacuation path according to the maximum deformation area, the deformation speed and the deformation trend; and sending the evacuation path to a mobile device of a second target object to instruct the second target object to stay away from the hydropower station slope, wherein the second target object is a target object located at the hydropower station slope.

[0045] The coordinate changes of each monitoring point are calculated by statistical methods (such as calculating the standard deviation, or using machine learning algorithms such as cluster analysis) to find the area with the largest change (i.e. the area with the largest deformation). At the same time, the displacement of the monitoring point is divided by the monitoring cycle time to obtain the deformation speed of each monitoring point. If the first deformation speed exceeds the preset threshold, the monitoring point corresponding to the first deformation speed will be marked as a high-risk area. And based on time series analysis (such as moving average, exponential smoothing or time series prediction model), the deformation trend of the slope is predicted.

[0046] According to the topography of the slope, the distribution of buildings and the location information of the second target object, combined with the location, deformation speed and trend of the deformation area, a safe evacuation path is intelligently planned through a path planning algorithm to find the shortest path or the safest path from the current personnel position to the safe area, while avoiding potential dangerous areas. Among them, the second target object includes on-site construction personnel, tourists or other on-site staff. The evacuation path is sent to the mobile device of the second target object through a secure transmission protocol. After the second target object receives the evacuation path information, it can view and navigate to the safe area through the map application on the mobile device.

[0047] In an exemplary embodiment, before determining the first vector coordinate value of the slope of the hydropower station in the first slope picture captured at the first moment through image recognition technology, the method also includes: obtaining the current light intensity of the slope of the hydropower station; and starting the lighting device embedded in the image acquisition device when the current light intensity is lower than a preset value.

[0048] Each image acquisition device is equipped with a light intensity sensor to monitor the light intensity of the slope area in real time. When the light intensity received by the light intensity sensor is lower than the preset value, the lighting device is started to enhance the light intensity of the image acquisition area. It should be clear that the image acquisition device can dynamically adjust the on state and brightness of the lighting device according to the changes in the lighting conditions of the slope area. For example, when there is sufficient light during the day, the image acquisition device can turn off the lighting device or set it to low brightness mode to save energy. At night or in rainy weather, the lighting device should be automatically turned on to ensure that the image acquisition quality is not affected.

[0049] In an exemplary embodiment, after determining whether the first vector coordinate value exceeds a preset threshold, the method further includes: if the first vector coordinate value does not exceed the preset threshold, determining that the deformation of the hydropower station slope is within a normal range.

[0050] In the online monitoring system of slope deformation of hydropower stations based on image recognition, the first vector coordinate value represents the position information of a specific point on the slope surface in the image. These coordinate values ​​can be compared and analyzed to monitor the deformation of the slope over time. The preset threshold is an upper limit of the deformation amount set according to the geological conditions, design standards and engineering experience of the slope, which is used to determine whether the deformation of the slope exceeds the safe or normal range. If the first vector coordinate value of the target monitoring point does not exceed the preset threshold, it can be determined that the deformation of the target monitoring point is within the normal range.

[0051] In order to better understand the process of the above-mentioned online monitoring method for slope deformation of a hydropower station based on image recognition, the above-mentioned online monitoring method for slope deformation of a hydropower station based on image recognition is described below in combination with an optional embodiment, but it is not used to limit the technical solution of the embodiment of the present application.

[0052] Figure 3 FIG. 1 is a schematic diagram of the device layout of an online monitoring method for slope deformation of a hydropower station based on image recognition according to an embodiment of the present application, such as Figure 3 As shown, specifically including the following:

[0053] When implementing the online monitoring system for slope deformation of a hydropower station based on image recognition, it is necessary to conduct a comprehensive topographic and geological analysis of the slope to identify key monitoring points and potential high-risk areas. These key points usually include the top, bottom, middle and geologically sensitive areas such as fault zones that may exist on the slope. The number and specific distribution of image acquisition points are determined by analysis. In this embodiment, four acquisition points are set on the slope of the hydropower station. However, for slopes with large scale or complex geological structure, four acquisition points may not be enough to fully cover the monitoring needs. At this time, more points should be added to ensure that the monitoring range of the entire slope is covered.

[0054] The image acquisition frequency is set according to the specific conditions of the slope and the monitoring requirements. In this embodiment, the image data of the hydropower station slope is collected every 30 minutes. However, in special circumstances, such as heavy rain or earthquakes, the acquisition frequency should be increased to capture potential slope deformation. At the same time, an intelligent acquisition frequency adjustment mechanism is integrated in the image acquisition device to automatically optimize the acquisition frequency based on historical image data and the current geological environment, which not only ensures the monitoring effect but also avoids excessive data collection, saving storage and network resources.

[0055] In order to facilitate subsequent image processing and analysis, the collected image data is converted into vector format. The processing of vector image data is integrated in the image and displacement monitoring data analysis module, and advanced image recognition algorithms such as deep learning are used to automatically analyze changes on the slope surface and identify small deformations. Edge computing devices are deployed at each image acquisition point to be responsible for preliminary processing of image data, including preprocessing, feature extraction, and anomaly detection, etc., to reduce the burden of data transmission and speed up response. Edge computing devices should have real-time communication capabilities and be able to quickly transmit processed data to the remote monitoring center to ensure that monitoring personnel can obtain monitoring results in a timely manner. Among them, data transmission should use wired or wireless networks to ensure the safe transmission and stable reception of image data. The data storage module needs to support large-scale data storage and implement redundant storage strategies to ensure the integrity and recoverability of image data, providing guarantees for subsequent data analysis and event backtracking.

[0056] Obviously, the embodiments described above are only part of the embodiments of the present application, not all of the embodiments. In order to better understand the above-mentioned hydropower station slope deformation online monitoring method based on image recognition, the above-mentioned process is described below in conjunction with the embodiments, but it is not intended to limit the technical solutions of the embodiments of the present application, specifically:

[0057] In an optional embodiment, in combination Figure 4 The online monitoring method of slope deformation of a hydropower station based on image recognition in this application is further described. Figure 4 As shown, including the following:

[0058] The image acquisition device (i.e., image acquisition module) acquires slope images regularly (e.g., every 30 minutes) and extracts the first slope image closest to the current moment. Using advanced image recognition technology, such as deep learning algorithm, the key point positions on the slope surface are accurately identified and determined from the first slope image to obtain the first vector coordinate value. At the same time, the second vector coordinate values ​​are obtained through sensors (traditional displacement measurement points) arranged on the slope. These coordinate values ​​reflect the real-time physical displacement of the slope, including key parameters such as slope displacement and stress change.

[0059] The first vector coordinate value (image recognition result) and the second vector coordinate value (sensor monitoring result) are transmitted to the data storage module in real time through the data transmission module. The transmission method can be either a wired connection, such as a fiber optic network, or a wireless transmission, such as a 4G / 5G network or satellite communication, to ensure the stability and security of data transmission. The data storage module receives and stores the above data, performs data cleaning, removes noise and invalid data, and ensures the accuracy and reliability of the data. Among them, data cleaning includes steps such as removing duplicate data, correcting sensor reading errors, and identifying and eliminating abnormal image data.

[0060] In the image and displacement monitoring data analysis module, the consistency of the first vector coordinate value and the second vector coordinate value is compared to verify the accuracy of the image recognition result. If the two are consistent, the first slope image is further compared with the slope image at the initial moment (i.e., the second slope image) to evaluate the changes in the slope surface. If inconsistency is found in the image, it indicates that the slope may have deformed or displaced. At this time, the first vector coordinate value is compared with the preset deformation threshold. If the first vector coordinate value exceeds the preset threshold, it indicates that the slope deformation has reached the alarm level. The computer terminal will immediately activate the alarm device of the hydropower station slope and notify relevant personnel to take emergency measures.

[0061] It should be made clear that the preset deformation threshold should be dynamically adjusted according to the geological conditions of the slope, historical monitoring data and real-time environmental factors (such as rainfall, seismic activity, etc.). The computer terminal should integrate intelligent algorithms, such as machine learning models, to achieve adaptive adjustment of the threshold and improve the accuracy and timeliness of early warning. The image and displacement monitoring data analysis module should not only compare the current data, but also analyze historical data to identify the trend and pattern of slope deformation, and use statistics and data mining techniques to predict possible deformation in the future, so as to provide data support for the long-term maintenance of the hydropower station. The computer terminal should support remote monitoring, and the target object of the monitoring center can view the image and monitoring data of the slope in real time. In an emergency, the on-site equipment can be controlled by remote commands, such as adjusting the camera angle, starting the emergency equipment, etc., to improve the efficiency and effectiveness of the emergency response.

[0062] In order to better understand the process of the above-mentioned online monitoring method for slope deformation of a hydropower station based on image recognition, the above-mentioned online monitoring method for slope deformation of a hydropower station based on image recognition is explained below in combination with a slope deformation comparison schematic diagram, but it is not used to limit the technical solution of the embodiment of the present application.

[0063] Figure 5 is a schematic diagram of slope deformation of a hydropower station slope deformation online monitoring method based on image recognition according to an embodiment of the present application, such as Figure 5 As shown, specifically including the following:

[0064] When the first vector coordinate value obtained from the image acquisition device is consistent with the second vector coordinate value obtained by the sensor, the first slope image is compared with the second slope image at the initial moment. This process uses image recognition and image processing technology, for example, by calculating the similarity score of the image (such as based on feature point matching, structural similarity index, etc.) to judge the change of the slope surface. If the image similarity score is lower than the target value, it indicates that there is a significant difference between the slope surface and the initial state, and the hydropower station slope is deformed or displaced. Once it is confirmed that the slope has deformed or displaced, the computer terminal further compares the first vector coordinate value with the preset threshold. The preset threshold is set based on the geological characteristics of the slope, historical monitoring data and engineering experience, and reflects the early warning level of slope deformation. If the first vector coordinate value exceeds the preset threshold, it indicates that the slope deformation has reached or exceeded the safety warning line. At this time, the computer terminal automatically starts the alarm device of the hydropower station slope, and quickly notifies the on-site personnel and the remote monitoring center to take emergency measures through SMS, phone calls, alarm sounds and other methods. In addition to the above threshold judgment, the computer terminal should also set up multiple early warning mechanisms, for example, dynamic threshold early warning based on slope deformation rate. When the deformation rate suddenly increases, even if the absolute deformation has not reached the preset threshold, an early warning should be issued so that preventive measures can be taken early. The computer terminal should also have data analysis and trend prediction functions. It can use historical monitoring data, statistical analysis and machine learning algorithms to predict the future deformation trend of the slope, and provide a scientific basis for the maintenance and management of the hydropower station. At the same time, the computer terminal should integrate emergency response plans. When the alarm is triggered, it will automatically start or recommend corresponding emergency measures, including but not limited to shutting down or adjusting the operating parameters of the hydropower station, starting the emergency evacuation procedure, and mobilizing emergency resources. Although the computer terminal has an automatic early warning function, after the early warning is triggered, the relevant personnel should be notified immediately for manual review, especially at night or under extreme weather conditions. Manual review can ensure the accuracy of the early warning and avoid unnecessary emergency response.

[0065] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of each embodiment of the present application.

[0066] In this embodiment, a device for online monitoring of slope deformation of a hydropower station based on image recognition is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the equipment described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0067] Figure 6 : is a structural block diagram of an online monitoring device for slope deformation of a hydropower station based on image recognition according to an embodiment of the present application, the device comprising:

[0068] A first determination module 60 is used to determine, by image recognition technology, a first vector coordinate value of the hydropower station slope in a first slope picture captured at a first moment, wherein the first moment is the moment closest to the current moment, the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, and the first slope picture is regularly acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope;

[0069] A second determination module 62 is used to determine whether the first slope image and the second slope image captured at the initial moment are consistent when the second vector coordinate value of the hydropower station slope obtained by the sensor is consistent with the first vector coordinate value, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to represent the position of the hydropower station slope at the current moment;

[0070] A third determination module 64 is used to determine whether the first vector coordinate value exceeds a preset threshold when it is determined that the first slope image and the second slope image are inconsistent;

[0071] The start module 66 is used to start the alarm device of the slope of the hydropower station when the first vector coordinate value exceeds the preset threshold.

[0072] Through the above device, the first vector coordinate value of the hydropower station slope in the first slope picture captured at the first moment is determined by image recognition technology, wherein the first moment is the moment closest to the current moment, the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, and the first slope picture is regularly acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope; when the second vector coordinate value of the hydropower station slope acquired by the sensor is consistent with the first vector coordinate value, it is determined whether the first slope picture is consistent with the second slope picture captured at the initial moment, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to characterize the position of the hydropower station slope at the current moment; when it is determined that the first slope picture and the second slope picture are inconsistent, it is determined whether the first vector coordinate value exceeds a preset threshold; when the first vector coordinate value exceeds the preset threshold, the alarm device of the hydropower station slope is activated. Thus, the problem in the related art that, due to the small monitoring range of the sensor, only the sensor is used to determine whether the hydropower station slope is deformed, which easily leads to inaccurate monitoring is solved.

[0073] In an exemplary embodiment, the second determination module 62 is further configured to determine that the slope of the hydropower station has not been deformed when the first slope image and the second slope image are consistent.

[0074] In an exemplary embodiment, the first determination module 60 is also used to perform data cleaning on the first vector coordinate values, wherein the data cleaning includes: removing abnormal values ​​in the first vector coordinate values; removing duplicate values ​​in the first vector coordinate values; and converting the data format of the first vector coordinate values ​​into a target format.

[0075] In an exemplary embodiment, the startup module 66 is also used to generate a warning report based on the first vector coordinate value; encrypt the warning report, and transmit the encrypted warning report to the mobile device of the first target object that maintains the slope of the hydropower station through a secure transmission protocol to instruct the first target object to inspect the slope of the hydropower station.

[0076] In an exemplary embodiment, the startup module 66 is also used to obtain the maximum deformation area, deformation speed and deformation trend of the hydropower station slope; determine an evacuation path according to the maximum deformation area, the deformation speed and the deformation trend; and send the evacuation path to a mobile device of a second target object to instruct the second target object to stay away from the hydropower station slope, wherein the second target object is a target object located on the hydropower station slope.

[0077] In an exemplary embodiment, the first determination module 60 is further configured to obtain a current light intensity of the slope of the hydropower station; and to start a lighting device embedded in the image acquisition device when the current light intensity is lower than a preset value.

[0078] In an exemplary embodiment, the third determination module 64 is further configured to determine that the deformation of the slope of the hydropower station is within a normal range when the first vector coordinate value does not exceed a preset threshold.

[0079] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.

[0080] Optionally, in this embodiment, the storage medium may be configured to store a computer program for performing the following steps:

[0081] S1, determining a first vector coordinate value of the hydropower station slope in a first slope picture captured at a first moment by image recognition technology, wherein the first moment is the moment closest to the current moment, the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, and the first slope picture is regularly acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope;

[0082] S2, when the second vector coordinate value of the hydropower station slope obtained by the sensor is consistent with the first vector coordinate value, determining whether the first slope image and the second slope image captured at the initial moment are consistent, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to represent the position of the hydropower station slope at the current moment;

[0083] S3, when it is determined that the first slope image and the second slope image are inconsistent, determining whether the first vector coordinate value exceeds a preset threshold;

[0084] S4, when the first vector coordinate value exceeds the preset threshold, starting the alarm device of the hydropower station slope.

[0085] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.

[0086] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail herein.

[0087] An embodiment of the present application further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0088] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:

[0089] S1, determining a first vector coordinate value of the hydropower station slope in a first slope picture captured at a first moment by image recognition technology, wherein the first moment is the moment closest to the current moment, the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, and the first slope picture is regularly acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope;

[0090] S2, when the second vector coordinate value of the hydropower station slope obtained by the sensor is consistent with the first vector coordinate value, determining whether the first slope image and the second slope image captured at the initial moment are consistent, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to represent the position of the hydropower station slope at the current moment;

[0091] S3, when it is determined that the first slope image and the second slope image are inconsistent, determining whether the first vector coordinate value exceeds a preset threshold;

[0092] S4, when the first vector coordinate value exceeds the preset threshold, starting the alarm device of the hydropower station slope.

[0093] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0094] An embodiment of the present application further provides a computer program product, comprising a non-volatile computer-readable storage medium, wherein the non-volatile computer-readable storage medium stores a computer program product, and when the computer program is executed by a processor, the steps of the method described in each embodiment of the present application are implemented.

[0095] Optionally, in this embodiment, the above computer program may be configured to implement the following steps when executed by a processor:

[0096] S1, determining a first vector coordinate value of the hydropower station slope in a first slope picture captured at a first moment by image recognition technology, wherein the first moment is the moment closest to the current moment, the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, and the first slope picture is regularly acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope;

[0097] S2, when the second vector coordinate value of the hydropower station slope obtained by the sensor is consistent with the first vector coordinate value, determining whether the first slope image and the second slope image captured at the initial moment are consistent, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to represent the position of the hydropower station slope at the current moment;

[0098] S3, when it is determined that the first slope image and the second slope image are inconsistent, determining whether the first vector coordinate value exceeds a preset threshold;

[0099] S4, when the first vector coordinate value exceeds the preset threshold, starting the alarm device of the hydropower station slope.

[0100] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail herein.

[0101] Obviously, those skilled in the art should understand that the above modules or steps of the present application can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order from that herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present application is not limited to any specific combination of hardware and software.

[0102] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. An online monitoring method for slope deformation of a hydropower station based on image recognition, characterized in that: include: Determine, by image recognition technology, a first vector coordinate value of the hydropower station slope in a first slope picture captured at a first moment, wherein the first moment is the moment closest to the current moment, the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, the first slope picture is regularly acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope; In the case where the second vector coordinate value of the hydropower station slope obtained by the sensor is consistent with the first vector coordinate value, determining whether the first slope image is consistent with the second slope image captured at the initial moment, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to characterize the position of the hydropower station slope at the current moment; In the case where it is determined that the first slope image and the second slope image are inconsistent, determining whether the first vector coordinate value exceeds a preset threshold; When the first vector coordinate value exceeds the preset threshold, an alarm device of the hydropower station slope is activated.

2. The method for online monitoring of slope deformation of a hydropower station based on image recognition according to claim 1 is characterized in that: After determining whether the first slope image is consistent with the second slope image captured at the initial moment, the method further includes: When the first slope image and the second slope image are consistent, it is determined that the slope of the hydropower station has not been deformed.

3. The method for online monitoring of slope deformation of a hydropower station based on image recognition according to claim 1 is characterized in that: After determining the first vector coordinate value of the slope of the hydropower station in the first slope picture captured at the first moment by using the image recognition technology, the method further includes: The first vector coordinate value is subjected to data cleaning, wherein the data cleaning comprises: removing abnormal values ​​in the first vector coordinate values; removing duplicate values ​​in the first vector coordinate values; The data format of the first vector coordinate value is converted into a target format.

4. The method for online monitoring of slope deformation of a hydropower station based on image recognition according to claim 1 is characterized in that: After activating the alarm device of the hydropower station slope, the method further comprises: generating a warning report according to the first vector coordinate value; The early warning report is encrypted, and the encrypted early warning report is transmitted to a mobile device of a first target object maintaining the slope of the hydropower station through a secure transmission protocol, so as to instruct the first target object to inspect the slope of the hydropower station.

5. The method for online monitoring of slope deformation of a hydropower station based on image recognition according to claim 1 is characterized in that: After activating the alarm device of the hydropower station slope, the method further comprises: Obtaining the maximum deformation area, deformation speed and deformation trend of the hydropower station slope; An evacuation path is determined according to the maximum deformation area, the deformation speed and the deformation trend; and the evacuation path is sent to a mobile device of a second target object to instruct the second target object to stay away from the slope of the hydropower station, wherein the second target object is a target object located at the slope of the hydropower station.

6. The method for online monitoring of slope deformation of a hydropower station based on image recognition according to claim 1 is characterized in that: Before determining the first vector coordinate value of the hydropower station slope in the first slope picture captured at the first moment by using the image recognition technology, the method further includes: Obtaining the current light intensity of the slope of the hydropower station; When the current light intensity is lower than a preset value, the lighting device embedded in the image acquisition device is started.

7. The method for online monitoring of slope deformation of a hydropower station based on image recognition according to claim 1 is characterized in that: After determining whether the first vector coordinate value exceeds a preset threshold, the method further includes: if the first vector coordinate value does not exceed the preset threshold, determining that the deformation of the hydropower station slope is within a normal range.

8. An online monitoring device for slope deformation of a hydropower station based on image recognition, characterized in that: include: A first determination module is used to determine a first vector coordinate value of the hydropower station slope in a first slope picture captured at a first moment by using an image recognition technology, wherein the first moment is the moment closest to the current moment, the first vector coordinate value is used to characterize the position of the hydropower station slope at the first moment, and the first slope picture is regularly acquired by an image acquisition device, and the image acquisition device is installed on the hydropower station slope; A second determination module is used to determine whether the first slope image and the second slope image captured at the initial moment are consistent when the second vector coordinate value of the hydropower station slope obtained by the sensor is consistent with the first vector coordinate value, wherein the sensor is installed on the hydropower station slope, and the second vector coordinate value is used to characterize the position of the hydropower station slope at the current moment; A third determination module is used to determine whether the first vector coordinate value exceeds a preset threshold when it is determined that the first slope image and the second slope image are inconsistent; A starting module is used to start the alarm device of the slope of the hydropower station when the first vector coordinate value exceeds the preset threshold.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein the program executes the method according to any one of claims 1 to 7 when executed.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images