A method and system for detecting and alarming abnormality of equipment in a hydraulic engineering

Abstract

The application relates to a water conservancy engineering equipment abnormality detection and alarm method and system, and relates to the field of equipment measurement. The method comprises the following steps: acquiring water surface equipment geographic position information of a current construction node, video information of a water surface of the water surface equipment and angle data on the water surface equipment; generating a first position distribution diagram of the water surface equipment based on the geographic position information; generating a pitch angle change curve of the water surface equipment based on the angle data; determining a stable value of the water surface equipment based on the video information and the pitch angle change curve; judging whether the water surface equipment is abnormal based on the stable value, the first position distribution diagram and a second position distribution diagram of a preset water surface equipment corresponding to the water surface equipment; the preset water surface equipment is a water surface equipment having an associated cooperation relationship with the water surface equipment; and if there is a target water surface equipment, the target water surface equipment is controlled to send an alarm. The application realizes more timely and accurate abnormality detection, alarm and early warning of water surface construction equipment.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of equipment measurement, in particular to a device anomaly detection and alarm method and system in water conservancy projects. BACKGROUND

[0002] In water surface construction scenes such as water conservancy projects, many construction equipment such as excavators and cranes need to be controlled on the water surface. These construction equipment are usually fixed on platforms floating on the water surface. However, due to the complex water surface construction environment, these construction equipment may change imperceptibly, which may eventually cause the construction equipment to be abnormal, and further cause accidents such as overturning and collapse. At present, satellite remote sensing, unmanned aerial vehicles, and total station observation equipment are usually used to monitor the construction equipment in real time. However, these monitoring methods are relatively single and cannot achieve more accurate detection and early prediction of accidents. Therefore, how to realize more accurate anomaly detection and alarm warning of water surface construction equipment becomes a problem. SUMMARY

[0003] In order to realize more timely and accurate anomaly detection and alarm warning of water surface construction equipment, the present application provides a device anomaly detection and alarm method in water conservancy projects.

[0004] In the first aspect, the present application provides a device anomaly detection and alarm method in water conservancy projects, which adopts the following technical solution:

[0005] A device anomaly detection and alarm method in water conservancy projects, comprising:

[0006] Obtaining the geographical position information of each water surface equipment corresponding to the time change, the video information of the water surface of each water surface equipment, and the angle data collected by the angle sensor on each water surface equipment of the current construction node;

[0007] Generating a first position distribution map of each water surface equipment based on the geographical position information, and generating a pitch angle change curve of each water surface equipment based on the angle data;

[0008] Determining the stable value of each water surface equipment based on the video information and the pitch angle change curve;

[0009] Judging whether each water surface equipment is abnormal based on the stable value, the first position distribution map, and the second position distribution map of the preset water surface equipment corresponding to each water surface equipment, the preset water surface equipment being the water surface equipment having a correlation and cooperation relationship with each water surface equipment;

[0010] If there is a target water surface equipment, controlling the target water surface equipment to issue an alarm, the target water surface equipment being the abnormal water surface equipment.

[0011] By adopting the technical scheme, the position geographical position information of each water surface equipment changing over time is obtained, so that the position change of each water surface equipment is known, the position change represents the stability of the position change of the water surface equipment, the video information of the water surface is obtained, so that the subsequent analysis of the impact of the water flow on the water surface equipment is facilitated, the impact of the water flow on the water surface equipment also affects the stability of the water surface equipment, the angle data of the water surface equipment is obtained, the pitch change of the water surface equipment can be known through the angle data, and the stability is also represented, the first position distribution map is generated according to the geographical position information, and the pitch angle change curve is generated according to the angle data, therefore, the stability value of each water surface equipment running on the water surface can be more accurately determined according to the video information and the pitch angle change curve, the stability value can reflect whether the water surface equipment is abnormal and the possibility of an abnormality, each water surface equipment corresponds to a preset water surface equipment that cooperates with the water surface equipment, and the position relationship between the water surface equipment and the corresponding preset water surface equipment also affects whether the water surface equipment is abnormal, therefore, it is more accurate to comprehensively judge whether each water surface equipment is abnormal in combination with the stability value of each water surface equipment, the first position distribution map and the second position distribution map of the corresponding preset water surface equipment, if it is judged that the target water surface equipment is abnormal, the target water surface equipment is controlled to issue an alarm, and finally more accurate and timely abnormal detection and alarm warning of the water surface equipment are realized.

[0012] In another possible implementation manner, the determination of the stability value of each water surface equipment based on the video information and the pitch angle change curve comprises:

[0013] feature recognition is performed on each frame of image of the video information to obtain water surface ripples at the water surface of each water surface equipment;

[0014] the bending degree of the water surface ripples of each frame of image and the draught depth of the water surface equipment are determined;

[0015] the pitch angle value of the corresponding moment is determined from the pitch angle change curve based on the time point of each frame of image;

[0016] a first sub-stability value of each water surface equipment with respect to each frame of image is determined based on the bending degree of the water surface ripples of each frame of image, the draught depth and the pitch angle value of the corresponding moment;

[0017] a bending degree change graph is generated according to the bending degree corresponding to each frame of image, and a first variance of the bending degree change graph is calculated;

[0018] a second variance of the pitch angle change curve is calculated, and the stability value of each water surface equipment is determined based on the first sub-stability value of each frame of image, the first variance and the second variance.

[0019] In another possible implementation manner, the first sub-stability value of each water surface device with respect to each frame of image is determined based on the bending degree of the water surface ripples of the frame of image, the draft, and the pitch angle value at the corresponding moment, and the first sub-stability value of each water surface device with respect to each frame of image is determined by:

[0020] determining the angle difference value between the pitch angle value at the corresponding moment of each frame of image and the pitch angle value at the previous moment;

[0021] amplifying the angle difference value by a preset multiple to obtain an amplified angle difference value;

[0022] determining the product of the amplified angle difference value, the bending degree, and the draft to obtain the first sub-stability value corresponding to each frame of image.

[0023] In another possible implementation manner, each scatter point in the first position distribution map and the second position distribution map corresponds to a time point of position collection, and whether each water surface device is abnormal is determined based on the stability value, the first position distribution map, and the second position distribution map of the preset water surface device corresponding to each water surface device, and the determination comprises:

[0024] drawing a minimum circumscribed circle based on the scatter points in the first position distribution map, and each scatter point is a position information;

[0025] determining the radius of the minimum circumscribed circle, and taking the stability value as the base radius and the radius as the index to obtain a feature value of each water surface device with respect to the abnormal degree;

[0026] determining a target scatter point from the second position distribution map which is closest to the time point of each scatter point in the first position distribution map, and determining a plurality of scatter point pairs according to the scatter points and the target scatter point;

[0027] determining the distance between the scatter point and the target scatter point in each scatter point pair, and calculating the difference value between the distance and a preset distance;

[0028] connecting the scatter point and the target scatter point in each scatter point pair, and calculating the included angle between the connection line and a preset straight line;

[0029] determining a deviation value of each scatter point pair based on the difference value and the included angle of each scatter point pair;

[0030] calculating the average value of the deviation values, and calculating the abnormal score of each water surface device based on the feature value, the average value of the deviation values, and the respective corresponding weight;

[0031] determining whether each water surface device is abnormal based on the abnormal score.

[0032] In another possible implementation manner, the bending degree of the water surface ripples of each frame of image is determined by:

[0033] drawing a contour of the water ripples along a water ripples edge of each image frame, and smoothing the contour to obtain a smoothed contour;

[0034] determining a number of wave crests and wave troughs in the smoothed contour, and a distance between each adjacent wave crest and wave trough;

[0035] calculating a distance variance of all distances, and determining the degree of bending based on the number of wave crests and wave troughs and the distance variance.

[0036] In another possible implementation manner, each angle value in the pitch angle change curve corresponds to a tilt direction, and the method further includes:

[0037] determining a number of target pitch angle values corresponding to each target water surface device in each tilt direction, and determining a proportion of a number of target tilt angle values corresponding to each tilt direction;

[0038] determining a target pitch angle value reaching a preset angle threshold in each tilt direction, and calculating a pitch angle average value of the target pitch angle value;

[0039] determining an abnormal tilt direction based on the pitch angle average value, the proportion, and a respective corresponding coefficient;

[0040] controlling an indicator light in the abnormal tilt direction on each target water surface device to light up.

[0041] In another possible implementation manner, the controlling the target water surface device to issue an alarm includes:

[0042] controlling at least one of a buzzer, an indicator light, and a lower computer on the target water surface device to work to issue the alarm.

[0043] In another possible implementation manner, the method further includes:

[0044] if the target water surface device exists, controlling the target water surface device and a corresponding preset water surface device to stop running.

[0045] In a second aspect, the present application provides a device anomaly detection and alarm system in a water conservancy project, which adopts the following technical scheme:

[0046] A device anomaly detection and alarm system in a water conservancy project includes:

[0047] a data acquisition module configured to acquire geographical position information corresponding to each of a plurality of water surface devices in a current construction node varying with time, video information of a water-facing surface of each water surface device, and angle data collected by an angle sensor on each water surface device;

[0048] The generation module is used to generate a first location distribution map of each surface device based on the geographic location information, and to generate a pitch angle change curve of each surface device based on the angle data.

[0049] The stability value determination module is used to determine the stability value of each surface device based on the video information and the pitch angle change curve.

[0050] An anomaly detection module is used to determine whether each water surface device is abnormal based on the stable value, the first location distribution map, and the second location distribution map of the preset water surface devices corresponding to each water surface device. The preset water surface devices are water surface devices that have a cooperative relationship with each water surface device.

[0051] The first control module is used to control the target water surface device to issue an alarm when the target water surface device is present, wherein the target water surface device is an abnormal water surface device.

[0052] By adopting the above technical solution, the data acquisition module obtains the geographical location information of each water surface device over time, facilitating the understanding of the positional changes of each device. These positional changes characterize the stability of the device's position. The data acquisition module also acquires video information from the water-facing side to facilitate subsequent analysis of the water flow's impact on the devices, as this impact also affects their stability. Furthermore, the data acquisition module obtains angle data from the devices, allowing for the determination of their pitch and tilt changes, which also characterize stability. The generation module generates a first position distribution map based on the geographical location information and a pitch angle change curve based on the angle data. Therefore, the stability value determination module, based on the video information and the pitch angle change curve, can... The system more accurately determines the stable value of each surface device operating on the water surface. This stable value can reflect, to a certain extent, whether there is an anomaly in the surface device and the possibility of an impending anomaly. Each surface device corresponds to a preset surface device that works with it. The positional relationship between the surface device and the corresponding preset surface device also affects whether there is an anomaly in the surface device. Therefore, the anomaly judgment module combines the stable value of each surface device, the first position distribution map, and the second position distribution map of the corresponding preset surface device to make a more accurate judgment on whether there is an anomaly in each surface device. If an anomaly is detected in a target surface device, the first control module controls the target surface device to issue an alarm, ultimately achieving more accurate and timely anomaly detection, alarm, and early warning for the surface devices.

[0053] In another possible implementation, the stability value determination module, when determining the stability value of each surface device based on the video information and the pitch angle change curve, is specifically used for:

[0054] Feature recognition is performed on each frame of the video information to obtain the water surface ripples at the water-facing side of each water surface device;

[0055] determine a curvature degree of water ripples and a draft of the water surface equipment of each frame of image;

[0056] determine a pitch angle value of a corresponding time point from the pitch angle change curve based on a time point of each frame of image;

[0057] determine a first sub-stability value of each water surface equipment with respect to each frame of image based on the curvature degree of water ripples, the draft and the pitch angle value of the corresponding time point of each frame of image;

[0058] generate a curvature degree change graph according to the curvature degree corresponding to each frame of image, and calculate a first variance of the curvature degree change graph;

[0059] calculate a second variance of the pitch angle change curve, and determine a stability value of each water surface equipment based on the first sub-stability value of each frame of image, the first variance and the second variance.

[0060] In another possible implementation, when the stability value determination module determines the first sub-stability value of each water surface equipment with respect to each frame of image based on the curvature degree of water ripples, the draft and the pitch angle value of the corresponding time point of each frame of image, the stability value determination module is specifically configured to:

[0061] determine an angle difference value between the pitch angle value of the corresponding time point of each frame of image and a pitch angle value of a previous time point;

[0062] amplify the angle difference value by a preset multiple to obtain an amplified angle difference value;

[0063] determine a product of the amplified angle difference value, the curvature degree and the draft to obtain the first sub-stability value corresponding to each frame of image.

[0064] In another possible implementation, each scatter point in the first position distribution graph and the second position distribution graph corresponds to a time point of position collection, and when the anomaly judgment module judges whether each water surface equipment is abnormal based on the stability value, the first position distribution graph and the second position distribution graph corresponding to a preset water surface equipment of each water surface equipment, the anomaly judgment module is specifically configured to:

[0065] draw a minimum circumscribed circle based on the scatter points in the first position distribution graph, and each scatter point is a position information;

[0066] determine a radius of the minimum circumscribed circle, and take the stability value as a base radius and an index to obtain a feature value of each water surface equipment with respect to an abnormal degree;

[0067] determine a target scatter point from the second position distribution graph that is closest to a time point of each scatter point in the first position distribution graph, and determine a plurality of scatter point pairs according to the scatter points and the target scatter point.

[0068] determining a distance between the scatter point and the target scatter point in each scatter point pair, and calculating a difference between the distance and a preset distance;

[0069] connecting the scatter point and the target scatter point in each scatter point pair, and calculating an included angle between the connection line and a preset straight line;

[0070] determining a deviation value of each scatter point pair based on the difference and the included angle of each scatter point pair;

[0071] calculating a deviation value average of the deviation values, and calculating an anomaly score of each water surface device based on the characteristic value, the deviation value average, and respective corresponding weights;

[0072] judging whether each water surface device is abnormal based on the anomaly score.

[0073] In another possible implementation, when determining the bending degree of the water surface ripples of each frame of image, the stability value determination module is specifically configured to:

[0074] drawing a contour of the water surface ripples along the edge of the water surface ripples of each frame of image, and performing smoothing processing on the contour to obtain a smoothed contour;

[0075] determining the number of wave crests and wave troughs in the smoothed contour, and the distance between each adjacent wave crest and wave trough;

[0076] calculating a distance variance of all the distances, and determining the bending degree based on the number of wave crests and wave troughs and the distance variance.

[0077] In another possible implementation, each angle value in the pitch angle change curve corresponds to a tilt direction, and the water conservancy project device anomaly detection and alarm system further includes:

[0078] a first determination module configured to determine the number of target pitch angle values corresponding to each tilt direction of each target water surface device, and determine the proportion of the number of tilt angle values corresponding to each tilt direction;

[0079] a calculation module configured to determine the target pitch angle value reaching a preset angle threshold in each tilt direction, and calculate a pitch angle average value of the target pitch angle value;

[0080] a second determination module configured to determine an abnormal tilt direction based on the pitch angle average value, the proportion of the number, and respective corresponding coefficients;

[0081] a second control module configured to control an indicator light in the abnormal tilt direction on each target water surface device to light up.

[0082] In another possible implementation, when the first control module controls the target surface equipment to issue an alarm, it is specifically used for:

[0083] Control at least one of the buzzer, indicator light, and lower-level machine on the target surface equipment to issue an alarm.

[0084] In another possible implementation, the equipment anomaly detection and alarm system in a water conservancy project further includes:

[0085] The third control module is used to control the target water surface equipment and the corresponding preset water surface equipment to stop operating when the target water surface equipment is present.

[0086] Thirdly, this application provides an electronic device that adopts the following technical solution:

[0087] An electronic device comprising:

[0088] At least one processor;

[0089] Memory;

[0090] At least one application, wherein the at least one application is stored in memory and configured to be executed by at least one processor, the at least one configuration being for: executing a method for detecting and alarming equipment anomalies in a hydraulic engineering project, as shown in any possible implementation of the first aspect.

[0091] Fourthly, this application provides a computer-readable storage medium, which adopts the following technical solution:

[0092] A computer-readable storage medium, when the computer program is executed in a computer, causes the computer to perform the equipment anomaly detection and alarm method in a water conservancy project as described in any one of the first aspects.

[0093] In summary, this application includes at least one of the following beneficial technical effects:

[0094] The position geographical position information of each water surface equipment changing over time is obtained, so as to know the position change of each water surface equipment. The position change represents the stability of the position change of the water surface equipment. The video information of the water surface is obtained, so as to analyze the impact of the water flow on the water surface equipment. The impact of the water flow on the water surface equipment also affects the stability of the water surface equipment. The angle data of the water surface equipment is obtained. The pitch change of the water surface equipment can be known through the angle data, and the stability is also represented. The first position distribution map is generated according to the geographical position information, and the pitch angle change curve is generated according to the angle data. Therefore, the stability value of each water surface equipment running on the water surface can be more accurately determined according to the video information and the pitch angle change curve. The stability value can reflect whether the water surface equipment is abnormal and the possibility of the abnormality. Each water surface equipment corresponds to a preset water surface equipment that cooperates with the water surface equipment. The position relationship between the water surface equipment and the corresponding preset water surface equipment also affects whether the water surface equipment is abnormal. Therefore, it is more accurate to comprehensively judge whether each water surface equipment is abnormal by combining the stability value of each water surface equipment, the first position distribution map, and the second position distribution map of the corresponding preset water surface equipment. If it is judged that the target water surface equipment is abnormal, the target water surface equipment is controlled to issue an alarm. Finally, more accurate and timely abnormal detection and alarm warning of the water surface equipment are realized. BRIEF DESCRIPTION OF DRAWINGS

[0095] Figure 1 FIG. 1 is a flow diagram of a water conservancy equipment abnormality detection and alarm method according to an embodiment of the present application.

[0096] Figure 2 FIG. 2 is a structural diagram of a water conservancy equipment abnormality detection and alarm system according to an embodiment of the present application.

[0097] Figure 3 FIG. 3 is a structural diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0098] The present application will be further described below in conjunction with the drawings.

[0099] Those skilled in the art can make modifications to the present embodiments without creative contribution after reading the present specification, but as long as the modifications are within the scope of the claims of the present application, they are protected by the patent law.

[0100] To make the purpose, technical scheme and advantages of the embodiments of the present application more clear, the technical scheme of the embodiments of the present application will be clearly and completely described below in conjunction with the drawings of the embodiments of the present application. Obviously, the described embodiments are some embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative contribution are within the scope of protection of the present application.

[0101] In addition, the term "and / or" in this document is only a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can represent the following three cases: A exists alone, A and B exist together, and B exists alone. In addition, the character " / " in this document generally represents an "or" relationship between the front and rear associated objects unless otherwise specified.

[0102] The embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0103] The embodiments of the present application provide a device anomaly detection and alarm method in a water conservancy project, which is executed by an electronic device. The electronic device can be a server or a terminal device. The server can be a stand-alone physical server, a server cluster composed of multiple physical servers or a distributed system, or a cloud server providing cloud computing services. The terminal device can be a smart phone, a tablet computer, a notebook computer, a desktop computer, etc., but is not limited thereto. The terminal device and the server can be directly or indirectly connected through wired or wireless communication, and the embodiments of the present application do not limit this. As shown in the figure, the method comprises steps S101, S102, S103, S104 and S105, wherein, Figure 1

[0104] S101, acquiring time-varying geographical position information corresponding to each water surface device of a current construction node, video information of a water surface of each water surface device, and angle data collected by an angle sensor on each water surface device.

[0105] For the embodiments of the present application, a high-precision GPS positioning device can be installed on each water surface device or a water surface platform for placing the water surface device. Specifically, the high-precision GPS positioning device can be installed at the center position of the water surface device or the water surface platform, so that the collected geographical position information is more accurate. Each time the geographical position information is collected, the geographical position information corresponds to a collection time point. For different construction node links, different water surface devices need to be maintained at a specified position, so the local storage medium of the electronic device stores the preset position of each water surface device at each construction node.

[0106] ​The monitoring camera is installed on the side of each water surface device or water surface platform to collect the video information of the water surface. The angle sensor and three-axis accelerometer and other sensor devices are also installed on the water surface device or water surface platform to collect the pitching and the pitching direction of the water surface device, and each angle data corresponds to the collection time.

[0107] In S102, the first position distribution map of each water surface device is generated based on the geographic position information, and the pitching angle change curve of each water surface device is generated based on the angle data.

[0108] For the embodiment of the present application, the electronic device maps the geographic position information in the preset plane rectangular coordinate system to obtain the first position distribution map of each water surface device. Similarly, the electronic device maps the angle data in the preset plane rectangular coordinate system to obtain the pitching angle change curve. The position change and the angle change can be more intuitively known through the first position distribution map and the pitching angle change curve.

[0109] In S103, the stability value of each water surface device is determined based on the video information and the pitching angle change curve.

[0110] For the embodiment of the present application, the video information records the specific situation and the intensity of the water flow impacting the water surface device or water surface platform, and the pitching angle change curve records the tilting and shaking of the water surface device. The water flow impacting the water surface device affects the stability of the water surface device, and the pitching angle change of the water surface device also indicates the stability of the water surface device. Therefore, the electronic device can accurately determine the stability value of each water surface device by comprehensively analyzing the video information and the pitching angle change curve.

[0111] In S104, whether each water surface device is abnormal is judged based on the stability value, the first position distribution map, and the second position distribution map of the preset water surface device corresponding to each water surface device.

[0112] The preset water surface device is the water surface device having the associated and cooperative relationship with each water surface device.

[0113] For the embodiment of the present application, because different water surface devices cooperate with each other in the construction, there is a correlation and cooperation relationship, so whether an abnormality exists in a water surface device is related to the corresponding correlation and cooperation water surface device, that is, the preset water surface device. For example, one water surface device is a crane, and the corresponding preset water surface device is another crane, and the two cranes cooperate with each other to complete the construction. In order to complete the construction action or step that meets the construction standard and requirement, the position change between the two cranes needs to meet the requirement or standard, that is, the position change between the two water surface devices with correlation and cooperation also affects whether an abnormality exists in the water surface device, and the stability value of the water surface device also reflects whether an abnormality exists in the water surface device to some extent. Therefore, the electronic device can accurately determine whether an abnormality exists in each water surface device by combining the stability value of each water surface device, the first position distribution map and the second position distribution map of the preset water surface device.

[0114] In S105, if the target water surface device exists, the electronic device controls the target water surface device to issue an alarm.

[0115] In the embodiment of the present application, the target water surface device is the water surface device with an abnormality.

[0116] For the embodiment of the present application, if the electronic device determines that the water surface device with an abnormality exists, it means that the target water surface device has an abnormality and is likely to have an accident. Therefore, the electronic device sends an alarm signal to the target water surface device, and the target water surface device issues an alarm after receiving the alarm signal. For example, a buzzer, an indicator light or a lower machine in wireless communication with the electronic device is installed on each water surface device, and the electronic device controls at least one of the buzzer, the indicator light or the lower machine on the target water surface device to operate, thereby issuing an alarm, so that relevant personnel can intuitively know that the target water surface device has an abnormality and is likely to have an accident.

[0117] In one possible implementation of the embodiment of the present application, the stability value of each water surface device is determined based on the video information and the pitch angle change curve in S103, and specifically includes S1031 (not shown in the figure), S1032 (not shown in the figure), S1033 (not shown in the figure), S1034 (not shown in the figure), S1035 (not shown in the figure) and S1036 (not shown in the figure), wherein,

[0118] In S1031, feature recognition is performed on each frame of image of the video information to obtain the water surface ripples at the water surface of each water surface device.

[0119] For the embodiment of the present application, the electronic device decomposes the video information to obtain each frame of image, and then can perform denoising processing on each frame of image, performs gray scale transformation on each frame of image after the denoising processing to obtain a gray scale image, and then performs edge detection on the gray scale image, that is, obtains the water surface ripples generated by the water flow impacting the water surface device or the side of the water surface platform according to the position where the gray scale value occurs.

[0120] S1032, determine the bending degree of the water surface ripples and the draft of the water surface device of each frame of image.

[0121] For the embodiment of the present application, after the electronic device determines the water surface ripples, different manifestations of the water surface ripples correspond to the impact degree of the water flow on the water surface device or the water surface platform, and further affect the stability of the water surface device, therefore the electronic device analyzes the water surface ripples to obtain the bending degree of the water surface ripples, the greater the bending degree, the more intense the impact of the water flow, and the more unstable the water surface device. The staff can draw the draft mark on the side of the water surface device or the water surface platform, the electronic device performs feature recognition on the transition between the water surface and the water surface device in each frame of image to obtain the draft corresponding to each frame of image, the greater the draft, the higher the possibility of accidents such as sinking and overturning of the water surface device. After the electronic device determines the draft in all frames of image, the average value of all the drafts is obtained, and the average value is used to represent the draft of the water surface device. Further, each water surface device corresponds to a standard draft, and the electronic device can obtain the draft difference value by subtracting the standard draft from the actual draft, and the draft difference value is used to represent the draft, the greater the difference value, the greater the risk of accidents.

[0122] S1033, determine the pitch angle value at the corresponding time from the pitch angle change curve based on the time point of each frame of image.

[0123] For the embodiment of the present application, since the video information corresponds to the time span information of shooting, the electronic device can determine the time point corresponding to each frame of image, the electronic device determines the pitch angle value at the corresponding time from the pitch angle change curve according to the time point of each frame of image, so as to facilitate comprehensive analysis of the stability of the water surface device at each time.

[0124] S1034, determine the first sub-stability value of each water surface device with respect to each frame of image based on the bending degree of the water surface ripples, the draft, and the pitch angle value at the corresponding time of each frame of image.

[0125] For the embodiment of the present application, as summarized above, the bending degree of the water surface ripples, the draft of the water surface device, and the pitch angle at the corresponding time in each frame of image all affect the stability degree of each water surface device at the time point corresponding to each frame of image, therefore the electronic device can comprehensively determine the first sub-stability value at each time point according to the above three factors.

[0126] S1035, generate a bending degree change graph according to the bending degree corresponding to each frame of image, and calculate a first variance of the bending degree change graph.

[0127] For the embodiment of the present application, the electronic device maps the bending degree of the water surface ripple corresponding to each frame of image into a plane rectangular coordinate system in which the bending degree changes over time to obtain a bending degree change graph, and then calculates the first variance of the bending degree of each point in the bending degree change graph through the variance calculation formula. The first variance represents the stable deviation degree of the bending degree, and the greater the first variance, the more unstable the bending degree of the water surface ripple changes over time, and thus the more unstable the water surface device, and the higher the possibility of accidents.

[0128] S1036, calculate a second variance of the pitch angle change curve, and determine the stability value of each water surface device based on the first sub-stability value, the first variance and the second variance of each frame of image.

[0129] For the embodiment of the present application, the electronic device calculates the second variance of the angle data in the pitch angle change curve through the variance calculation formula. The greater the second variance, the more serious the shaking of the water surface device and the more unstable the water surface device. In summary, the first sub-stability value, the first variance and the second variance are all key factors affecting the stability value of each water surface device, and have different degrees of influence on the stability value. The electronic device can average all the first sub-stability values, and calculate the stability value of each water surface device using the average value, the first variance and the second variance. The staff can set respective coefficients corresponding to the average value of the first sub-stability value, the first variance and the second variance in advance and store them in the local storage medium in the electronic device. The electronic device calls the respective coefficients to perform weighted operation to obtain a value, which is the stability value of each water surface device. The stability value determined by the first sub-stability value, the first variance and the second variance is more accurate.

[0130] In one possible implementation of the embodiment of the present application, the first sub-stability value of each water surface device with respect to each frame of image is determined based on the bending degree of the water surface ripple, the draft depth and the pitch angle value at the corresponding time of each frame of image in step S1034, and specifically includes steps one, step two and step three, wherein,

[0131] Step one, determine the angle difference value between the pitch angle value at the corresponding time of each frame of image and the pitch angle value at the previous time.

[0132] For the embodiment of the present application, the electronic device obtains the angle difference value by subtracting the pitch angle value at the previous time from the pitch angle value at the time of each frame of image and taking the absolute value. The greater the angle difference value, the more intense the shaking change of the water surface device at the two times, and thus the more unstable the water surface device at the current time.

[0133] Step two, the angle difference is amplified by a preset multiple to obtain an amplified angle difference.

[0134] For the embodiment of the present application, the shaking range of the water surface equipment is small, resulting in a small angle difference. Therefore, in order to facilitate calculation, the electronic device stores a preset multiple, such as 5 times, 10 times, etc. The electronic device multiplies the determined angle difference by the preset multiple to obtain the amplified angle difference.

[0135] Step three, the product of the amplified angle difference, the bending degree and the draft depth is determined to obtain a first sub-stability value corresponding to each frame of image.

[0136] For the embodiment of the present application, as described above, the amplified angle difference, the bending degree and the draft depth are all key factors reflecting the stability of the water surface equipment at the same time. The electronic device multiplies the above three factors to obtain a value, which is the first sub-stability value. The first sub-stability value considers the superimposed influence of the angle difference, the bending degree and the draft depth at the same time, so the first sub-stability value is more accurate.

[0137] In one possible implementation of the embodiment of the present application, each scatter point in the first position distribution map and the second position distribution map corresponds to a time point of position collection. In step S104, whether each water surface equipment is abnormal is determined based on the stability value, the first position distribution map and the second position distribution map of the preset water surface equipment corresponding to each water surface equipment, and specifically includes steps S1041 (not shown in the figure), S1042 (not shown in the figure), S1043 (not shown in the figure), S1044 (not shown in the figure), S1045 (not shown in the figure), S1046 (not shown in the figure), S1047 (not shown in the figure) and S1048 (not shown in the figure), wherein,

[0138] S1041, a minimum circumscribed circle is drawn based on the scatter points in the first position distribution map, and each scatter point is a position information.

[0139] For the embodiment of the present application, the electronic device can calculate the minimum circumscribed circle of the first position distribution map by using the Welzl algorithm. The algorithm traverses each scatter point. If the current point is not in the current minimum circle, the point is taken as a new boundary point, the minimum circle is recalculated, the remaining points are processed recursively, and the minimum circle is gradually expanded. When all points are in the current circle, the circle is returned.

[0140] S1042, the radius of the minimum circumscribed circle is determined, and the feature value of each water surface equipment with respect to the abnormal degree is obtained by taking the stability value as the base radius and the index.

[0141] For the embodiment of the present application, the electronic device determines the radius of the minimum circumscribed circle after determining the minimum circumscribed circle. The greater the radius, the greater the area of the minimum circumscribed circle, and the more extensive the position distribution of the water surface device, the more frequent the position change, the more unstable the water surface device, and the greater the possibility of abnormality. Both the stability value and the radius are factors that affect whether the water surface device has an abnormality. The stability value represents the degree of abnormality through the specific manifestations of the shaking and water impact of the water surface device itself, and the radius represents the degree of abnormality through the position change of the water surface device. Therefore, the electronic device calculates the characteristic value of each water surface device with respect to the degree of abnormality by taking the stability value as the base and the radius as the exponent, and the characteristic value obtained through the above calculation makes the characteristic values of different water surface devices more specific and consistent with their own situations.

[0142] S1043, determining a target scatter point closest in time to each scatter point in the first position distribution map from the second position distribution map, and determining a plurality of scatter point pairs according to the scatter point and the target scatter point.

[0143] For the embodiment of the present application, the electronic device subtracts the time point of each scatter point in the second position distribution map from the time point corresponding to each scatter point in the first position distribution map, thereby determining a target scatter point closest in time to each scatter point in the first position distribution map, and determining the scatter point and the target scatter point that meet this condition as a scatter point pair. Whether the water surface device has an abnormality is also related to the position relationship with the corresponding preset water surface device at the same time, so the electronic device determines such scatter point pairs, and subsequent analysis through the scatter point pairs is more convenient.

[0144] S1044, determining the distance between the scatter point and the target scatter point in each scatter point pair, and calculating the difference between the distance and the preset distance.

[0145] For the embodiment of the present application, since the position information of the scatter point is composed of longitude and latitude, the electronic device can calculate the distance between the scatter point and the target scatter point in each scatter point pair through the distance formula between two points. In different construction nodes, the position relationship between the water surface device and the preset water surface device needs to meet the construction requirements and standards of the corresponding node. Therefore, the position relationship between the water surface device and the preset water surface device cannot deviate from the requirements and standards. The requirements and standards of the position relationship include distance and angle, so the electronic device stores the preset distance between the water surface device and the preset water surface device set by the worker, and then subtracts the preset distance from the distance between the scatter point and the target scatter point to obtain a difference value. The greater the difference value, the more serious the deviation of the distance between the two water surface devices from the preset distance, and the higher the possibility of abnormality of the water surface device.

[0146] S1045, connecting the scatter point and the target scatter point in each scatter point pair, and calculating the included angle between the connection line and the preset straight line.

[0147] For the embodiment of the present application, the electronic device draws a straight line through the scatter point of each scatter point pair and the target scatter point, and maps the straight line with the preset straight line, and then the included angle between the connecting line and the preset straight line can be calculated. The larger the included angle, the more serious the position deviation between the two water surface devices, and the higher the possibility of abnormality of the water surface device. The preset straight line is the straight line obtained by connecting the standard positions of the water surface device and the preset water surface device at the current construction node.

[0148] S1046, determine the deviation value of each scatter point pair based on the difference value and the included angle of each scatter point pair.

[0149] For the embodiment of the present application, in summary, both the difference value about distance and the included angle about position are key factors affecting whether the water surface device is abnormal, so the staff can set and store respective corresponding weights for the difference value of distance and the included angle of position, for example, the weight of the difference value of distance is 0.6, and the weight of the included angle is 0.4. The electronic device calls the respective corresponding weights to perform weighted operation on the difference value of distance and the included angle to obtain the deviation value about each scatter point pair.

[0150] S1047, calculate the average value of the deviation value, and calculate the abnormal score of each water surface device based on the characteristic value, the average value of the deviation value, and the respective corresponding weights.

[0151] For the embodiment of the present application, the electronic device calculates the average value of the deviation values of all scatter point pairs by using the average value calculation formula, that is, the average value of the deviation value, which is more accurate and practical to represent the overall deviation degree between each water surface device and the preset water surface device. In summary, both the characteristic value of the water surface device and the average value of the deviation value are key factors affecting whether the water surface device is abnormal, and the influence degree is different. The staff sets and stores respective corresponding weights for the characteristic value and the average value of the deviation value in the electronic device, and the electronic device calls the respective corresponding weights to perform weighted operation to obtain the abnormal score of each water surface device. Quantifying the abnormal degree of the water surface device through the abnormal score is more intuitive.

[0152] S1048, determine whether each water surface device is abnormal based on the abnormal score.

[0153] For the embodiment of the present application, the electronic device can store a preset anomaly score threshold value, which is used as a demarcation point for determining whether the anomaly score is too high. The electronic device compares the anomaly score of each water surface device with the preset anomaly score threshold value. If the anomaly score of a water surface device reaches the preset anomaly score threshold value, it is determined that the water surface device has an anomaly and a high possibility of an accident. Therefore, the electronic device determines the water surface device as a target water surface device. If the preset anomaly score threshold value is not reached, it is indicated that the anomaly degree is acceptable, and the water surface device is normal and safe. The determination of whether there is an anomaly based on the characteristic value and the average value of the position deviation value of each water surface device is more accurate.

[0154] In one possible implementation of the embodiment of the present application, the step S1032 of determining the bending degree of the water surface ripples of each frame of image includes steps Sa (not shown in the figure), Sb (not shown in the figure), and Sc (not shown in the figure), wherein,

[0155] Sa, the contour of the water surface ripples is drawn along the edge of the water surface ripples of each frame of image, and the contour is smoothed to obtain a smoothed contour.

[0156] For the embodiment of the present application, the electronic device can segment the gray-scale image corresponding to each frame of image to obtain the water surface ripple contour of each frame of image. Then, the electronic device can input the water surface ripple contour into the Origin plug-in for smoothing to obtain a smoothed contour. The smoothed contour is a curve composed of multiple peaks and valleys.

[0157] Sb, the number of peaks and valleys in the smoothed contour is determined, and the distance between each adjacent peak and valley is determined.

[0158] For the embodiment of the present application, the electronic device counts the number of peaks and valleys in each frame of image. The more the number of peaks and valleys, the more serious the impact of the water flow on the water surface device or the water surface platform, the more unstable the water surface device, and the greater the bending degree of the water surface ripples. In addition, the electronic device calculates the distance between adjacent peaks and valleys. The analysis of the distance can also determine the bending degree of the water surface ripples to a certain extent.

[0159] Sc, the distance variance of all distances is calculated, and the bending degree is determined based on the number of peaks and valleys and the distance variance.

[0160] For the embodiment of the present application, the electronic device calculates the distance variance between all the wave crests and adjacent wave troughs by using the distance variance calculation formula. The greater the distance variance, the more chaotic and irregular the ripples, and the higher the degree of bending. In summary, the number of wave crests and wave troughs and the distance variance are both key factors affecting the bending degree of water surface ripples. The coefficients of these two factors are set and stored, and the electronic device calls the respective coefficients for weighted operation to obtain a numerical value, which can represent the bending degree of water surface ripples in each frame of image. The number of wave crests and wave troughs is obtained by smoothing the water surface ripples, and the bending degree of water surface ripples determined by comprehensive analysis of the number of wave crests and wave troughs and the distance between wave crests and adjacent wave troughs is more intuitive and accurate.

[0161] In a possible implementation of the embodiment of the present application, each angle value in the pitch angle change curve corresponds to a tilt direction. After step S105, the method further includes step S106 (not shown in the figure), step S107 (not shown in the figure), step S108 (not shown in the figure), and step S109 (not shown in the figure), wherein,

[0162] In step S106, the number of pitch angle values corresponding to each target water surface device in each tilt direction is determined, and the proportion of the number of pitch angle values corresponding to each tilt direction is determined.

[0163] For the embodiment of the present application, a three-axis accelerometer is installed on the water surface device or water surface platform, so the number of pitch angle values of each target water surface device in each tilt direction can be determined according to the data of the three-axis accelerometer. The tilt direction can be divided into four, such as east, west, south, and north. Each tilt direction corresponds to a certain range of angles in the 360-degree horizontal plane. After the pitch angle value falls within the angle range corresponding to the tilt direction, the number of pitch angle values in each tilt direction can be determined. Then, the number of pitch angle values is divided by the total number of pitch angle values in the tilt direction to obtain the proportion of the number. The greater the proportion of the number, the more the target water surface device prefers to tilt and sway in that direction.

[0164] In step S107, the target pitch angle value reaching the preset angle threshold in each tilt direction is determined, and the average value of the pitch angle of the target pitch angle value is calculated.

[0165] For the embodiment of the present application, the preset angle threshold is used as a demarcation point for excessive tilt and sway. The electronic device compares the pitch angle value in each tilt direction with the preset angle threshold to filter out the target pitch angle value reaching the preset angle threshold. Then, the average value of the pitch angle of the target pitch angle value is calculated. The greater the average value of the pitch angle corresponding to a certain tilt direction, the greater the sway amplitude in the tilt direction, and the greater the possibility of abnormal failure in that direction of the water surface device or water surface platform.

[0166] S108, determine the abnormal tilt direction based on the pitch angle average value, the quantity proportion, and the respective corresponding coefficients.

[0167] For the embodiment of the present application, the pitch angle value average value and the quantity proportion are both key factors affecting the existence of abnormalities or faults of the water surface equipment in each tilt direction, and the relevant personnel set respective corresponding coefficients for the pitch angle value and the quantity proportion and store them in the electronic device. The electronic device can obtain a score by performing weighted operation on the pitch angle average value and the quantity proportion by using the respective corresponding coefficients. The electronic device compares the scores corresponding to all the tilt directions, and the tilt direction with the maximum score is the abnormal tilt direction.

[0168] S109, control the indicator light in the abnormal tilt direction on each target water surface equipment to be turned on.

[0169] For the embodiment of the present application, the worker can install one or more indicator lights in each tilt direction on the water surface equipment or the water surface platform in advance. When the abnormal tilt direction of each target water surface equipment is determined, the electronic device sends a control signal to the target water surface equipment. After receiving the control signal, the target water surface equipment can control the indicator light in the abnormal tilt direction to be turned on according to the control signal, so that the relevant personnel can know the area and direction where the abnormality or fault is most likely to occur, and then the relevant personnel can preferentially maintain the area and direction, so as to preferentially find the abnormality or fault and improve the maintenance efficiency.

[0170] In one possible implementation manner of the embodiment of the present application, after step S104, step S110 (not shown in the figure) is further included, wherein,

[0171] S110, if there is a target water surface equipment, control the target water surface equipment and the corresponding preset water surface equipment to stop running.

[0172] For the embodiment of the present application, after the electronic device determines that there is a target water surface equipment, the electronic device sends a control signal to the target water surface equipment and the corresponding preset water surface equipment respectively, so that the target water surface equipment and the preset water surface equipment stop running, further reducing the possibility of accidents and improving the construction safety.

[0173] The above embodiment introduces a device abnormality detection and alarm method in a water conservancy project from the perspective of method flow. The following embodiment introduces a device abnormality detection and alarm system 20 in a water conservancy project from the perspective of virtual module or virtual unit. For details, please refer to the following embodiment.

[0174] The embodiment of the present application provides a device abnormality detection and alarm system 20 in a water conservancy project, as shown in Figure 2 The device abnormality detection and alarm system 20 in a water conservancy project can specifically include:

[0175] The data acquisition module 201 is configured to acquire time-varying geographical position information corresponding to each of a plurality of water surface devices of a current construction node, video information of a water surface of each water surface device, and angle data collected by an angle sensor on each water surface device.

[0176] The generation module 202 is configured to generate a first position distribution map of each water surface device based on the geographical position information, and generate a pitch angle change curve of each water surface device based on the angle data.

[0177] The stable value determination module 203 is configured to determine a stable value of each water surface device based on the video information and the pitch angle change curve.

[0178] The anomaly judgment module 204 is configured to judge whether each water surface device has an anomaly based on the stable value, the first position distribution map, and a second position distribution map of a preset water surface device corresponding to each water surface device, the preset water surface device being a water surface device having an associated cooperative relationship with each water surface device.

[0179] The first control module 205 is configured to control a target water surface device to issue an alarm when the target water surface device exists, the target water surface device being an abnormal water surface device.

[0180] The embodiment of the application discloses a device abnormality detection alarm system 20 in a water conservancy project, wherein a data acquisition module 201 acquires position geographical position information of each water surface device changing with time, so as to know the position change condition of each water surface device; the position change condition represents the stability of the position change of the water surface device; the data acquisition module 201 acquires video information of a water-facing surface, so as to facilitate subsequent analysis of the impact of the water flow on the water surface device; the impact of the water flow on the water surface device also affects the stability of the water surface device; the data acquisition module 201 acquires angle data of the water surface device; the pitch change of the water surface device can be known through the angle data, and the stability is also represented; a generation module 202 generates a first position distribution map according to the geographical position information and generates a pitch angle change curve according to the angle data; therefore, a stability value determination module 203 can more accurately determine the stability value of each water surface device running on the water surface according to the video information and the pitch angle change curve; the stability value can reflect whether the water surface device is abnormal and the possibility of an imminent abnormality to a certain extent; each water surface device corresponds to a preset water surface device that cooperates with the water surface device; the position relationship between the water surface device and the corresponding preset water surface device also affects whether the water surface device is abnormal; therefore, an abnormality judgment module 204 combines the stability value of each water surface device, the first position distribution map and a second position distribution map of the corresponding preset water surface device to comprehensively judge whether each water surface device is abnormal, which is more accurate; if it is judged that a target water surface device is abnormal, a first control module 205 controls the target water surface device to issue an alarm, and finally realizes more accurate and timely abnormality detection alarm warning of the water surface device.

[0181] In another possible implementation, when determining the stability value of each water surface device based on the video information and the pitch angle change curve, the stability value determination module 203 is specifically used for:

[0182] performing feature recognition on each frame of image of the video information to obtain water surface ripples at a water-facing surface of each water surface device;

[0183] determining a bending degree of the water surface ripples of each frame of image and a draught depth of the water surface device;

[0184] determining a pitch angle value at a corresponding moment from the pitch angle change curve based on a time point of each frame of image;

[0185] determining a first sub-stability value of each water surface device with respect to each frame of image based on the bending degree of the water surface ripples of each frame of image, the draught depth and the pitch angle value at the corresponding moment;

[0186] generating a bending degree change map according to the bending degree corresponding to each frame of image, and calculating a first variance of the bending degree change map;

[0187] The second variance of the pitch angle change curve is calculated, and a stability value of each water surface device is determined based on the first sub-stability value, the first variance and the second variance of each frame of image.

[0188] In a possible implementation of the embodiments of the present application, when the stability value determination module 203 determines the first sub-stability value of each water surface device with respect to each frame of image based on the bending degree of the water surface ripples of each frame of image, the draft and the pitch angle value at the corresponding moment, the stability value determination module 203 is specifically configured to:

[0189] determine the angle difference value between the pitch angle value at the corresponding moment of each frame of image and the pitch angle value at the previous moment;

[0190] amplify the angle difference value by a preset multiple to obtain an amplified angle difference value;

[0191] determine the product of the amplified angle difference value, the bending degree and the draft to obtain the first sub-stability value corresponding to each frame of image.

[0192] In a possible implementation of the embodiments of the present application, each scatter point in the first position distribution map and the second position distribution map corresponds to a time point of position collection, and when the anomaly judgment module 204 judges whether each water surface device is abnormal based on the stability value, the first position distribution map and the second position distribution map corresponding to the preset water surface device of each water surface device, the anomaly judgment module 204 is specifically configured to:

[0193] draw a minimum circumscribed circle based on the scatter points in the first position distribution map, and each scatter point is a position information;

[0194] determine the radius of the minimum circumscribed circle, and take the stability value as the base and the radius as the exponent to obtain the feature value of each water surface device with respect to the abnormal degree;

[0195] determine the target scatter point closest to the time point of each scatter point in the first position distribution map from the second position distribution map, and determine a plurality of scatter point pairs according to the scatter points and the target scatter points;

[0196] determine the distance between the scatter points and the target scatter points in each scatter point pair, and calculate the difference value between the distance and the preset distance;

[0197] connect the scatter points and the target scatter points in each scatter point pair, and calculate the included angle between the connection line and the preset straight line;

[0198] determine the deviation value of each scatter point pair based on the difference value and the included angle of each scatter point pair;

[0199] calculate the average value of the deviation value, and calculate the abnormal score of each water surface device based on the feature value, the average value of the deviation value and the respective corresponding weight;

[0200] judge whether each water surface device is abnormal based on the abnormal score.

[0201] In a possible implementation of the embodiments of the present application, the stability value determination module 203 is specifically configured to:

[0202] draw a contour of the water surface ripples along the edges of the water surface ripples of each frame of image, and perform smoothing processing on the contour to obtain a smoothed contour;

[0203] determine the number of wave crests and wave troughs in the smoothed contour, and the distance between each adjacent wave crest and wave trough;

[0204] calculate the distance variance of all distances, and determine the bending degree based on the number of wave crests and wave troughs and the distance variance.

[0205] In a possible implementation of the embodiments of the present application, each angle value in the pitch angle change curve corresponds to a tilt direction, and the water conservancy project equipment abnormality detection alarm system 20 further includes:

[0206] a first determination module configured to determine the number of target water surface equipment corresponding pitch angle values in each tilt direction, and determine the proportion of the number of target water surface equipment corresponding pitch angle values in each tilt direction;

[0207] a calculation module configured to determine the target pitch angle value reaching the preset angle threshold in each tilt direction, and calculate the average value of the target pitch angle value;

[0208] a second determination module configured to determine the abnormal tilt direction based on the average value of the pitch angle, the proportion of the number, and the respective corresponding coefficients;

[0209] a second control module configured to control the indicator light in the abnormal tilt direction on each target water surface equipment to light up.

[0210] In a possible implementation of the embodiments of the present application, the first control module 205 is specifically configured to:

[0211] control at least one of the buzzer, the indicator light and the lower computer on the target water surface equipment to issue an alarm.

[0212] In a possible implementation of the embodiments of the present application, the water conservancy project equipment abnormality detection alarm system 20 further includes:

[0213] a third control module configured to control the target water surface equipment and the corresponding preset water surface equipment to stop running when the target water surface equipment exists.

[0214] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the device anomaly detection alarm system 20 in the water conservancy project described above can refer to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0215] An electronic device is provided in the embodiments of the present application, as shown in Figure 3 Figure 3 The electronic device 30 shown in the figure includes a processor 301 and a memory 303. The processor 301 and the memory 303 are connected, such as through a bus 302. Optionally, the electronic device 30 can also include a transceiver 304. It should be noted that the transceiver 304 is not limited to one in actual application, and the structure of the electronic device 30 does not constitute a limitation on the embodiments of the present application.

[0216] The processor 301 can be a CPU (Central Processing Unit, central processor), a general-purpose processor, a DSP (Digital Signal Processor, data signal processor), an ASIC (Application Specific Integrated Circuit, application specific integrated circuit), an FPGA (Field Programmable Gate Array, field programmable gate array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can realize or execute various exemplary logical blocks, modules and circuits described in combination with the disclosure content of the present application. The processor 301 can also be a combination of computing functions, such as one or more microprocessor combinations, combinations of DSP and microprocessor, etc.

[0217] The bus 302 can include a channel for transmitting information between the above-mentioned components. The bus 302 can be a PCI (Peripheral Component Interconnect, peripheral component interconnect) bus or an EISA (Extended Industry Standard Architecture, extended industry standard architecture) bus, etc. The bus 302 can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, Figure 3 In the figure, only one thick line is used to represent the bus, but it does not mean that there is only one bus or one type of bus.

[0218] ​The memory 303 can be a ROM (Read Only Memory) or other type of static storage device that can store static information and instructions, a RAM (Random Access Memory) or other type of dynamic storage device that can store information and instructions, an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto.

[0219] The memory 303 is configured to store application program codes for implementing the solutions of the present application, and the processor 301 is configured to control the execution of the application program codes. The processor 301 is configured to execute the application program codes stored in the memory 303 to implement the content shown in the foregoing method embodiments.

[0220] The electronic device includes, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet Personal Computer), a PMP (Portable Multimedia Player), a car terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. It can also be a server or the like. Figure 3 The electronic device shown is merely an example, and should not bring any limitation to the functions and use range of the embodiments of the present application.

[0221] The computer readable storage medium provided in the embodiment of the present application stores a computer program, and when the computer program runs on a computer, the computer can execute the corresponding content in the foregoing method embodiment. Compared with the related art, the position geographical position information of each water surface device changing over time is obtained in the embodiment of the present application, which facilitates knowing the position change of each water surface device. The position change represents the stability of the position change of the water surface device. The video information of the water surface is obtained, which facilitates subsequent analysis of the impact of the water flow on the water surface device. The impact of the water flow on the water surface device also affects the stability of the water surface device. The angle data of the water surface device is obtained. The pitch change of the water surface device can be known through the angle data, which also represents the stability. The first position distribution map is generated according to the geographical position information, and the pitch angle change curve is generated according to the angle data. Therefore, the stability value of each water surface device running on the water surface can be more accurately determined according to the video information and the pitch angle change curve. The stability value can reflect whether the water surface device has an anomaly and the possibility of an anomaly. Each water surface device corresponds to a preset water surface device that cooperates with the water surface device. The position relationship between the water surface device and the corresponding preset water surface device also affects whether the water surface device has an anomaly. Therefore, it is more accurate to comprehensively judge whether each water surface device has an anomaly by combining the stability value of each water surface device, the first position distribution map, and the second position distribution map of the corresponding preset water surface device. If it is judged that the target water surface device has an anomaly, the target water surface device is controlled to issue an alarm. Ultimately, more accurate and timely anomaly detection and alarm warning of the water surface device are realized.

[0222] It should be understood that, although each step in the flowchart of the accompanying drawings is shown in sequence according to the direction of the arrow, these steps are not necessarily executed in sequence according to the direction of the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and they can be executed in other sequences. Moreover, at least part of the steps in the flowchart of the accompanying drawings can include multiple sub-steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times. The execution sequence of these sub-steps or stages is not necessarily sequential, but can be executed in rotation or alternation with at least part of other steps or sub-steps or stages of other steps.

[0223] The above only describes some embodiments of the present application. It should be pointed out that, for ordinary skilled persons in the technical field, some improvements and refinements can be made without departing from the principles of the present application. These improvements and refinements should also be considered as the protection scope of the present application.

Claims

1. A method for detecting and alarming equipment malfunctions in water conservancy projects, characterized in that, include: Obtain the time-varying geographical location information of each of the multiple surface equipment at the current construction node, the video information of the water-facing side of each surface equipment, and the angle data collected by the angle sensor on each surface equipment; A first location distribution map of each surface device is generated based on the geographical location information, and a pitch angle change curve of each surface device is generated based on the angle data. The stability value of each surface device is determined based on the video information and the pitch angle change curve. Based on the stable value, the first location distribution map, and the second location distribution map of the preset water surface equipment corresponding to each water surface equipment, it is determined whether each water surface equipment is abnormal. The preset water surface equipment is the water surface equipment that has a cooperative relationship with each water surface equipment. If a target surface device is present, control the target surface device to issue an alarm, indicating that the target surface device is an abnormal surface device; The determination of the stable value of each surface device based on the video information and the pitch angle change curve includes: Feature recognition is performed on each frame of the video information to obtain the water surface ripples at the water-facing side of each water surface device; Determine the curvature of the water surface ripples and the draft of the water surface equipment in each frame of the image; The pitch angle value at the corresponding moment is determined from the pitch angle change curve based on the time point of each frame image. The first sub-stability value of each surface device is determined based on the curvature of the water surface ripples, the draft, and the pitch angle value at the corresponding moment in each frame of the image. A curvature variation map is generated based on the curvature corresponding to each frame of the image, and the first variance of the curvature variation map is calculated. Calculate the second variance of the pitch angle change curve, and determine the stability value of each surface device based on the first sub-stabilized value, the first variance, and the second variance of each frame image; Each scatter point in the first and second location distribution maps corresponds to a location acquisition time point. The step of determining whether each surface device is abnormal based on the stable value, the first location distribution map, and the second location distribution map of the preset surface devices for each device includes: Draw the minimum circumcircle based on the scattered points in the first location distribution map, with each scattered point representing a location information; Determine the radius of the minimum circumcircle, and obtain the characteristic value of each surface device with respect to the degree of anomaly using the stable value as the base radius as the exponent; From the second location distribution map, determine the target scatter point that is closest to the time point of each scatter point in the first location distribution map, and determine multiple scatter point pairs based on the scatter points and the target scatter points; Determine the distance between the center point and the target point in each scatter point pair, and calculate the difference between the distance and the preset distance; Connect the scattered points in each scatter point pair to the target scattered point, and calculate the angle between the connecting line and the preset straight line; The deviation value of each scatter point pair is determined based on the difference and the included angle of each scatter point pair; Calculate the average deviation value of the deviation values, and calculate the anomaly score of each surface device based on the feature value, the average deviation value, and their respective weights; The anomaly score is used to determine whether each surface device is abnormal.

2. The method for detecting and alarming equipment anomalies in a water conservancy project according to claim 1, characterized in that, The determination of the first sub-stabilized value for each surface device with respect to each frame of image based on the curvature of the water surface ripples, the draft, and the corresponding pitch angle value at each moment includes: Determine the angle difference between the pitch angle value at the corresponding moment of each frame and the pitch angle value at the previous moment; The angle difference is amplified by a preset factor to obtain the amplified angle difference; The first sub-stabilized value corresponding to each frame of the image is obtained by multiplying the magnified angle difference, the degree of curvature, and the draft.

3. The method for detecting and alarming equipment anomalies in water conservancy projects according to claim 1, characterized in that, Determining the curvature of the water ripples in each frame of the image includes: Draw the outline of the water ripples along the edge of the water ripples in each frame of the image, and smooth the outline to obtain a smooth outline. Determine the number of peaks and troughs in the smooth profile, and the distance between each adjacent peak and trough; Calculate the distance variance for the entire distance, and determine the degree of curvature based on the number of peaks and troughs and the distance variance.

4. The method for detecting and alarming equipment anomalies in water conservancy projects according to claim 1, characterized in that, Each angle value in the pitch angle variation curve corresponds to a tilt direction, and the method further includes: Determine the number of pitch angle values ​​corresponding to each target surface equipment in each tilt direction, and determine the proportion of the number of tilt angle values ​​corresponding to each tilt direction; Determine the target pitch angle value that reaches the preset angle threshold in each tilt direction, and calculate the average pitch angle value of the target pitch angle values; The abnormal tilt direction is determined based on the average pitch angle, the proportion of the number of pitch angles, and their respective coefficients. The indicator light on each target surface device illuminates in the direction of the abnormal tilt.

5. The method for detecting and alarming equipment anomalies in a water conservancy project according to claim 1, characterized in that, The control of the target surface equipment to issue an alarm includes: Control at least one of the buzzer, indicator light, and lower-level machine on the target surface equipment to issue an alarm.

6. The method for detecting and alarming equipment anomalies in a water conservancy project according to claim 1, characterized in that, The method further includes: If the target water surface device exists, then control the target water surface device and the corresponding preset water surface device to stop operating.

7. A system for detecting and alarming abnormal equipment in water conservancy projects, characterized in that, include: The data acquisition module is used to acquire the time-varying geographical location information of each of the multiple water surface devices at the current construction node, the video information of the water-facing side of each water surface device, and the angle data collected by the angle sensor on each water surface device. The generation module is used to generate a first location distribution map of each surface device based on the geographic location information, and to generate a pitch angle change curve of each surface device based on the angle data. The stability value determination module is used to determine the stability value of each surface device based on the video information and the pitch angle change curve. An anomaly detection module is used to determine whether each water surface device is abnormal based on the stable value, the first location distribution map, and the second location distribution map of the preset water surface devices corresponding to each water surface device. The preset water surface devices are water surface devices that have a cooperative relationship with each water surface device. The first control module is used to control the target surface equipment to issue an alarm when the target surface equipment is present, wherein the target surface equipment is an abnormal surface equipment; When determining the stability value of each surface device based on the video information and the pitch angle change curve, the stability value determination module is specifically used for: Feature recognition is performed on each frame of the video information to obtain the water surface ripples at the water-facing side of each water surface device; Determine the curvature of the water surface ripples and the draft of the water surface equipment in each frame of the image; The pitch angle value at the corresponding moment is determined from the pitch angle change curve based on the time point of each frame image. The first sub-stability value of each surface device is determined based on the curvature of the water surface ripples, the draft, and the pitch angle value at the corresponding moment in each frame of the image. A curvature variation map is generated based on the curvature corresponding to each frame of the image, and the first variance of the curvature variation map is calculated. Calculate the second variance of the pitch angle change curve, and determine the stability value of each surface device based on the first sub-stabilized value, the first variance, and the second variance of each frame image; Each scatter point in the first and second location distribution maps corresponds to a location acquisition time point. When the anomaly detection module determines whether each surface device is abnormal based on the stable value, the first location distribution map, and the second location distribution map of the preset surface devices corresponding to each surface device, it is specifically used for: Draw the minimum circumcircle based on the scattered points in the first location distribution map, with each scattered point representing a location information; Determine the radius of the minimum circumcircle, and obtain the characteristic value of each surface device with respect to the degree of anomaly using the stable value as the base radius as the exponent; From the second location distribution map, determine the target scatter point that is closest to the time point of each scatter point in the first location distribution map, and determine multiple scatter point pairs based on the scatter points and the target scatter points; Determine the distance between the center point and the target point in each scatter point pair, and calculate the difference between the distance and the preset distance; Connect the scattered points in each scatter point pair to the target scattered point, and calculate the angle between the connecting line and the preset straight line; The deviation value of each scatter point pair is determined based on the difference and the included angle of each scatter point pair; Calculate the average deviation value of the deviation values, and calculate the anomaly score of each surface device based on the feature value, the average deviation value, and their respective weights; The anomaly score is used to determine whether each surface device is abnormal.

Images