A monitoring system, method and medium for mud water level

Abstract

The present application provides a monitoring system, method and medium for the mud and water level, which relate to the field of debris flow monitoring. The electronic water gauge of the system is used to collect first height data of the mud and water level in the area to be detected, and send the first height data to a data processor; the image acquisition device is used to collect target image data, and send the target image data to the image processor; the image processor is used to extract features from the target image data to obtain second height data, and send the second height data to the data processor; the data processor is used to fuse the first height data and the second height data according to the water gauge weight and the image weight to obtain target height data of the mud and water level; the monitoring system provided by the present application uses an electronic water gauge and an image acquisition device for dual monitoring, which avoids false alarms. The collected images are later subjected to feature recognition and classification by the image processor, so that the target height data can be accurately obtained.

Description

Technical Field

[0001] The present application relates to the field of debris flow monitoring, and more specifically, to a system, method, and medium for monitoring mud and water level height. Background Art

[0002] Monitoring changes in mud and water levels is an important and effective means of monitoring debris flow geological hazards, determining their occurrence and scale. Previously, mud and water level monitoring primarily involved contact and non-contact methods. The contact method uses sensors installed in the debris flow channel to directly sense the movement and arrival of the debris flow. Specific contact methods include the wire breakage method and the impact force measurement method. The wire breakage method involves installing a metal sensing wire within the debris flow channel. Once the debris flow breaks the wire, a wire breakage signal pulse is generated, which is then transmitted via an on-site sensing terminal to the early warning center for alarm. The impact force measurement method involves placing impact force sensors within the debris flow channel. Once a debris flow passes through, the impact force signal generated by the flow is captured by the device and transmitted back to the early warning center for alarm. The contact method only indicates that the mud and water level has exceeded a certain value, but cannot accurately measure the actual level, making it difficult to monitor the dynamic mud and water level. The primary non-contact method is ultrasonic measurement, which involves installing an ultrasonic sensor above the debris flow channel to monitor changes in the mud and water levels. While ultrasonic measurement can dynamically monitor mud and water level changes to a certain extent, it places high demands on the working conditions of the debris flow channel. The area directly below the sensor must be flat. Uneven conditions can reduce the ultrasonic echo energy, resulting in significant deviations in the mud and water level monitoring values. Ultrasonic waves are also significantly affected by rain and fog, which is detrimental to mud and water level measurement and limits their application in debris flow monitoring projects.

[0003] In summary, the above monitoring methods cannot obtain mud water level monitoring values ​​with high accuracy. Summary of the Invention

[0004] The purpose of the embodiments of the present application is to provide a mud water level monitoring system, method and medium to solve the above-mentioned problems existing in the prior art and to obtain mud water level monitoring values ​​(mud water level height data) with high accuracy.

[0005] In a first aspect, a system for monitoring mud and water level height is provided, which may include: an image acquisition device, an electronic water gauge, an image processor, and a data processor;

[0006] The electronic water gauge is used to collect first height data of the mud and water level in the area to be detected and send the first height data to the data processor;

[0007] The image acquisition device is configured to acquire target image data including an image corresponding to the electronic water level gauge within a preset time interval when the electronic water level gauge acquires the first height data, and send the target image data to the image processor;

[0008] The image processor is used to extract features from the target image data to obtain second height data of the mud and water level in the area to be detected, and send the second height data to the data processor;

[0009] The data processor is used to fuse the first height data and the second height data according to the configured water gauge weight and the configured image weight to obtain the target height data of the mud water level in the area to be detected; the water gauge weight and the image weight are determined based on the difference between the first height data and the second height data.

[0010] In one possible implementation, the data processor is further configured to, if a difference between the first height data and the second height data is less than a first preset difference, fuse the first height data and the second height data according to the water gauge weight and the image weight to obtain target height data of the mud water level in the area to be detected;

[0011] If the difference between the first height data and the second height data is not less than a first preset difference and less than a second preset difference, the first height data and the second height data are fused according to a new gauge weight and a new image weight to obtain target height data of the mud water level; wherein the new gauge weight and the new image weight are obtained by adjusting the gauge weight and the image weight using an adjustment coefficient;

[0012] If the difference between the first height data and the second height data is not less than the second preset difference, the future first height data and the future second height data are used as the new first height and the new second height data respectively, and the execution step is returned to: if the difference between the first height data and the second height data is less than the first preset difference, the first height data and the second height data are fused according to the water gauge weight and the image weight to obtain the target height data of the mud water level in the area to be detected; wherein, the future first height data and the future second height data are the height data corresponding to the next moment after the collection moment of the first height data and the second height data.

[0013] In a possible implementation, the electronic water gauge and the image acquisition device are fixed at corresponding positions in the area to be detected via the same fixing pile.

[0014] In a possible implementation, the electronic water gauge and the image acquisition device are respectively fixed at corresponding positions of the area to be detected through different fixing piles.

[0015] In one possible implementation, the image processor is used to use a YOLOv8 model to perform feature extraction on the image data to obtain sub-image data including the image corresponding to the electronic water level gauge; and determine the second height data based on the sub-image data.

[0016] In a possible implementation, the image acquisition device is further used to acquire image data including an image corresponding to the electronic water level gauge at multiple angles according to a preset angle spacing and a preset time interval when the electronic water level gauge acquires the first height data.

[0017] In a possible implementation, the image processor is further configured to fuse image data corresponding to each angle, including the image corresponding to the electronic water level gauge, to obtain the target image data corresponding to the preset time interval.

[0018] In a second aspect, a method for monitoring mud water level is provided. The method is applied to a monitoring system including an image acquisition device, an electronic water gauge, an image processor, and a data processor. The method includes:

[0019] The electronic water gauge collects first height data of the mud and water level in the area to be detected, and sends the first height data to the data processor;

[0020] When the electronic water level gauge collects the first height data, the image acquisition device collects target image data including an image corresponding to the electronic water level gauge within a preset time interval, and sends the target image data to the image processor;

[0021] The image processor performs feature extraction on the target image data to obtain second height data of the mud and water level in the area to be detected, and sends the second height data to the data processor;

[0022] The data processor fuses the first height data and the second height data according to the configured water gauge weight and the configured image weight to obtain the target height data of the mud water level in the area to be detected; the water gauge weight and the image weight are determined based on the difference between the first height data and the second height data.

[0023] In a third aspect, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium. When the computer program is executed by a processor, the method described in the second aspect is implemented.

[0024] The present application provides a monitoring system for the mud and water level, which includes: an image acquisition device, an electronic water gauge, an image processor and a data processor; the electronic water gauge is used to acquire first height data of the mud and water level in the area to be detected and send the first height data to the data processor; the image acquisition device is used to acquire target image data including an image corresponding to the electronic water gauge within a preset time interval when the electronic water gauge acquires the first height data, and send the target image data to the image processor; the image processor is used to extract features from the target image data to obtain second height data of the mud and water level in the area to be detected and send the second height data to the data processor; the data processor is used to fuse the first height data and the second height data according to the configured water gauge weight and the configured image weight to obtain target height data of the mud and water level in the area to be detected; the water gauge weight and the image weight are determined based on the difference between the first height data and the second height data. Traditional mud and water level meters can monitor changes in mud and water levels, but have a high false alarm rate. Since the monitoring is carried out by radar waves, it is easy to be interfered by external factors. For example, if there are weeds, animals, human activities, etc. under the sensor, the monitoring value will change. To judge the authenticity of the data, it is necessary to conduct on-site inspections, which is relatively inconvenient. The monitoring system provided by this application uses an electronic water gauge and an image acquisition device for dual monitoring, which avoids false alarms and makes the monitoring data highly accurate. Later, the collected images are subjected to feature recognition and classification by an image processor, which can accurately obtain the target height data of the mud and water level in the area to be detected while identifying the material composition and morphology of the debris flow. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without creative work.

[0026] Figure 1 A schematic diagram of the structure of a mud water level monitoring system provided in an embodiment of the present application;

[0027] Figure 2 A flow chart of a method for monitoring mud water level provided in an embodiment of the present application. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0029] For ease of understanding, the terms involved in the embodiments of this application are explained below:

[0030] The YOLOv8 model is a state-of-the-art model that builds on the success of previous YOLO versions and introduces new features and improvements to further enhance performance and flexibility. Specific innovations include a new backbone network, a new Ancher-Free detection head, and a new loss function that can run on a variety of hardware platforms from CPUs to GPUs.

[0031] The model only needs to browse once to identify the category and location of objects in the image. YOLO's prediction is based on the entire image, and it will output all detected target information at once, including category and location. The commonly used algorithm before YOLO was to first slide windows of different sizes across the image to identify each object one by one; by designing windows of different sizes, these windows are slid according to the minimum step size, and all images in the window are put into the classifier for identification one by one. R-CNN scans the image and obtains about 2,000 regions (windows) to replace the hundreds of thousands of windows that may be obtained in the sliding window method (Region Proposal), and proposes the Selective Search algorithm.

[0032] Monitoring changes in mud and water levels is an important and effective means of monitoring debris flow geological hazards, determining their occurrence and scale. Previously, mud and water level monitoring primarily involved contact and non-contact methods. The contact method uses sensors installed in the debris flow channel to directly sense the movement and arrival of the debris flow. Specific contact methods include the wire breakage method and the impact force measurement method. The wire breakage method involves installing a metal sensing wire within the debris flow channel. Once the debris flow breaks the wire, a wire breakage signal pulse is generated, which is then transmitted via an on-site sensing terminal to the early warning center for alarm. The impact force measurement method involves placing impact force sensors within the debris flow channel. Once a debris flow passes through, the impact force signal generated by the flow is captured by the device and transmitted back to the early warning center for alarm. The contact method only indicates that the mud and water level has exceeded a certain value, but cannot accurately measure the actual level, making it difficult to monitor the dynamic mud and water level. The primary non-contact method is ultrasonic measurement, which involves installing an ultrasonic sensor above the debris flow channel to monitor changes in the mud and water levels. While ultrasonic measurement can dynamically monitor mud and water level changes to a certain extent, it places high demands on the working conditions of the debris flow channel. The area directly below the sensor must be flat. Uneven conditions can reduce the ultrasonic echo energy, resulting in significant deviations in the mud and water level monitoring values. Ultrasonic waves are also significantly affected by rain and fog, which is detrimental to mud and water level measurement and limits their application in debris flow monitoring projects.

[0033] In summary, the above monitoring methods cannot obtain highly accurate mud and water level monitoring values. Therefore, this application proposes a mud and water level height monitoring system to solve the above problems existing in the prior art and obtain highly accurate mud and water level monitoring values ​​(mud and water level height data).

[0034] The preferred embodiments of the present application are described below in conjunction with the drawings in the specification. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present application and are not used to limit the present application. In addition, the embodiments and features in the embodiments of the present application can be combined with each other if there is no conflict.

[0035] Figure 1 This is a schematic diagram of the structure of a mud water level monitoring system provided in an embodiment of the present application. Figure 1 As shown, the system may include: an image acquisition device, an electronic water level gauge, an image processor, a data processor and an acquisition processor.

[0036] Among them, the image acquisition device is wirelessly connected to the image processor; the electronic water level and the image processor are wirelessly connected to the data processor respectively; the image acquisition device and the electronic water level are wirelessly connected to the acquisition processor respectively.

[0037] The acquisition processor can be used to control the acquisition frequency, acquisition time and other related information when the image acquisition device and the electronic water level gauge acquire corresponding data.

[0038] The electronic water gauge can be used to collect first height data of the mud and water level in the area to be detected, and send the first height data to the data processor.

[0039] The image acquisition device may be configured to acquire target image data including an image corresponding to the electronic water gauge within a preset time interval when the electronic water gauge acquires first height data, and transmit the target image data to the image processor. Specifically, the acquisition processor controls the image acquisition device to acquire the target image data when the electronic water gauge acquires first height data of the mud and water level in the area to be inspected.

[0040] In some embodiments, the image acquisition device can also be used to acquire image data including an image corresponding to the electronic water level gauge at multiple angles according to a preset angle interval and a preset time interval when the electronic water level gauge acquires the first height data.

[0041] In some embodiments, the electronic water gauge and the image acquisition device are fixed to corresponding positions in the area to be detected by the same fixed pile. The specific fixing method is as follows: one end of the fixed pile is fixed in the debris flow channel in the area to be detected, and the electronic water gauge is fixed at a certain height from bottom to top at the contact position between the fixed pile and the upper surface of the debris flow channel; a fixed cross bar is vertically set at the end of the fixed pile away from the debris flow channel, and the image acquisition device is fixed to the end of the fixed cross bar away from the fixed pile. Among them, the length setting of the fixed cross bar needs to ensure that the image acquisition device can capture images of the electronic water gauge from multiple angles, clearly and completely. Therefore, this application does not limit the specific length of the fixed cross bar.

[0042] In some embodiments, the electronic water gauge and the image acquisition device are fixed to corresponding positions of the area to be detected by different fixing piles. The fixing method is specifically as follows: one end of the first fixing pile is fixed in the debris flow channel of the area to be detected, and the electronic water gauge is fixed at a certain height from bottom to top at the contact position between the fixing pile and the upper surface of the debris flow channel; one end of the second fixing pile is fixed in the debris flow channel at a certain distance from the first fixing pile; the image acquisition device is fixed to the end of the second fixing pile away from the debris flow channel. Among them, the distance between the first fixing pile and the second fixing pile needs to ensure that the image acquisition device can capture images of the electronic water gauge from multiple angles, clearly and completely. Therefore, this application does not limit the distance between the first fixing pile and the second fixing pile.

[0043] The image processor is used to extract features from the target image data, obtain second height data of the mud and water level in the area to be detected, and send the second height data to the data processor.

[0044] In some embodiments, the image processor is further configured to fuse image data corresponding to each angle, including images corresponding to the electronic water level gauge, to obtain target image data corresponding to a preset time interval.

[0045] The specific process may include: the image processor can move at multiple angles to collect video data, process the video data frame by frame, and obtain image data corresponding to each frame; then, fuse the image data of each frame, and the image data fusion process of two adjacent frames can be fused using multiple reference points in the image data; in this embodiment, only one reference point is provided for illustration: for example, fusion is performed based on the position of point P at the contact point between the fixed pile and the upper surface of the debris flow channel in the world coordinate system, the position of point P in the electronic water gauge coordinate system, the position of point P in the image acquisition device coordinate system, and the conversion relationship between the electronic water gauge coordinate system and the image acquisition device coordinate system and the world coordinate system. This method fuses the same image features in the image data of two frames based on multiple reference points to improve the clarity of the image data. Other background features in the image data, except for the electronic water gauge and the muddy water area, can be discarded and not processed. Therefore, clear target image data of the electronic water gauge and the muddy water area can be obtained.

[0046] In some embodiments, the image processor can be specifically used to use the YOLOv8 model to extract features from the image data to obtain sub-image data including the image corresponding to the electronic water level gauge; and determine the second height data based on the sub-image data.

[0047] In some embodiments, feature extraction can also be performed on the image data using a preset image processing model to obtain sub-image data including the image corresponding to the electronic water level gauge; and the second height data can be determined based on the sub-image data.

[0048] Among them, the preset image processing model includes a segmentation module, a grid generation module and an image fusion module.

[0049] Step A: The segmentation module is used to segment the image data into a×a grids; the size of each grid is equal.

[0050] Step B: The grid generation module generates bounding boxes based on the grid. Specifically, each of the a×a grids predicts B bounding boxes. Each bounding box has five parameters: the object's center position (x, y), height (h), width (w), and the confidence level of the prediction.

[0051] Each grid not only predicts B bounding boxes but also the category of the object within them. The categories are represented using one-hot encoding (i.e., each category corresponds to one or more registers, with a 0 / 1 value indicating whether the object belongs to that category, and each object can only have one category). This means that the initial sub-image data corresponding to the electronic water gauge is determined based on the object's category.

[0052] Step C, the image fusion module, first processes the acquired initial sub-image data. The specific processing may include: obtaining a scale area within the scale area, which includes two boundaries, namely, the boundaries of the rectangle corresponding to the scale area; one boundary is perpendicular to the scale lines; the other is parallel to the scale lines; comparing the two boundaries, determined by the scale lines in the scale area, with the boundaries of the scale area determined in the initial sub-image data. If the pixels of the two are within a preset difference range, the scale area extraction is accurate. If the pixels of the two are not within the preset difference range, the initial sub-image data is re-extracted through steps A and B. This method can re-determine the accuracy of the scale area boundaries using the scale lines in the scale area. Secondly, multiple muddy water areas in the scale area are detected. If the width of the muddy water area is smaller than the width of the scale, it indicates that the muddy water in the muddy water area is interfering muddy water (mud spots) attached to the scale, and the corresponding muddy water areas in the initial sub-image data are removed. If the width of the muddy water area is not less than the width of the scale, and the lower edge of the muddy water area coincides with the lower edge of the scale, it indicates that the muddy water in the muddy water area is non-interfering muddy water, that is, muddy water whose height data needs to be read. Finally, the distance between any two adjacent scales of the electronic water gauge image in the initial sub-image data is extracted and compared with the standard distance to determine the target ratio of the initial sub-image data and the standard electronic water gauge image data; the standard electronic water gauge image data is scaled according to the target ratio to determine the target electronic water gauge image data; the target electronic water gauge image data replaces the electronic water gauge image in the initial sub-image data to obtain the sub-image data. Among them, the standard distance is the distance between any two adjacent scales in the standard electronic water gauge image data. In this way, the sub-image data removes interfering muddy water and replaces a clear and complete electronic water gauge image, which can accurately obtain the height data of non-interfering muddy water to obtain the second height data.

[0053] In practice, an electronic water gauge may experience multiple jumps when collecting the first height data. This may be due to the following: after rainfall, mud and sand may remain between adjacent monitoring contacts on the electronic water gauge scale. When the temperature drops at night, water droplets condense, causing the two contacts to conduct, resulting in erroneous monitoring values. During the day, the water evaporates and the data returns to normal. This application removes the interfering mud and water, thereby discarding the data corresponding to multiple jumps, thus avoiding this situation.

[0054] The data processor can be used to fuse the first height data and the second height data according to the configured water gauge weight and the configured image weight to obtain the target height data of the mud water level in the area to be detected.

[0055] Specifically, they may include:

[0056] If the difference between the first height data and the second height data is less than the first preset difference, the first height data and the second height data are fused according to the configured water gauge weight and image weight to obtain the target height data of the mud and water level in the area to be detected. For example, the water gauge weight is set to 0.8, the image weight is set to 0.2, and the first preset difference is 0.5cm; when the first height data is 10cm and the second height data is 10.4cm, the calculated target height data is 10.08cm. Since the image acquisition device is triggered to acquire the second height data after the electronic water gauge acquires the first height data, there will be a certain time difference between the two acquired data. Therefore, the acquired data may be different due to the change of the mud and water level caused by the debris flow over time.

[0057] If the difference between the first and second height data is not less than the first preset difference and less than the second preset difference, the first and second height data are fused according to the new gauge weight and the new image weight to obtain the target mud level height data. The gauge weight can be set to 0.8, and the image weight can be set to 0.2; the first preset difference can be set to 0.5 cm, and the second preset difference can be set to 2 cm. The adjustment coefficient can be determined based on the ratio of the first and second preset differences as: 1 + 0.5 / 2 = 1.25.

[0058] The new ruler weight and image weight are obtained by adjusting the ruler weight and image weight using the adjustment coefficient. Specifically, the new ruler weight = ruler weight × adjustment coefficient; the new image weight = 1 - new ruler weight.

[0059] If the difference between the first height data and the second height data is not less than the second preset difference, it indicates that the first height data and the second height data differ significantly, and this set of data can be discarded without processing; after a certain time interval from the current acquisition moment (the next moment), the electronic water gauge collects the future first height data and the image acquisition device collects the future second height data, and uses the future first height data and the future second height data as the new first height and new second height data, respectively, and returns to the execution step: if the difference between the first height data and the second height data is less than the first preset difference, the first height data and the second height data are fused according to the water gauge weight and the image weight to obtain the target height data of the mud and water level in the area to be detected. Since debris flows do not disappear instantly, the first height data and the second height data can be acquired again after a certain time interval to determine the final target height data.

[0060] In some embodiments, after obtaining the target height data, the data processor compares it with multiple pre-configured warning values ​​(each warning value corresponds to a debris flow level). When the target height data reaches a certain warning value, an alarm including the target height data, the debris flow level and the corresponding geographic location is issued to remind relevant staff of the debris flow level occurring at the geographic location.

[0061] The present application provides a monitoring system for the mud and water level, which includes: an image acquisition device, an electronic water gauge, an image processor and a data processor; the electronic water gauge is used to acquire first height data of the mud and water level in the area to be detected and send the first height data to the data processor; the image acquisition device is used to acquire target image data including an image corresponding to the electronic water gauge within a preset time interval when the electronic water gauge acquires the first height data, and send the target image data to the image processor; the image processor is used to extract features from the target image data to obtain second height data of the mud and water level in the area to be detected and send the second height data to the data processor; the data processor is used to fuse the first height data and the second height data according to the configured water gauge weight and the configured image weight to obtain target height data of the mud and water level in the area to be detected; the water gauge weight and the image weight are determined based on the difference between the first height data and the second height data. Traditional mud and water level meters can monitor changes in mud and water levels, but have a high false alarm rate. Since the monitoring is carried out by radar waves, it is easy to be interfered by external factors. For example, if there are weeds, animals, human activities, etc. under the sensor, the monitoring value will change. To judge the authenticity of the data, it is necessary to conduct on-site inspections, which is relatively inconvenient. The monitoring system provided by this application uses an electronic water gauge and an image acquisition device for dual monitoring, which avoids false alarms and makes the monitoring data highly accurate. Later, the collected images are subjected to feature recognition and classification by an image processor, which can accurately obtain the target height data of the mud and water level in the area to be detected while identifying the material composition and morphology of the debris flow.

[0062] Figure 2 The following is a flow chart of a method for monitoring mud water level provided in an embodiment of the present application. Figure 2 As shown, the method is applied to a monitoring system including an image acquisition device, an electronic water gauge, an image processor, and a data processor. The method may include:

[0063] Step S210: The electronic water gauge collects first height data of the mud and water level in the area to be detected, and sends the first height data to a data processor.

[0064] Step S220 : When the electronic water gauge collects the first height data, the image acquisition device collects target image data including an image corresponding to the electronic water gauge within a preset time interval, and sends the target image data to the image processor.

[0065] Step S230: The image processor extracts features from the target image data to obtain second height data of the mud and water level in the area to be detected, and sends the second height data to the data processor.

[0066] Step S240: The data processor fuses the first height data and the second height data according to the configured water gauge weight and the configured image weight to obtain target height data of the mud water level in the area to be detected;

[0067] The water level weight and the image weight are determined based on the difference between the first height data and the second height data.

[0068] In another embodiment provided in the present application, a computer-readable storage medium is also provided, which stores instructions. When the computer-readable storage medium is run on a computer, it enables the computer to execute a method for monitoring mud water level height described in any of the above embodiments.

[0069] In another embodiment provided by the present application, a computer program product including instructions is also provided, which, when executed on a computer, enables the computer to execute a method for monitoring mud water level height as described in any one of the above embodiments.

[0070] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the embodiments of the present application may take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware. Furthermore, the embodiments of the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0071] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0072] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1The function specified in one or more boxes.

[0073] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0074] Unless otherwise defined, the technical or scientific terms used in this application should have the usual meanings understood by persons of ordinary skill in the field to which the invention belongs. The words "first", "second" and similar terms used in this application do not indicate any order, quantity or importance, but are only used to distinguish different components. Words such as "include" or "comprise" mean that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connect", "couple" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the object being described changes, the relative positional relationship may also change accordingly.

[0075] Although preferred embodiments have been described in the present application, those skilled in the art may make additional changes and modifications to these embodiments once they become aware of the basic inventive concepts. Therefore, the present application is intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present application.

[0076] Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. Thus, if these modifications and variations of the embodiments of the present application fall within the scope of the embodiments of the present application and their equivalents, the embodiments of the present application are also intended to include these modifications and variations.

Claims

1. A mud water level monitoring system, characterized in that: The system includes: an image acquisition device, an electronic water gauge, an image processor and a data processor; The electronic water gauge is used to collect first height data of the mud and water level in the area to be detected and send the first height data to the data processor; The image acquisition device is configured to acquire target image data including an image corresponding to the electronic water level gauge within a preset time interval when the electronic water level gauge acquires the first height data, and send the target image data to the image processor; The image processor is used to extract features from the target image data to obtain second height data of the mud and water level in the area to be detected, and send the second height data to the data processor; The data processor is configured to fuse the first height data and the second height data according to a configured water gauge weight and a configured image weight to obtain target height data of the mud water level in the area to be detected; the water gauge weight and the image weight are determined based on the difference between the first height data and the second height data; The image processor may perform feature extraction on the image data by using a preset image processing model to obtain sub-image data including an image corresponding to the electronic water level gauge; and determine the second height data based on the sub-image data; The preset image processing model includes a segmentation module, a grid generation module and an image fusion module: The image fusion module determines the initial sub-image data including the image corresponding to the electronic water level gauge according to the category to which the object belongs; The image fusion module obtains a scale area in the scale area, wherein the scale area includes two boundaries: one boundary is perpendicular to the scale lines; the other boundary is parallel to the scale lines; the two boundaries determined by the scale lines in the scale area are compared with the boundaries of the scale area determined in the initial sub-image data; if the pixel points of the two are within a preset difference range, it indicates that the scale area extraction is accurate; Detect multiple muddy and water areas in the scale area: If the width of the muddy water area is smaller than the width of the scale bar, it indicates that the muddy water in the muddy water area is interference muddy water attached to the scale bar, and the corresponding muddy water area in the initial sub-image data is removed; If the width of the muddy water area is not less than the width of the scale, and the lower edge of the muddy water area coincides with the lower edge of the scale, it indicates that the muddy water in the muddy water area is non-interference muddy water; The distance between any two adjacent scale marks of the electronic water gauge image in the initial sub-image data is extracted and compared with the standard distance to determine the target ratio of the initial sub-image data and the standard electronic water gauge image data; the standard electronic water gauge image data is scaled according to the target ratio to determine the target electronic water gauge image data; wherein the standard distance is the distance between any two adjacent scale marks in the standard electronic water gauge image data.

2. The system according to claim 1, wherein The data processor is further configured to, if a difference between the first height data and the second height data is less than a first preset difference, fuse the first height data and the second height data according to the water gauge weight and the image weight to obtain target height data of the mud water level in the area to be detected; If the difference between the first height data and the second height data is not less than a first preset difference and less than a second preset difference, the first height data and the second height data are fused according to a new gauge weight and a new image weight to obtain target height data of the mud water level; wherein the new gauge weight and the new image weight are obtained by adjusting the gauge weight and the image weight using an adjustment coefficient; If the difference between the first height data and the second height data is not less than the second preset difference, the future first height data and the future second height data are used as the new first height and the new second height data respectively, and the execution step is returned to: if the difference between the first height data and the second height data is less than the first preset difference, the first height data and the second height data are fused according to the water gauge weight and the image weight to obtain the target height data of the mud water level in the area to be detected; wherein, the future first height data and the future second height data are the height data corresponding to the next moment after the collection moment of the first height data and the second height data.

3. The system according to claim 1, wherein The electronic water gauge and the image acquisition device are fixed at corresponding positions of the area to be detected through the same fixing pile.

4. The system according to claim 1, wherein: The electronic water gauge and the image acquisition device are respectively fixed at corresponding positions of the area to be detected through different fixing piles.

5. The system according to claim 1, wherein: The image processor is used to use the YOLOv8 model to extract features from the image data to obtain sub-image data including the image corresponding to the electronic water level gauge; and determine the second height data based on the sub-image data.

6. The system according to claim 1, wherein: The image acquisition device is further configured to acquire image data including an image corresponding to the electronic water level gauge at multiple angles according to a preset angle interval and a preset time interval when the electronic water level gauge acquires the first height data.

7. The system according to claim 6, wherein: The image processor is further configured to fuse the image data corresponding to each angle, including the image corresponding to the electronic water level gauge, to obtain the target image data corresponding to the preset time interval.

8. A method for monitoring mud water level, characterized in that: The method is applied to a monitoring system including an image acquisition device, an electronic water gauge, an image processor, and a data processor, and the method includes: The electronic water gauge collects first height data of the mud and water level in the area to be detected, and sends the first height data to the data processor; When the electronic water level gauge collects the first height data, the image acquisition device collects target image data including an image corresponding to the electronic water level gauge within a preset time interval, and sends the target image data to the image processor; The image processor performs feature extraction on the target image data to obtain second height data of the mud and water level in the area to be detected, and sends the second height data to the data processor; The data processor fuses the first height data and the second height data according to a configured water gauge weight and a configured image weight to obtain target height data of the mud water level in the area to be detected; the water gauge weight and the image weight are determined based on the difference between the first height data and the second height data; The image processor may perform feature extraction on the image data by using a preset image processing model to obtain sub-image data including an image corresponding to the electronic water level gauge; and determine the second height data based on the sub-image data; The preset image processing model includes a segmentation module, a grid generation module and an image fusion module: The image fusion module determines the initial sub-image data including the image corresponding to the electronic water level gauge according to the category to which the object belongs; The image fusion module obtains a scale area in the scale area, wherein the scale area includes two boundaries: one boundary is perpendicular to the scale lines; the other boundary is parallel to the scale lines; the two boundaries determined by the scale lines in the scale area are compared with the boundaries of the scale area determined in the initial sub-image data; if the pixel points of the two are within a preset difference range, it indicates that the scale area extraction is accurate; Detect multiple muddy and water areas in the scale area: If the width of the muddy water area is smaller than the width of the scale bar, it indicates that the muddy water in the muddy water area is interference muddy water attached to the scale bar, and the corresponding muddy water area in the initial sub-image data is removed; If the width of the muddy water area is not less than the width of the scale, and the lower edge of the muddy water area coincides with the lower edge of the scale, it indicates that the muddy water in the muddy water area is non-interference muddy water; The distance between any two adjacent scale marks of the electronic water gauge image in the initial sub-image data is extracted and compared with the standard distance to determine the target ratio of the initial sub-image data and the standard electronic water gauge image data; the standard electronic water gauge image data is scaled according to the target ratio to determine the target electronic water gauge image data; wherein the standard distance is the distance between any two adjacent scale marks in the standard electronic water gauge image data.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to claim 8 is implemented.

Images