Water gate monitor control device, water gate monitor system, water gate monitor method, and computer program that causes computer to implement the water gate monitor method

The water gate monitoring system uses multiple cameras and flow data to detect and manage foreign objects, improving gate closure reliability by preventing obstruction and ensuring safe operation.

JP2024159394AActive Publication Date: 2024-11-08EBARA JITSUGYO

Patent Information

Application Number
JP2023127991
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-08-04
Publication Date
2024-11-08
Estimated Expiration
2043-04-28

AI Technical Summary

Technical Problem

Existing water gate monitoring systems struggle to detect foreign objects that remain under the gate, especially in cloudy conditions, leading to potential failure in closing the gate due to obstruction.

Method used

A water gate monitoring system that utilizes multiple cameras to capture images along the flow direction of a river or waterway, combined with flow direction and velocity information, to detect and calculate the velocity of foreign objects, determining if they pose an obstacle to gate closure, and adjusts gate operation accordingly.

Benefits of technology

Enhances the reliability of gate closure by detecting and removing foreign objects that could obstruct the gate, even in challenging conditions, ensuring timely and safe operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024159394000001_ABST
    Figure 2024159394000001_ABST
Patent Text Reader

Abstract

To provide a water gate monitor installation capable of detecting debris that stays at the bottom of a gate door of a water gate to interrupt the closure of the gate door, and of enhancing reliability of the closure of the gate door.SOLUTION: A water gate monitor installation consists of: a network communication section 117 to obtain multiple images that are captured with cameras 21a, 21b, 21c which take pictures of multiple positions along the flow direction of a river or a canal; a flow speed / direction meter 17 to obtain flow-direction information that shows the flow direction of water; a debris detection section 111 which assesses time sequence of the images based on the flow direction information and distinguishes the debris by making comparison between the images taken earlier and those taken later to detect the debris that flows in the river or canal; a debris flow-speed calculation section 113 which calculates the flow speed of the detected debris based on their positions and the time at which the debris is detected in the river or canal; and an interference determination section 115 which determines based on the calculated flow speed of the debris whether or not the debris will become obstruction to the closure of a gate door 13 of a water gate 3.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a water gate monitoring control device, a water gate monitoring system, a water gate monitoring method, and a computer program for causing a computer to execute the water gate monitoring method. [Background technology]

[0002] In recent years, there has been a tendency for flood disasters to occur more frequently due to increased rainfall caused by climate change. During the 2019 East Japan Typhoon (Typhoon Hagibis), floodgate gates were not closed, causing swollen river water to back up into sewer systems and overflow into urban areas, resulting in flooding damage. In addition, as gates and other equipment are operated during storms, safety measures for operators are also necessary. Furthermore, as such operators are currently aging and securing staff is an issue, there is a need to reduce the workload associated with operation.

[0003] Technologies made in consideration of the above points are described in, for example, Patent Document 1 and Patent Document 2. The "method and system for closing a gate when a tsunami and / or high tide warning is issued" described in Patent Document 1 is configured by connecting a surrounding monitoring camera, a gate monitoring device, a warning device, a gate drive device, etc. to a gate control device via communication means. Patent Document 1 also describes that an operator checks the status of a foreign object with a monitoring camera, issues a closing command if the foreign object is not a problem, and when a problematic foreign object is confirmed, instructs the site to remove the foreign object or waits for the foreign object to pass before issuing a closing command. The emergency closing control system for waterproofing equipment described in Patent Document 2 includes monitoring television cameras installed on the left and right sides of the bank of the water gate. The image processing circuit described in Patent Document 2 processes and analyzes the image taken by the television camera. It also describes that the water gate is closed urgently if it is determined that no ships are passing through. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2003-278122 A [Patent Document 2] JP 2007-332534 A Summary of the Invention [Problem to be solved by the invention]

[0005] In both of the above-mentioned Patent Documents 1 and 2, the premise is that a foreign object near the water gate will pass through the water gate, and the water gate is closed after a foreign object is detected and passed through. 2 In sluice gates and other structures smaller than 100 meters, foreign objects may get caught near the gate of the sluice gate (water gate). Or sand and other materials may accumulate and prevent the gate from closing. Such foreign objects can be detected by cameras that photograph the water surface from above near the water gate or by cameras that photograph the water below. However, the water in the waterway becomes murky, especially in situations with heavy rainfall, making it difficult for the camera to capture a clear enough image to detect the foreign object.

[0006] The present invention has been made in consideration of the above points, and provides a floodgate monitoring device, a floodgate monitoring method, and a computer program for causing a computer to execute the floodgate monitoring method, which can detect foreign objects that remain under a floodgate and prevent the gate from closing, thereby improving the reliability of gate closure. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, one form of a floodgate monitoring device of the present invention is a floodgate monitoring device that monitors a floodgate installed in a river or waterway, and includes an image acquisition unit that acquires multiple images taken by multiple cameras that photograph multiple positions along the flow direction of the river or waterway, a flow direction information acquisition unit that acquires flow direction information that indicates the flow direction of water in the river or waterway, a foreign object detection unit that detects foreign objects flowing in the river or waterway from the multiple images acquired by the image acquisition unit, a foreign object velocity calculation unit that calculates a foreign object velocity, which is the flow speed of the foreign object, based on the position in the river or waterway and the time of the foreign object detected by the foreign object detection unit, and an obstacle determination unit that determines whether the foreign object may be an obstacle to closing the floodgate gate based on the foreign object velocity calculated by the foreign object velocity calculation unit, and the foreign object detection unit determines the time series of the images based on the flow direction information, and determines whether the foreign object is similar or different from the image taken earlier based on this determination with the image taken later.

[0008] One form of the present invention's floodgate monitoring system is a floodgate monitoring system that monitors a floodgate installed in a river or waterway, and includes: a plurality of cameras that capture images of a plurality of positions along the flow direction of the river or waterway; a flow direction information acquisition unit that acquires flow direction information that indicates the direction of water flow in the river or waterway; a foreign object detection unit that detects foreign objects flowing in the river or waterway from a plurality of images captured by the multiple cameras; a foreign object velocity calculation unit that calculates a foreign object velocity, which is the flow speed of the foreign object, based on the position in the river or waterway and the time of the foreign object detected by the foreign object detection unit; an obstacle determination unit that determines whether the foreign object may be an obstacle to closing the floodgate gate based on the foreign object velocity calculated by the foreign object velocity calculation unit; and a gate drive unit that drives the floodgate gate to open and close one or more times if the obstacle determination unit determines that the foreign object may be an obstacle to closing the floodgate gate.The foreign object detection unit determines the time series of the images based on the flow direction information, and determines whether the foreign object is the same or different from the image captured earlier based on this determination with the image captured later.

[0009] A water gate monitoring method of one embodiment of the present invention is a water gate monitoring method for monitoring a water gate installed in a river or waterway, comprising the steps of: an image acquisition unit acquiring a plurality of images taken by a plurality of cameras that photograph a plurality of positions along the flow direction of the river or waterway; a flow direction information acquisition unit acquiring flow direction information indicating the direction of water flow in the river or waterway; a foreign object detection unit detecting a foreign object flowing in the river or waterway from the plurality of acquired images; and a foreign object flow velocity calculation unit calculating the foreign object flow velocity, which is the flow velocity of the foreign object, based on the position and time of the detected foreign object in the river or waterway. The method includes a step in which the obstacle determination unit determines, based on the foreign object flow velocity, whether or not a foreign object may obstruct the closing of the gate of the floodgate. In the step of detecting a foreign object, the foreign object detection unit determines the time series of images based on flow direction information, and compares an image taken earlier and an image taken later based on this determination to determine whether the foreign object is the same or different.

[0010] A computer program for causing a computer to execute a water gate monitoring method according to one aspect of the present invention causes the computer to execute the water gate monitoring method. Effect of the Invention

[0011] According to the above embodiment, foreign objects that remain under a floodgate and prevent the gate from closing can be detected, thereby improving the reliability of the gate closure. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a schematic diagram for explaining a water gate monitoring system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic block diagram for explaining details of a control panel shown in FIG. [Diagram 3] 5A, 5B, 5C, and 5D are schematic diagrams illustrating a foreign object detected by the foreign object detection unit. [Figure 4] 13A and 13B are diagrams illustrating a subroutine for explaining a foreign matter determination process. [Diagram 5]FIG. 2 is a schematic diagram showing the state of a floodgate during normal water conditions. [Figure 6] 4 is a flowchart for explaining the operation performed in the floodgate monitoring system during normal water conditions. [Figure 7] FIG. 13 is a schematic diagram for explaining removal of foreign objects from the floodgate monitoring system. [Figure 8] This is a schematic diagram to explain the state of a floodgate during floods and high tides. [Figure 9] This is a schematic diagram following Figure 8 to explain the state of the floodgate 3 during flooding and high tide. [Figure 10] This is a schematic diagram following Figure 9 to explain the state of the floodgate 3 during flooding and high tide. [Figure 11] 1 is a flowchart for explaining the operations performed in a floodgate monitoring system during floods and high tides. [Figure 12] This is a schematic diagram to explain the state of a floodgate when there is a possibility of an earthquake or tsunami. [Figure 13] FIG. 13 is a schematic diagram illustrating the state of the floodgate 3 when there is a possibility of an earthquake or tsunami, following FIG. 12. [Figure 14] This is a schematic diagram following Figure 13 to explain the state of the floodgates when there is a possibility of an earthquake or tsunami. [Figure 15] 1 is a flowchart for explaining the operations performed in the water gate monitoring system 1 when there is a possibility of an earthquake or tsunami. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, a floodgate monitoring device, a floodgate monitoring system, and a floodgate monitoring method according to an embodiment of the present invention will be described. In the drawings used in this embodiment, the same components are given the same reference numerals, and some of the descriptions thereof may be omitted. Furthermore, the drawings are intended to aid in the description and understanding of this embodiment, and do not necessarily accurately show the specific shapes, aspect ratios, and sense of scale. In this specification, a "river" refers to a water topography formed by a natural phenomenon. Furthermore, a "waterway" refers to a water passageway that is artificially constructed, and includes a "canal" that is a waterway that connects rivers and is mainly intended for the transportation of goods by ship. Furthermore, in this specification, a "floodgate" includes a "sluice gate" that is provided in a culvert constructed through a waterway in a levee.

[0014] [Watergate monitoring system] FIG. 1 is a schematic diagram for explaining a floodgate monitoring system 1 of this embodiment, and is a cross-sectional view along the flow direction of a waterway. The floodgate monitoring system 1 monitors a floodgate 3 installed between a main river 4A and a tributary 4B. In FIG. 1, water flows from the main river 4A in the direction of an arrow d1 into the tributary 4B. The tributary 4B in this embodiment is a culvert (waterway) passing through a levee 2, and the main river 4A is a river wider than the tributary 4B. The side of the tributary 4B from the levee 2 is an urban area C. The flow direction of a river or waterway in this embodiment is the flow direction of the main river 4A and the tributary 4B, and the flow direction between the main river 4A and the tributary 4B changes depending on the water levels of both, and unless the main river 4A and the tributary 4B are linear when viewed from above, the flow direction of the main river 4A and the tributary 4B change depending on the shape and position of the channel.

[0015] However, the water gate monitoring system of this embodiment is not limited to application between rivers and waterways, but can be applied to water gates between waterways and between rivers. Furthermore, the waterway is not limited to a culvert that passes through the embankment 2, and may have a U-shaped cross section.

[0016] The floodgate 3 is disposed in a direction intersecting the flow direction of the inflow intersection of the tributary 4B, for example, so as to straddle the tributary 4A, and the gate 13 opens and closes to allow or block water flow from the main river 4A to the tributary 4B. The floodgate 3 is provided with a gate support part 14 that supports the gate 13 so that it can be opened and closed.

[0017] The floodgate monitoring system 1 includes multiple cameras 21a, 21b, and 21c that capture images of multiple positions along the flow direction of the waterway, and a control panel 11 that controls the entire floodgate monitoring system 1. The camera 21a is a camera that captures an image capture range R1 of the upper surface of the tributary 4B from below the embankment 2, and the camera 21c is a camera that captures an image capture range R3 in the main river 4A that is the furthest from the floodgate 3. The camera 21b is a camera that captures an image capture range R2 that is between the image capture ranges R1 and R3 and includes the gate 13. However, the floodgate monitoring system 1 may include cameras that capture a wider range of the main river 4A and the tributary 4B in addition to the cameras 21a, 21b, and 21c. The minimum image capture range of the camera may be approximately 10 to 30 meters.

[0018] The water gate monitoring system 1 also includes an external water level gauge 15 for measuring the water level of the main river 4A, an internal water level gauge 19 for measuring the water level of the tributary 4B, and a flow velocity and direction gauge 17 for measuring the speed and direction of the water flow in the tributary 4B. The external water level gauge 15 and the internal water level gauge 19 may be, for example, an ultrasonic water level sensor or a radio wave sensor. The flow velocity and direction gauge 17 may be a fixed radio wave current gauge, or may be a gauge in which a plurality of pressure sensors are fixed in the axial direction to an axis extending in the depth direction of the tributary 4B, and the water flow velocity in the tributary 4B is measured from the pressure measured by the pressure sensor. When the gate 13 is slightly open, water flows below the gate 13, and the water flow is blocked above the gate 13. The pressure sensor can detect such a difference in the water flow and detect that the gate 13 is not completely closed.

[0019] Furthermore, the floodgate monitoring system 1 is equipped with a speaker 23 and a light 25 that issue an alarm or warning as necessary. The speaker 23 may output a voice represented by words such as "Please evacuate" or may output a siren sound. The light 25 may be a red light or a display showing letters such as "Danger".

[0020] [Floodgate monitoring device] FIG. 2 is a schematic block diagram for explaining the details of the processing performed in the control panel 11 shown in FIG. 1. The control panel 11 corresponds to the floodgate monitoring device of this embodiment, and performs part of the processing by using a cloud system CS. The floodgate monitoring device of this embodiment includes the control panel 11 and a cloud system CS that cooperates with the control panel 11. The cloud system CS includes a foreign object detection unit 111 that detects foreign objects flowing through a waterway from a plurality of images taken by a plurality of cameras 21a, 21b, and 21c, a foreign object flow velocity calculation unit 113 that calculates the flow velocity of the foreign object (hereinafter, referred to as "foreign object flow velocity") based on the position and time in the river or waterway of the foreign object detected by the foreign object detection unit 111, and an obstacle determination unit 115 that determines whether the foreign object can become an obstacle to closing the gate of the floodgate 3 based on the foreign object flow velocity calculated by the foreign object flow velocity calculation unit 113.

[0021] The cloud system CS also includes a network communication unit 118 that receives image data a, b, c sent from the cameras 21a, 21b, 21c, and measurement data sent from the inland water level gauge 15, the outland water level gauge 19, and the flow velocity / direction sensor 17, and transmits the processing results to the control panel 11, and a buffering unit 120 that temporarily stores the data in accordance with the processing order. Such a configuration includes software such as a program, and hardware such as a CPU (Central Processing Unit) and memory that operate the software.

[0022] Meanwhile, the control panel 11 of this embodiment is equipped with a signal transmission unit 119 that transmits control signals to the alarm device group including the light 25 and the speaker 23, and the gate drive driver 20. The control signal may be an ON signal for an audio playback device, or an ON signal for an electric motor that moves the gate 13 up and down. Furthermore, the control panel 11 is also equipped with a network communication unit 117 that communicates with the cloud system CS through a network line. The control panel 11 is equipped with a central processing control unit 110 that comprehensively controls the water gate monitoring device, including the above configuration. The network communication unit 117 and the signal transmission unit 119 are hardware configurations controlled by the central processing control unit 110.

[0023] The floodgate monitoring system 1 incorporating the control panel 11 includes a gate driver 20 that drives the gate 13 of the floodgate 3 to repeatedly open and close when a fault determination unit 115 determines that a foreign object may be an obstacle to closing the gate 13 of the floodgate 3. The gate driver 20 functions as a gate driver in this embodiment.

[0024] The floodgate monitoring system 1 includes a storage battery 30 that stores at least one of the electricity generated by wind power generation and solar power generation. The storage battery 30 may supply power to the entire floodgate monitoring system, including the gate opening / closing mechanism of the gate 13, the outer water level gauge 15, the inner water level gauge 19, the flow speed / direction gauge 17, and the camera 21a. Since the floodgate monitoring system 1 is installed at a location away from a commercial power source, power is supplied from the storage battery. Since strong winds blow near rivers and the like and there are few structures that block the sun, this embodiment has conceived of generating power using wind or solar power and storing the power in the storage battery 30.

[0025] The cloud system CS sequentially inputs image data a, b, c captured by the cameras 21a, 21b, 21c. The input of the image data a, b, c can be realized, for example, by the cameras 21a, 21b, 21c being provided with communication devices for connecting to a network line and transmitting the captured images to the cloud system CS. The image data a, b, c include data for identifying the cameras 21a, 21b, 21c that captured the image data a, b, c, and data indicating the capture time.

[0026] The cloud system CS also inputs the water level, water flow velocity, and flow direction measured by the outer water level gauge 15, the inner water level gauge 19, and the flow velocity and flow direction gauge 17. This input can be realized by similarly equipping the outer water level gauge 15, the inner water level gauge 19, and the flow velocity and flow direction gauge 17 with small communication devices, and the cloud system CS receives the information via the network communication unit 118. In this embodiment, the network communication unit 118 functions as a water flow velocity acquisition unit of the water gate monitoring device.

[0027] The components included in the cloud system CS will be explained below in order. (Foreign object detection unit) The foreign object detection unit 111 performs image analysis on a plurality of images including the image data a, b, c, and d, and detects foreign objects at least a part of which is floating on the water surface. For example, the detection of foreign objects may be performed by detecting only those objects that satisfy a condition, such as being smaller than a predetermined size, among the detected objects on the water surface. This is based on the expectation that relatively small foreign objects are unlikely to obstruct the closing of the gate 13.

[0028] 3(a), 3(b), 3(c), and 3(d) are schematic diagrams for explaining foreign objects detected by the foreign object detection unit 111. In each of FIGS. 3(a) to 3(d), the direction of water flow is indicated by an arrow in the figure. FIGS. 3(a) to 3(d) are arranged in chronological order according to the time of shooting, with the image in FIG. 3(a) being shot first and the image in FIG. 3(d) being shot last. Hereinafter, the image shown in FIG. 3(a) will be referred to as image data a. Also, the images shown in FIGS. 3(b), 3(c), and 3(d) will be referred to as image data b, c, and d, respectively. The foreign object detection unit 111 detects foreign objects F1 and F2 from the image data a. Then, foreign objects F3, F4, F5, and F6 are detected from the next input image data b, foreign objects F7, F8, F9, and F10 are detected from the next image data c, and foreign objects F11, F12, F13, and F14 are detected from the next image data d.

[0029] The direction of water flow between the main river 4A and the tributary 4B may change depending on the water level. Therefore, prior to detecting a foreign object, the foreign object detection unit 111 has the network communication unit 118 acquire flow direction information from the flow velocity / flow direction meter 17, which indicates the direction of water flow in a river or waterway. In this embodiment, the network communication unit 118 functions as a flow direction information acquisition unit. The foreign object detection unit 111 determines the time series of the image data based on the flow direction information.

[0030] (Different flow velocity calculation department) The foreign object flow velocity calculation unit 113 performs, for example, feature point matching on the foreign objects F1 to F14 detected by the foreign object detection unit 111, and estimates the amount of movement and rotation as well as the amount of detection. This processing makes it possible to estimate that the foreign object F2 in the image data a is the same foreign object as the foreign object F6 in the image data b, and that the foreign object F1 is the same foreign object as the foreign object F10 in the image data c. The foreign object flow velocity calculation unit 113 also estimates that the foreign object F3 in the image data b is the same foreign object as the foreign object F9 in the image data c and the foreign object F13 in the image data d. Thereafter, in the same manner, the foreign object F4 in the image data F4, the foreign object F7 in the image data c, and the foreign object F12 in the image data d are estimated to be the same foreign object. The foreign object F8 in the image data c is estimated to be the same foreign object as the foreign object data F14 in the image data d.

[0031] The foreign object flow velocity calculation unit 113 has data linking the cameras 21a, etc. with their positions, and acquires the position where the image data was captured from the camera 21a, etc. that transmitted the image data. In addition, the flow velocity of each foreign object is calculated using the time stamp attached to the image data. The flow velocity may be calculated, for example, each time new image data is input. In this case, the average speed while the foreign object moves within a predetermined range may be taken as the foreign object flow velocity. In addition, the speed calculated between the image data in which the last foreign object was detected and the image data in which the previous foreign object was detected may be taken as the foreign object flow velocity.

[0032] According to this process, when the foreign object flow velocity is the average velocity, the foreign object flow velocity of the foreign objects F3, F9, and F13, which are the same foreign object, is calculated by dividing the difference between the position where the foreign object F3 was photographed and the position where the foreign object F13 was photographed by the difference between the time when the foreign object F3 was photographed and the time when the foreign object F13 was photographed. When the foreign object flow velocity is the most recent velocity, the foreign object flow velocity of the foreign object F3, F9, and F13, which are the same foreign object, is calculated by dividing the difference between the position where the foreign object F9 was photographed and the position where the foreign object F13 was photographed by the difference between the time when the foreign object F9 was photographed and the time when the foreign object F13 was photographed. Furthermore, the foreign object flow velocity is not limited to being calculated from images photographed consecutively, and the foreign object flow velocity of the same foreign object F1 and F10 is calculated using image data a and image data c.

[0033] (Fault determination section) The fault determining unit 115 of this embodiment is capable of performing two types of determination processing. The two types of determination processing will be described below as determination processing A and determination processing B.

[0034] (1) Fault determination process A The judgment process A compares the foreign object flow velocity with the water flow velocity. If the foreign object flow velocity is slower than the water flow velocity, it is judged that the foreign object may become an obstacle to closing the gate 13 of the floodgate 3. The judgment process A is performed because a foreign object with a slow flow velocity cannot pass through the gate 13 together with the water, and may be left behind under the floodgate and prevent the gate 13 from closing.

[0035] 4(a) is a flowchart for explaining the determination process A performed by the fault determination unit 115, and includes the processes performed by the foreign object detection unit 111 and the foreign object flow velocity calculation unit 113. This process is incorporated as a subroutine in the flowchart of the process performed in the water gate monitoring system, which will be described later.

[0036] Prior to detecting a foreign object, the foreign object detection unit 111 detects the water flow direction from the flow velocity / flow direction meter 17. Then, based on the water flow direction, the time series of the image data is determined. That is, the multiple cameras take images at a predetermined time interval and transmit them as image data to the cloud system CS. The cloud system CS temporarily buffers the received image data to organize the input order, and sets it to process in the order from upstream to downstream in the flow direction of the foreign object (step S401). The foreign object detection unit 111 detects a foreign object from each of the image data (step S402), and the foreign object flow velocity calculation unit 113 identifies the same foreign object among the foreign objects (step S403). The foreign object flow velocity calculation unit 113 calculates the foreign object flow velocity using different image data in which foreign objects identified as the same are taken (step S404).

[0037] Here, the fault determination unit 115 compares the calculated foreign flow velocity with the water flow velocity and foreign flow velocity input from the flow velocity / flow direction meter 17. In this embodiment, the foreign flow velocity is subtracted from the water flow velocity, and the velocity after the subtraction is set as the velocity threshold value V th (step S405). If the speed after subtraction is greater than the threshold value Vth (step S405: YES), it is determined that there is a possibility that a foreign object will occur that will prevent the gate 13 from being fully closed (step S406). If the speed after subtraction is less than the threshold value Vth (step S405: NO), it is determined that there is no foreign object that will prevent the gate 13 from being fully closed (step S414). After the above processing, the judgment process A ends and returns to the main routine.

[0038] The process of step 405 is not limited to subtracting the water flow velocity from the foreign flow velocity. For example, the process of step 405 may determine that a fault may occur if the ratio of the foreign flow velocity to the water flow velocity is less than a threshold value.

[0039] (2) Fault determination process B Judgment process B is a process that judges that a foreign object may be an obstacle to closing the gate 13 if a foreign object detected in an image taken of the main river 4A or tributary 4B upstream of the sluice gate 3 is not detected in an image taken of the main river 4A or tributary 4B downstream of the sluice gate 3 within a time range based on the foreign object flow velocity.

[0040] Fig. 4(b) is a flowchart for explaining the judgment process B performed by the fault judgment unit 115, and includes the processes performed by the foreign object detection unit 111 and the foreign object flow velocity calculation unit 113 described above. Moreover, such a process is incorporated as a subroutine into the flowchart of the process performed in the water gate monitoring system described later. Steps S407 to S410 in the flowchart of Fig. 4(b) are similar to steps S401 to S404. Below, steps S412 and S413 that are different from judgment process A will be described.

[0041] The fault determination unit 115 predicts the shooting range and shooting time range that are likely to be captured by the camera if the foreign object passes through the floodgate 3, based on the calculated foreign object flow velocity (step S411). If the fault determination unit 115 does not detect a foreign object within the predicted shooting range and shooting time range, it determines that there is a possibility that the foreign object will get caught below the floodgate 3 and cause a fault that will prevent the gate 13 from being closed (step S413). On the other hand, if the fault determination unit 115 detects a foreign object within the predicted shooting range and shooting time range, it determines that the foreign object will pass through the floodgate 3 and that there is no foreign object that will prevent the gate 13 from being closed (step S415).

[0042] Judgment process B can set an appropriate time for judging the possibility of a fault occurring by predicting the range and time when a foreign object will be detected, and can prevent the time required for judgment from becoming too long. Also, by setting an appropriate range and time range for judging the possibility of a fault occurring, it is possible to narrow down the conditions for identifying foreign objects that have flowed in from upstream among those detected downstream of the floodgate 3.

[0043] In this embodiment, the possibility of an abnormality occurring in the closure of the gate 13 due to a foreign object may be determined using either the above-mentioned determination process A or the determination process B. Also, both the determination processes A and B may be used, in which case the determination process A may be applied first, and if it is determined that there is no possibility of a fault occurring, the determination process B may be performed subsequently. Also, the determination process B may be applied first, and if it is determined that there is no possibility of a fault occurring, the determination process A may be performed subsequently.

[0044] [Overall operation of the gate] Next, the overall operation of the floodgate monitoring system explained above will be explained separately for times of normal water, times of flooding / high tide, and times when there is a possibility of an earthquake / tsunami. (during normal water) FIG. 5 is a schematic diagram showing the state of the floodgate 3 during normal water levels. FIG. 6 is a flowchart for explaining the operation of the floodgate monitoring system 1 during normal water levels. As shown in FIG. 5, during normal water levels, the water of the tributary 4B flows into the main river. At this time, the gate 13 is fully open (hereinafter, referred to as "fully open state"). Whether or not the water level is normal is determined, for example, by whether the water level measured by the external water level gauge 15 is below a threshold value and whether there is no risk of flooding, high tide, earthquake, or tsunami according to information released by the Japan Meteorological Agency. The information released by the Japan Meteorological Agency can be obtained, for example, by obtaining alert information via the cloud.

[0045] During normal water conditions, if a foreign object that may hinder the opening and closing of gate 13 is detected, the object is identified using image analysis such as differential images. Furthermore, after confirming the safety of the surrounding area, an attempt is made to remove the identified foreign object by opening and closing gate 13, and then it is confirmed that the opening and closing operation of gate 13 was performed normally.

[0046] In this embodiment, image data captured by at least one of the multiple cameras installed near the water gate is transmitted to the control panel 11 in parallel with the cloud system CS. However, this embodiment is not limited to this configuration, and a camera for capturing images of intruders may be installed separately and image data may be transmitted directly to the control panel 11.

[0047] As shown in Fig. 6, the central processing control unit 110 judges whether or not there is an intruder at the water gate 3 from an image taken around the water gate (step S501). If it is judged that there is an intruder (step S501: YES), a warning is issued by the speaker 23 or the warning light 25 (step S509). If the intruder does not leave after the warning (step S510: NO), or if the warning reaches a threshold value (n times, for example, 2 times) (step S511: YES), the central processing control unit 110 notifies the police or the like (step S512). If the warning does not reach the threshold value (step S511: NO), the process returns to the judgment of whether or not there is an intruder again (step S501).

[0048] If there is no intruder (step S501: NO), the fault determination process subroutine of either or both of FIG. 4(a) and (b) is executed (step S502). The central processing control unit 110 judges whether or not a foreign object has been detected by the fault determination process subroutine (step S503). If a foreign object has been detected (step S503: YES), the central processing control unit 110 judges whether or not the cause of the inability to fully close is related to a danger to life or body (step S504). Step S504 is a process for judging whether or not a person is near the floodgate 3 by the camera 21a or the like and whether or not there is a possibility of a danger to the life or body of the person by closing the gate 3. For example, if the detected foreign object is a person or an animal, it is desirable not to attempt to remove the foreign object by opening or closing the gate 3 so that the life or body of the person or animal is not endangered or the safety of the foreign object can be ensured. Here, "the safety of the foreign object can be ensured" refers to being able to prevent a danger to the life or body of the foreign object, which is a person or an animal.

[0049] If it is determined that the reason why the gate 13 cannot be fully closed is not related to a threat to life or body (step S504: NO), the signal transmission unit 119 transmits a drive signal to operate the gate 13 to open and close one or more times. The gate 13 moves up and down repeatedly in accordance with the drive signal, and executes removal of foreign matter by opening and closing the gate (step S505). FIG. 7 is a schematic diagram for explaining the removal of foreign matter F. The gate 13 is opened and closed repeatedly in small increments. According to such an operation, the foreign matter under the gate 13 can be removed from under the gate 13 by crushing, squashing, removing, etc. Note that the opening and closing one or more times may be performed repeatedly by opening and closing in small increments without fully closing the gate 13, for example.

[0050] If no foreign object is detected (step S503: NO), the signal transmission unit 119 moves the gate 13 to the lowest position (hereinafter, referred to as "fully closed") (step S506). The central processing control unit 110 determines whether the gate 13 has been fully closed (step S507). The full closure of the gate 13 is confirmed by the pressure measured by the flow velocity / flow direction meter 17.

[0051] If the gate 13 cannot be fully closed (step S507: NO), the central processing control unit 110 communicates with an administrator or the like to take action on-site (step S513). If the gate 13 can be fully closed (step S507: YES), the gate is opened and the process returns to the start.

[0052] If it is determined in step S504 that the cause of the inability to fully close the door is related to a threat to life or health (step S504: YES), the police or the like is notified and measures are taken to deal with the situation on-site (step S513).

[0053] (during floods and high tides) 8, 9, and 10 are schematic diagrams for explaining the state of the sluice gate 3 during floods and high tides. FIG. 11 is a flow chart for explaining the operation performed by the sluice gate monitoring system 1 during floods and high tides. As shown in FIG. 8, when the external water level of the main river 4A becomes higher than that of the tributary 4B during floods and high tides, the water of the main river 4A flows back into the tributary 4B through the open gate 13 in the direction of the arrow d2. FIG. 9 is a diagram showing a state in which water flows into the tributary 4B and the internal water level rises. When water flows into the tributary 4A, the internal water level rises, but the gate 13 cannot be opened due to the backflow while the external water level is higher than the internal water level. To avoid this, the sluice gate monitoring system 1 of this embodiment closes the gate 13 before water flows back into the tributary 4B. FIG. 10 is a diagram showing a state in which the gate 13 opens when the external water level becomes lower than the internal water level, and the water of the tributary 4B flows into the main river 4A.

[0054] As shown in Fig. 11, during flooding or high tide, the central processing control unit 110 first issues an alarm to warn of the occurrence of flooding or high tide (step S601), and executes a fault determination subroutine (step S602). The fault determination subroutine determines whether a foreign object has been detected (step S603). If a foreign object has been detected (step S603: YES), it determines whether the cause of the inability to fully close the gate is related to a threat to life or body (step S604). If there is no threat to life or body (step S604: NO), the gate 13 is opened or closed to remove the foreign object (step S605).

[0055] If no foreign matter is detected in step S602 (step S603: NO), the gate 13 is fully closed (step S606), and it is determined whether the gate has been fully closed (step S607).

[0056] If it is determined that the cause is a threat to the body or life (step S604: YES), it is determined whether the safety of the operator can be ensured (step S611). If the central processing control unit 110 determines that the safety of the operator can be ensured (step S611: YES), the signal transmission unit 119 transmits an on-site response instruction signal to the operator, etc., to instruct the operator to remove the foreign object manually (step S612). If it is determined that the safety of the operator cannot be ensured (step S611: NO), the foreign object cannot be removed manually. The signal transmission unit 119 transmits an alarm instruction signal to instruct the speaker 23 and the light 25 to issue an alarm, and notifies the police (step S613). Next, it is determined whether the gate 13 can be fully closed (step S607), and if it cannot be fully closed, it is determined whether the safety of the operator can be ensured (step S607: NO).

[0057] After removing the foreign object by opening and closing the gate, or after dealing with the situation on site, the central processing control unit 110 closes the gate 13 completely (step S606). It is determined whether the gate 13 can be fully closed (step S607), and if it cannot be fully closed, the process returns to step S604 to determine whether the cause of the inability to fully close the gate is a threat to life or body. In this embodiment, if it is determined that the gate cannot be fully closed even after removing the foreign object by opening and closing the gate a predetermined number of times, the central processing control unit 110 may check the safety of the operator (step S611) and deal with the situation on site (step S112). If the gate 13 can be fully closed (step S607: YES), it is determined whether the water level has reached a predetermined threshold time or more for determining that the risk of flooding or high tide has passed, or is below the threshold depth of the outside water level (step S608). If it is determined in step S608 that the risk of flooding or high tide has passed (step S608: YES), the central processing control unit 110 opens the gate 13 (step S609).

[0058] After opening the gate 13, the central processing control unit 110 determines whether or not a backflow of water has occurred using the current velocity / current direction meter 17 (step S610). If a backflow has occurred (step S610: NO), the signal transmission unit 119 issues an alarm through the speaker 23 and light 25 (step S614) and closes the gate 13 again (step S615). If it is determined that a backflow has not occurred (step S610: YES), the flood / high tide processing ends.

[0059] (If there is a possibility of an earthquake or tsunami) 12, 13, and 14 are schematic diagrams for explaining the state of the floodgate 3 when there is a possibility of an earthquake or tsunami. FIG. 15 is a flow chart for explaining the operation performed in the floodgate monitoring system 1 when there is a possibility of an earthquake or tsunami. As shown in FIG. 12, when the floodgate monitoring system 1 receives a tsunami or earthquake warning via a cloud system or the like, it issues a warning by voice via the speaker 23, a warning light 25, or the like. As shown in FIG. 13, the gate 13 is closed while a tsunami or earthquake warning is issued. As shown in FIG. 14, when the cancellation of the tsunami or earthquake warning is received, the gate 13 is opened after confirming that the outside water level is below the water level threshold and is maintained for the threshold time. However, if water flows back from the main river 4A to the tributary 4B after the gate 13 is opened, the gate 13 is closed again.

[0060] 15, the central processing control unit 110 issues an alarm to the signal transmission unit 119 to notify the signal transmission unit 119 of the possibility of an earthquake or tsunami (step S701), and executes a fault determination processing subroutine by the cloud system CS (step S702). If the foreign object is removed by the fault determination processing subroutine (step S703: YES), it is determined whether the cause of the inability to fully close the gate is related to a threat to life or health (step S604). If there is no threat to life or health (step S704: NO), the foreign object is removed by opening and closing the gate 13 (step S705).

[0061] If no foreign matter is detected in step S703 (step S703: NO), the gate 13 is fully closed (step S706), and it is determined whether or not the gate has been fully closed (step S707).

[0062] If it is determined that the cause is a threat to the body or life (step S704: YES), the signal transmission unit 119 issues an alarm to the speaker 23 and the light 25 indicating that damage may occur (step S712).

[0063] After removing the foreign object by opening and closing the gate, the central processing control unit 110 fully closes the gate 13 (step S706). It is determined whether the gate 13 can be fully closed (step S707). If the gate 13 cannot be fully closed, it is determined that manual response is not possible in the situation where there is a possibility of an earthquake or tsunami, and an alarm is issued via the speaker 23 and the light 25 to indicate the possibility of damage (step S712). If the gate 13 can be fully closed (step S707: YES), the central processing control unit 110 waits until the earthquake and tsunami alarm is lifted (step S708). Then, if the earthquake and tsunami alarm is lifted (step S708: YES), it is determined whether the water level has fallen below the threshold depth of the outside water level for a predetermined threshold time or more, which is determined to be the end of the danger of the earthquake or tsunami (step S709). If it is determined in step S709 that the danger of earthquake and tsunami has passed (step S709: YES), the central processing control unit 110 issues a warning (step S710) and then opens the gate 13 (step S711).

[0064] As described above, according to this embodiment, it is possible to detect foreign objects near the gate installed in the water gate 3 and determine the possibility of preventing the gate from being fully closed. In addition, when a foreign object is detected, the gate can be moved up and down one or more times to crush and remove the foreign object, and the gate can be closed reliably. In addition, when detecting a foreign object, the presence or absence of a foreign object under the gate can be estimated with a high probability because the foreign object flow velocity is sufficiently slower than the water flow velocity, and the foreign object flowing toward the water gate 3 did not pass through the water gate. In addition, the accuracy of foreign object detection can be improved by detecting a foreign object based on factors other than the image, such as the flow velocity of water and foreign objects. Furthermore, by detecting a foreign object under the gate not only from the vicinity of the water gate but also from images before and after the gate, it is possible to detect the foreign object more reliably than directly under the water gate, which is difficult to observe.

[0065] In addition, the present embodiment is not limited to the above-described embodiment. For example, in the present embodiment, an alarm may be sent to a government agency via a cloud system CS along with an alarm from the speaker 23 or the warning light 25. In addition, in the present embodiment, an alarm may be sent to a mobile terminal located in an area that may be affected by a flood or the like, based on the alert information.

[0066] Furthermore, this embodiment is not limited to detecting a foreign object by acquiring images taken by all of the cameras among the multiple cameras 21a, etc. For example, in this embodiment, the foreign object detection unit 111 may function as a camera selection unit that discontinuously selects multiple cameras, and detects a foreign object flowing in a river or the like from images taken by the selected cameras. With such a configuration, the number of image data used in the fault determination process can be thinned out, and the load on the fault determination process can be reduced. At this time, this embodiment may select a camera according to the water flow speed of the river or the like. The selection of cameras according to the water flow speed may be, for example, by selecting cameras densely in a range where the water flow speed is fast, and selecting cameras sparsely in a range where the water flow speed is slow. In this way, the number of image data can be reduced and the load on the process can be reduced without reducing the detection accuracy of the foreign object.

[0067] In the embodiment described above, the process of determining whether or not a foreign object may cause a failure that prevents the gate from being fully closed is performed in the cloud system CS, but the present embodiment is not limited to this configuration. For example, more processes, such as issuing an alarm, may be performed in the cloud system CS, and part of the process of determining whether a failure may occur may be performed in the control panel 11. Furthermore, the floodgate monitoring system may include a large computer that performs all processes, and the computer may communicate with and control the control panel 11. [Explanation of symbols]

[0068] 1. Water Gate Monitoring System 2. Embankment 3 sluice gate 11 Control Panel 13 Gate 14 Gate support 15 Outside water level gauge 17 Flow velocity / current direction meter 19 Inner water level gauge 20 Gate driver 21a, 21b, 21c Camera 23 Speaker 25 Warning light 30 Storage battery 110 Central Processing Unit 111 Foreign object detection unit 113 Foreign flow velocity calculation department 115 Disability Assessment Department 117,118 Network Communication Department 119 Signal transmitter 120 Buffering Section

Claims

1. A water gate monitoring device for monitoring a water gate installed in a river or waterway, an image acquisition unit that acquires a plurality of images taken by a plurality of cameras that capture a plurality of positions along the flow direction of the river or the waterway; a flow direction information acquisition unit that acquires flow direction information indicating a flow direction of water in the river or the waterway; a foreign object detection unit that detects a foreign object flowing in the river or the waterway from the plurality of images acquired by the image acquisition unit; an extraneous object flow velocity calculation unit that calculates an extraneous object flow velocity, which is a flow velocity of the extraneous object, based on a position and a time in the river or the waterway of the extraneous object detected by the extraneous object detection unit; an obstacle determination unit that determines whether or not the foreign object may be an obstacle to closing the gate of the water gate based on the foreign object velocity calculated by the foreign object velocity calculation unit, The foreign object detection unit includes: determining a time sequence of the images based on the flow direction information, and comparing the image captured earlier and the image captured later based on the determination to determine whether the foreign object is the same or different; Water gate monitoring device.

2. A water flow velocity acquisition unit that acquires flow velocity data that measures the flow velocity of water flowing through the river or the waterway, The floodgate monitoring device of claim 1, wherein the fault determination unit includes a flow velocity comparison unit that compares the foreign object flow velocity with the water flow velocity, and determines that the foreign object may be an obstacle to closing the gate of the floodgate if the foreign object flow velocity is slower than the water flow velocity.

3. The floodgate monitoring device of claim 1, wherein the obstacle determination unit determines that the foreign object may be an obstacle to closing the gate of the floodgate when the foreign object detected in the image taken of the river or waterway upstream of the floodgate is not detected in the image taken of the river or waterway downstream of the floodgate within a time range based on the foreign object flow velocity.

4. The floodgate monitoring device of claim 1, further comprising a drive signal transmitting unit that transmits a drive signal to a gate driving unit that opens and closes the gate of the floodgate to open and close the gate one or more times when it is determined that the foreign object may be an obstacle to closing the gate of the floodgate.

5. The floodgate monitoring device of claim 1, further comprising a response signal transmission unit that transmits an on-site response instruction signal instructing the foreign object to be manually removed if it is determined that the foreign object may hinder the closing of the floodgate gate and the safety of the foreign object cannot be ensured.

6. The floodgate monitoring device of claim 1, further comprising an alarm signal transmitting unit that transmits an alarm instruction signal to an alarm device including at least one of a speaker and a light to issue an alarm when it is determined that the foreign object may hinder the closing of the floodgate gate and manual removal of the foreign object is not possible.

7. A water gate monitoring system for monitoring a water gate installed in a river or a waterway, comprising: A plurality of cameras that capture images of a plurality of positions along the flow direction of the river or the waterway; a flow direction information acquisition unit that acquires flow direction information indicating a flow direction of water in the river or the waterway; a foreign object detection unit that detects foreign objects flowing in the river or the waterway from the plurality of images captured by the plurality of cameras; an extraneous object flow velocity calculation unit that calculates an extraneous object flow velocity, which is a flow velocity of the extraneous object, based on a position and a time in the river or the waterway of the extraneous object detected by the extraneous object detection unit; an obstacle determination unit that determines whether the foreign object may be an obstacle to closing the gate of the water gate based on the foreign object velocity calculated by the foreign object velocity calculation unit; a gate driving unit that drives the gate of the water gate to open and close one or more times when the fault determination unit determines that the foreign object may be an obstacle to closing the gate of the water gate, The foreign object detection unit includes: determining a time sequence of the images based on the flow direction information, and comparing the image captured earlier and the image captured later based on the determination to determine whether the foreign object is the same or different; Water gate monitoring system.

8. 8. The water gate monitoring system according to claim 7, wherein at least a part of the foreign object detection unit, the foreign object flow velocity calculation unit and the fault determination unit are provided in a server device connected via a network.

9. The floodgate monitoring system of claim 7, further comprising a camera selection unit that discontinuously selects the plurality of cameras, and the foreign object detection unit detects foreign objects flowing in the river or waterway from images taken by the cameras selected by the camera selection unit.

10. 8. The watergate monitoring system according to claim 7, further comprising a storage battery that stores at least one of power generated by wind power generation and power generated by solar power generation, the storage battery supplying power to the gate driving unit.

11. A water gate monitoring method for monitoring a water gate installed in a river or a waterway, comprising the steps of: An image acquisition unit acquires a plurality of images taken by a plurality of cameras that capture a plurality of positions along the flow direction of the river or the waterway; A flow direction information acquisition unit acquires flow direction information indicating a flow direction of water in the river or the waterway; a step of detecting a foreign object flowing in the river or the waterway from the plurality of acquired images by a foreign object detection unit; a step of an extraneous flow velocity calculation unit calculating an extraneous flow velocity, which is a flow velocity of the extraneous object, based on a position and a time of the detected extraneous object in the river or the waterway; a step of determining whether or not the foreign object may be an obstacle to closing the gate of the water gate based on the foreign object flow velocity by a fault determination unit; In the step of detecting the foreign object, the foreign object detection unit determining a time sequence of the images based on the flow direction information, and comparing the image captured earlier and the image captured later based on the determination to determine whether the foreign object is the same or different; Flood gate monitoring method.

12. A computer program that causes a computer to execute the water gate monitoring method according to claim 11.

Citation Information

Patent Citations

  • River monitoring and early warning method and system

    CN112289004A

  • River channel monitoring method and device

    CN113239863A

  • River runoff analysis method and system based on river floater autonomous learning

    CN115761520A

  • Water conservancy flap gate

    CN212175706U

  • Automatic open / Closure control method of sluice gate

    JP1999336057A

Cited By

  • Water gate control system, water gate control device, water gate control program

    JP7774758B1