Anomaly monitoring device

Abstract

To provide a method by which an abnormality of a blockade machine is accurately detected by means of properly extracting a shutdown rod part from an image of a photographed shutdown rod.SOLUTION: An abnormality monitoring device 10 monitors an abnormality of a shutdown machine based on a shutdown rod image which is an image of the shutdown rod photographed by a camera 3 installed in a railroad crossing. The shutdown rod is constituted of a rod with distributed prescribed marker color bands accompanied by prescribed intervals along the longitudinal length. The abnormality monitoring device 10 has a detection picture image generation unit 141 to generate detection pictures with mask processing for masking parts other than marker color components from shutdown rod pictures, and an abnormality detection unit 143 to detect an abnormality of the shutdown machine based on picture parts corresponding to the marker color in the detection picture image.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to an abnormality monitoring device that monitors abnormalities in a circuit breaker. [Background technology]

[0002] For example, various abnormalities can occur in the barriers installed at railroad crossings, one of the most common of which is the breakage of the barrier rod due to a car collision, etc. If the barrier rod breaks, it loses its function of preventing vehicles from entering the crossing, so for safety reasons, the barrier rod must be replaced or repaired promptly.

[0003] For example, there is a technology for detecting breakage of a barrier rod in Patent Document 1. In the technology in Patent Document 1, a camera is mounted on a train and photographs the barrier rod when the train passes through a railroad crossing. Then, based on the photographed part of the barrier rod, it is determined whether or not there is an abnormality in the barrier rod. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2012-056514 Summary of the Invention [Problem to be solved by the invention]

[0005] In order to use the technology of Patent Document 1 to photograph the barrier rod and detect abnormalities such as breakage, it is necessary to correctly extract the barrier rod portion from the photographed image. However, the technology of Patent Document 1 photographs the barrier rod using a photographing device mounted on a train, and does not mention in detail the method of said extraction, which could lead to a problem of reduced accuracy in detecting abnormalities depending on the method applied. Furthermore, while the explanation has been given about barriers at railroad crossings, similar problems could arise with barriers installed at the entrances and exits of gated parking lots such as coin parking lots.

[0006] The problem that the present invention aims to solve is to provide a technology that can accurately detect abnormalities in a circuit breaker by properly extracting the circuit breaker rod portion from an image of the circuit breaker rod. [Means for solving the problem]

[0007] The first invention for solving the above problem is an abnormality monitoring device that monitors abnormalities in a circuit breaker based on a circuit breaker image, which is an image of a circuit breaker, wherein the circuit breaker has predetermined marker colors arranged at predetermined intervals along its longitudinal direction, and the abnormality monitoring device comprises: a detection image generation means that generates a detection image by performing a masking process to mask all color components from the circuit breaker image other than the marker color; and an abnormality detection means that detects abnormalities in the circuit breaker based on an image portion in the detection image that corresponds to the marker color.

[0008] According to the first aspect of the present invention, by focusing on the color scheme of the marker colors applied at predetermined intervals along the longitudinal direction of the barrier rod and masking color components other than the marker color in the barrier rod image, it is possible to extract the image portion corresponding to the marker color. Then, it is possible to detect abnormalities in the barrier based on the image portion. This makes it possible to properly extract the barrier portion from the barrier rod image, and to accurately detect abnormalities in the barrier.

[0009] A second invention is the anomaly monitoring device of the first invention, wherein the detection image generating means generates the detection image by performing grayscale processing and binarization processing on the image that has been subjected to the mask processing.

[0010] According to the second aspect of the present invention, after the masking process is performed on the blocking bar image, the grayscale process and the binarization process are performed to generate the detection image.

[0011] A third invention is an abnormality monitoring device of the first or second invention, in which the abnormality detection means performs an edge detection process on the detection image and an extraction process to extract, from the detected edge portions, barrier bar edge portions that are included in a predetermined barrier bar photography area, and detects an abnormality in the barrier based on the extracted barrier bar edge portions.

[0012] According to the third aspect of the present invention, edge detection processing is performed on the detection image to extract the edge portion of the barrier rod included in the barrier rod photographed area, thereby making it possible to properly extract the image portion of the barrier rod.

[0013] A fourth invention is an abnormality monitoring device of the third invention, in which the abnormality detection means detects breakage of the circuit breaker rod based on any one of the arrangement direction, arrangement number, and arrangement length of the circuit breaker rod edge portion in the image.

[0014] According to the fourth aspect of the present invention, breakage of the breaker cans can be detected from the arrangement direction, arrangement number and arrangement length of the breaker can edge portions included in the breaker can photographing area.

[0015] Further, a fifth invention is an abnormality monitoring device of the third invention, in which the detection image generating means generates a first detection image for a first barrier bar image relating to a first barrier bar, and generates a second detection image for a second barrier bar image relating to a second barrier bar installed at the same railroad crossing as the first barrier bar, and the abnormality detection means compares the barrier bar edge portion relating to the first detection image with the barrier bar edge portion relating to the second detection image to detect a failure in the raising or lowering of either the first barrier bar or the second barrier bar.

[0016] According to the fifth invention, a fault in the raising and lowering of a barrier rod can be detected by comparing the barrier rod edge portion extracted from one of the barrier rods installed at the same railroad crossing with the barrier rod edge portion extracted from the other barrier rod.

[0017] A sixth invention is an abnormality monitoring device of the third invention, in which the abnormality detection means detects a failure in the raising and lowering of the circuit breaker based on the barrier edge portion obtained by performing the edge detection process and the extraction process on the detection image at two timings separated by a predetermined time interval equal to or greater than the raising and lowering operation time.

[0018] According to the sixth aspect of the present invention, for example, a failure in the raising and lowering of a circuit breaker can be detected based on the edge portion of the circuit breaker bar extracted at each of the timing when the circuit breaker bar starts to raise and lower and the timing when the circuit breaker bar is supposed to end its raising and lowering operation.

[0019] A seventh invention is an abnormality monitoring device of the third invention, in which the abnormality detection means detects a total loss of the circuit breaker rod when the circuit breaker rod edge portion is not extracted within a predetermined time period that is equal to or longer than the lifting / lowering operation time.

[0020] According to the seventh aspect of the present invention, it is possible to detect a total breakage in which the circuit breaker rod is broken off at its base. [Brief explanation of the drawings]

[0021] [Figure 1] FIG. 1 is a diagram showing an example of a schematic configuration of a monitoring system to which an anomaly monitoring device is applied. [Figure 2] FIG. 2 is a diagram showing an example of a circuit breaker to be monitored by the abnormality monitoring device. [Figure 3] FIG. 10 is a diagram showing an example of an image of the circuit breaker rod when the circuit breaker rod is in an open state. [Figure 4] FIG. 10 is a diagram showing an example of an image of the interrupter rod when the interrupter rod is in an interrupted state. [Figure 5] FIG. 10 is a diagram showing an example of a detection image after edge detection processing for an image of a barrier rod when the barrier rod is not broken. [Figure 6] FIG. 10 is a diagram showing another example of a detection image after edge detection processing for an image of a barrier rod when the barrier rod is not broken. [Figure 7] 10 is a diagram showing an example of a detection image after edge detection processing on an image of a breaker rod when the breaker rod is broken; FIG. [Figure 8]FIG. 10 is a diagram showing another example of a detection image after edge detection processing for an image of a breaker rod when the breaker rod is broken. [Figure 9] FIG. 2 is a block diagram showing an example of the functional configuration of the abnormality monitoring device. [Figure 10] 4 is a flowchart showing the flow of processing performed by the abnormality monitoring device. [Figure 11] 11 is a flowchart showing the processing flow following FIG. 10. [Figure 12] FIG. 4 is a diagram showing an example of a first image. [Figure 13] FIG. 10 is a diagram showing an example of a second image. [Figure 14] 10A and 10B are diagrams illustrating an abnormality detection process in Modification 2. DETAILED DESCRIPTION OF THE INVENTION

[0022] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments described below, and the forms to which the present invention can be applied are not limited to the following embodiments. In addition, in the description of the drawings, the same parts are given the same reference numerals.

[0023] Fig. 1 is a diagram showing a schematic configuration example of a monitoring system to which an anomaly monitoring device 10 according to this embodiment is applied. For example, the monitoring system shown in Fig. 1 is configured such that a central device 9 and an anomaly monitoring device 10 are communicably connected via a network N.

[0024] The abnormality monitoring device 10 monitors abnormalities in the crossing gates installed at the crossing based on images of the crossing gates taken by the camera 3 installed at the crossing.

[0025] The central device 9 receives an abnormality occurrence notification from the abnormality monitoring device 10 and controls alarm output, etc. For example, the central device 9 controls the display device to display the occurrence of an abnormality in the circuit breaker 5 that is the monitoring target of the abnormality monitoring device 10 that issued the notification, the type of abnormality that has occurred, etc., to be displayed, to output an alarm sound to notify the occurrence of the abnormality, and to notify a predetermined contact of the abnormality that has occurred. The content of the received occurrence notification can also be saved in a storage device as an abnormality occurrence history. The central device 9 can also control the transfer of the content of the occurrence notification to a mobile device such as a smartphone or tablet computer carried by a maintenance worker.

[0026] FIG. 2 is a diagram showing an example of a crossing gate 5 that is monitored by the abnormality monitoring device 10. Railroad tracks and the like are not shown. FIG. 2 shows an example in which a crossing gate 5 is installed at each entrance to a road section that crosses the railroad tracks, so as to block access to the crossing 1, more specifically, to block access to the road section that crosses the railroad tracks. As shown in FIG. 2, each crossing gate 5 is equipped with a barrier rod 7 that descends when a train passes, blocking access to people and vehicles into the crossing 1. After the train has passed, the barrier rod 7 of one of the crossing gates 5 in FIG. 2 is raised, as shown by the dashed line, to allow access into the crossing 1.

[0027] The barrier rod 7 is configured with a predetermined marker color 71 applied at predetermined intervals along the longitudinal direction. The marker color 71 is applied by attaching a reflective material of the marker color to the surface of the barrier rod 7, or by applying paint of the marker color. For example, there are barrier rods in which the marker color is alternately arranged with yellow and black, and barrier rods in which the marker color is alternately arranged with red and white, etc.

[0028] The camera 3 for capturing images of the barrier bars is installed at each crossing gate 5 at the railroad crossing 1, and captures images of the barrier bars 7 of that gate 5. In this embodiment, the camera 3 is installed so that its capturing range includes both the barrier bars (dashed lines) 7 in an open state that have been raised to a predetermined raised position, and the barrier bars (solid lines) 7 in a closed state that have been lowered to a predetermined lowered position. The camera 3 then captures an image of that capturing range as a barrier bar image and outputs it to the abnormality monitoring device 10.

[0029] FIG. 3 is a diagram showing an example of an image of the barrier rod 7 when the barrier rod 7 is in the open state. FIG. 4 is a diagram showing an example of an image of the barrier rod 7 when the barrier rod 7 is in the closed state. For ease of understanding, FIG. 3 illustrates the barrier rod in an upright position (at an elevation angle of 90 degrees) as the open state. However, some barriers stop at a certain tilt when in the open state (for example, at an elevation angle of approximately 70 degrees). Therefore, it is advisable to define the state of the barrier rod in the open state according to the barrier to be monitored. As shown in FIG. 3, in the image of the barrier rod 7 when the barrier rod 7 is in the open state, if the barrier rod 7 is not broken, the barrier rod 7 is captured in the barrier rod photographing area A1 surrounded by a dashed line (hereinafter referred to as the "barrier rod photographing area when open"). As shown in FIG. 4, in the image of the barrier rod 7 when the barrier rod 7 is in the closed state, if the barrier rod 7 is not broken, the barrier rod 7 is captured in the barrier rod photographing area A3 surrounded by a dashed line (hereinafter referred to as the "barrier rod photographing area when closed").

[0030] On the other hand, the image of the circuit breaker rod 7 when the circuit breaker rod 7 is in the raising and lowering operation shows, although not shown, the circuit breaker rod 7 descending from the raised position in Fig. 3 to the lowered position in Fig. 4, and ascending from the lowered position in Fig. 4 to the raised position in Fig. 3. Therefore, during the raising and lowering operation, the circuit breaker rod 7 is not captured in the open circuit breaker rod photographing area A1 or the closed circuit breaker rod photographing area A3.

[0031] Therefore, the abnormality monitoring device 10 processes the barrier bar image from the camera 3 and detects the image portion in the barrier bar image that corresponds to the color scheme 71 of the marker color of the barrier bar 7, thereby monitoring the abnormality of the barrier 5 being monitored. Specifically, the abnormality monitoring device 10 performs a detection image generation process that generates a detection image by performing a mask process that masks color components other than the marker color from the barrier bar image, and an abnormality detection process that detects an abnormality in the barrier 5 based on the image portion in the detection image that corresponds to the marker color. In the example of Fig. 2, the abnormality monitoring device 10 repeatedly performs each process for each barrier 5 based on the barrier bar images input from the two cameras 3.

[0032] 1. Detection image generation process In the detection image generation process, the anomaly monitoring device 10 first performs masking of the interrupted light image. For example, a range of brightness values ​​indicating the RGB (red, green, blue) of the marker color is set in advance as the color components of the marker color. Then, the anomaly monitoring device 10 performs masking of the interrupted light image by masking color components other than the marker color of the interrupted light image. By using masking, it is possible to extract only the color component of the marker color from the interrupted light image. For example, if the marker color is yellow, the masking process masks pixels other than yellow in the interrupted light image, so it is possible to extract only the yellow pixels in the interrupted light image.

[0033] Next, the anomaly monitoring device 10 performs grayscale processing on the masked image.The anomaly monitoring device 10 then performs binarization processing on the grayscaled image, and obtains the binarized image as a detection image. Note that after the grayscale processing, various filters such as a median filter, Gaussian filter, bilateral filter, and non-local means filter may be used to remove noise such as flickering from the image.

[0034] 2.About abnormality detection processing In the abnormality detection process, the abnormality monitoring device 10 first performs edge detection on the detection image. This can be achieved by applying known methods, such as edge detection using the Canny method, a Laplacian filter, or a Sobel filter. The abnormality monitoring device 10 then performs extraction processing to extract the barrier rod edge portion from the edge portion detected by the edge detection processing, and detects an abnormality in the circuit breaker 5 based on the extracted barrier rod edge portion. FIG. 5 is a diagram showing an image obtained after edge detection processing has been performed on the detection image obtained from the barrier rod image of FIG. 3, which illustrates an example of a case where the barrier rod 7 is not broken. FIG. 6 is a diagram showing an image obtained after edge detection processing has been performed on the detection image obtained from the barrier rod image of FIG. 4, which illustrates an example of a case where the barrier rod 7 is not broken. Meanwhile, FIGS. 7 and 8 are diagrams showing examples of images obtained after edge detection processing has been performed on the detection image obtained from the barrier rod image of a case where the barrier rod 7 is broken.

[0035] 3 and 4, the circuit breaker rod 7 in the open state is captured in the open circuit breaker rod photographing area A1 in the circuit breaker rod image, and the circuit breaker rod in the closed state is captured in the closed circuit breaker rod photographing area A3. If the circuit breaker rod 7 is not broken, the marker color scheme 71 applied to the circuit breaker rod 7 will all be lined up in a straight line across the entire open circuit breaker rod photographing area A1 or the closed circuit breaker rod photographing area A3. Therefore, in the image after edge detection processing, if the circuit breaker rod 7 is in the open state, as shown in FIG. 5, an edge portion corresponding to the marker color scheme 71 (hereinafter referred to as the "marker edge portion") is included in the open circuit breaker rod photographing area A1 as a circuit breaker rod edge portion. If the circuit breaker rod 7 is in the closed state, as shown in FIG. 6, a marker edge portion related to the color scheme 71 is included in the closed circuit breaker rod photographing area A3 as a circuit breaker rod edge portion.

[0036] On the other hand, if the circuit breaker rod 7 is broken, for example, because it is bent or the broken part is chipped due to falling, all of the marker edge parts that would be captured if the circuit breaker rod 7 was sound will not be captured in the circuit breaker rod open imaging area A1 or the circuit breaker rod closed imaging area A3. Therefore, the number of marker edge parts included in the circuit breaker rod open imaging area A1 or the circuit breaker rod closed imaging area A3 will be reduced by the number corresponding to the cut or bent parts, etc.

[0037] For example, Figure 7 shows an example where the tip of the interrupter rod 7 is broken and chipped. In the example of Figure 7, because part of the interrupter rod 7 is chipped, the arrangement of the marker edge portions in the interrupter rod shooting area A1 when open is interrupted halfway, and the marker edge portion is not included within range A101. Also, Figure 8 shows an example where the interrupter rod 7 is bent halfway. In the example of Figure 8, the interrupter rod 7 is bent halfway, and the bent portion is captured outside the interrupter rod shooting area A3 when closed. Therefore, the arrangement of the marker edge portions in the interrupter rod shooting area A3 when closed is interrupted halfway, and the marker edge portion is not included within range A301.

[0038] Therefore, in the extraction process, the abnormality monitoring device 10 extracts the breaker rod edge portion included in the breaker rod photographing area A1 when open and the breaker rod edge portion included in the breaker rod photographing area A3 when closed from the image after edge detection processing of the detection image. When the breaker rod 7 is in the open state, the breaker rod edge portion is extracted from the breaker rod photographing area A1 when open, and when it is in the closed state, the breaker rod edge portion is extracted from the breaker rod photographing area A3 when closed. Then, if the breaker rod edge portion is extracted from the breaker rod photographing area A1 when open or the breaker rod photographing area A3 when closed as a result of the extraction process, the abnormality monitoring device 10 performs a break determination process to detect an abnormality in the crossing barrier 5.

[0039] In addition, in this embodiment, when the barrier rod edge portion is not extracted from either the barrier rod photographing area A1 when opened or the barrier rod photographing area A3 when closed, that is, when the barrier rod 7 is in the lifting or lowering operation and is not captured in each area A1, A3, a lifting or lowering failure determination process is performed to detect an abnormality in the barrier 5.

[0040] Specifically, in the breakage determination process, the abnormality monitoring device 10 first counts the number of marker edge portions (arrangement number) by treating each rectangular edge portion among the breaker rod edge portions extracted in the extraction process as one marker edge portion. Then, if the counted number is the same as the number of marker color arrangements 71 when there is no breakage in the breaker rod 7, the abnormality monitoring device 10 determines that there is no breakage, and if it is less than that number, it determines that there is breakage.

[0041] In addition, if a determination is made that a break has occurred, the position where the arrangement of the marker edge portions in the open-state interrupter can imaging area A1 or the closed-state interrupter can imaging area A3 is discontinued may be detected as the cut position or bent position (break position) of the interrupter can 7. For example, position P1 shown in FIG. 7 may be detected as the break position (cut position in the example of FIG. 7). Furthermore, by detecting marker edge portions whose arrangement direction does not follow the longitudinal direction (direction from the base of the interrupter can to the tip) of the open-state interrupter can imaging area A1 or the closed-state interrupter can imaging area A3, it may be possible to determine whether the break position is a cut position or a bent position (i.e., whether the broken portion is missing or bent). This can be detected by determining whether a marker edge portion exists outside the open-state interrupter can imaging area A1 or the closed-state interrupter can imaging area A3. For example, in the example of FIG. 8, marker edge portions exist outside the closed-state interrupter can imaging area A3, and their arrangement direction does not follow the longitudinal direction of the closed-state interrupter can imaging area A3. Therefore, the breakage position P3 is detected as a bent position. In this way, when it is determined that "a breakage has occurred," it becomes possible to detect the breakage position and whether the breakage position is a cut position or a bent position.

[0042] Alternatively, the length (array length) of the array of marker edge portions included in the open-state interrupter can imaging area A1 or the closed-state interrupter can imaging area A3 may be calculated to determine whether or not there is breakage. The array length is calculated as the length between both ends of the array of marker edge portions included in the open-state interrupter can imaging area A1 or the closed-state interrupter can imaging area A3. For example, if the calculated length is shorter than the normal length L1 shown in FIG. 5 or the normal length L3 shown in FIG. 6, it is determined that there is breakage. In the example of FIG. 7, the length L11 of the array of marker edge portions in the open-state interrupter can imaging area A1 is calculated, and since the calculated length L11 is shorter than the length L1, it is determined that there is breakage. Similarly, in the example of FIG. 8, it is determined that there is breakage because the length L31 is shorter than the length L3.

[0043] On the other hand, in the lifting / lowering failure determination process, the abnormality monitoring device 10 detects a lifting / lowering failure of the circuit breaker rod 7 based on the circuit breaker rod edge portion obtained by performing edge detection and extraction processes on detection images at two timings separated by a predetermined time interval equal to or greater than the lifting / lowering operation time. Specifically, the abnormality monitoring device 10 determines the arrival of the first timing, which is the timing when the circuit breaker rod edge portion (marker edge portion) is no longer detected from either the open circuit breaker rod imaging area A1 or the closed circuit breaker rod imaging area A3. If the abnormality monitoring device 10 determines that the first timing has arrived, if the circuit breaker rod 7 is descending, it sets the second timing to a timing after a predetermined time for determining when the circuit breaker rod 7 has descended, which is equal to or greater than the time required for the circuit breaker rod 7 to descend from the raised position to the lowered position. If the circuit breaker rod 7 is ascending, it sets the second timing to a timing after a predetermined time for determining when the circuit breaker rod 7 has ascended, which is equal to or greater than the time required for the circuit breaker rod 7 to ascend from the lowered position to the upper position. Whether the timing is up or down can be determined by determining whether the timing is down if the edge of the barrier rod is included in the open barrier rod photography area A1 until just before the timing is determined as the first timing, and determining whether the timing is up if the edge of the barrier rod is included in the closed barrier rod photography area A3 until just before the timing is determined as the first timing.

[0044] Here, for example, if the edge portion of the interrupter rod is no longer detected from the interrupter rod photographing area A1 when opened, and the edge portion of the interrupter rod is not detected from the interrupter rod photographing area A3 when closed even after the descent time has passed, it is considered that a lifting / lowering malfunction has occurred, such as when the interrupter rod 7 stops halfway before descending to the descended position, or when the descent is slow due to an abnormality such as motor deterioration. Similarly, if the edge portion of the interrupter rod is no longer detected from the interrupter rod photographing area A3 when closed, and the edge portion of the interrupter rod is not detected from the interrupter rod photographing area A1 when opened even after the rise time has passed, it is considered that a lifting / lowering malfunction has occurred.

[0045] Therefore, in the lifting / lowering defect determination process, once the second timing is set as described above, the abnormality monitoring device 10 determines that the second timing has arrived. Then, when the second timing arrives, the abnormality monitoring device 10 determines whether or not an edge portion of the barrier bar is detected from the open barrier bar photographing area A1 or the closed barrier bar photographing area A3. If it is detected, the abnormality monitoring device 10 determines that "there is no lifting / lowering defect," and if it is not detected, it determines that "there is a lifting / lowering defect," thereby detecting a lifting / lowering defect of the circuit breaker 5. At this time, it can also determine and detect whether the lifting or lowering operation is faulty.

[0046] [Function Configuration] Fig. 9 is a block diagram showing an example of the functional configuration of the anomaly monitoring device 10. As shown in Fig. 9, the anomaly monitoring device 10 includes an operation unit 110, a display unit 120, an image input unit 130, a calculation processing unit 140, a storage unit 150, and a communication unit 190, and can be configured as a type of computer.

[0047] The operation unit 110 is configured to have push switches, dials, etc., and the display unit 120 is configured to have LEDs, a small liquid crystal display device, etc. The operation unit 110 and the display unit 120 are mainly used by workers during maintenance.

[0048] The image input unit 130 is connected to the camera 3 and inputs a barrier bar image at predetermined frame time intervals (hereinafter also simply referred to as a "frame"). As explained with reference to FIG. 2, the camera 3 is installed for each barrier 5 that is the monitoring target of the abnormality monitoring device 10, and takes an image of the barrier bar 7 of that barrier 5. The input barrier bar image is stored in the memory unit 150 as barrier bar image data 153 for each barrier 5.

[0049] The arithmetic processing unit 140 is realized by electronic components such as a processor, such as a central processing unit (CPU) or a digital signal processor (DSP), an application specific integrated circuit (ASIC), or a field-programmable gate array (FPGA), and controls the input and output of data between each unit of the device. The arithmetic processing unit 140 performs various arithmetic processing based on predetermined programs, data, and barrier bar images input to the image input unit 130, thereby controlling the operation of the anomaly monitoring device 10. The arithmetic processing unit 140 includes a detection image generating unit 141 as a detection image generating means and an anomaly detection unit 143 as an anomaly detecting means. These functional units may be processing blocks realized as software by executing a program, or may be circuit blocks realized by hardware circuits, such as an ASIC or FPGA. In this embodiment, the arithmetic processing unit 140 will be described as processing blocks realized as software by executing a railroad crossing monitoring program 151.

[0050] The detection image generation unit 141 is a functional unit that performs detection image generation processing. In this embodiment, the detection image generation unit 141 performs mask processing on the obstruction image from the camera 3, and performs grayscale processing and binarization processing on the masked image to generate a detection image.

[0051] The abnormality detection unit 143 is a functional unit that performs abnormality detection processing. In this embodiment, the abnormality detection unit 143 performs edge detection processing on the detection image and extraction processing to extract edge portions included in the open-time shutoff bar photography area A1 and the closed-time shutoff bar photography area A3 in the image after the edge detection processing as shutoff bar edge portions. Then, if a shutoff bar edge portion is extracted from the open-time shutoff bar photography area A1 or the closed-time shutoff bar photography area A3 as a result of the extraction processing, the abnormality detection unit 143 performs breakage determination processing, and if a shutoff bar edge portion is not extracted from either the open-time shutoff bar photography area A1 or the closed-time shutoff bar photography area A3, the abnormality detection unit 143 performs lifting / lowering failure determination processing to detect an abnormality in the crossing barrier 5.

[0052] The storage unit 150 is realized by a storage medium such as an IC memory, a hard disk, an optical disk, etc. Programs for operating the abnormality monitoring device 10 and realizing the various functions of the abnormality monitoring device 10, data used during execution of the programs, etc. are stored in advance in this storage unit 150, or are temporarily stored each time processing is performed. For example, the storage unit 150 stores a railroad crossing monitoring program 151, barrier bar image data 153, and abnormality detection result data 155.

[0053] The railroad crossing monitoring program 151 is a program for causing the arithmetic processing unit 140 to function as the detection image generating unit 141 and the abnormality detecting unit 143 .

[0054] The abnormality detection result data 155 stores the result of abnormality detection for each frame based on the crossing bar image from the corresponding camera 3 for each crossing bar 5 that is the monitoring target of the abnormality monitoring device 10.

[0055] The communication unit 190 is a device that communicates with external devices via wired or wireless communication. For example, when the abnormality detection unit 143 detects an abnormality in the crossing gate 5, specifically when a breakage or lifting failure of the crossing rod 7 is detected, a notification of the occurrence of the abnormality is sent to the central device 9. For example, the notification of the occurrence of the abnormality may include identification information of the crossing gate 5 in which the abnormality occurred, an image of the crossing gate 5, and the type of abnormality indicating whether the detected abnormality is a breakage or lifting failure of the crossing rod 7. In addition to the notification of the occurrence of the abnormality, the communication unit 190 may be configured to send an alarm signal to an on-board device of the train or a station device, or to send an alarm activation signal to a predetermined alarm issuing device that outputs an alarm sound around the railroad crossing 1.

[0056] [Processing flow] Fig. 10 is a flowchart showing the flow of processing performed by the abnormality monitoring device 10. Fig. 11 is a flowchart showing the flow of processing following Fig. 10. The processing described here can be realized in the abnormality monitoring device 10 by the calculation processing unit 140 reading out and executing the railroad crossing monitoring program 151 from the storage unit 150.

[0057] 10 and 11, the arithmetic processing unit 140 repeats the processing of loop A for each frame to monitor the circuit breaker 5 for abnormalities (steps S1 to S35). Note that Figs. 10 and 11 show a processing flow focusing on the abnormality monitoring of one circuit breaker 5, and the arithmetic processing unit 140 repeats the processing of loop A for each circuit breaker 5 based on the circuit breaker bar image input for each frame from the corresponding camera 3.

[0058] In Loop A, first, the detection image generation unit 141 performs mask processing on the blocking image (step S3). Next, the detection image generation unit 141 performs grayscale processing on the image after the mask processing in step S3 (step S5). Then, the detection image generation unit 141 performs binarization processing on the image after the grayscale processing in step S5 (step S7) to generate a detection image.

[0059] Once the detection image has been generated, the abnormality detection unit 143 performs edge detection processing on the detection image (step S9). Subsequently, the abnormality detection unit 143 performs extraction processing (step S11). In this embodiment, the abnormality detection unit 143 extracts the interrupter rod edge portion included in the open interrupter rod photography area A1 and the interrupter rod edge portion included in the closed interrupter rod photography area A3 from the detection image after the edge detection processing in step S9.

[0060] Then, when an edge portion of the barrier rod is extracted from the barrier rod photographing area A1 when opened or the barrier rod photographing area A3 when closed (step S13: YES), the abnormality detection unit 143 performs a breakage determination process to detect breakage of the barrier rod 7 (step S15). When the abnormality detection unit 143 determines that "breakage has occurred" as a result of the breakage determination process in step S15 (step S17: YES), it performs control to send a notification of the occurrence of an abnormality to the central device 9 (step S19).

[0061] On the other hand, when the interrupter rod edge portion is no longer extracted from either the open interrupter rod imaging area A1 or the closed interrupter rod imaging area A3, the abnormality detection unit 143 determines that this is the first timing (step S21: YES) and starts the lifting / lowering failure determination process. That is, if the interrupter rod 7 is descending, the abnormality detection unit 143 sets the timing after the descending determination time as the second timing, and if the interrupter rod 7 is ascending, the abnormality detection unit 143 sets the timing after the ascending determination time as the second timing (step S23). Furthermore, in the frame in which the second timing has arrived (step S25: YES), the abnormality detection unit 143 determines whether or not the interrupter rod edge portion is detected from the open interrupter rod imaging area A1 or the closed interrupter rod imaging area A3. Then, if the interrupter rod edge portion is detected (step S27: YES), the abnormality detection unit 143 determines that "there is no lifting / lowering failure" (step S29). On the other hand, if no abnormality is detected (step S27: NO), the abnormality detection unit 143 determines that there is a "lifting malfunction" (step S31) and performs control to send a notification of the occurrence of an abnormality to the central device 9 (step S33).

[0062] As described above, according to this embodiment, by performing a masking process that masks color components other than the marker color in the barrier bar image, it is possible to generate a detection image in which objects of color components other than the marker color are removed from the barrier bar image. Furthermore, by performing an edge detection process on the detection image, it is possible to accurately detect the rectangular outline of the color scheme 71 of the marker color that appears in the barrier bar image, improving the accuracy of extraction of the marker edge portion. As a result, it is possible to properly extract the barrier bar 7 portion from the barrier bar image, making it possible to accurately detect abnormalities in the barrier 5. Furthermore, by masking color components other than the marker color, it is also possible to reduce the processing load related to abnormality detection in the subsequent stage.

[0063] Furthermore, it is possible to detect whether or not a breakage has occurred and whether or not there is a failure to raise or lower the crossing gate 5 as abnormalities in the crossing gate 5. When an abnormality in the crossing gate 5 is detected, a notice of the occurrence of the abnormality can be sent to the central device 9. Therefore, it is possible to carry out prompt maintenance work on the crossing gate 5 in which an abnormality has been detected.

[0064] The forms to which the present invention can be applied are not limited to the above-described embodiments, and constituent elements can be added, omitted, or modified as appropriate.

[0065] [Variation 1] For example, a configuration may be adopted in which a lifting / lowering malfunction is detected by comparing images of barrier bars installed at the same crossing. For example, at the crossing 1 in FIG. 2, two barriers 5, 5 are installed, one at the entrance side and one at the exit side of the road that crosses the crossing 1. If each barrier bar 7, 7 is set to simultaneously raise and lower when a train passes, each barrier bar 7, 7 will begin lowering at the same time prior to the arrival of a train approaching the crossing 1 and will descend to its lowered position. After the train has passed, each barrier bar 7, 7 will begin raising at the same time and will rise to its raised position. Therefore, if the two barrier bars do not move in the same way, it can be determined that one of the barrier bars 7, 7 is malfunctioning.

[0066] Therefore, in this modified example, the abnormality monitoring device 10 performs the lifting / lowering failure determination process by grouping together the barrier rods 7 that perform lowering and raising operations at the same timing in the monitored barrier 5. For example, if the two barrier rods 7, 7 in Fig. 2 are grouped together, the detection image generated for the first barrier rod image related to one of the first barrier rods 7 is set as the first detection image, and the detection image generated for the second barrier rod image related to the other second barrier rod 7 is set as the second detection image.

[0067] Specifically, in the lifting / lowering failure determination process, a detection image (first detection image) is generated for the first barrier rod 7, and a rectangular edge portion is extracted as a marker edge portion from the first image obtained by further performing edge detection processing on the first detection image. Also, a detection image (second detection image) is generated for the second barrier rod 7, and a rectangular edge portion is extracted as a marker edge portion from the second image obtained by further performing edge detection processing on the second detection image. Then, the movement of the marker edge portion extracted for the first image is compared with the movement of the marker edge portion extracted for the second image, and if the two movements differ, a lifting / lowering failure of either the first barrier rod 7 or the second barrier rod 7 is detected.

[0068] FIG. 12 is a diagram showing an example of a first image obtained at a certain timing after edge detection processing, and FIG. 13 is a diagram showing an example of a second image obtained at the same timing as FIG. 12 after edge detection processing. For example, as shown in FIG. 12, in the first image, the marker edge portion of the first barrier rod 7 has moved to a lowered position included in the barrier rod shooting area A3 during opening. In contrast, as shown in FIG. 13, in the second image, the marker edge portion of the second barrier rod 7 has not moved to the lowered position included in the barrier rod shooting area A3 during opening, but is located halfway. By comparing images taken at the same timing, if the positions of the marker edge portions are different, it is determined that there is a lifting / lowering error. The same applies when the barrier rod 7 is raised. For example, if the marker edge portion of the second barrier rod 7 has moved to a raised position included in the barrier rod shooting area A1 during opening in the second image, but the marker edge portion of the first barrier rod 7 is located halfway in the first image, it is determined that there is a lifting / lowering error.

[0069] [Variation 2] 14 is a diagram for explaining the abnormality detection process in this modified example, and shows an image after edge detection process has been performed on the detection image obtained from the image of the barrier rod. In the above embodiment, the presence or absence of breakage of the barrier rod is determined by detecting the edge portion of the barrier rod while focusing on the barrier rod open-time photographing area A1 in which the barrier rod 7 in the open state is captured and the barrier rod closed-time photographing area A3 in which the barrier rod 7 in the closed state is captured. In contrast to this, as shown in FIG. 14, a barrier rod photographing area A5 in which the barrier rod 7 is captured during the lifting / lowering operation (hereinafter referred to as the "barrier rod photographing area during the lifting / lowering operation") may also be set in advance, so that the presence or absence of breakage of the barrier rod 7 can be constantly determined even during the lifting / lowering operation.

[0070] Specifically, the edge of the breaker rod is detected for each of the breaker rod photography areas A1 when opened, A3 when closed, and A5 when raising and lowering, and a breakage determination process is performed in the same manner as in the above embodiment for the breaker rod photography area A5 when raising and lowering in which the edge of the breaker rod is detected. This makes it possible to monitor in real time whether the breaker rod 7 is broken. Note that Figure 14 shows an example in which the breaker rod 7 is in the closed state and is not broken.

[0071] Furthermore, the lifting / lowering failure determination process can be carried out in the same manner as in the above embodiment, but if it is determined that there is a "lifting / lowering failure," the stopping position of the barrier rod 7 can also be detected depending on which barrier rod photography area A5 during the lifting / lowering operation the barrier rod edge portion is detected within.

[0072] Alternatively, in the case of the configuration of this modified example, a lifting / lowering failure can also be determined as follows: That is, when the edge portion of the barrier rod continues to be detected for a predetermined time in one barrier rod photographing area A5 during lifting / lowering operation, it is determined that there is a "lifting / lowering failure," and the position of the barrier rod photographing area A5 during lifting / lowering operation is determined as the stop position of the barrier rod 7.

[0073] [Variation 3] Furthermore, in the configuration of the second modified example, it is also possible to distinguish between a total loss in which the circuit breaker rod 7 has broken off at the base and a case in which the circuit breaker rod 7 has stopped midway through its lifting operation due to a failure to lift. In other words, while the circuit breaker rod 7 is lifting or lowering, the circuit breaker rod 7 will not be captured in the open circuit breaker rod photography area A1 or the closed circuit breaker rod photography area A3. On the other hand, the same thing happens when the circuit breaker rod 7 is totally damaged. In this modified example, both cases are distinguished.

[0074] Specifically, if the edge portion of the barrier rod is not detected in any of the barrier rod photographing areas A1 when opened, A3 when closed, and A5 when raising and lowering, it is determined that there is a total loss of the barrier rod 7. On the other hand, even if the edge portion of the barrier rod is no longer detected from the barrier rod photographing area A1 when opened or A3 when closed, if the edge portion of the barrier rod is detected in any of the barrier rod photographing areas A5 when raising and lowering, it is determined that there is no total loss.

[0075] As a processing procedure, for example, after setting the second timing in the same manner as the lifting / lowering failure determination process of the above embodiment, if the edge portion of the barrier rod is not detected from the open barrier rod photographing area A1 or the closed barrier rod photographing area A3 when the second timing arrives, it is determined whether the barrier rod 7 is completely damaged or has a lifting / lowering failure. If the edge portion of the barrier rod is not detected in any of the lifting / lowering operation barrier rod photographing areas A5, it is determined that the barrier rod 7 has been completely damaged. On the other hand, if the edge portion of the barrier rod is detected in any of the lifting / lowering operation barrier rod photographing areas A5, it is determined that there is a "lifting / lowering failure." At that time, the position of the lifting / lower operation barrier rod photographing area A5 is determined to be the stop position of the barrier rod 7.

[0076] [Variation 4] Furthermore, the range of brightness values ​​used as the color components of the marker color may be configured to be set for each time period, such as daytime or nighttime, and for each weather condition, such as sunny or rainy. In this case, the abnormality monitoring device 10 selectively uses a brightness range according to the current time and the surrounding weather to perform masking. The weather may be determined by installing a necessary measurement sensor at each railroad crossing, or by acquiring weather information from an external device, etc. This allows for masking according to the time, weather, and other conditions, further improving the accuracy of extracting the marker edge portion.

[0077] [Variation 5] Furthermore, when an abnormality in the crossing bar 5 is detected, images of the crossing bar for a predetermined time before and after the detection may be saved for verifying the cause of the breakage. Images of the past crossing bar can be acquired by always saving images of the crossing bar for the most recent predetermined time as crossing bar image data 153.

[0078] [Other variations] Furthermore, in the above embodiment, the case of detecting an abnormality was explained using a barrier installed at a railroad crossing as an example, but the above embodiment can also be applied to cases where an abnormality is detected in a barrier (barrier) installed at the entrance / exit of a gated parking lot such as a coin parking lot, not limited to railroad crossings. [Explanation of symbols]

[0079] 10 Abnormality monitoring device, 110 Operation unit, 120 Display unit, 130 Image input unit, 140 Processing unit, 141 Detection image generation unit, 143 Abnormality detection unit, 150 Memory unit, 151 Railroad crossing monitoring program, 153 Barrier image data, 155 Abnormality detection result data, 1 Railroad crossing, 3 Camera, 5 Barrier, 7 Barrier, 9 Central device

Claims

1. An abnormality monitoring device that monitors abnormalities in a crossing gate based on a crossing gate image, which is an image of a crossing gate at a railroad crossing, The interrupter rod is colored in a predetermined marker color at predetermined intervals along the longitudinal direction, a detection image generating means for generating a detection image by performing a masking process for masking color components other than the marker color from the blocking image; an abnormality detection means for detecting an abnormality in the crossing barrier based on the extracted edge portions of the crossing barrier, the abnormality detection means performing an edge detection process on the detection image and an extraction process for extracting the edge portions of the crossing barrier included in a predetermined crossing barrier photographing area from the detected edge portions; Equipped with The detection image generating means generates a first detection image for a first barrier bar image relating to a first barrier bar, and generates a second detection image for a second barrier bar image relating to a second barrier bar installed at the same railroad crossing as the first barrier bar, the abnormality detection means compares the interrupter rod edge portion relating to the first detection image with the interrupter rod edge portion relating to the second detection image to detect a failure in the lifting and lowering of either the first interrupter rod or the second interrupter rod. Abnormality monitoring device.

2. An abnormality monitoring device that monitors abnormalities in a circuit breaker based on a circuit breaker bar image, which is an image of a circuit breaker bar, The interrupter rod is colored in a predetermined marker color at predetermined intervals along the longitudinal direction, a detection image generating means for generating a detection image by performing a masking process for masking color components other than the marker color from the blocking image; an abnormality detection means for detecting an abnormality in the crossing barrier based on the extracted edge portions of the crossing barrier, the abnormality detection means performing an edge detection process on the detection image and an extraction process for extracting the edge portions of the crossing barrier included in a predetermined crossing barrier photographing area from the detected edge portions; Equipped with the abnormality detection means detects a failure in raising or lowering the circuit breaker based on the circuit breaker rod edge portion obtained by performing the edge detection process and the extraction process on the detection image at two timings separated by a predetermined time interval equal to or longer than the raising or lowering operation time when the circuit breaker rod is raised or lowered, Abnormality monitoring device.

3. An abnormality monitoring device that monitors abnormalities in a circuit breaker based on a circuit breaker bar image, which is an image of a circuit breaker bar, The interrupter rod is colored in a predetermined marker color at predetermined intervals along the longitudinal direction, a detection image generating means for generating a detection image by performing a masking process for masking color components other than the marker color from the blocking image; an abnormality detection means for detecting an abnormality in the crossing barrier based on the extracted edge portions of the crossing barrier, the abnormality detection means performing an edge detection process on the detection image and an extraction process for extracting the edge portions of the crossing barrier included in a predetermined crossing barrier photographing area from the detected edge portions; Equipped with the abnormality detection means detects a total loss of the circuit breaker rod when the circuit breaker rod edge portion is not extracted for a predetermined time equal to or longer than a lifting / lowering operation time during the raising or lowering of the circuit breaker rod. Abnormality monitoring device.

4. the detection image generating means performs grayscale processing and binarization processing on the image that has been subjected to the mask processing to generate the detection image; The abnormality monitoring device according to any one of claims 1 to 3.

5. the abnormality detection means detects breakage of the circuit breaker rod based on any one of an arrangement direction, an arrangement number, and an arrangement length of the circuit breaker rod edge portions in the image. The abnormality monitoring device according to any one of claims 1 to 3.

Images