Converter valve monitoring and checking method, device and equipment and storage medium

Abstract

The invention discloses a converter valve monitoring and checking method and device, equipment and a storage medium, and the method comprises the steps: extracting a copper bar, connected with a valve box, of a converter module and all converter modules from a monitoring image after the monitoring image of all converter modules is obtained, numbering the converter modules based on the distance from the converter modules to the copper bar, and storing the numbered converter modules in a database; determining the serial number of the converter module monitored by each camera, calling the monitoring picture of the camera corresponding to the converter module with the target serial number when an abnormal signal of the converter module with the target serial number is received, and amplifying the area where the converter module with the target serial number is located in the monitoring picture, the abnormal converter module monitoring picture is automatically called and amplified, operation of workers is not needed, the checking efficiency is improved, and the labor cost is reduced.

Description

Technical Field

[0001] The present invention relates to a converter valve monitoring technology, and in particular to a converter valve monitoring and viewing method, device, equipment and storage medium. Background Art

[0002] The converter valve is the core equipment of the DC transmission project. It connects the three-phase AC voltage to the DC end in sequence to obtain the desired DC voltage and realize power control.

[0003] At the substation site, multiple converter modules are usually connected in series to form a converter valve. The converter module is set in the valve box, and a camera is set in the valve box. During the operation of the converter valve, the staff cannot enter the valve box. When the background machine displays an abnormal alarm of a converter module, it is necessary to check the condition of a specific single converter module. The existing inspection method is: based on work experience, the staff selects the monitoring screen corresponding to one of the cameras from the monitor, selects the corresponding converter module from the monitoring screen, and enlarges the screen for inspection.

[0004] The above inspection process is highly dependent on the experience of the staff. If the staff is inexperienced, it will take a lot of time. Summary of the invention

[0005] The present invention provides a method, device, equipment and storage medium for monitoring and viewing a converter valve, so as to realize automatic calling and enlarging of the monitoring screen of an abnormal converter module without the need for staff operation, thereby improving viewing efficiency and reducing labor costs.

[0006] In a first aspect, the present invention provides a method for monitoring and viewing a converter valve, comprising:

[0007] Acquire a monitoring image including all converter modules, where the converter valve includes a plurality of converter modules;

[0008] Extracting the copper busbar connecting the commutation module and the valve box, and all the commutation modules from the monitoring image;

[0009] Numbering the commutation modules based on the distance from the commutation modules to the copper busbar;

[0010] Determine the serial number of the commutation module that each camera is responsible for monitoring;

[0011] When an abnormal signal of a commutation module with a target number is received, a monitoring screen of a camera corresponding to the commutation module with the target number is called;

[0012] Enlarge the area where the commutation module with the target number is located in the monitoring screen.

[0013] Optionally, extracting the copper busbar connecting the converter module and the valve box, and all the converter modules from the monitoring image, includes:

[0014] The copper busbar connecting the commutation module and the valve box is extracted from the monitoring image by using a target detection model, and a detection frame surrounding the commutation module and a detection frame surrounding the copper busbar are formed in the monitoring image.

[0015] Optionally, the target detection model is a YOLO V5 model, which includes a backbone network, a neck network, and a detection head. The target detection model is used to extract the copper busbar connecting the commutation module and the valve box from the monitoring image, and a detection frame surrounding the commutation module and a detection frame surrounding the copper busbar are formed in the monitoring image, including:

[0016] Using the backbone network to extract feature maps of multiple scales from the surveillance image;

[0017] The feature map of the neck network is used for multiple sampling to obtain sampling features of multiple different scales, and the sampling features and feature maps of the same scale are fused to obtain fused feature maps of multiple different scales;

[0018] The detection head is used to process the fused feature map to obtain target detection results at different scales, wherein the target detection results include identifying the commutation module and the copper busbar, and forming a detection frame surrounding the commutation module and a detection frame surrounding the copper busbar in the monitoring image.

[0019] Optionally, two rows of stacked converter modules are provided in the valve box, and the converter modules are numbered based on the distance from the converter modules to the copper busbar, including:

[0020] For each of the commutation modules, calculating the distance from the center of the detection frame of the commutation module to the center of the detection frame of the copper busbar;

[0021] For the commutation modules in the first row, the commutation modules are numbered sequentially according to the ascending order of the distance;

[0022] For the commutation modules in the second row, the numbering of the first row is continued, and the commutation modules are numbered sequentially according to the descending order of the distance.

[0023] Optionally, after determining the serial number of the flow conversion module that each camera is responsible for monitoring, the method further includes:

[0024] The numbers of the two oppositely stacked converter modules are verified based on the numbers of the converter modules in the first row and the numbers of the converter modules in the second row.

[0025] Optionally, enlarging the area where the converter module with the target number is located in the monitoring screen includes:

[0026] Determine a target detection frame surrounding the commutation module with the target number;

[0027] The area within the target detection frame is maximized in the display image.

[0028] Optionally, maximizing the area within the target detection frame in the display screen includes:

[0029] Calculate the target distances from the edges of the target detection frame to the edges corresponding to the display screen, with the goal of minimizing the sum of the distances from the edges of the target detection frame to the edges corresponding to the display screen;

[0030] The area within the target detection frame is enlarged according to the target distance from each side of the target detection frame to the corresponding edge of the display screen.

[0031] In a second aspect, the present invention further provides a converter valve monitoring and viewing device, comprising:

[0032] An image acquisition module, used to acquire monitoring images including all the converter modules, where the converter valve includes a plurality of converter modules;

[0033] A target detection module, used to extract the copper busbar connecting the commutation module and the valve box, and all the commutation modules from the monitoring image;

[0034] A numbering module, used for numbering the commutation modules based on the distance between the commutation modules and the copper busbar;

[0035] A number determination module, used to determine the number of the flow conversion module that each camera is responsible for monitoring;

[0036] A monitoring screen calling module, used to call the monitoring screen of the camera corresponding to the target numbered commutation module when receiving an abnormal signal from the target numbered commutation module;

[0037] The area magnification module is used to magnify the area where the commutation module with the target number is located in the monitoring screen.

[0038] In a third aspect, the present invention further provides an electronic device, comprising:

[0039] one or more processors;

[0040] A storage device for storing one or more programs;

[0041] When the one or more programs are executed by the one or more processors, the one or more processors implement the converter valve monitoring and viewing method provided in the first aspect of the present invention.

[0042] In a fourth aspect, the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method for monitoring and viewing a converter valve as provided in the first aspect of the present invention.

[0043] The converter valve monitoring and viewing method provided by the present invention, after obtaining a monitoring image including all converter modules, extracts the copper busbar connecting the converter module and the valve box, and all converter modules from the monitoring image, and numbers the converter modules based on the distance from the converter module to the copper busbar, determines the number of the converter module that each camera is responsible for monitoring, and when an abnormal signal of a converter module with a target number is received, calls the monitoring screen of the camera corresponding to the converter module with the target number, zooms in on the area where the converter module with the target number is located in the monitoring screen, thereby realizing automatic calling and zooming in of the monitoring screen of the abnormal converter module without the need for staff operation, thereby improving viewing efficiency and reducing labor costs.

[0044] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0046] Figure 1 A flow chart of a method for monitoring and viewing a converter valve provided by the present invention;

[0047] Figure 2 A schematic diagram of the structure of a converter valve monitoring and viewing device provided by the present invention;

[0048] Figure 3 A schematic structural diagram of an electronic device provided by an embodiment of the present invention.

[0049] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0050] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0051] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0052] Figure 1 This is a flow chart of a method for monitoring and viewing a converter valve provided by the present invention. This embodiment is applicable to the case of automatically viewing a converter module. The method can be executed by a device for monitoring and viewing a converter valve provided by the present invention. The device can be implemented by software and / or hardware and is usually configured in an electronic device, such as Figure 1 As shown, the commutation module monitoring and viewing method includes:

[0053] S101. Acquire a monitoring image including all converter modules.

[0054] In an embodiment of the present invention, the converter valve includes a plurality of converter modules connected in series, and the plurality of converter modules are arranged in a valve box. The magnification of a camera in the valve box is adjusted to the minimum so that the image it can capture is the largest, thereby obtaining a monitoring image including all the converter modules.

[0055] S102: extract the copper busbars connecting the commutation modules and the valve box, as well as all commutation modules, from the monitoring image.

[0056] In an embodiment of the present invention, the copper busbar connecting the converter module and the valve box, as well as all converter modules, are extracted from the monitoring image including all converter modules. The copper busbar is used to connect the converter module and the valve box, the converter modules inside the valve box are connected in series in sequence, and the converter module on one side edge of the converter valve connects the entire converter valve to the equipment outside the valve box through the copper busbar, and transmits the current output by the converter valve to the outside of the valve box. Usually, multiple converter modules are stacked in one or more rows, and the copper busbar is exposed on the same side of each row, which can be captured by the camera.

[0057] In some embodiments of the present invention, a target detection algorithm of a pre-trained target detection model can be used to extract the copper busbars connected to the commutation module and the valve box, as well as all commutation modules from the monitoring image. Exemplarily, the target detection model can be a one-stage target detection model (e.g., a YOLO model or an SDD model) or a two-stage target detection model (e.g., R-CNN, Fast R-CNN, and Faster R-CNN).

[0058] Exemplarily, in a specific embodiment of the present invention, the YOLO V5 model is used to extract the copper busbars connecting the commutation module and the valve box, as well as all commutation modules, from the monitoring image. The YOLO V5 model includes a backbone network, a neck network, and a detection head. The process of extracting the copper busbars connecting the commutation module and the valve box from the monitoring image using the YOLO V5 model is as follows:

[0059] S1021. Use a backbone network to extract feature maps of various scales from surveillance images.

[0060] The main function of the backbone network is to extract features of multiple scales from the input surveillance image to obtain feature maps of multiple scales for use in subsequent detection tasks. Exemplarily, the backbone network includes two convolution modules, a C3 module, a convolution module, a C3 module, a convolution module, a C3 module, a convolution module, a C3 module, a convolution module, a C3 module, and an SPPF (SpecailPyramid Pooling Fast) module connected in sequence.

[0061] The convolution module includes a convolutional layer (Conv), a batch normalization layer (Batch Normalization), and an activation function layer (SiLU) connected in sequence.

[0062] The C3 module includes a first convolution unit, a second convolution unit, a third convolution unit and a Bottleneck, and the Bottleneck includes at least two convolution units connected in sequence. The structure of the convolution unit is the same as the convolution module in the aforementioned embodiment, including a convolution layer, a batch normalization layer and an activation function layer connected in sequence. The processing process of the C3 module is:

[0063] 1. In the first convolution unit, the input features of the C3 module are convolved, batch normalized, and nonlinearly activated to obtain the first convolution feature.

[0064] 2. In the second convolution unit, the input features of the C3 module are convolved, batch normalized, and nonlinearly activated to obtain a second convolution feature with a scale half that of the first convolution feature.

[0065] 3. Process the first convolution feature in Bottleneck to obtain a third convolution feature with a scale half that of the first convolution feature.

[0066] The stride of the convolution module in Bottleneck is 2, which can halve the size of the input feature map. The purpose of this is to increase the receptive field of the network while reducing the amount of calculation. By halving the size of the feature map, the network can pay more attention to the global information of the object, thereby improving the effect of feature extraction. The stride of other convolution units in the C3 module is 1, which means that they do not change the size of the feature map. The purpose of this is to maintain the spatial resolution of the feature map, thereby better preserving the local information of the object. At the same time, the main function of these convolution units is to further extract features and increase the depth and receptive field of the network.

[0067] 4. Fuse the second convolution feature and the third convolution feature to obtain the fourth convolution feature.

[0068] The second convolution feature and the third convolution feature are fused (Concat) to obtain a fourth convolution feature whose dimension is the sum of the dimensions of the second convolution feature and the third convolution feature.

[0069] 5. In the third convolution unit, the fourth convolution feature is convolved, batch normalized and nonlinearly activated to obtain the output feature of the C3 module.

[0070] The SPPF module includes a fourth convolution unit, a fifth convolution unit, a first maximum pooling layer, a second maximum pooling layer and a third maximum pooling layer. The convolution unit is represented by ConvBNSiLU, and its structure is the same as the convolution module in the aforementioned embodiment, including a convolution layer, a batch normalization layer and an activation function layer connected in sequence. The maximum pooling layer is represented by Maxpool. The SPPF module is a pooling module, which is usually used in convolutional neural networks to achieve spatial invariance and position invariance of input data, so as to improve the recognition ability of the neural network. The main idea is to apply receptive fields of different sizes to the same image, so as to capture feature information of different scales. In the SPPF module, firstly, pooling operations of different sizes are performed on the input feature map to obtain a set of feature maps of different sizes. Then these feature maps are connected together, and the dimension is reduced through the fully connected layer to finally obtain a feature vector of fixed size. The processing process of the SPPF module is:

[0071] 1. In the fourth convolution unit, the input features of the SPPF module are convolved, batch normalized and nonlinearly activated to obtain convolution features.

[0072] 2. In the first maximum pooling layer, the convolution features output by the fourth convolution unit are subjected to maximum pooling processing to obtain the first pooling features.

[0073] 3. In the second maximum pooling layer, the first pooling feature is subjected to maximum pooling processing to obtain the second pooling feature.

[0074] 4. In the third maximum pooling layer, the second pooling feature is subjected to maximum pooling processing to obtain the third pooling feature.

[0075] 5. Fuse the convolution feature output by the fourth convolution unit, the first pooling feature, the second pooling feature, and the third pooling feature to obtain a fused feature.

[0076] 6. In the fifth convolution unit, the fused features are convolved, batch normalized, and nonlinearly activated to obtain the output features of the SPPF module.

[0077] S1022. Use the neck network feature map to perform multiple sampling to obtain sampling features of multiple different scales, and fuse the sampling features and feature maps of the same scale to obtain fused feature maps of multiple different scales.

[0078] The Neck network is a series of network layers that mix and combine image features and pass the image features to the prediction layer. It adopts the PANet (Path Aggregation Network) structure. Neck is mainly used to generate feature pyramids.

[0079] Exemplarily, two of the C3 modules and the SPPF module in the aforementioned embodiment respectively output three feature maps of different scales, namely a first feature map, a second feature map, and a third feature map.

[0080] The processing of the neck network is:

[0081] 1. The third feature map output by the SPPF module is input into the convolution module (ConvBNSiLU) and the upsampling layer (Upsample) connected in sequence for processing to obtain the first upsampled feature.

[0082] 2. Concatenate the first upsampled feature with the second feature map output by the third C3 module in the backbone network to obtain the first fused feature.

[0083] 3. The first fusion feature is input into the C3 module, convolution module and upsampling layer connected in sequence for processing to obtain the second upsampling feature.

[0084] 4. Concatenate the second upsampled feature with the first feature map output by the second C3 module in the backbone network to obtain the second fused feature.

[0085] 5. The second fusion feature is input into the C3 module and the convolution module connected in sequence for processing to obtain the first down-sampling feature.

[0086] 6. Fuse the first down-sampled feature with the feature output by the convolution module in step 3 to obtain the third fused feature.

[0087] 7. The third fusion feature is input into the C3 module and the convolution module connected in sequence for processing to obtain the second down-sampling feature.

[0088] 8. Fuse the second down-sampled feature with the feature output by the convolution module in step 1 to obtain the fourth fused feature.

[0089] 9. Input the fourth fusion feature into the C3 module for processing. The structure of the C3 module is the same as that of the C3 module in the previous text, and the embodiment of the present invention will not be repeated here.

[0090] S1023. Use a detection head to process the fused feature map to obtain target detection results at different scales. The target detection results include identifying the commutation module and the copper busbar, and forming a detection frame surrounding the commutation module and a detection frame surrounding the copper busbar in the monitoring image.

[0091] In an embodiment of the present invention, a plurality of fused feature maps of different scales output by the neck network (Neck) are input into the detection head (Head) of YOLO V5 for processing to obtain target detection results at different image scales. The target detection results include identifying the commutation module and the copper busbar, and forming a detection frame surrounding the commutation module and a detection frame surrounding the copper busbar in the monitoring image.

[0092] The detection head may include a region proposal network (RPN), an alignment layer (RoIPooling layer), a fully connected layer, a classification head, and a regression head. Exemplarily, the detection head processes the fused feature map as follows:

[0093] The region generation network receives the fused feature map and filters out the candidate regions (Region of Interest, RoI) that may contain the target (person) from the fused feature map. The candidate regions are represented by candidate anchor boxes. The alignment layer matches the obtained candidate regions with the pixels of the acquired image to avoid the problem of deviation between the candidate target regions obtained later and the actual target positions. The classification head classifies the candidate regions after pixel alignment and obtains the probability value of the existence of the commutation module or copper busbar in the candidate regions. The regression head is used to perform edge regression on the boundaries and postures of the candidate regions after pixel alignment to obtain the detection box used to represent the commutation module or copper busbar.

[0094] S103: number the commutation modules based on the distances from the commutation modules to the copper busbars.

[0095] After extracting the commutation modules and the copper busbar, the commutation modules are numbered based on the distance from the commutation modules to the copper busbar. Exemplarily, the commutation modules can be numbered sequentially according to the distance from the commutation modules to the copper busbar, for example, the smaller the distance, the higher the number.

[0096] Exemplarily, in some embodiments of the present invention, two rows of stacked converter modules are provided in the valve box, and the converter modules are numbered based on the distance from the converter modules to the copper busbar, including:

[0097] S1031. For each commutation module, calculate the distance between the center of the detection frame of the commutation module and the center of the detection frame of the copper busbar.

[0098] Exemplarily, for each converter module, the distance from the center of the detection frame of the converter module to the center of the detection frame of the copper busbar is calculated. Exemplarily, the distance in the embodiment of the present invention may be the distance in pixel coordinates.

[0099] S1032: For the commutation modules in the first row, number the commutation modules sequentially in ascending order of distance.

[0100] For the first row (i.e., upper layer) of converter modules, the converter modules are numbered sequentially in ascending order of distance. For example, assuming that there are N converter modules in total, for the first row of converter modules, the converter module closest to the copper bus is numbered 01, and then the numbers increase in sequence as the distance increases, and are numbered 02, 03, 04, and the last one is numbered N / 2.

[0101] S1033: For the commutation modules in the second row, continue the numbering of the first row and number the commutation modules in descending order of distance.

[0102] For the commutation modules in the second row (i.e., the lower layer), the numbering of the first row is continued, and the commutation modules are numbered sequentially in descending order of distance. For example, for the commutation modules in the second row, the commutation module farthest from the copper bus is numbered N, and then the numbers decrease as the distance gets closer, and are numbered N-1, N-2, N-3, and the last one is numbered N / 2+1.

[0103] In some embodiments of the present invention, after determining the serial number of the converter module that each camera is responsible for monitoring, the method further includes:

[0104] The numbers of the two oppositely stacked converter modules are verified based on the numbers of the converter modules in the first row and the numbers of the converter modules in the second row.

[0105] For example, after the numbering is completed, the numbers of the commutation modules at corresponding positions of the upper and lower layers need to satisfy a certain relationship. If the upper commutation module is numbered Q, the lower commutation module must be numbered N+1-Q. If not, manual judgment is introduced.

[0106] S104: Determine the serial number of the converter module that each camera is responsible for monitoring.

[0107] After numbering each converter module, determine the number of the converter module that each camera is responsible for monitoring. Exemplarily, the camera is set at a predetermined position, and each camera is responsible for monitoring one or more converter modules. After numbering each converter module, determine the number of the converter module that each camera is responsible for monitoring, for example, camera 1 (responsible for monitoring converter modules No. 01, 02, 03, 04, and 05); camera 2 (responsible for monitoring converter modules No. 04, 05, 06, 07, and 08); camera 3 (responsible for monitoring converter modules No. 07, 08, 09, 10, and 11).

[0108] S105. When an abnormal signal of the commutation module with the target number is received, the monitoring screen of the camera corresponding to the commutation module with the target number is called.

[0109] When an abnormal signal of the target numbered inverter module is received, the monitoring screen of the camera corresponding to the target numbered inverter module is called. For example, when an abnormal signal is received that the inverter module numbered 02 is abnormal, the monitoring screen of the camera 1 corresponding to the inverter module numbered 02 is called and the monitoring screen is presented on the monitor. Of course, the monitoring screen also includes other inverter modules, such as inverter modules 01, 03, 04, and 05.

[0110] S106: Enlarge the area where the commutation module with the target number is located in the monitoring image.

[0111] In order to observe the commutation module of the target number more clearly, the area where the commutation module of the target number is located in the monitoring screen is enlarged.

[0112] Exemplarily, a target detection frame surrounding the inverter module with the target number is first determined, and the area within the target detection frame is maximized in the display screen of the monitor. The process of determining the detection frame has been described in detail in the above embodiments, and the embodiments of the present invention will not be repeated here.

[0113] Exemplarily, the target distances from the edges of the target detection frame to the edges corresponding to the display screen are calculated with the goal of minimizing the sum of the distances (d1+d2+d3+d4) from the edges of the target detection frame to the edges corresponding to the display screen. Exemplarily, an optimization algorithm can be used to minimize the sum of the distances (d1+d2+d3+d4) from the edges of the target detection frame to the edges corresponding to the display screen, with the constraint that the distances from the edges of the target detection frame to the edges corresponding to the display screen are all greater than 0, to calculate the target distances from the edges of the target detection frame to the edges corresponding to the display screen. Then, the area within the target detection frame is enlarged according to the target distances from the edges of the target detection frame to the edges corresponding to the display screen.

[0114] The converter valve monitoring and viewing method provided by the present invention, after obtaining a monitoring image including all converter modules, extracts the copper busbar connecting the converter module and the valve box, and all converter modules from the monitoring image, and numbers the converter modules based on the distance from the converter module to the copper busbar, determines the number of the converter module that each camera is responsible for monitoring, and when an abnormal signal of a converter module with a target number is received, calls the monitoring screen of the camera corresponding to the converter module with the target number, zooms in on the area where the converter module with the target number is located in the monitoring screen, thereby realizing automatic calling and zooming in of the monitoring screen of the abnormal converter module without the need for staff operation, thereby improving viewing efficiency and reducing labor costs.

[0115] The present invention also provides a converter valve monitoring and viewing device. Figure 2 A schematic diagram of the structure of a converter valve monitoring and viewing device provided by the present invention, such as Figure 2 As shown, the converter valve monitoring and viewing device includes:

[0116] An image acquisition module 201 is used to acquire a monitoring image including all converter modules, and the converter valve includes multiple converter modules;

[0117] The target detection module 202 is used to extract the copper busbar connecting the commutation module and the valve box, and all the commutation modules from the monitoring image;

[0118] A numbering module 203, configured to number the commutation modules based on the distance between the commutation modules and the copper busbar;

[0119] A number determination module 204, used to determine the number of the switching module that each camera is responsible for monitoring;

[0120] The monitoring screen calling module 205 is used to call the monitoring screen of the camera corresponding to the target numbered commutation module when receiving the abnormal signal of the target numbered commutation module;

[0121] The area magnifying module 206 is used to magnify the area where the commutation module with the target number is located in the monitoring screen.

[0122] In some embodiments of the present invention, the target detection module 202 includes:

[0123] The target detection submodule is used to extract the copper busbar connecting the commutation module and the valve box from the monitoring image by using a target detection model, and form a detection frame surrounding the commutation module and a detection frame surrounding the copper busbar in the monitoring image.

[0124] In some embodiments of the present invention, the target detection model is a YOLO V5 model, the YOLO V5 model includes a backbone network, a neck network and a detection head, and the target detection submodule includes:

[0125] A feature map extraction unit, used to extract feature maps of multiple scales from the monitoring image using the backbone network;

[0126] A feature map fusion unit, used to perform multiple sampling using the feature map of the neck network to obtain sampling features of multiple different scales, and to fuse the sampling features and feature maps of the same scale to obtain fused feature maps of multiple different scales;

[0127] A detection unit is used to process the fused feature map using the detection head to obtain target detection results at different scales, wherein the target detection results include identifying the commutation module and the copper busbar, and forming a detection frame surrounding the commutation module and a detection frame surrounding the copper busbar in the monitoring image.

[0128] In some embodiments of the present invention, two rows of stacked converter modules are provided in the valve box, and the numbering module 203 includes:

[0129] A distance calculation submodule, used for calculating, for each of the commutation modules, the distance from the center of the detection frame of the commutation module to the center of the detection frame of the copper busbar;

[0130] A first numbering submodule, configured to sequentially number the commutation modules in the first row according to the ascending order of the distance;

[0131] The second numbering submodule is used to continue the numbering of the first row for the commutation modules in the second row, and to sequentially number the commutation modules in descending order of the distance.

[0132] In some embodiments of the present invention, the converter valve monitoring and viewing device further includes:

[0133] The number verification module is used to verify the numbers of the two stacked inverter modules based on the numbers of the inverter modules in the first row and the numbers of the inverter modules in the second row after determining the numbers of the inverter modules monitored by each camera.

[0134] In some embodiments of the present invention, the region enlargement module 206 includes:

[0135] A target detection frame determination submodule, used to determine a target detection frame surrounding the commutation module of the target number;

[0136] The maximization submodule is used to maximize the area within the target detection frame in the display picture.

[0137] In some embodiments of the present invention, the maximization submodule includes:

[0138] a target distance calculation unit, configured to calculate a target distance between each edge of the target detection frame and an edge corresponding to the display screen, with the sum of distances between each edge of the target detection frame and an edge corresponding to the display screen being minimized as the goal;

[0139] The enlarging unit is used to enlarge the area within the target detection frame according to the target distance from each side of the target detection frame to the edge corresponding to the display screen.

[0140] The above-mentioned converter valve monitoring and viewing device can execute the converter valve monitoring and viewing method provided by the aforementioned embodiment of the present invention, and has the corresponding functional modules and beneficial effects for executing the converter valve monitoring and viewing method.

[0141] Figure 3 A schematic diagram of the structure of an electronic device provided for an embodiment of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0142] like Figure 3As shown, the electronic device includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0143] A number of components in the electronic device are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0144] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the converter valve monitoring and viewing method.

[0145] In some embodiments, the converter valve monitoring and viewing method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the converter valve monitoring and viewing method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the converter valve monitoring and viewing method in any other appropriate manner (e.g., by means of firmware).

[0146] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0147] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0148] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0149] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0150] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0151] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0152] An embodiment of the present invention further provides a computer program product, including a computer program, which, when executed by a processor, implements the method for monitoring and viewing a converter valve as provided in any embodiment of the present application.

[0153] In the process of implementation, the computer program product can be written in one or more programming languages ​​or a combination thereof to perform the computer program code of the present invention, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

[0154] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0155] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for monitoring and viewing a converter valve, characterized in that: include: Acquire a monitoring image including all converter modules, where the converter valve includes a plurality of converter modules; Extracting the copper busbar connecting the commutation module and the valve box, and all the commutation modules from the monitoring image; Numbering the commutation modules based on the distance from the commutation modules to the copper busbar; Determine the serial number of the commutation module that each camera is responsible for monitoring; When an abnormal signal of a commutation module with a target number is received, a monitoring screen of a camera corresponding to the commutation module with the target number is called; Enlarge the area where the commutation module with the target number is located in the monitoring screen.

2. The method for monitoring and checking a converter valve according to claim 1, characterized in that: Extracting the copper busbar connecting the converter module and the valve box, and all the converter modules from the monitoring image, including: The copper busbar connecting the commutation module and the valve box is extracted from the monitoring image by using a target detection model, and a detection frame surrounding the commutation module and a detection frame surrounding the copper busbar are formed in the monitoring image.

3. The method for monitoring and checking the converter valve according to claim 2, characterized in that: The target detection model is a YOLO V5 model, which includes a backbone network, a neck network, and a detection head. The target detection model is used to extract the copper busbar connecting the commutation module and the valve box from the monitoring image, and a detection frame surrounding the commutation module and a detection frame surrounding the copper busbar are formed in the monitoring image, including: Using the backbone network to extract feature maps of multiple scales from the surveillance image; The feature map of the neck network is used for multiple sampling to obtain sampling features of multiple different scales, and the sampling features and feature maps of the same scale are fused to obtain fused feature maps of multiple different scales; The detection head is used to process the fused feature map to obtain target detection results at different scales, wherein the target detection results include identifying the commutation module and the copper busbar, and forming a detection frame surrounding the commutation module and a detection frame surrounding the copper busbar in the monitoring image.

4. The method for monitoring and checking the converter valve according to claim 2, characterized in that: Two rows of stacked converter modules are arranged in the valve box, and the converter modules are numbered based on the distance from the converter modules to the copper busbar, including: For each of the commutation modules, calculating the distance from the center of the detection frame of the commutation module to the center of the detection frame of the copper busbar; For the commutation modules in the first row, the commutation modules are numbered sequentially according to the ascending order of the distance; For the commutation modules in the second row, the numbering of the first row is continued, and the commutation modules are numbered sequentially according to the descending order of the distance.

5. The method for monitoring and checking the converter valve according to claim 4, characterized in that: After determining the serial number of the converter module that each camera is responsible for monitoring, the method further includes: The numbers of the two oppositely stacked converter modules are verified based on the numbers of the converter modules in the first row and the numbers of the converter modules in the second row.

6. The method for monitoring and checking a converter valve according to any one of claims 1 to 4, characterized in that: Enlarging the area where the commutation module with the target number is located in the monitoring screen includes: Determine a target detection frame surrounding the commutation module with the target number; The area within the target detection frame is maximized in the display image.

7. The method for monitoring and checking a converter valve according to claim 6, characterized in that: Maximizing the area within the target detection frame in the display screen includes: Calculate the target distances from the edges of the target detection frame to the edges corresponding to the display screen, with the goal of minimizing the sum of the distances from the edges of the target detection frame to the edges corresponding to the display screen; The area within the target detection frame is enlarged according to the target distance from each side of the target detection frame to the corresponding edge of the display screen.

8. A converter valve monitoring and viewing device, characterized in that: include: An image acquisition module, used to acquire monitoring images including all the converter modules, where the converter valve includes a plurality of converter modules; A target detection module, used to extract the copper busbar connecting the commutation module and the valve box, and all the commutation modules from the monitoring image; A numbering module, used for numbering the commutation modules based on the distance between the commutation modules and the copper busbar; A number determination module, used to determine the number of the flow conversion module that each camera is responsible for monitoring; A monitoring screen calling module, used to call the monitoring screen of the camera corresponding to the target numbered commutation module when receiving an abnormal signal of the target numbered commutation module; The area magnification module is used to magnify the area where the commutation module with the target number is located in the monitoring screen.

9. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the converter valve monitoring and viewing method as described in any one of claims 1-7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the converter valve monitoring and viewing method as described in any one of claims 1 to 7 is implemented.

Images