Pull ring operation auxiliary equipment, visual control method and device and medium

Abstract

The invention discloses pull ring operation auxiliary equipment, a visual control method and device and a medium. The device comprises a 7-shaped hollow insulating rod, an information detection assembly and a visual control terminal. The information detection assembly is horizontally arranged at the hollow part of the transverse end of the 7-shaped hollow insulating rod; the information detection assembly is connected with the visual control terminal, and the information detection assembly comprises a laser range finder and a camera; the laser range finder is used for emitting a horizontal laser beam to the front end of the 7-shaped hollow insulating rod; the camera is used for collecting a real-time video of a pull ring operation scene and sending the real-time video to the visual control terminal; and the visual control terminal is used for generating a real-time operation picture according to the target pull ring and the laser beam in the real-time video, so that an operator can execute the pull ring operation according to the real-time operation picture. By the adoption of the technical scheme, the ground can operate the pull ring at a high position or at a long distance under the condition that a line is not powered off, and the operation efficiency of high-altitude equipment is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of electrical equipment maintenance, and in particular to a pull ring operation auxiliary device, a visual control method, a device and a medium. Background Art

[0002] There are a large number of electrical equipment distributed in the distribution network. Due to some objective factors, some faults may occur in the equipment during operation, and it is often necessary for operators to patrol and maintain the equipment in order to solve the fault problems of the electrical equipment in a timely manner.

[0003] In order to solve the problem of electrical equipment failure, the operator needs to use the metal hook at the tip of the insulated operating rod to open and close the hook ring of the faulty electrical equipment. However, when opening or closing the equipment at a high altitude, due to the long distance and the influence of factors such as direct sunlight or reflection, it is difficult for the operator to align the operating hole at one time during the opening or closing process, and even misoperation or mistouch may occur, resulting in difficulty in operation and low efficiency. Summary of the invention

[0004] The present invention provides a pull ring operation auxiliary device, a visual control method, a device and a medium, which can realize the operation of a high or long-distance pull ring on the ground without power outage, thereby improving the operating efficiency of high-altitude equipment.

[0005] According to one aspect of the present invention, a pull ring operation auxiliary device is provided, comprising a 7-shaped hollow insulating rod, an information detection component and a visual control terminal; wherein the information detection component is horizontally arranged at the hollow part of the horizontal end of the 7-shaped hollow insulating rod;

[0006] The information detection component is connected to the visual control terminal, and the information detection component includes a laser rangefinder and a camera;

[0007] The laser rangefinder is used to emit a horizontal laser beam to the front end of the 7-shaped hollow insulating rod; the camera is used to collect real-time video of the pull ring operation scene and send the real-time video to the visual control terminal;

[0008] The visualization control terminal is used to generate a real-time operation screen according to the target pull ring and laser beam in the real-time video, so that the operator can perform the pull ring operation according to the real-time operation screen.

[0009] According to another aspect of the present invention, a visual control method is provided, which is executed by a visual control terminal in the pull ring operation auxiliary device according to an embodiment of the present invention, and includes:

[0010] Identify electrical devices and pull rings corresponding to each electrical device in the real-time video sent by the camera, and calibrate the target pull ring according to the target electrical device selected by the operator;

[0011] Calculate the center point position of the target pull ring, generate a center point mark according to the center point position, and add the center point mark to the real-time video;

[0012] According to the positional relationship between the laser beam and the center point mark in the real-time video, operation prompt information is generated, and the operation prompt information is added to the real-time video to generate a real-time operation picture.

[0013] According to another aspect of the present invention, a visual control device is provided, which is executed by a visual control terminal in the pull ring operation auxiliary device according to an embodiment of the present invention, and includes:

[0014] A pull ring identification module is used to identify electrical equipment and the pull ring corresponding to each electrical equipment in the real-time video sent by the camera, and calibrate the target pull ring according to the target electrical equipment selected by the operator;

[0015] A center point mark generation module is used to calculate the center point position of the target pull ring, generate a center point mark according to the center point position, and add the center point mark to the real-time video;

[0016] The real-time operation screen generation module is used to generate operation prompt information according to the positional relationship between the laser beam and the center point mark in the real-time video, and add the operation prompt information to the real-time video to generate a real-time operation screen.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the visualization control method described in any embodiment of the present invention when executed.

[0018] The technical solution of the embodiment of the present invention is to set a 7-shaped hollow insulating rod, an information detection component and a visual control terminal in the pull ring operation auxiliary equipment, and set the information detection component horizontally in the hollow part of the horizontal end of the 7-shaped hollow insulating rod, the information detection component is connected to the visual control terminal, and a laser rangefinder and a camera are set in the information detection component. When the operator uses the pull ring operation auxiliary equipment to operate the pull ring, the operator can clearly understand the details of the electrical equipment and the pull ring through the visual control terminal, and the 7-shaped hollow insulating rod can facilitate the operator to align the pull ring, so that the operator can operate the high or long-distance pull ring from the ground without power outage, and effectively survey the electrical equipment, thereby improving the operating efficiency of the high-altitude equipment.

[0019] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1 is a structural schematic diagram of a pull ring operation auxiliary device provided according to Embodiment 1 of the present invention;

[0022] Figure 2 is a flow chart of a visualization control method provided according to the second embodiment of the present invention;

[0023] Figure 3 is a flow chart of another visual control method provided according to Embodiment 3 of the present invention;

[0024] Figure 4 It is a structural schematic diagram of a visualization control device provided according to Embodiment 4 of the present invention. DETAILED DESCRIPTION

[0025] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0027] Embodiment 1

[0028] Figure 1 This is a schematic diagram of the structure of a pull ring operation auxiliary device provided in Example 1 of the present invention. Figure 1 As shown, the pull ring operation auxiliary device includes a 7-shaped hollow insulating rod 110, an information detection component 120 and a visual control terminal 130.

[0029] It can be understood that the electrical equipment may refer to equipment such as disconnectors and drop-out fuses, and each electrical equipment is equipped with a corresponding pull ring, and pulling the pull ring can realize the opening or closing operation of the electrical equipment.

[0030] Optionally, the pull ring operation auxiliary equipment proposed in the present application is that the operator can hold the bottom of the 7-shaped hollow insulating rod 110, and after the horizontal end of the 7-shaped hollow insulating rod 110 is aligned with the pull ring hole, the pull ring can be pulled by driving the 7-shaped hollow insulating rod 110 to move. In order to facilitate the operator to hold the 7-shaped hollow insulating rod 110, an ergonomic handle can be installed at the bottom of the 7-shaped hollow insulating rod 110.

[0031] The information detection component 120 is horizontally arranged in the hollow part of the horizontal end of the 7-shaped hollow insulating rod 110 .

[0032] The information detection component 120 is connected to the visualization control terminal 130 , and the information detection component 120 includes a laser rangefinder 121 and a camera 122 .

[0033] Optionally, the laser rangefinder 121 is used to emit a horizontal laser beam toward the front end of the 7-shaped hollow insulating rod 110 .

[0034] Optionally, the camera 122 is used to collect real-time video of the pull ring operation scene and send the real-time video to the visual control terminal 130.

[0035] Optionally, the information detection component 120 is installed in the hollow part of the horizontal end of the 7-shaped hollow insulating rod 110, which can effectively ensure that the information detection component 120 is not blocked, does not affect the normal use of the 7-shaped hollow insulating rod 110, and does not damage the information detection component 120 during operation.

[0036] Optionally, the laser rangefinder 121 may emit a laser beam to the front end through the hollow 7-shaped hollow insulating rod 110, and the laser beam is kept horizontal with the 7-shaped hollow insulating rod 110. Figure 1 The dotted line portion in may represent a horizontal laser beam emitted by the laser rangefinder 121 .

[0037] Optionally, the visualization control terminal 130 is used to generate a real-time operation screen according to the target pull ring and laser beam in the real-time video, so that the operator can perform the pull ring operation according to the real-time operation screen.

[0038] Optionally, in order to facilitate the operator to observe the real-time operation screen of the visualization control terminal 130, the visualization control terminal 130 can be installed on the upper end of the operator's hand-held part of the 7-shaped hollow insulating rod 110.

[0039] Optionally, the visualization control terminal 130 may be a portable computing device such as a tablet computer or a mobile phone. The visualization control terminal 130 may have a touch screen operation function or may be operated by buttons.

[0040] Optionally, the display screen of the visualization control terminal 130 may be affixed with an anti-reflective protective film.

[0041] Optionally, after the pull-ring operation auxiliary device is powered on for the first time, only the camera 122 and the visual control terminal 130 may be started, and the operator holds the pull-ring operation auxiliary device and moves it to the electrical equipment to be repaired, and captures the real-time video of the electrical equipment through the camera 122 and sends it to the visual control terminal 130. After the visual terminal recognizes the target pull-ring to be pulled, the laser rangefinder 121 is turned on. After the laser rangefinder 121 is turned on, the real-time video captured by the camera 122 contains a laser beam, and the visual control terminal 130 can analyze the laser beam and the pull ring in the picture to generate a real-time operation picture.

[0042] Optionally, the laser emission direction of the laser rangefinder 121 is the same as the shooting direction of the camera 122. When in use, the technician can first roughly align the front end of the 7-shaped hollow insulating rod 110 with the electrical equipment and the pull ring, and after calibrating the target pull ring, mainly align the target pull ring according to the display content of the visualization control terminal 130, so that the visualization control terminal 130 can display clearer and more accurate indication content.

[0043] Optionally, the real-time operation screen may include real-time video, the center point mark of the pull ring marked in the real-time video, and when the laser beam and the center point of the pull ring are on the same horizontal line, it also includes instruction information for indicating that the two should remain horizontal; when the laser beam and the center point of the pull ring are not on the same horizontal line, it also includes instruction information for prompting the operator how to move the pull ring operation auxiliary device; when the center point of the laser beam coincides with the center point of the pull ring, it also includes instruction information for indicating that the pull ring operation conditions are met.

[0044] Optionally, the laser rangefinder 121 is also used to measure the distance between the laser rangefinder 121 and the target pull ring in real time, and send the distance measurement result to the visual control terminal 130.

[0045] Optionally, the visual control terminal 130 is further used to adjust the laser beam emission length of the laser rangefinder 121 according to the distance measurement result.

[0046] Optionally, the distance measurement result of the laser rangefinder 121 may refer to the distance between the laser rangefinder 121 and the ring wall of the pull ring.

[0047] Optionally, after the visualization control terminal 130 obtains the distance measurement result, the laser beam emission length of the laser rangefinder 121 can be set to the same length as the distance measurement result. When the front end of the horizontal end of the 7-shaped hollow insulating rod 110 reaches the pull ring position, the laser beam emission length will become 0.

[0048] The advantage of this setting is that since the interior of the pull ring is a hollow structure, the laser beam will be infinitely long if the emission length is not set, and the operator will not be able to determine the positional relationship between the 7-shaped hollow insulating rod and the target pull ring through the visual control terminal 130. As the 7-shaped hollow insulating rod moves toward the pull ring, the laser beam emission length also decreases synchronously. When the laser beam emission length is shortened to 0, it can be quickly determined that the 7-shaped hollow insulating rod and the target pull ring are in an overlapping state.

[0049] Optionally, when the pull-ring operation auxiliary device is set to a data collection mode, the laser rangefinder 121 is turned off.

[0050] Optionally, in the data acquisition mode, the camera 122 is used to capture real-time video and / or multi-angle photos of the electrical equipment.

[0051] Optionally, in the data acquisition mode, the visualization control terminal 130 is used to identify at least one item of electrical equipment information based on the real-time video and / or multi-angle photos of the electrical equipment, and store the real-time video and / or multi-angle photos of the electrical equipment in correspondence with the electrical equipment information.

[0052] It is understandable that due to the large number of medium-voltage equipment such as transformers, drop-out fuses, knife switches, lightning arresters, switches, etc. in overhead lines, and the long service life of equipment in some areas, the nameplate information of the equipment is missing. When these devices fail, if the high-altitude equipment is checked manually, there may be visual blind spots. If it is checked by drone, due to the large size of the drone, it may not be possible to clearly capture the nameplate details, which is not conducive to repair and replacement after fault detection.

[0053] Therefore, in another optional embodiment, the pull ring operation auxiliary device proposed in the present invention has another usage scenario, that is, in the data acquisition mode, it can realize auxiliary collection of electrical equipment information, which can be specifically applied to daily inspection of electrical equipment or to obtain equipment information of electrical equipment during fault repair.

[0054] Optionally, the electrical equipment information may include nameplate information of the electrical equipment, size information of the electrical equipment, preliminary fault diagnosis information of the electrical equipment, etc.

[0055] The technical solution of the embodiment of the present invention is to set a 7-shaped hollow insulating rod, an information detection component and a visual control terminal in the pull ring operation auxiliary equipment, and set the information detection component horizontally in the hollow part of the horizontal end of the 7-shaped hollow insulating rod, the information detection component is connected to the visual control terminal, and a laser rangefinder and a camera are set in the information detection component. When the operator uses the pull ring operation auxiliary equipment to operate the pull ring, the operator can clearly understand the details of the electrical equipment and the pull ring through the visual control terminal, and the 7-shaped hollow insulating rod can facilitate the operator to align the pull ring, so that the operator can operate the high or long-distance pull ring from the ground without power outage, and effectively survey the electrical equipment, thereby improving the operating efficiency of the high-altitude equipment.

[0056] Embodiment 2

[0057] Figure 2 This is a flow chart of a visualization control method provided in the second embodiment of the present invention. This embodiment can be applied to marking the center point of the pull ring in the real-time video and generating operation prompt information so that the operator can quickly and accurately operate the pull ring according to the real-time operation screen. The method can be executed by a visualization control device, which can be implemented in the form of hardware and / or software and can generally be configured in a visualization control terminal in the pull ring operation auxiliary device. Figure 2 As shown, the method includes:

[0058] S210, respectively identifying electrical devices and the pull rings corresponding to each electrical device in the real-time video sent by the camera, and calibrating the target pull ring according to the target electrical device selected by the operator.

[0059] Optionally, the electrical equipment in the real-time video can be detected using a pre-trained detection model to determine the type of each electrical equipment, and the type of each electrical equipment can be displayed in the real-time video, so that the user can select the target electrical equipment to be opened or closed through the visual control terminal. Since the electrical equipment and the pull ring are generally installed in groups, when the electrical equipment can be captured in the real-time video, the pull ring can generally be captured.

[0060] Optionally, after determining the target electrical device, the pull ring corresponding to the target electrical device can be calibrated as the target pull ring. If there are identical electrical devices around the target electrical device, the pull rings corresponding to the remaining electrical devices are set as the pull rings to be operated in the next round to avoid the influence of the identical pull ring on the identification of the target pull ring.

[0061] In an optional example, the isolating switches of the distribution network lines are generally used as a group of three phases A, B, and C, and are installed in a horizontal position. If it is necessary to identify the isolating switch of phase C and the pull ring of the isolating switch of phase C, it is necessary to synchronously set the isolating switches of phases A and B and the corresponding pull rings to the next round of work to prevent the isolating switches of other phases from affecting the operation.

[0062] S220, calculating the center point position of the target pull ring, generating a center point mark according to the center point position, and adding the center point mark to the real-time video.

[0063] Optionally, after determining the target pull ring, the detection model may be used to detect the structure of the target pull ring. The pull ring structure includes but is not limited to a circle, a regular hexagon, a square, a trapezoid, etc., which are only exemplified here.

[0064] Optionally, the detection model is pre-loaded with center point calculation formulas corresponding to various types of pull ring structures. After the target pull ring structure is determined, the corresponding calculation formula is selected to calculate the center point position, and a center point mark is generated. The center point mark is added to the real-time video as a virtual center point of the target pull ring to facilitate observation by the operator.

[0065] In an optional example, taking a target pull ring of a circular structure as an example, the method of calculating the center point is explained: using the perpendicular bisector method, draw two diameters of a circle at random, and draw perpendicular lines through the endpoints of the two diameters. The intersection of the two perpendicular lines is the center of the circle. Specifically, draw a perpendicular bisector PQ of the chord GH inside the circle, and then find the part of the perpendicular bisector PQ inside the circle, which is the diameter of the circle. Furthermore, draw a perpendicular bisector P′Q′ of this diameter, and the intersection with the diameter is the midpoint O′ of the diameter, which is also the center point of the pull ring.

[0066] Optionally, the center point mark may be a colored dot, but this is not limited here.

[0067] S230, generating operation prompt information according to the positional relationship between the laser beam and the center point mark in the real-time video, and adding the operation prompt information to the real-time video to generate a real-time operation screen.

[0068] Optionally, in order to facilitate the operator to use the 7-shaped hollow insulating rod to pull the pull ring and solve the problem that ground operators have difficulty in aiming at the pull ring in the air, the operator can be guided to move the 7-shaped hollow insulating rod through a real-time operation screen. The operator is first guided to keep the front part of the horizontal end of the 7-shaped hollow insulating rod horizontal with the center point of the pull ring, and then the operator is guided to move the 7-shaped hollow insulating rod forward until the front part of the horizontal end of the 7-shaped hollow insulating rod coincides with the center point of the pull ring.

[0069] Optionally, after determining the center point mark, it can be determined whether the laser beam and the center point mark are kept on the same horizontal line. If they are kept on the same horizontal line, the operator can be directly prompted to translate the insulating rod forward until the front end of the insulating rod is detected to coincide with the center point mark, and a prompt is sent to the operator again to remind the operator that the pull ring operation conditions are currently met.

[0070] Optionally, if they are not kept on the same horizontal line, the translation mode and translation distance can be determined according to the positional relationship between the laser beam and the center point mark. The translation mode can include up and down translation and left and right translation, and the translation mode and translation distance are displayed in the visual control terminal for the operator to move the insulating rod according to the prompts of the visual control terminal until the laser beam and the center point mark are on the same horizontal line.

[0071] The technical solution of the embodiment of the present invention is to respectively identify electrical equipment and the pull ring corresponding to each electrical equipment in the real-time video sent by the camera, calibrate the target pull ring according to the target electrical equipment selected by the operator, calculate the center point position of the target pull ring, generate a center point mark according to the center point position, add the center point mark to the real-time video, generate operation prompt information according to the positional relationship between the laser beam and the center point mark in the real-time video, and add the operation prompt information to the real-time video to generate a real-time operation screen. The operator can be guided through the real-time operation screen in the visualization screen, so that the operator can accurately move the 7-shaped hollow insulating rod, quickly align the insulating rod and the pull ring, and realize ground operation of high or long-distance pull rings without power outages, thereby improving the operating efficiency of high-altitude equipment.

[0072] Embodiment 3

[0073] Figure 3 This is a flow chart of another visualization control method provided by Embodiment 3 of the present invention. This embodiment specifically describes the visualization control method based on the above embodiments. Figure 3 As shown, the method includes:

[0074] S310. When at least one pair of electrical devices and corresponding pull rings are detected in the real-time video, the type of each electrical device is determined using a pre-trained detection model, and the type of each electrical device is marked in the real-time video so that the operator can operate the visual control terminal to select the target electrical device.

[0075] The types of electrical equipment include at least disconnectors and drop-out fuses.

[0076] Optionally, use a pre-trained detection model to determine the type of each electrical device, including:

[0077] Using the detection model, image preprocessing is performed on video frames containing electrical equipment in real-time video, and feature extraction is performed on the preprocessed video frames to obtain features of the target electrical equipment;

[0078] The target electrical device characteristics are compared with pre-stored sample device characteristics, and the type of the electrical device is determined according to the comparison result.

[0079] Optionally, the detection model includes multi-angle sample images of various types of electrical devices and feature information matching each electrical device.

[0080] Optionally, performing image preprocessing on the video frame includes: converting the original image into a grayscale image; converting the grayscale image into a black and white image; and performing boundary removal processing on the black and white image.

[0081] Optionally, the method for extracting features from video frames includes: extracting pixel distribution patterns from a black and white image after removing boundaries; after obtaining the pixel distribution patterns, removing some interference points; and extracting image features based on the pixels after removing the interference points.

[0082] Optionally, after obtaining the image features of the video frame, the detection model may compare the image features of the video frame with the features of its pre-stored sample images. When the comparison result is multiple pictures, the junk pictures are filtered out to obtain the target image, and the electrical equipment type corresponding to the target image is used as the type of the target electrical equipment.

[0083] S320, calibrating the pull ring corresponding to the target electrical device as the target pull ring.

[0084] S330: Determine the pull ring structure of the target pull ring by using the detection model, and determine the center point position of the target pull ring according to the center point calculation formula corresponding to the pull ring structure.

[0085] Optionally, similar to the method for determining the type of electrical equipment, pull ring images and feature information of a variety of pull ring structures are pre-stored in the detection model. After the target pull ring is determined, the image of the target pull ring is preprocessed, and feature extraction is performed on the pull ring after preprocessing. The feature information of the target pull ring is compared with the feature information stored in the detection model. When the comparison result is multiple pictures, the junk pictures are filtered out to obtain the target image, and the pull ring structure corresponding to the target image is used as the pull ring structure of the target pull ring.

[0086] S340. Determine whether the laser beam and the center point of the pull ring are on the same horizontal line based on the positional relationship between the laser beam and the center point mark; if not, execute step S350 until the laser beam and the center point of the pull ring are on the same horizontal line, and then execute step S360; if so, directly execute step S360.

[0087] S350, generating a third prompt information, so that the operator can move the 7-shaped hollow insulating rod according to the third prompt information until the laser beam and the center point of the pull ring are kept on the same horizontal line.

[0088] Optionally, the third prompt information may include a translation mode and a translation distance, and the third prompt information may prompt the operator how to move the 7-shaped hollow insulating rod so that the laser beam and the center point mark are on the same horizontal line.

[0089] S360, generating a first prompt message for the operator to translate the 7-shaped hollow insulating rod in the pull ring operation auxiliary equipment toward the pull ring according to the first prompt message, and when it is determined that the laser beam length is 0, generating a second prompt message to prompt the operator to meet the pull ring operation conditions.

[0090] Optionally, the first prompt information may indicate that the current laser beam and the center point of the pull ring are kept on the same horizontal line, and the operator can move the insulating rod forward; the second prompt information may indicate that the front end of the 7-shaped hollow insulating rod has coincided with the center point of the pull ring, and the operator can perform the pull ring operation.

[0091] S370: Add operation prompt information to the real-time video to generate a real-time operation screen.

[0092] The technical solution of the embodiment of the present invention is to respectively identify electrical equipment and the pull ring corresponding to each electrical equipment in the real-time video sent by the camera, calibrate the target pull ring according to the target electrical equipment selected by the operator, calculate the center point position of the target pull ring, generate a center point mark according to the center point position, add the center point mark to the real-time video, generate operation prompt information according to the positional relationship between the laser beam and the center point mark in the real-time video, and add the operation prompt information to the real-time video to generate a real-time operation screen. The operator can be guided through the real-time operation screen in the visualization screen, so that the operator can accurately move the 7-shaped hollow insulating rod, quickly align the insulating rod and the pull ring, and realize ground operation of high or long-distance pull rings without power outages, thereby improving the operating efficiency of high-altitude equipment.

[0093] Embodiment 4

[0094] Figure 4 This is a schematic diagram of the structure of a visual control device provided in Embodiment 4 of the present invention. Figure 4 As shown, the device includes: a pull ring recognition module 410, a center point mark generation module 420 and a real-time operation picture generation module 430.

[0095] The pull ring identification module 410 is used to respectively identify electrical devices and the pull ring corresponding to each electrical device in the real-time video sent by the camera, and calibrate the target pull ring according to the target electrical device selected by the operator.

[0096] The center point mark generation module 420 is used to calculate the center point position of the target pull ring, generate a center point mark according to the center point position, and add the center point mark to the real-time video.

[0097] The real-time operation screen generation module 430 is used to generate operation prompt information according to the positional relationship between the laser beam and the center point mark in the real-time video, and add the operation prompt information to the real-time video to generate a real-time operation screen.

[0098] The technical solution of the embodiment of the present invention is to respectively identify electrical equipment and the pull ring corresponding to each electrical equipment in the real-time video sent by the camera, calibrate the target pull ring according to the target electrical equipment selected by the operator, calculate the center point position of the target pull ring, generate a center point mark according to the center point position, add the center point mark to the real-time video, generate operation prompt information according to the positional relationship between the laser beam and the center point mark in the real-time video, and add the operation prompt information to the real-time video to generate a real-time operation screen. The operator can be guided through the real-time operation screen in the visualization screen, so that the operator can accurately move the 7-shaped hollow insulating rod, quickly align the insulating rod and the pull ring, and realize ground operation of high or long-distance pull rings without power outages, thereby improving the operating efficiency of high-altitude equipment.

[0099] Based on the above embodiments, the pull ring identification module 410 can be used for:

[0100] When at least one pair of electrical devices and the corresponding pull rings are detected in the real-time video, the type of each electrical device is determined using a pre-trained detection model, and the type of each electrical device is marked in the real-time video so that the operator can operate the visual control terminal to select the target electrical device;

[0101] The types of electrical equipment include at least disconnectors and drop-out fuses;

[0102] The pull ring corresponding to the target electrical device is marked as the target pull ring.

[0103] Based on the above embodiments, the center point mark generating module 420 can be used to:

[0104] The pull ring structure of the target pull ring is determined by using the detection model, and the center point position of the target pull ring is determined according to a center point calculation formula corresponding to the pull ring structure.

[0105] Based on the above embodiments, the real-time operation screen generation module 430 can be used to:

[0106] According to the positional relationship between the laser beam and the center point mark, it is determined whether the laser beam and the center point of the pull ring are on the same horizontal line;

[0107] If yes, a first prompt message is generated, so that the operator can translate the 7-shaped hollow insulating rod in the pull-ring operation auxiliary device toward the pull-ring direction according to the first prompt message, and when it is determined that the laser beam length is 0, a second prompt message is generated to prompt the operator that the pull-ring operation condition is met;

[0108] If not, a third prompt message is generated, so that the operator can move the 7-shaped hollow insulating rod according to the third prompt message until the laser beam and the center point of the pull ring are kept on the same horizontal straight line.

[0109] Based on the above embodiments, the pull ring identification module 410 can be further specifically used for:

[0110] Using the detection model, image preprocessing is performed on video frames containing electrical equipment in real-time video, and feature extraction is performed on the preprocessed video frames to obtain features of the target electrical equipment;

[0111] The target electrical device characteristics are compared with pre-stored sample device characteristics, and the type of the electrical device is determined according to the comparison result.

[0112] The visualization control device provided in the embodiment of the present invention can execute the visualization control method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0113] Embodiment 5

[0114] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0115] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0116] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0117] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0118] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0119] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0120] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0121] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A pull ring operation auxiliary device, characterized in that: It includes a 7-shaped hollow insulating rod, an information detection component and a visual control terminal; wherein the information detection component is horizontally arranged at the hollow part of the horizontal end of the 7-shaped hollow insulating rod; The information detection component is connected to the visual control terminal, and the information detection component includes a laser rangefinder and a camera; The laser rangefinder is used to emit a horizontal laser beam to the front end of the 7-shaped hollow insulating rod; the camera is used to collect real-time video of the pull ring operation scene and send the real-time video to the visual control terminal; The visualization control terminal is used to generate a real-time operation screen according to the target pull ring and laser beam in the real-time video, so that the operator can perform the pull ring operation according to the real-time operation screen.

2. The device according to claim 1, characterized in that The laser rangefinder is also used to measure the distance between the laser rangefinder and the target pull ring in real time, and send the distance measurement result to the visual control terminal; The visual control terminal is also used to adjust the laser beam emission length of the laser rangefinder according to the distance measurement result.

3. The device according to claim 1, characterized in that When the pull-ring operation auxiliary device is set to a data acquisition mode, turning off the laser rangefinder; In data acquisition mode, the camera is used to capture real-time video and / or multi-angle photos of the electrical equipment; In the data acquisition mode, the visual control terminal is used to identify at least one item of electrical equipment information based on the real-time video and / or multi-angle photos of the electrical equipment, and store the real-time video and / or multi-angle photos of the electrical equipment in correspondence with the electrical equipment information.

4. A visual control method, executed by a visual control terminal in the pull ring operation auxiliary device according to any one of claims 1 to 3, characterized in that: include: Identify electrical devices and the pull rings corresponding to each electrical device in the real-time video sent by the camera, and calibrate the target pull ring according to the target electrical device selected by the operator; Calculate the center point position of the target pull ring, generate a center point mark according to the center point position, and add the center point mark to the real-time video; According to the positional relationship between the laser beam and the center point mark in the real-time video, operation prompt information is generated, and the operation prompt information is added to the real-time video to generate a real-time operation picture.

5. The method according to claim 4, characterized in that Identify electrical equipment and the pull ring corresponding to each electrical equipment in the real-time video sent by the camera, and calibrate the target pull ring according to the target electrical equipment selected by the operator, including: When at least one pair of electrical devices and the corresponding pull rings are detected in the real-time video, the type of each electrical device is determined using a pre-trained detection model, and the type of each electrical device is marked in the real-time video so that the operator can operate the visual control terminal to select the target electrical device; The types of electrical equipment include at least disconnectors and drop-out fuses; The pull ring corresponding to the target electrical device is marked as the target pull ring.

6. The method according to claim 5, characterized in that Calculate the center point position of the target pull ring, including: The pull ring structure of the target pull ring is determined by using the detection model, and the center point position of the target pull ring is determined according to a center point calculation formula corresponding to the pull ring structure.

7. The method according to claim 4, characterized in that Based on the positional relationship between the laser beam and the center point mark in the real-time video, operation prompt information is generated, including: According to the positional relationship between the laser beam and the center point mark, it is determined whether the laser beam and the center point of the pull ring are on the same horizontal line; If yes, a first prompt message is generated, so that the operator can translate the 7-shaped hollow insulating rod in the pull-ring operation auxiliary device toward the pull-ring direction according to the first prompt message, and when it is determined that the laser beam length is 0, a second prompt message is generated to prompt the operator that the pull-ring operation condition is met; If not, a third prompt message is generated, so that the operator can move the 7-shaped hollow insulating rod according to the third prompt message until the laser beam and the center point of the pull ring are kept on the same horizontal straight line.

8. The method according to claim 6, characterized in that Leverage pre-trained detection models to determine the type of each electrical device, including: Using the detection model, image preprocessing is performed on video frames containing electrical equipment in real-time video, and feature extraction is performed on the preprocessed video frames to obtain features of the target electrical equipment; The target electrical device characteristics are compared with pre-stored sample device characteristics, and the type of the electrical device is determined according to the comparison result.

9. A visual control device, executed by a visual control terminal in the pull ring operation auxiliary device according to any one of claims 1 to 3, characterized in that: include: A pull ring identification module is used to identify electrical equipment and the pull ring corresponding to each electrical equipment in the real-time video sent by the camera, and calibrate the target pull ring according to the target electrical equipment selected by the operator; A center point mark generation module is used to calculate the center point position of the target pull ring, generate a center point mark according to the center point position, and add the center point mark to the real-time video; The real-time operation screen generation module is used to generate operation prompt information according to the positional relationship between the laser beam and the center point mark in the real-time video, and add the operation prompt information to the real-time video to generate a real-time operation screen.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the visualization control method according to any one of claims 4 to 8 when executed.

Images