Binocular vision-based circuit breaker operating characteristic equipment and detection method

Through binocular vision technology, real-time monitoring of the circuit breaker action characteristics is solved, and the traditional detection methods affect the stability of the power system and incomplete information is achieved, accurate and safe detection of the circuit breaker action status is achieved, and fault diagnosis efficiency is improved.

CN119063987AInactive Publication Date: 2024-12-03ELECTRIC POWER SCI & RES INST OF STATE GRID TIANJIN ELECTRIC POWER CO +2
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411561874.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-05
Publication Date
2024-12-03
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The traditional circuit breaker action characteristic detection method requires the circuit breaker to be powered off, which affects the stable operation of the power system. The detection information is not comprehensive and accurate enough, making it difficult to accurately judge the performance status of the circuit breaker in the real environment, and potential safety hazards may be missed.

Method used

Using the circuit breaker action characteristic equipment and detection methods based on binocular vision, the circuit breaker link movement trajectory is captured through the parallax principle of multiple cameras, combined with image processing technology, the circuit breaker action status is monitored in real time, and the action characteristics, including moving contacts are obtained. Displacement and velocity information to avoid errors and damages in contact detection.

Benefits of technology

It realizes accurate and safe detection of the operating status of the circuit breaker, reduces the inconvenience and economic losses caused by power outages, provides more comprehensive data support, and improves the efficiency of circuit breaker performance evaluation and fault diagnosis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119063987A_ABST
    Figure CN119063987A_ABST
Patent Text Reader

Abstract

The invention provides circuit breaker operating characteristic equipment based on binocular vision and a detection method, and mainly relates to the technical field of power transmission and transformation equipment operation and maintenance. The circuit breaker operating characteristic equipment based on binocular vision comprises a camera module which comprises a plurality of cameras, the plurality of cameras are configured to face a test platform, the test platform is provided with a to-be-tested circuit breaker, the camera visual fields of the plurality of cameras on the test platform have overlapping areas, the overlapping areas comprise connecting rods of the to-be-tested circuit breaker, and the connecting rods are connected with the camera module. The connecting rod is configured to act synchronously with a moving contact of the circuit breaker to be tested; the control module is configured to be electrically connected with the to-be-tested circuit breaker and the plurality of cameras respectively, and the control module is configured to control the plurality of cameras to synchronously perform image acquisition on the to-be-tested circuit breaker while controlling a moving contact of the to-be-tested circuit breaker to perform switching-on and switching-off actions, and to determine the to-be-tested circuit breaker based on image sequences acquired by the plurality of cameras respectively. And the operating characteristics of the to-be-tested circuit breaker are obtained.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of power transmission and transformation equipment operation and maintenance, and more specifically, to a circuit breaker action characteristic device and a detection method based on binocular vision. Background Art

[0002] As an indispensable high-voltage equipment in the power system, the operating characteristics of the circuit breaker are crucial to ensuring the safe and stable operation of the circuit breaker itself and the entire power system.

[0003] However, the traditional mechanical performance testing method needs to be carried out when the circuit breaker is in a power-off state, which can easily affect the stable operation of the power system and increase the risk of power outages. Secondly, the traditional test scheme is relatively complicated, and the test information is not comprehensive and accurate enough, which makes it difficult for maintenance personnel to accurately judge the performance status of the circuit breaker in the actual operating environment, and may thus miss potential safety hazards. Summary of the invention

[0004] In view of this, the present invention provides a circuit breaker action characteristic device and a detection method based on binocular vision.

[0005] One aspect of the present invention provides a circuit breaker action characteristic device based on binocular vision, comprising: a camera module, comprising a plurality of cameras, wherein the plurality of cameras are configured to be arranged facing a test platform, wherein a circuit breaker to be tested is arranged on the test platform, and the camera fields of the plurality of cameras on the test platform have overlapping areas, wherein the overlapping areas include a connecting rod of the circuit breaker to be tested, and the connecting rod is configured to move synchronously with a moving contact of the circuit breaker to be tested; a control module, configured to be electrically connected to the circuit breaker to be tested and the plurality of cameras, respectively, wherein the control module is configured to control the plurality of cameras to synchronously capture images of the circuit breaker to be tested while controlling the moving contact of the circuit breaker to be tested to perform closing and opening actions, and obtain the action characteristics of the circuit breaker to be tested based on the image sequences captured by the plurality of cameras.

[0006] According to an embodiment of the present invention, the plurality of cameras are configured to be arranged relative to the circuit breaker to be tested based on a preset distance and a preset angle, so that the proportion of the overlapping area to the camera field of view of the camera on the test platform is within a preset range, wherein the preset range is determined based on the lateral resolution of the camera, the camera accuracy of the camera and the lateral movement distance of the target point on the connecting rod.

[0007] According to an embodiment of the present invention, the control module is configured to perform image processing on the image sequences captured by the plurality of cameras to obtain a time-series disparity map sequence, and perform information processing based on the depth information contained in the time-series disparity map sequence to obtain the action characteristics of the circuit breaker to be tested.

[0008] According to an embodiment of the present invention, the control module is configured to determine an image group corresponding to each acquisition moment from the image sequences respectively acquired by the plurality of cameras, and to match the plurality of images included in the image group to obtain a time-series disparity map with depth information of each pixel at the acquisition moment, and to obtain the time-series disparity map sequence based on the respective time-series disparity maps at the plurality of acquisition moments.

[0009] According to an embodiment of the present invention, the circuit breaker action characteristic device further includes: a light source module, the light source module includes a plurality of fill lights, and the fill lights are configured to surround the circuit breaker to be tested.

[0010] According to an embodiment of the present invention, the fill light is configured to illuminate the circuit breaker to be tested so that the exposure amount obtained by the camera during the exposure period reaches a preset value, wherein the duration of the exposure period of the camera is configured to be less than the preset duration.

[0011] According to an embodiment of the present invention, the light source module further includes a plurality of light sensors, which are used to determine the intensity of the ambient light when the fill light is turned off; wherein the light source module is further configured to adjust the power supply provided to each of the plurality of fill lights based on the intensity of the ambient light determined by each of the plurality of light sensors and the relative position relationship between the plurality of light sensors and the plurality of fill lights, so as to adjust the brightness of each of the plurality of fill lights.

[0012] According to an embodiment of the present invention, the circuit breaker under test is configured to be welded and fixed on the test platform, so that during the closing and opening actions of the moving contact of the circuit breaker under test, the vibration amplitude of the circuit breaker under test is smaller than a preset amplitude.

[0013] According to an embodiment of the present invention, the action characteristics of the circuit breaker to be tested include a circuit breaker depth time-varying characteristic curve and a circuit breaker stroke characteristic curve; the action characteristics are used to characterize the displacement information and speed information of the target point on the connecting rod in the three-dimensional space during the closing and opening action of the moving contact of the circuit breaker to be tested.

[0014] Another aspect of the present invention provides a method for detecting circuit breaker action characteristics based on binocular vision, which is applied to any of the above-mentioned circuit breaker action characteristic devices based on binocular vision. The method comprises: in the process of controlling the moving contact of the circuit breaker to be tested to perform closing and opening actions, controlling multiple cameras to synchronously capture images of the circuit breaker to be tested to obtain image sequences captured by each of the multiple cameras; and obtaining the action characteristics of the circuit breaker to be tested based on the image sequences captured by each of the multiple cameras.

[0015] According to the embodiment of the present invention, since the connecting rod and the moving contact move synchronously, the parallax principle of multiple cameras is used to capture the motion trajectory of the connecting rod of the circuit breaker to be tested by overlapping the field of view of the cameras on the test platform, so as to indirectly obtain the motion characteristics of the moving contact of the circuit breaker to be tested. In addition, the image sequences collected by multiple cameras are processed and analyzed in real time by the control module, so that the equipment can monitor the action status of the circuit breaker in real time in a non-contact manner without power failure, thereby avoiding errors and damages that may be caused by contact detection, ensuring the accuracy and safety of detection; at the same time, reducing the inconvenience and economic losses caused by power failures. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:

[0017] Figure 1 A schematic diagram of a circuit breaker action characteristic device based on binocular vision according to an embodiment of the present invention is shown.

[0018] Figure 2 A schematic diagram showing the overlapping fields of view of left and right cameras according to a specific embodiment of the present invention is shown.

[0019] Figure 3 A schematic diagram for representing depth information of each pixel according to a specific embodiment of the present invention is shown.

[0020] Figure 4 A schematic diagram showing a time-series disparity map containing depth information of a key area of ​​a circuit breaker to be tested according to a specific embodiment of the present invention is shown.

[0021] Figure 5 A schematic diagram of a circuit breaker action characteristic device based on binocular vision according to another embodiment of the present invention is shown.

[0022] Figure 6 A schematic diagram showing a marker attached to a circuit breaker connecting rod according to a specific embodiment of the present invention is shown.

[0023] Figure 7 A schematic diagram of a time-varying characteristic curve of circuit breaker depth according to a specific embodiment of the present invention is shown.

[0024] Figure 8 A schematic diagram of a circuit breaker travel characteristic curve according to a specific embodiment of the present invention is shown.

[0025] Fig. 9 A schematic diagram of wiring of various modules of a device platform according to a specific embodiment of the present invention is shown.

[0026] Fig.10A flow chart of a method for detecting circuit breaker action characteristics based on binocular vision according to an embodiment of the present invention is shown.

[0027] Fig.11 A block diagram of a circuit breaker action characteristic detection device based on binocular vision according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0028] Below, embodiments of the present invention will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present invention. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of embodiments of the present invention. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of concepts of the present invention.

[0029] The terms used herein are only for describing specific embodiments and are not intended to limit the present invention. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0030] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0031] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0032] In the embodiments of the present invention, the collection, updating, analysis, processing, use, transmission, provision, invention, storage and other aspects of the data involved (for example, including but not limited to user personal information) are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. In particular, necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information and network security.

[0033] As an indispensable high-voltage device in the power system, the action characteristics of the circuit breaker (such as opening time, closing time, action speed, synchronization, etc.) are crucial to ensure the safe and stable operation of the circuit breaker itself and the entire power system. The changes in these action characteristics can directly reflect the performance status of the circuit breaker and are an important basis for evaluating whether the circuit breaker is operating healthily.

[0034] Traditional mechanical performance testing methods have brought great challenges to the maintenance of circuit breakers. For example, mechanical property tests and closing and opening coil current test experiments need to be carried out when the circuit breaker is powered off, which can easily affect the stable operation of the power system, thereby increasing the risk of power outages. Secondly, traditional test plans are often complicated, and the test information is not comprehensive and accurate, which makes it difficult for maintenance personnel to accurately judge the performance status of the circuit breaker in the actual operating environment, and thus may miss potential safety hazards.

[0035] In view of this, the embodiment of the present invention configures the connecting rod and the moving contact to move synchronously, and uses the parallax principle of multiple cameras to capture the motion trajectory of the connecting rod of the circuit breaker to be tested by overlapping the field of view of the cameras on the test platform, so as to indirectly obtain the motion characteristics of the moving contact of the circuit breaker to be tested. In addition, the image sequences collected by multiple cameras are processed and analyzed in real time by the control module, so that the equipment can monitor the action status of the circuit breaker in real time in a non-contact manner without power failure, thereby avoiding errors and damages that may be caused by contact detection, ensuring the accuracy and safety of detection; at the same time, reducing the inconvenience and economic losses caused by power failures.

[0036] An embodiment of the present invention provides a circuit breaker action characteristic device based on binocular vision, comprising: a camera module, comprising multiple cameras, and the multiple cameras are all configured to be set facing a test platform, wherein a circuit breaker to be tested is arranged on the test platform, and the camera fields of the multiple cameras on the test platform have overlapping areas, and the overlapping areas include a connecting rod of the circuit breaker to be tested, and the connecting rod is configured to move synchronously with a moving contact of the circuit breaker to be tested; a control module, configured to be electrically connected to the circuit breaker to be tested and the multiple cameras respectively, and the control module is configured to control the multiple cameras to synchronously perform image acquisition on the circuit breaker to be tested while controlling the moving contact of the circuit breaker to be tested to perform closing and opening actions, and obtain the action characteristics of the circuit breaker to be tested based on the image sequences acquired by the multiple cameras.

[0037] Figure 1 A schematic diagram of a circuit breaker action characteristic device based on binocular vision according to an embodiment of the present invention is shown.

[0038] like Figure 1 As shown, the circuit breaker action characteristic device based on binocular vision includes a camera module 1 and a control module 2.

[0039] According to an embodiment of the present invention, the camera module 1 includes a plurality of cameras 11 arranged facing the test platform 3, and a circuit breaker 31 to be tested is placed on the test platform 3. The plurality of cameras 11 may be high-speed industrial cameras and fixed by a camera bracket 12.

[0040] Specifically, the camera support 12 may include a camera base plate 121, a vertical pole 122, and a binocular stereoscopic vision fixing plate 123, wherein the camera base plate 121 may be used for stable support, and the vertical pole 122, as an extension of the camera support 12, may be connected to the binocular stereoscopic vision fixing plate 123, and connected to the camera base plate 121 through the binocular stereoscopic vision fixing plate 123. The binocular stereoscopic vision fixing plate 123 may fix the plurality of cameras 11 on the camera support 12 at a certain relative position.

[0041] According to an embodiment of the present invention, the test platform 3 may be a flexible platform for fixing the circuit breaker 31 to be tested.

[0042] According to the embodiment of the present invention, in order to ensure that the action characteristics of the circuit breaker 31 to be tested can be fully and accurately captured, the fields of view of the multiple cameras 11 on the test platform 3 have an overlapping area. The overlapping area includes the connecting rod of the circuit breaker to be tested.

[0043] According to the embodiment of the present invention, since the speed of the moving contact of the circuit breaker 31 to be tested can reflect the opening and closing performance, the fast movement of the moving contact helps to quickly cut off the fault current, which is the key to whether the fault current can be cut off and switching can be performed. However, the moving contact is usually located in the arc extinguishing chamber and is not directly exposed to the external environment. Therefore, the connecting rod can be connected to the moving contact of the circuit breaker 31 to achieve synchronous movement of the connecting rod and the moving contact of the circuit breaker 31 to be tested.

[0044] According to an embodiment of the present invention, the circuit breaker action characteristic device based on binocular vision further includes a control module 2. The control module 2 is electrically connected to the circuit breaker 31 to be tested and the multiple cameras 11, respectively, so that the control module 2 can simultaneously send an operation instruction to the circuit breaker 31 to be tested and receive image acquisition data from the multiple cameras 11.

[0045] According to an embodiment of the present invention, in response to a test start instruction, the control module 2 controls the moving contact of the circuit breaker 31 to be tested to perform closing and opening actions, and controls multiple cameras 11 to synchronously perform high frame rate synchronous shooting and other image acquisition operations on the connecting rod of the circuit breaker 31 to be tested, so that each camera can capture the state of the circuit breaker 31 to be tested at different action stages, so as to obtain the image sequence acquired by each of the multiple cameras 11.

[0046] According to an embodiment of the present invention, when the control module 2 receives the image sequences captured by the multiple cameras 11 , it can use image processing algorithms and binocular vision technology to process the image sequences to obtain the action characteristics of the circuit breaker 31 to be tested.

[0047] According to an embodiment of the present invention, the action characteristics of the circuit breaker to be tested may include information such as motion displacement, motion speed, motion stability, and motion process in the depth direction. By analyzing the action characteristics of the circuit breaker to be tested, it is not only possible to provide more comprehensive data support for subsequent fault diagnosis of the circuit breaker, such as mechanical characteristic hazards such as mechanism jamming, loose contacts, transmission failure, and different opening phases, but also to improve the efficiency of circuit breaker action detection. At the same time, the action characteristics analysis of the circuit breaker to be tested is also helpful to timely discover potential safety hazards, so as to take necessary maintenance measures to ensure the safe operation of the equipment.

[0048] Based on this, the embodiment of the present invention configures the connecting rod and the moving contact to move synchronously, and uses the parallax principle of multiple cameras to capture the motion trajectory of the connecting rod of the circuit breaker to be tested by overlapping the field of view of the cameras on the test platform, so as to indirectly obtain the motion characteristics of the moving contact of the circuit breaker to be tested. In addition, the image sequences collected by multiple cameras are processed and analyzed in real time by the control module, so that the equipment can monitor the action status of the circuit breaker in real time in a non-contact manner without power failure, thereby avoiding errors and damages that may be caused by contact detection, ensuring the accuracy and safety of detection; at the same time, reducing the inconvenience and economic losses caused by power failures.

[0049] According to an embodiment of the present invention, the plurality of cameras are configured to be arranged relative to the circuit breaker to be tested based on a preset distance and a preset angle so that the proportion of the overlapping area to the camera field of view of the camera on the test platform is within a preset range.

[0050] According to an embodiment of the present invention, camera parameters and shooting conditions of multiple cameras can be set relative to the circuit breaker to be tested based on a preset distance and a preset angle to ensure that the cameras capture clear and accurate image information on the test platform.

[0051] Figure 2 A schematic diagram showing the overlapping fields of view of left and right cameras according to a specific embodiment of the present invention is shown.

[0052] In order to ensure that at least two cameras can simultaneously capture the target point on the connecting rod of the circuit breaker under test during the operation of the circuit breaker under test, the proportion of the overlapping area to the camera field of view on the test platform can be controlled within a preset range. Figure 2 As shown, the common field of view of the two cameras is the overlapping area.

[0053] Specifically, in a specific embodiment of the present invention, the camera parameters and shooting conditions may include: the ratio of the overlapping fields of view of the left and right cameras to the total field of view, ghosting, camera accuracy, lateral movement distance of the measured target, lateral resolution, movement speed, frame rate, and exposure time.

[0054] Among them, the ratio of the overlapped field of view of the left and right cameras to the total field of view, the smear, the camera accuracy, the lateral moving distance and the moving speed of the measured target can be set as a preset quantity. The preset range of the ratio of the overlapped area to the camera field of view of the camera on the test platform can be determined based on the lateral resolution of the camera, the camera accuracy and the lateral moving distance of the target point on the connecting rod.

[0055] For example, the ratio p of the overlapped field of view of the left and right cameras to the total field of view is set to 80% to ensure that the overlapped field of view is large enough to reduce the error of image stitching; the smear s is set to no more than 2px to ensure image clarity; the camera accuracy a is set to 0.1mm to ensure that the camera can capture small displacement changes; the lateral movement distance l is set to 40mm, and the movement speed v is set to 2.5m / s. On this basis, it is required to collect one image every millisecond. According to the following formula, the specific data of camera parameters and shooting conditions can be obtained, as shown in Table 1.

[0056] (1);

[0057] (2);

[0058] Among them, r represents the lateral resolution, a represents the camera accuracy, p represents the ratio of the overlapping fields of view of the left and right cameras to the total field of view, v represents the moving speed, t represents the exposure time, s represents the smear, and l represents the lateral moving distance.

[0059] Table 1

[0060]

[0061] In Table 1, the proportion of the overlapped field of view of the left and right cameras to the total field of view, p, the camera accuracy a, and the lateral moving distance l are substituted into the above formula (1), and the lateral resolution r can be calculated to be 500px. Therefore, the lateral resolution r can be set to no less than 500px. In addition, the lateral resolution r, the smear s, the moving speed v, and the lateral moving distance l are substituted into formula (2), and 0.0025t<0.04 is obtained. The calculated exposure time t should be less than 16μs.

[0062] In this specific embodiment, the higher the camera shooting frame rate is, the more information is obtained per second, but the redundant data and cost are higher. Therefore, on the basis of obtaining sufficient circuit breaker movement information, the cost is minimized. In Table 1, the shooting frame rate f can be set to be greater than 800 frames (pix) to ensure that the multiple cameras in this embodiment can take 8 photos within 10ms.

[0063] According to an embodiment of the present invention, the control module is configured to perform image processing on the image sequences captured by the multiple cameras to obtain a time-series disparity map sequence, and perform information processing based on the depth information contained in the time-series disparity map sequence to obtain the action characteristics of the circuit breaker to be tested.

[0064] According to an embodiment of the present invention, when receiving image sequences respectively acquired by a plurality of cameras, the control module may obtain a time-series disparity map sequence by performing image processing on the image sequences respectively acquired by the plurality of cameras.

[0065] The sequence of time-series disparity maps may include time-series disparity maps of the circuit breaker to be tested at multiple moments obtained according to the shooting sequence, and the time-series disparity map may be used to represent an image with depth information of each pixel obtained after stereo matching of left and right views.

[0066] According to an embodiment of the present invention, the control module is configured to determine an image group corresponding to each acquisition moment from an image sequence acquired by each of the multiple cameras, and to match the multiple images included in the image group to obtain a time-series disparity map with depth information of each pixel at the acquisition moment, and to obtain a time-series disparity map sequence based on the respective time-series disparity maps at the multiple acquisition moments.

[0067] Specifically, the method for determining the sequence of time-series disparity maps includes: at each image acquisition moment, the control module will synchronously acquire images from multiple cameras to form an image group. Each image in these image groups corresponds to the same moment, but the shooting angle or position is different. For each image group, the control module matches the multiple images included in the image group to find the correspondence between different images. Through image matching, the control module can determine the position of each pixel in different images, and then calculate the disparity between these pixels. For each image group at each acquisition moment, the control module uses the obtained disparity information and known camera parameters (such as camera focal length, baseline distance, etc.) to calculate the depth information of each pixel through the principle of triangulation, and generate a time-series disparity map with the depth information of each pixel. The time-series disparity map is as follows: Figure 3 As time goes by, the control module will continue to repeat the above process, generate a time-series disparity map for each acquisition moment, and arrange these time-series disparity maps in chronological order to form a time-series disparity map sequence.

[0068] Figure 3 A schematic diagram for representing depth information of each pixel according to a specific embodiment of the present invention is shown.

[0069] like Figure 3 As shown, F is the focal length of the camera, O l , O r are the optical centers of the left and right cameras respectively; the optical center distance b represents the camera spacing; P l and P r are the imaging points of the target point P in the left and right eye phase planes, that is, P l and P r The points are of the same name; the image point P of the target point P on the left eye phase plane l Project to the right eye plane as projection point P l ', through the principle of similar triangles, the distance between the target point P and the camera can be obtained. The specific calculation method is as follows.

[0070] (3);

[0071] Among them, z represents the distance between the target point P and the camera, F represents the focal length of the camera, b represents the camera spacing, and x l ' represents the image point P of the target point P in the left eye phase plane l Point P projected on the right eye plane l 'The horizontal coordinate, x r Represents the image point P of the target point P in the right eye phase plane r The horizontal axis of x l '-x r It is expressed as disparity d.

[0072] Figure 4 A schematic diagram showing a time-series disparity map containing depth information of a key area of ​​a circuit breaker to be tested according to a specific embodiment of the present invention is shown.

[0073] like Figure 4 As shown in the figure, the area marked in the left figure is taken as the key area of ​​the circuit breaker to be tested (as shown in the gray box in the left figure). Through the image matching step in image processing, the area that best matches the left and right eye views and the key area is obtained. l '-x r Establish the disparity relationship between the left and right eye's most matching areas, traverse all pixels in the key area, fill the disparity value into this area, and obtain a disparity map containing only the key area (see the gray box on the right), whose pixel value is the disparity value d, and then the depth value of the area can be calculated according to formula (3). The control module can extract the depth information of each pixel from the time-series disparity map. This depth information reflects the motion state of the circuit breaker to be tested in three-dimensional space, such as motion trajectory and motion speed.

[0074] According to an embodiment of the present invention, the control module can further process the depth information extracted from the time-series disparity map sequence. The information processing method may include analyzing whether the motion trajectory of the circuit breaker to be tested meets expectations, calculating the action speed of the circuit breaker to be tested, and detecting whether the circuit breaker to be tested has abnormal behaviors such as excessive vibration and jamming. Based on the above information processing results, the action characteristics of the circuit breaker to be tested, such as the action time, action speed, and stability, can be obtained through the control module.

[0075] Based on this, the embodiment of the present invention can generate a high-precision time-series disparity map sequence by performing image processing on the image sequences collected by multiple cameras through the control module. These disparity maps can not only intuitively reflect the position changes of the circuit breaker at different time points, but also contain depth information. Based on this information, the control module can accurately calculate the key action characteristics of the circuit breaker, such as the action time, action speed, and displacement, which helps to timely discover potential problems or anomalies and provide reliable data support for the performance evaluation of the circuit breaker.

[0076] According to an embodiment of the present invention, the circuit breaker action characteristic device based on binocular vision further includes a light source module, the light source module includes a plurality of fill lights, and the fill lights are configured to be arranged around the circuit breaker to be tested.

[0077] According to an embodiment of the present invention, the fill light is configured to illuminate the circuit breaker to be tested so that the exposure amount obtained by the camera during the exposure period reaches a preset value, wherein the duration of the camera's exposure period is configured to be less than the preset duration.

[0078] According to an embodiment of the present invention, in the captured black and white image, features such as edges may not be easy to identify. Therefore, a light source module can be set in the circuit breaker action characteristic device based on binocular vision, and the visibility of these features can be enhanced by multiple fill lights included in the light source module, helping the recognition system to better detect and analyze these details. In addition, for fast-moving objects such as the moving contact of the circuit breaker to be tested, the smear of the fast-moving object in each frame of the image can be reduced by configuring multiple fill lights, thereby improving the accuracy of subsequent image processing.

[0079] According to an embodiment of the present invention, since uneven illumination may produce shadows or highlight areas, such uneven illumination may interfere with the overall quality of the image, obscure the details of the target object or cause misidentification, affecting the processing speed and efficiency. Therefore, a plurality of fill lights may be arranged around the circuit breaker to be tested to eliminate the shadow areas, making the camera's field of view clearer and more comprehensive.

[0080] Figure 5 A schematic diagram of a circuit breaker action characteristic device based on binocular vision according to another embodiment of the present invention is shown.

[0081] like Figure 5As shown, the binocular vision-based circuit breaker action characteristic device may further include a light source module, wherein the light source module includes two fill-in lights 41 and a light source frame 42. The two fill-in lights 41 are respectively arranged at one end of the left and right side uprights 122, and the uprights 122 are connected to the light source frame 42, and the fill-in lights 41 are fixed by the light source frame 42.

[0082] According to an embodiment of the present invention, multiple fill lights can be configured as light emitting diode (LED) light sources to illuminate the circuit breaker to be tested, ensuring that the camera can obtain sufficient exposure within an exposure period less than a preset time. The brightness of the fill light can be controlled by adjusting the power supply, so that the light source module can flexibly adjust the brightness of the fill light according to different lighting conditions (such as the intensity of ambient light) and shooting requirements to ensure the best lighting effect. For example, for an LED light source, its brightness can be controlled by a brightening digital controller with a maximum output power of 60W. Among them, the brightness level range can be set to 0~255.

[0083] According to an embodiment of the present invention, the light source module also includes multiple light sensors, which are used to determine the intensity of ambient light when the fill light is turned off; wherein the light source module is also configured to adjust the power supply provided to each of the multiple fill lights based on the intensity of the ambient light determined by each of the multiple light sensors and the relative position relationship between the multiple light sensors and the multiple fill lights, so as to adjust the brightness of each of the multiple fill lights.

[0084] According to an embodiment of the present invention, the light source module further includes a plurality of light sensors, which can be used for ambient light detection and can also be used for intelligently adjusting the brightness of the fill light. Specifically, when the fill light is turned off, the light sensor can accurately measure the intensity of the ambient light, and based on the data input from the light sensor, the light source module can automatically adjust the brightness of the fill light to adapt to different ambient light conditions.

[0085] According to the embodiment of the present invention, since the action of the circuit breaker has the characteristics of instantaneousness and short distance, in order to ensure that the object presents a clear and sharp image in the photo instead of a blurred image, it is necessary to shorten the exposure time as much as possible, that is, use a faster shutter speed. Based on this, the embodiment of the present invention uses multiple fill lights arranged around the circuit breaker to be tested to improve the overall brightness of the scene, thereby allowing the camera to obtain sufficient exposure while using a faster shutter speed, ensuring that the action details of the circuit breaker to be tested can be clearly captured.

[0086] According to an embodiment of the present invention, the circuit breaker to be tested is configured to be welded and fixed on the test platform, so that during the closing and opening actions of the moving contact of the circuit breaker to be tested, the vibration amplitude of the circuit breaker to be tested is smaller than a preset amplitude.

[0087] According to the embodiment of the present invention, when performing closing and opening actions, in order to ensure the reliable execution of the closing and opening actions, the moving contact will undergo a rapid movement and contact / separation process. In addition, since the forces generated by the closing spring and the opening spring must meet 2200±200N and 1400±200N respectively, these actions will cause huge vibrations in the circuit breaker under test.

[0088] Therefore, in an embodiment of the present invention, in order to reduce the influence of vibration, the circuit breaker to be tested can be fixed on the test platform by welding, so that during the closing and opening action of the moving contact of the circuit breaker to be tested, the vibration amplitude of the circuit breaker to be tested is less than the preset amplitude, so as to ensure the stability of the connecting rod action and the accuracy of the measurement result.

[0089] Based on this, the embodiment of the present invention welds the circuit breaker to be tested on the test platform to ensure that the vibration amplitude of the circuit breaker can be strictly controlled when the moving contact is closing and opening, thereby helping to improve the accuracy and reliability of the test and providing strong support for performance evaluation and fault diagnosis of the circuit breaker.

[0090] According to an embodiment of the present invention, the action characteristics of the circuit breaker to be tested include a circuit breaker depth time-varying characteristic curve and a circuit breaker stroke characteristic curve; the action characteristics are used to characterize the displacement information and speed information of the target point on the connecting rod in the three-dimensional space during the closing and opening action of the moving contact of the circuit breaker to be tested.

[0091] Figure 6 A schematic diagram showing a marker attached to a circuit breaker connecting rod according to a specific embodiment of the present invention is shown.

[0092] like Figure 6 As shown, in order to cooperate with subsequent image processing, reduce the matching difficulty in subsequent image preprocessing and improve the matching efficiency, a marker for representing the shooting target can be pasted on the flat position of the connecting rod.

[0093] According to an embodiment of the present invention, the nut in the connecting rod can be used as a key area, and its position and movement state can reflect the overall movement of the connecting rod. By observing the movement of the nut, the movement speed and stability of the moving contact can be indirectly inferred. In order to accurately capture the movement state of the nut, multiple cameras can be used to capture images of the connecting rod nut of the circuit breaker to be tested. By analyzing the image acquisition data taken by the camera, the movement speed, displacement and other parameters of the nut can be quantified to obtain the action characteristics of the moving contact of the circuit breaker to be tested.

[0094] According to an embodiment of the present invention, the control module can extract information from the time-series disparity map sequence to obtain the action characteristics of the circuit breaker to be tested. The action characteristics of the circuit breaker to be tested can include a circuit breaker depth time-varying characteristic curve and a circuit breaker stroke characteristic curve.

[0095] Figure 7 A schematic diagram of a time-varying characteristic curve of circuit breaker depth according to a specific embodiment of the present invention is shown.

[0096] Figure 8 A schematic diagram of a circuit breaker travel characteristic curve according to a specific embodiment of the present invention is shown.

[0097] like Figure 7 As shown, the upper curve can be used to represent the time-varying characteristic curve of the circuit breaker closing depth, and the lower curve can be used to represent the time-varying characteristic curve of the circuit breaker opening depth.

[0098] like Figure 8 As shown in the figure, within 0~16ms, the displacement changes with time and shows an upward trend. After 16ms, the displacement changes with time and shows a downward trend.

[0099] According to an embodiment of the present invention, in order to extract the circuit breaker action characteristic parameters from the processed time-series disparity map sequence, in a specific embodiment of the present invention, the position of the key area in each frame image is recorded as N n , converted to time interval according to the camera frame rate. For example, for a camera with a frame rate of 1000fps, the time interval between two images is 1ms. The relationship between position and time can be used to obtain the circuit breaker stroke characteristic curve and circuit breaker speed time curve.

[0100] Specifically, the start time of the target to be measured is recorded as N1, the coordinates are (X1, Y1), and the next frame is recorded as N2, the coordinates are (X2, Y2). Since calculations need to be made between consecutive frames, the motion time of each frame is It can be determined by the time difference from N1 to N2. The specific formula is as follows.

[0101] (4);

[0102] In the formula, Indicates the motion interval time between the current frame and the next frame.

[0103] Then, the specific calculation formula for the speed in the X direction during the motion interval between the current frame and the next frame is as follows.

[0104] (5);

[0105] In the formula, Indicates the displacement of the target to be measured in the X direction, vx Indicates the speed of the target in the X direction during the motion interval between the current frame and the next frame.

[0106] Since the target to be measured moves in three-dimensional space, for simplicity, it can be assumed that the movement is mainly carried out on the XY plane, and the total speed of the target to be measured during the movement interval time between the current frame and the next frame can be calculated by the following formula.

[0107] (6);

[0108] In the formula, v represents the total speed of the target during the motion interval between the current frame and the next frame, v y Indicates the speed of the target in the Y direction during the motion interval between the current frame and the next frame. The calculation method is the same as v x same.

[0109] Calculate the motion interval time of the target to be measured between the current frame and the next frame In the case of total speed, let the total motion time be Q, then , where n is the total number of frames of images captured during the motion process, and there are (n-1) time intervals. The average speed within the total motion time Q can be calculated according to the following formula to obtain the circuit breaker speed time curve.

[0110] (7);

[0111] In the formula, represents the average speed from N1 to N2 within the total movement time Q, v i It represents the total speed of the target to be measured in the i-th motion time interval.

[0112] Fig. 9 A schematic diagram of wiring of various modules of a device platform according to a specific embodiment of the present invention is shown.

[0113] like Fig. 9 As shown, the device includes a high-speed industrial camera 901, a camera synchronization cable 902, a synchronization module 903, a camera transmission cable 904, an I / O interface 905, a network interface 906, a camera control module 907, and a storage module 908, wherein the storage module 908 may include a random access memory RAM 909 or a cache memory Cache 910 or a read-only memory ROM 911.

[0114] In this specific embodiment, the high-speed industrial camera 901 is connected to the synchronization module through the machine synchronization cable 902, wherein the synchronization module 903 needs to be powered, and the power supply voltage is a DC voltage of +10V to 30V; at the same time, an external power supply is required between the digital output common positive terminal and the digital output common negative terminal of the synchronization module 903, so a power supply can be shared, and the "+" that triggers the high-speed industrial camera 901 is connected to the digital output common positive terminal, and the "-" is connected to the digital output common negative terminal. At this time, the high-speed industrial camera 901 is a load, which is equivalent to a pull-up resistor, so that the high-speed industrial camera 901 triggers a voltage value at both ends, and is connected to the camera control module 907 through the network cable interface 906, which can control the camera to collect / stop taking pictures. The camera 901 is provided with a Micro B data interface with a fastening screw, and is connected to the I / O interface 905 of the camera control module 907 through the camera transmission cable 904 with a USB3.0 interface to realize the real-time transmission of the shooting time sequence image. It is stored through the storage module 908.

[0115] Fig.10 A flow chart of a method for detecting circuit breaker action characteristics based on binocular vision according to an embodiment of the present invention is shown.

[0116] like Fig.10 As shown, the detection method includes operations S1001~S1002.

[0117] In operation S1001, in the process of controlling the moving contact of the circuit breaker to be tested to perform closing and opening actions, multiple cameras are controlled to synchronously capture images of the circuit breaker to be tested, and image sequences captured by each of the multiple cameras are obtained.

[0118] In operation S1002, the action characteristics of the circuit breaker to be tested are obtained based on the image sequences acquired by the multiple cameras.

[0119] Fig.11 A block diagram of a circuit breaker action characteristic detection device based on binocular vision according to an embodiment of the present invention is shown.

[0120] like Fig.11 As shown, the circuit breaker action characteristic detection device based on binocular vision includes an image sequence determination module 1110 and an action characteristic determination module 1120 .

[0121] The image sequence determination module 1110 is used to control multiple cameras to synchronously capture images of the circuit breaker to be tested during the process of controlling the moving contact of the circuit breaker to be tested to perform closing and opening actions, so as to obtain image sequences captured by each of the multiple cameras.

[0122] The action characteristic determination module 1120 is used to obtain the action characteristics of the circuit breaker to be tested based on the image sequences acquired by the multiple cameras.

[0123] According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits, or at least part of the functions of any one of them can be implemented in one module. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be split into multiple modules for implementation. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be at least partially implemented as hardware circuits, such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), systems on chips, systems on substrates, systems on packages, application specific integrated circuits (ASICs), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging the circuit, or by any one of the three implementation methods of software, hardware, and firmware, or by a proper combination of any of them. Alternatively, according to the embodiments of the present invention, one or more of the modules, submodules, units, and subunits can be at least partially implemented as computer program modules, and when the computer program modules are run, the corresponding functions can be executed.

[0124] For example, any multiple of the image sequence determination module 1110 and the motion characteristic determination module 1120 can be combined in one module / unit / sub-unit for implementation, or any one of the modules / units / sub-units can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of these modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to an embodiment of the present invention, at least one of the image sequence determination module 1110 and the motion characteristic determination module 1120 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in a suitable combination of any of them. Alternatively, at least one of the image sequence determination module 1110 and the motion characteristic determination module 1120 may be at least partially implemented as a computer program module, and when the computer program module is executed, a corresponding function may be performed.

[0125] It should be noted that the circuit breaker action characteristic detection device based on binocular vision in the embodiment of the present invention corresponds to the circuit breaker action characteristic detection method based on binocular vision in the embodiment of the present invention. The description of the circuit breaker action characteristic detection device based on binocular vision specifically refers to the circuit breaker action characteristic detection method based on binocular vision, which will not be repeated here.

[0126] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. In this regard, each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. It can be understood by those skilled in the art that the features recorded in the various embodiments of the present invention can be combined and / or combined in various ways, even if such a combination or combination is not explicitly recorded in the present invention. In particular, without departing from the spirit and teachings of the present invention, the features recorded in the various embodiments of the present invention can be combined and / or combined in various ways. All such combinations and / or combinations fall within the scope of the present invention.

[0127] The embodiments of the present invention are described above. However, these embodiments are only for the purpose of illustration, and are not intended to limit the scope of the present invention. Although each embodiment is described above, it does not mean that the measures in each embodiment cannot be used in combination advantageously. Without departing from the scope of the present invention, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present invention.

Claims

1. A circuit breaker action characteristic device based on binocular vision, characterized in that: The circuit breaker action characteristic device comprises: A camera module, comprising a plurality of cameras, wherein the plurality of cameras are configured to be arranged facing a test platform, wherein a circuit breaker to be tested is arranged on the test platform, and the camera fields of view of the plurality of cameras on the test platform have an overlapping area, wherein the overlapping area includes a connecting rod of the circuit breaker to be tested, and the connecting rod is configured to move synchronously with a moving contact of the circuit breaker to be tested; A control module is configured to be electrically connected to the circuit breaker to be tested and the plurality of cameras, respectively. The control module is configured to control the plurality of cameras to synchronously capture images of the circuit breaker to be tested while controlling the moving contact of the circuit breaker to be tested to perform closing and opening actions, and obtain the action characteristics of the circuit breaker to be tested based on the image sequences captured by the plurality of cameras.

2. The circuit breaker action characteristic device according to claim 1, characterized in that: The plurality of cameras are configured to be arranged relative to the circuit breaker to be tested based on a preset distance and a preset angle so that a proportion of the overlapping area to the camera field of view of the camera on the test platform is within a preset range, wherein the preset range is determined based on a lateral resolution of the camera, a camera accuracy of the camera, and a lateral movement distance of a target point on the connecting rod.

3. The circuit breaker action characteristic device according to claim 1, characterized in that: The control module is configured to perform image processing on the image sequences captured by the plurality of cameras to obtain a time-series disparity map sequence, and perform information processing based on the depth information contained in the time-series disparity map sequence to obtain the action characteristics of the circuit breaker to be tested.

4. The circuit breaker action characteristic device according to claim 3, characterized in that: The control module is configured to determine an image group corresponding to each acquisition moment from the image sequences respectively acquired by the multiple cameras, and match the multiple images included in the image group to obtain a time-series disparity map with depth information of each pixel at the acquisition moment, and obtain the time-series disparity map sequence based on the respective time-series disparity maps at the multiple acquisition moments.

5. The circuit breaker action characteristic device according to claim 1, characterized in that: The circuit breaker action characteristic device also includes: A light source module includes a plurality of fill-in lights, and the fill-in lights are configured to surround the circuit breaker to be tested.

6. The circuit breaker action characteristic device according to claim 5, characterized in that: The fill light is configured to illuminate the circuit breaker to be tested so that the exposure amount acquired by the camera during an exposure period reaches a preset value, wherein the duration of the exposure period of the camera is configured to be less than the preset duration.

7. The circuit breaker action characteristic device according to claim 5, characterized in that: The light source module further comprises a plurality of light sensors, and the light sensors are used to determine the light intensity of the ambient light when the fill light is turned off; Wherein, the light source module is also configured to adjust the power supply provided to each of the multiple fill lights based on the intensity of the ambient light determined by each of the multiple light sensors and the relative position relationship between the multiple light sensors and the multiple fill lights, so as to adjust the brightness of each of the multiple fill lights.

8. The circuit breaker action characteristic device according to claim 1, characterized in that: The circuit breaker to be tested is configured to be welded and fixed on the test platform, so that during the closing and opening actions of the moving contact of the circuit breaker to be tested, the vibration amplitude of the circuit breaker to be tested is smaller than a preset amplitude.

9. The circuit breaker action characteristic device according to any one of claims 1 to 8, characterized in that: The action characteristics of the circuit breaker to be tested include a circuit breaker depth time-varying characteristic curve and a circuit breaker stroke characteristic curve; The action characteristic is used to characterize the displacement information and speed information of the target point on the connecting rod in three-dimensional space during the closing and opening action of the moving contact of the circuit breaker to be tested.

10. A method for detecting circuit breaker action characteristics based on binocular vision, applied to the circuit breaker action characteristics device based on binocular vision as claimed in any one of claims 1 to 9, characterized in that: The method comprises: In the process of controlling the moving contact of the circuit breaker to be tested to perform closing and opening actions, controlling multiple cameras to synchronously capture images of the circuit breaker to be tested, and obtaining image sequences captured by each of the multiple cameras; Based on the image sequences acquired by each of the plurality of cameras, the action characteristics of the circuit breaker to be tested are obtained.

Citation Information

Patent Citations

  • Method and device for detecting mechanical characteristics of non-intrusive circuit breaker

    CN117330298A

  • Circuit breaker motion characteristic detection method and device, electronic equipment and medium

    CN117491003A

  • Circuit breaker agreed operation performance test method and device based on machine vision

    CN117906663A

  • Binocular camera-based circuit breaker motion characteristic measurement system and method

    CN118734877A