Pressure-free device detection method, system and device

Through image acquisition and convolutional neural network extraction, fault correlation characteristics are predicted, and the failure probability of pressure-free device is solved, and the problems of low efficiency and poor accuracy of traditional manual inspection are solved, achieving efficient and intelligent fault detection.

CN120107943AActive Publication Date: 2025-06-06NORTH CHINA ELECTRICAL POWER RES INST +1
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202510573449.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-06
Publication Date
2025-06-06
Estimated Expiration
2045-05-06

AI Technical Summary

Technical Problem

The traditional pressure-free device detection method relies on manual inspection, which has problems such as low detection efficiency, poor accuracy, and inability to detect potential defects in a timely manner.

Method used

The fault correlation feature extraction is performed through image acquisition, keyframe extraction and convolutional neural network to predict the failure probability of the pressure-free device, and the fault probability interval is given through historical data analysis.

Benefits of technology

The automation and intelligence of pressure-free device detection has been realized, which significantly improves the accuracy, real-time and efficiency of fault detection, and provides reliable guarantees for the stable operation of electrical equipment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120107943A_ABST
    Figure CN120107943A_ABST
Patent Text Reader

Abstract

The invention provides a pressure-free device detection method, system and device, and relates to the field of intelligent detection, and the method comprises the steps: carrying out the image collection of a pressure-free device at a cable at regular intervals, and obtaining a device image sequence; carrying out key frame extraction to obtain a device key image sequence; performing fault correlation feature extraction by using a convolutional neural network to obtain a fault correlation feature distribution sequence; performing fault occurrence prediction according to the fault association feature distribution sequence, and outputting a historical prediction fault probability sequence; and performing fault analysis in a future time zone based on the historical prediction fault probability sequence, and outputting a prediction fault probability interval sequence as a fault detection result. The technical problems that a traditional pressure-free device detection method mostly depends on manual inspection, the detection efficiency is low, the accuracy is poor, and potential defects cannot be found in time are solved, the automation and intelligence of pressure-free device detection can be effectively improved, and the accuracy, real-time performance and efficiency of pressure-free device fault detection can be remarkably improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent detection, and in particular to a pressure-free device detection method, system and device. Background Art

[0002] Traditional methods of detecting pressure-free devices mainly rely on manual inspections or regular inspections to discover potential equipment failures. Although manual inspections are effective in some cases, they have obvious limitations. First, manual inspections usually rely on the experience and judgment of operators, and are easily affected by fatigue, negligence, and subjective factors, resulting in inaccurate and missed detection results. Secondly, due to the long inspection cycle, many potential faults and defects may occur quietly between inspection cycles and cannot be discovered and handled in time, thereby increasing the risk of equipment failure. Thirdly, manual inspection efficiency is low, especially when the pressure-free device is in a high-risk working environment or large-scale application, the frequency and coverage of manual inspections often cannot meet the needs of real-time monitoring and rapid response.

[0003] Therefore, there is an urgent need for a new detection method that can monitor the operating status of the pressure-free device in real time and automatically, and detect potential faults in a timely manner to ensure the stable operation of the equipment, improve the efficiency and accuracy of detection, and reduce reliance on manual intervention. Summary of the invention

[0004] The purpose of the present invention is to provide a pressure-free device detection method, system and device to solve the technical problems that the traditional pressure-free device detection method mostly relies on manual inspection, has low detection efficiency, poor accuracy, and cannot detect potential defects in time, including: In the first aspect, the present invention provides a method for detecting a voltage-free device, comprising: regularly collecting images of the voltage-free device at a preset time interval to obtain a device image sequence; extracting key frames from the device image sequence to obtain a device key image sequence; using a convolutional neural network to extract fault-related features from the device key image sequence to obtain a fault-related feature distribution sequence; predicting the occurrence of a voltage-free device fault based on the fault-related feature distribution sequence, and outputting a historical predicted fault probability sequence; performing fault analysis in a future time zone based on the historical predicted fault probability sequence, and outputting a predicted fault probability interval sequence as a fault detection result of the voltage-free device.

[0005] Preferably, the pressure-free device detection method also includes: configuring key parts of the pressure-free device, wherein the key parts include but are not limited to terminal connection parts, locking components, positioning cylinders and drive components; regularly collecting images of multiple key parts of the pressure-free device at the cable at preset time intervals, and fusing them into a complete image according to the part position coordinates as a device image, to obtain a device image sequence.

[0006] Preferably, the pressure-free device detection method also includes: selecting the device image at the earliest monitoring time point in the device image sequence as the first image, setting the first image as the first key image, and using the adjacent image of the first image as the second image; performing a similarity comparison on the first image and the second image according to a preset comparison strategy, and outputting the first image similarity; if the first image similarity is greater than or equal to a preset similarity threshold, discarding the second image, and performing an iterative similarity comparison on subsequent images based on the first image; if the first image similarity is less than the preset similarity threshold, setting the second image as the second key image, and performing an iterative similarity comparison on subsequent images based on the second image, until all images in the device image sequence are compared, and multiple key images are obtained, which are combined to construct a device key image sequence.

[0007] Preferably, the pressure-free device detection method also includes: selecting a first similarity comparison algorithm according to a pixel similarity measure; selecting a second similarity comparison algorithm according to a feature similarity measure; selecting a third similarity comparison algorithm according to a structural similarity measure; and obtaining a preset comparison strategy based on a combination of the first similarity comparison algorithm, the second similarity comparison algorithm and the third similarity comparison algorithm.

[0008] Preferably, the pressure-free device detection method also includes: configuring fault-related features, wherein the fault-related features include at least displacement features, deformation features and surface corrosion; using the fault-related features as constraints, querying historical detection records of similar pressure-free devices, collecting sample device image sets and sample fault-related feature distribution sets, wherein the fault-related feature distribution includes fault-related features of multiple key parts, and the key parts are marked with position coordinates; using the sample device image set and the sample fault-related feature distribution set, supervised training and testing of the convolutional neural network until the network converges to obtain a feature extractor; using the feature extractor, sequentially extracting fault-related features from multiple device key images in the device key image sequence, and outputting a fault-related feature distribution sequence.

[0009] Preferably, the pressure-free device detection method also includes: collecting a sample fault-related feature distribution set based on historical detection records of similar pressure-free devices, and counting the failure frequency of the pressure-free device under different sample fault-related feature distributions as the sample failure probability, to obtain a sample failure probability set; using the sample fault-related feature distribution set and the sample failure probability set to train the generator and discriminator of the adversarial neural network until both the generation loss function and the discriminant loss function converge to obtain a fault prediction model; using the fault prediction model to predict the occurrence of pressure-free device failures in sequence according to the fault-related feature distribution sequence, and output a historical predicted fault probability sequence.

[0010] Preferably, the pressure-free device detection method also includes: in a two-dimensional coordinate system, according to the chronological order of monitoring time, fitting the historical predicted fault probability sequence to generate a historical predicted fault probability curve; configuring a future time zone, wherein the future time zone includes a number of consecutive monitoring time nodes; in the two-dimensional coordinate system, extending according to the historical predicted fault probability curve, predicting and obtaining a number of predicted fault probabilities of a number of monitoring time nodes, and constructing a predicted fault probability sequence; performing fluctuation error analysis on the historical predicted fault probability sequence, and outputting a fluctuation error ratio; expanding the predicted fault probability sequence according to the fluctuation error ratio, and outputting a predicted fault probability interval sequence.

[0011] Preferably, the pressure-free device detection method also includes: performing mean calculation on multiple historical predicted failure probabilities in the historical predicted failure probability sequence to generate a mean of historical predicted failure probabilities; taking the mean of historical predicted failure probability as a reference, performing deviation amplitude analysis on the multiple historical predicted failure probabilities respectively, and performing mean calculation on multiple deviation amplitudes to obtain the fluctuation error ratio.

[0012] In the second aspect, the present invention also provides a voltage-free device detection system for executing a voltage-free device detection method as described in the first aspect, including: an image acquisition module, used to regularly acquire images of the voltage-free device at the cable at preset time intervals to obtain a device image sequence; a key frame extraction module, used to extract key frames from the device image sequence to obtain a device key image sequence; a fault feature extraction module, used to use a convolutional neural network to extract fault-related features from the device key image sequence to obtain a fault-related feature distribution sequence; a fault occurrence prediction module, used to predict the occurrence of voltage-free device faults based on the fault-related feature distribution sequence, and output a historical predicted fault probability sequence; a detection result acquisition module, used to perform fault analysis in a future time zone based on the historical predicted fault probability sequence, and output a predicted fault probability interval sequence as a fault detection result of the voltage-free device.

[0013] In a third aspect, the present invention further provides a pressure-free device detection device, which can be executed by a pressure-free device detection method described in any one of the first aspects above.

[0014] The embodiments of the present invention include the following advantages: By regularly collecting images of the voltage-free device at the cable at preset time intervals, a device image sequence is obtained; then the key frames of the device image sequence are extracted to obtain the device key image sequence; then the convolutional neural network is used to extract fault-related features of the device key image sequence to obtain a fault-related feature distribution sequence; further, the voltage-free device fault is predicted based on the fault-related feature distribution sequence, and a historical predicted fault probability sequence is output; finally, based on the historical predicted fault probability sequence, a fault analysis in the future time zone is performed, and a predicted fault probability interval sequence is output as the fault detection result of the voltage-free device. In other words, by extracting key features through image recognition and analyzing fault-related features, the probability of device failure can be predicted in real time, and the fault probability interval can be given through historical data analysis, which can effectively improve the automation and intelligence of voltage-free device detection, thereby significantly improving the accuracy, real-time performance and efficiency of voltage-free device fault detection, and providing reliable protection for the stable operation of electrical equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A flow chart of the steps of a pressure-free device detection method of the present invention; Figure 2 The present invention is a schematic structural diagram of a pressure-free device detection system.

[0016] Description of reference numerals: Image acquisition module 11, key frame extraction module 12, fault feature extraction module 13, fault occurrence prediction module 14, detection result acquisition module 15. DETAILED DESCRIPTION

[0017] The present invention solves the technical problems that traditional methods for detecting pressure-free devices mostly rely on manual inspections, have low detection efficiency, poor accuracy, and cannot detect potential defects in a timely manner by providing a method, system, and device for detecting pressure-free devices. By extracting key features through image recognition and analyzing fault-related features, the probability of device failure can be predicted in real time, and the fault probability interval can be given through historical data analysis, which can effectively improve the automation and intelligence of pressure-free device detection, thereby significantly improving the accuracy, real-time performance, and efficiency of pressure-free device fault detection, and providing reliable protection for the stable operation of electrical equipment.

[0018] Below, the technical solutions in the present invention will be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments of the present invention. It should be understood that the present invention is not limited to the example embodiments described herein. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. It should also be noted that, for the convenience of description, only the parts related to the present invention are shown in the accompanying drawings, rather than all of them.

[0019] For example, please refer to the attached Figure 1 The present invention provides a method for detecting a pressure-free device, which specifically comprises the following steps: S1: regularly collecting images of the pressure-free device at the cable at preset time intervals to obtain a sequence of device images.

[0020] Further, step S1 of the present invention further comprises: S11: configure key parts of the pressure-free device, wherein the key parts include but are not limited to terminal connection parts, locking components, positioning cylinders and driving components; S12: regularly collect images of multiple key parts of the pressure-free device at the cable at preset time intervals, and fuse them into a complete image according to the position coordinates of the parts as the device image, thereby obtaining a device image sequence.

[0021] Specifically, in this application, the pressure-free device refers to a pressure-free terminal block, which is a terminal with a simple design that can complete wire connections without the use of traditional crimping tools. It is widely used in the electrical field and is suitable for occasions where electrical connections need to be quickly installed, disassembled, maintained or replaced.

[0022] First of all, it is necessary to determine the key parts of the pressure-free device, which are the core parts that determine the normal operation and failure of the device. The key parts include but are not limited to the terminal connection part, the locking assembly, the positioning cylinder and the driving assembly. Among them, the terminal connection part is the part where the pressure-free device is connected to the cable, and it is also the key interface of the entire electrical connection. The state of the terminal connection part directly affects the transmission stability of current and signals. Any looseness, poor contact or corrosion may cause failure; the locking assembly is used to fix the various parts of the pressure-free device to ensure that the components will not loosen or shift during operation. The stability of the locking assembly is the key to whether the pressure-free device can operate stably for a long time. If the locking assembly fails, it may cause the failure of the entire pressure-free device; the positioning cylinder is used to position the various parts in the device to the specified position to ensure that the device components are accurately aligned and effectively matched. The accuracy of the positioning cylinder is crucial to the structural stability and working performance of the pressure-free device; the driving assembly is responsible for providing power so that the relevant components in the pressure-free device can correctly perform actions such as crimping or unlocking. Failure of the driving assembly may cause the device to fail to operate correctly, so its monitoring is crucial.

[0023] Next, according to the working conditions and monitoring requirements of the equipment, a fixed time interval (such as 24 hours, that is, image acquisition is performed once a day) is set to collect images of multiple key parts of the pressure-free device, so as to ensure that the monitoring system can continuously and stably obtain the status of the device and timely discover potential faults. Then, according to the preset time interval (such as 24 hours), the images of multiple key parts of the pressure-free device at the cable are regularly collected. When collecting images, the image of each part has a specific position coordinate, which means that the image of each part is associated with the actual physical position of the pressure-free device. In order to obtain a complete image of the device, the image of each part needs to be fused according to its actual position coordinates. The fusion process is to synthesize image data from different positions and parts into a complete image to form a comprehensive image of the state of the pressure-free device. The fused image will retain the information of all key parts and help the subsequent analysis system to comprehensively evaluate the device. Further, these device images are formed into a continuous image sequence in the order of acquisition time to obtain a device image sequence, in which each image represents the state of the pressure-free device at different time points. The continuity of the image sequence provides rich data support for subsequent fault detection and prediction.

[0024] S2: extracting key frames from the device image sequence to obtain a device key image sequence.

[0025] Further, step S2 of the present invention also includes: S21: Selecting the device image at the earliest monitoring time point in the device image sequence as the first image, setting the first image as the first key image, and setting the adjacent image of the first image as the second image.

[0026] Specifically, in the device image sequence, the device image at the earliest monitoring time point is selected as the first image. This image will show the initial state of the pressure-free device and is the basis for subsequent analysis; then, the first image is set as the first key image, which represents the state of the equipment at the initial stage and is the starting point for all subsequent image comparisons and fault detection; then the adjacent image of the first image is used as the second image.

[0027] S22: performing a similarity comparison on the first image and the second image according to a preset comparison strategy, and outputting a first image similarity.

[0028] Further, step S22 of the present invention further includes: S221: Select a first similarity comparison algorithm according to a pixel similarity metric; S222: Select a second similarity comparison algorithm according to a feature similarity metric; S223: Select a third similarity comparison algorithm according to a structural similarity metric; S224: Obtain a preset comparison strategy based on a combination of the first similarity comparison algorithm, the second similarity comparison algorithm and the third similarity comparison algorithm.

[0029] Specifically, first, the first similarity comparison algorithm is selected according to the pixel similarity metric. The pixel similarity metric refers to directly comparing the differences between two images at the pixel level. The pixel similarity metric is usually used to detect intuitive differences in images and compare the color, brightness and other features of each pixel. For example, the mean square error calculates the difference in pixel values ​​between the two images. The smaller the value, the higher the image similarity. The pixel comparison algorithm is suitable for detecting simple and direct changes between images, such as obvious damage, dirt or morphological changes on the surface of the device. Next, the second similarity comparison algorithm is selected according to the feature similarity measure. The feature similarity measure refers to extracting representative features (such as edges, corners, textures, etc.) in the image and comparing the similarities between these features. Feature comparison is usually used to compare global features in the image to avoid interference caused by external factors such as lighting and perspective changes. For example, algorithms such as SIFT (Scale Invariant Feature Transform) and SURF (Speeded Up Robust Features) extract stable feature points from the image for matching, which is suitable for robust detection of image rotation, scaling and lighting changes. Feature comparison is suitable for identifying high-level features such as shape, texture, and structure of the device. For example, when the structure of the pressure-free device is deformed or the positioning components become loose, the feature comparison algorithm can capture these changes more keenly.

[0030] On the other hand, the third similarity comparison algorithm is selected according to the structural similarity metric. The structural similarity metric focuses on the comparison of the overall structure or geometric shape of the image. It not only considers pixels and features, but also considers factors such as the spatial layout and structural relationship of the image. The structural similarity metric method is particularly suitable for comparing the shape and structural information of objects when judging changes in image content, such as Fourier transform and Hough transform of images. Hough transform is used to detect changes in geometric shapes such as straight lines and circles in images, and is suitable for detection of structural features. Structural comparison is suitable for detecting changes in the overall layout and structure of pressure-free devices, such as displacement of positioning cylinders and drive components, damage to locking components, etc. These problems are often early signals of equipment failure.

[0031] Then, the first similarity comparison algorithm, the second similarity comparison algorithm and the third similarity comparison algorithm are combined in a weighted manner to obtain a preset comparison strategy, that is, different weights are assigned to each comparison algorithm according to actual needs. For example, for some scenes that are very sensitive to structural changes, a higher weight can be given to structural comparison; while for the detection of small changes on the surface of the device, more pixel comparison or feature comparison may be relied on. By combining the comparison results of the three algorithms, the similarity between the images can be comprehensively judged, so as to more comprehensively and accurately evaluate the status of the pressure-free device.

[0032] Next, according to the previously configured preset comparison strategy (including pixel similarity, feature similarity and structural similarity), the first image and the second image are analyzed for similarity, and the similarity between the images is calculated. This similarity value can reflect the visual and structural similarity of the images. The first image similarity is output through the comparison algorithm, that is, the similarity score between the first image and the second image. The similarity value is usually expressed as a percentage, value or distance metric. If the similarity is high, it means that the change between the two images is small; if the similarity is low, it means that the difference between the two images is large, and there may be a change in the device status.

[0033] S23: If the similarity of the first image is greater than or equal to a preset similarity threshold, the second image is discarded, and the first image is used as a benchmark to perform iterative similarity comparison of subsequent images; S24: If the similarity of the first image is less than the preset similarity threshold, the second image is set as a second key image, and the second image is used as a benchmark to perform iterative similarity comparison of subsequent images until all images in the device image sequence are compared, and multiple key images are obtained, which are combined to construct a device key image sequence.

[0034] Specifically, a preset similarity threshold is configured, which can be set according to the actual scenario, such as 80%; if the similarity of the first image is greater than or equal to the preset similarity threshold, it means that the second image has little visual and structural changes with the first image, and the device state is stable or has no obvious abnormalities. In this case, the second image is discarded and the first image is used as a benchmark for subsequent image comparison.

[0035] If the similarity between the first image and the second image is less than the preset similarity threshold, it means that there is a large difference between the two images, which may be due to the change of the device state. In this case, the second image is regarded as a new key image, and the second image is used as a benchmark for subsequent image comparison; if images with lower similarity continue to be found, the key image will continue to be updated and compared until all images in the entire device image sequence are processed. Finally, after a series of iterations and comparisons, a set of key images will be obtained, and they will be combined into a complete device key image sequence, which can reflect the state changes of the pressure-free device during operation. By extracting key images, the state changes of the device at different time points can be accurately captured, thereby providing reliable image data support for subsequent fault detection and effectively improving the accuracy and efficiency of detection.

[0036] S3: Using a convolutional neural network, extract fault-related features from the key image sequence of the device to obtain a fault-related feature distribution sequence.

[0037] Further, step S3 of the present invention also includes: S31: configure fault-related features, wherein the fault-related features include at least displacement features, deformation features and surface corrosion; S32: use the fault-related features as constraints, query historical inspection records of similar pressure-free devices, collect sample device image sets and sample fault-related feature distribution sets, wherein the fault-related feature distribution includes fault-related features of multiple key parts, and the key parts are marked with position coordinates; S33: use the sample device image set and the sample fault-related feature distribution set to supervise the training and testing of the convolutional neural network until the network converges to obtain a feature extractor; S34: use the feature extractor to extract fault-related features of multiple device key images in the device key image sequence in turn, and output a fault-related feature distribution sequence.

[0038] Specifically, fault-related features are configured. Fault-related features refer to physical quantities or state parameters that are closely related to the failure or performance change of the pressure-free device. These features can reflect the changes caused by different factors (such as mechanical pressure, environmental impact, usage time, etc.) during the use of the device. Among them, the fault-related features at least include displacement features, deformation features and surface corrosion. The displacement feature refers to the movement of key components (such as positioning cylinders, crimping sleeves, etc.) in the pressure-free device relative to the original position. The size of the displacement is related to whether the device is subjected to excessive pressure, collision or vibration. A larger displacement usually indicates that the device may be at risk of loosening, falling off or damage; the deformation feature focuses on the shape change of the components of the pressure-free device, such as the deformation of the crimping plate, the bending of the clamping ring, etc. The equipment may be deformed during operation due to external factors such as pressure and temperature, which is usually a precursor to failure; the surface corrosion feature focuses on the degree of corrosion of the surface material of the device, especially metal parts. Corrosion is usually caused by environmental factors (such as moisture, chemicals, etc.), which will directly affect the electrical connection performance of the device and even cause short circuits or equipment failures. The purpose of configuring these fault-related features is to monitor and analyze the status changes of the pressure-free device from multiple dimensions. By extracting these features, a more comprehensive assessment of the health status of the equipment can be made, thereby predicting possible faults.

[0039] Next, with the fault-related features as constraints, historical inspection records of similar pressure-free devices are queried. These records contain past inspection data, including image data and fault feature data, which can be used as historical references for equipment failure analysis. By querying historical records, the failure modes and laws of similar devices in the past can be discovered and learned, providing a basis for predicting failures of new equipment; then, based on the historical inspection records, sample device image sets and sample fault-related feature distribution sets are collected. The sample device image set refers to a collected image data set containing different device states (normal, faulty, etc.). By comparing these images, image features of the device in different fault states can be identified. For example, there may be structural changes, corrosion marks or looseness between a normal device and a faulty device; the sample fault-related feature distribution set refers to feature data associated with device failures collected by analyzing historical records. These data include information such as displacement, deformation and corrosion degree of different components. The feature distribution set can help the system understand the different feature distributions exhibited by different parts during the failure process. Among them, the fault-related feature distribution includes fault-related features of multiple key parts. The key parts are marked with position coordinates, that is, the spatial position of the component in the device, which helps to associate the fault features with specific parts, so as to accurately locate the part where the fault occurs during the detection process.

[0040] Then, the sample device image set and the sample fault-related feature distribution set are used as sample data, and divided into a sample training set and a sample test set according to a certain ratio, wherein the training set usually accounts for 75% to 90%, and the test set usually accounts for 10% to 25%. Convolutional neural network (CNN) is a type of deep learning algorithm, which is widely used in image processing, computer vision and other fields. Its core advantage is that it can automatically extract features from raw data, and it is more effective than traditional machine learning methods when processing image data. Then, a feature extractor is constructed based on the convolutional neural network, which includes an input layer, a convolution layer, a pooling layer, a fully connected layer and an output layer. The input layer is used to pass the image data to the subsequent convolution layer for feature extraction. The convolution layer is the core part of the feature extractor, which is responsible for extracting local features from the input image. Each convolution layer includes multiple convolution kernels, which slide on the image and extract different features (such as edges, textures, colors, etc.) through convolution operations (i.e., matrix multiplication and addition). The pooling layer is used to downsample the feature map and reduce the size of the feature map, thereby reducing the amount of calculation, avoiding overfitting, and retaining important information in the image. The fully connected layer is used to integrate the previously extracted features. The neurons in this layer are connected to all the neurons in the previous layer, which are used to integrate the high-level information of the image. The output layer gives the final prediction result.

[0041] Then, the sample training set and the sample test set are used to supervise the training and test of the feature extractor, respectively. During the training process, the images in the training set are input into the feature extractor, and each input image is processed through a convolution layer, an activation function, a pooling layer, etc. to extract features in the image; then, through multi-layer convolution and pooling operations, the network will automatically learn low-level and high-level features in the image. For example, in an image of an electrical device, the network may learn corrosion on the surface of the device, loose wiring parts or other fault features; then the output of the feature extractor is compared with the actual label (fault type, fault location, etc.), and the error between the predicted result and the true label is calculated, and the difference is usually measured using a cross entropy loss function or a mean square error loss function; further, based on the calculated loss value, the weights in the network are adjusted using a back propagation algorithm to reduce the error. Through multiple iterative training, the weights of the network will be gradually optimized, so that the feature extractor can better extract features related to the fault; the training process usually sets a stop condition, such as loss value convergence, reaching a preset training round, etc. Once the training is completed, the feature extractor will have the ability to extract relevant features from the image. During the test, the images in the test set are input into the trained feature extractor and the same feature extraction process is performed. Next, the network output is compared with the actual labels in the test set to check whether the extracted features can accurately reflect the fault information. Then, based on the difference between the network output and the actual labels, the performance of the feature extractor is evaluated using evaluation indicators (such as accuracy). If the performance of the feature extractor on the test set is not ideal, it can be tuned until the expected output accuracy is achieved to obtain a trained feature extractor.

[0042] Finally, the feature extractor is used to extract fault-related features of multiple device key images in the device key image sequence in turn. The feature extractor performs multi-level feature extraction tasks on each key image, and learns features at different levels (such as edges, textures, shapes, colors, etc.), and finally obtains feature data related to equipment failures. The output fault-related features include the above-mentioned numerical features such as displacement, deformation, corrosion degree, or other more complex fault indication signals; the extracted fault-related features will form a fault-related feature distribution sequence in chronological order or image order, providing data support for subsequent fault prediction and analysis.

[0043] S4: Predicting the occurrence of a voltage-free device failure based on the fault-related feature distribution sequence, and outputting a historical prediction failure probability sequence.

[0044] Further, step S4 of the present invention also includes: S41: Based on the historical detection records of similar pressure-free devices, collect sample fault-related feature distribution sets, and count the failure frequencies of the pressure-free devices under different sample fault-related feature distributions as sample failure probabilities to obtain sample failure probability sets; S42: Use the sample fault-related feature distribution set and the sample failure probability set to train the generator and discriminator of the adversarial neural network until both the generation loss function and the discriminant loss function converge to obtain a fault prediction model; S43: Use the fault prediction model to predict the occurrence of pressure-free device failures in sequence according to the fault-related feature distribution sequence, and output a historical predicted fault probability sequence.

[0045] Specifically, key feature data related to equipment failure are collected from historical inspection records of similar pressure-free devices. These data can come from historical maintenance records, sensor data, regular inspections or image detection results, etc., to obtain a sample fault-related feature distribution set; then, the frequency of failure of the pressure-free device under different sample fault-related feature distributions is counted. For example, if the equipment frequently fails under certain specific fault-related features (such as displacement, corrosion, deformation, etc.), then there may be a strong correlation between the occurrence of these features and the occurrence of failures. The statistical results form a sample failure probability set, that is, the failure probability of each sample. These failure probabilities are obtained by analyzing the failure data in historical records, reflecting the possibility of equipment failure under specific conditions.

[0046] Next, the sample fault-associated feature distribution set and the sample fault probability set are used as training data to train the generator and discriminator of the adversarial neural network, wherein the goal of the generator is to generate realistic sample fault probabilities from the input fault-associated feature distribution, close to the actual fault distribution; the goal of the discriminator is to determine whether a sample is from a real fault data set (historical record) or pseudo data generated by the generator; the training process is carried out in an adversarial training manner, the generator and the discriminator are against each other, the generator is continuously optimized to generate a more realistic fault probability distribution, and the discriminator is continuously optimized to improve the ability to distinguish true and false data. During the training process, the generator and the discriminator are optimized through a loss function, the generation loss function is used to measure the difference between the fault probability samples generated by the generator and the real fault data; the discriminant loss function is used to measure the accuracy of the discriminator in distinguishing between real samples and generated samples; the training will continue until the generation loss function and the discriminant loss function converge, that is, the generator can generate samples close to the real data, and the discriminator can correctly distinguish between real and generated samples, at which time the training is stopped to obtain a trained fault prediction model, which can predict the failure probability of the equipment according to the fault-associated feature distribution.

[0047] Then, the feature distribution sequence formed by the fault-related features (such as displacement, deformation, corrosion degree, etc.) extracted from the key image sequence of the device is used as the input data, and these feature distribution sequences are input into the trained fault prediction model. The model will predict the failure probability of the pressure-free device based on these input features. Each time point or each key image corresponds to a failure probability, indicating the possibility of failure of the equipment in the current state, and output the historical predicted failure probability sequence, that is, the failure probability corresponding to each time point or each key image. This sequence can provide the probability trend of equipment failure in the future.

[0048] S5: Based on the historical predicted fault probability sequence, perform fault analysis in the future time zone and output a predicted fault probability interval sequence as a fault detection result of the pressure-free device.

[0049] Further, step S5 of the present invention also includes: S51: In a two-dimensional coordinate system, according to the chronological order of monitoring time, fit the historical predicted fault probability sequence to generate a historical predicted fault probability curve; S52: Configure a future time zone, wherein the future time zone includes a number of consecutive monitoring time nodes; S53: In a two-dimensional coordinate system, extend the historical predicted fault probability curve to predict and obtain a number of predicted fault probabilities of a number of monitoring time nodes, and construct a predicted fault probability sequence.

[0050] Specifically, in a two-dimensional coordinate system, with time as the horizontal axis and the failure probability as the vertical axis, the data points in the historical predicted failure probability sequence are connected into a curve, that is, these data points are fitted (for example, using polynomial fitting, spline interpolation or other curve fitting methods) to obtain a smooth historical predicted failure probability curve. The fitted curve can reflect the trend of equipment failure probability over time and can help observe the fluctuation pattern of failure probability and changes in long-term time periods. Then, configure the future time zone, where the future time zone includes several consecutive monitoring time nodes, which are the time ranges for prediction and early warning after the historical data, for example, the next few days or weeks. Further, in the two-dimensional coordinate system, the historical predicted failure probability curve is extended, that is, the curve is extended to the monitoring time nodes in the future time zone in the two-dimensional coordinate system. This step is essentially to use the trend of historical data for extrapolation, that is, to predict the failure probability of future time nodes based on historical data, and to predict the failure probability of several time nodes in the future through the extended curve or fitting model. For example, if the historical data shows an upward trend, the extended curve may predict an increase in the failure probability in the future period of time. The predicted failure probability of each monitoring time node represents the possibility of the equipment failing at that time point. Finally, these predicted failure probabilities are arranged in chronological order to construct a predicted failure probability sequence. This sequence can help predict the changes in the failure probability of the equipment in the future time zone and reflect the changing trend of the failure risk of the equipment over time.

[0051] S54: performing fluctuation error analysis on the historical predicted fault probability sequence, and outputting a fluctuation error ratio.

[0052] Further, step S54 of the present invention further includes: S541: Calculate the mean of multiple historical predicted failure probabilities in the historical predicted failure probability sequence to generate the mean of historical predicted failure probabilities; S542: Based on the mean of historical predicted failure probability, perform deviation amplitude analysis on the multiple historical predicted failure probabilities respectively, and calculate the mean of multiple deviation amplitudes to obtain the fluctuation error ratio.

[0053] Specifically, first, the mean of multiple historical predicted failure probability values ​​in the sequence is calculated to obtain a historical predicted failure probability mean, which represents the average level of the failure probability of the equipment in the past monitoring period; then, based on the historical predicted failure probability mean, the deviation amplitude of the multiple historical predicted failure probabilities is analyzed respectively, and the deviation amplitude represents the degree of difference between the failure probability at a certain point in time and the mean, that is, the deviation amplitude is the ratio of the absolute value of the difference between the historical predicted failure probability and the historical predicted failure probability mean to the historical predicted failure probability mean, and multiple deviation amplitudes are obtained; finally, the multiple deviation amplitudes are averaged to obtain the fluctuation error ratio, which reflects the degree of fluctuation of the historical predicted failure probability. If the fluctuation error ratio is small, it means that the failure probability is relatively stable and the prediction accuracy is high; if the fluctuation error ratio is large, it means that the failure probability fluctuates greatly, and there may be high uncertainty or prediction error.

[0054] S55: Expanding the predicted fault probability sequence according to the fluctuation error ratio, and outputting a predicted fault probability interval sequence.

[0055] Specifically, multiple predicted fault probabilities in the predicted fault probability sequence are expanded respectively according to the fluctuation error ratio, that is, each predicted fault probability value is expanded into an interval, the lower limit of the interval is the product of the difference between 1 and the fluctuation error ratio and the predicted fault probability, and the upper limit of the interval is the product of the sum of 1 and the fluctuation error ratio and the predicted fault probability. Each predicted fault probability value is expanded upward and downward, and a fault probability interval (i.e., upper limit and lower limit) is generated according to the fluctuation error ratio, reflecting the predicted range of the fault occurrence probability. Finally, these intervals are arranged in chronological order to form a predicted fault probability interval sequence, which provides a reference for subsequent fault warning and equipment maintenance decisions.

[0056] In summary, the pressure-free device detection method provided by the present invention has the following technical effects: By regularly collecting images of the voltage-free device at the cable at preset time intervals, a device image sequence is obtained; then the key frames of the device image sequence are extracted to obtain the device key image sequence; then the convolutional neural network is used to extract fault-related features of the device key image sequence to obtain a fault-related feature distribution sequence; further, the voltage-free device fault is predicted based on the fault-related feature distribution sequence, and a historical predicted fault probability sequence is output; finally, based on the historical predicted fault probability sequence, a fault analysis in the future time zone is performed, and a predicted fault probability interval sequence is output as the fault detection result of the voltage-free device. In other words, by extracting key features through image recognition and analyzing fault-related features, the probability of device failure can be predicted in real time, and the fault probability interval can be given through historical data analysis, which can effectively improve the automation and intelligence of voltage-free device detection, thereby significantly improving the accuracy, real-time performance and efficiency of voltage-free device fault detection, and providing reliable protection for the stable operation of electrical equipment.

[0057] Embodiment 2: Based on the same inventive concept as the pressure-free device detection method in the above embodiment, the present invention also provides a pressure-free device detection system, please refer to the attached Figure 2 , including: an image acquisition module 11, used to regularly acquire images of the voltage-free device at the cable at preset time intervals to obtain a device image sequence; a key frame extraction module 12, used to extract key frames from the device image sequence to obtain a device key image sequence; a fault feature extraction module 13, used to use a convolutional neural network to extract fault-related features from the device key image sequence to obtain a fault-related feature distribution sequence; a fault occurrence prediction module 14, used to predict the occurrence of a voltage-free device fault based on the fault-related feature distribution sequence, and output a historical predicted fault probability sequence; a detection result acquisition module 15, used to perform fault analysis in a future time zone based on the historical predicted fault probability sequence, and output a predicted fault probability interval sequence as a fault detection result of the voltage-free device.

[0058] Furthermore, the pressure-free device detection system is also used to: configure key parts of the pressure-free device, wherein the key parts include but are not limited to terminal connection parts, locking components, positioning cylinders and drive components; regularly collect images of multiple key parts of the pressure-free device at the cable at preset time intervals, and fuse them into a complete image according to the position coordinates of the parts as the device image, to obtain a device image sequence.

[0059] Furthermore, the pressure-free device detection system is also used to: select the device image at the earliest monitoring time point in the device image sequence as the first image, set the first image as the first key image, and use the adjacent image of the first image as the second image; perform a similarity comparison on the first image and the second image according to a preset comparison strategy, and output the first image similarity; if the first image similarity is greater than or equal to a preset similarity threshold, discard the second image, and use the first image as a reference to perform an iterative similarity comparison of subsequent images; if the first image similarity is less than the preset similarity threshold, set the second image as the second key image, and use the second image as a reference to perform an iterative similarity comparison of subsequent images, until all images in the device image sequence are compared, and multiple key images are obtained, which are combined to construct a device key image sequence.

[0060] Furthermore, the pressure-free device detection system is also used to: select a first similarity comparison algorithm according to a pixel similarity measure; select a second similarity comparison algorithm according to a feature similarity measure; select a third similarity comparison algorithm according to a structural similarity measure; and obtain a preset comparison strategy based on a combination of the first similarity comparison algorithm, the second similarity comparison algorithm and the third similarity comparison algorithm.

[0061] Furthermore, the pressure-free device detection system is also used to: configure fault-related features, wherein the fault-related features include at least displacement features, deformation features and surface corrosion; using the fault-related features as constraints, querying historical detection records of similar pressure-free devices, collecting sample device image sets and sample fault-related feature distribution sets, wherein the fault-related feature distribution includes fault-related features of multiple key parts, and the key parts are marked with position coordinates; using the sample device image set and the sample fault-related feature distribution set, supervised training and testing of the convolutional neural network are performed until the network converges to obtain a feature extractor; using the feature extractor, fault-related feature extraction is performed on multiple device key images in the device key image sequence in turn, and a fault-related feature distribution sequence is output.

[0062] Furthermore, the pressure-free device detection system is also used to: collect sample fault-related feature distribution sets based on historical detection records of similar pressure-free devices, and count the failure frequencies of the pressure-free devices under different sample fault-related feature distributions as sample failure probabilities to obtain sample failure probability sets; use the sample fault-related feature distribution sets and sample failure probability sets to train the generator and discriminator of the adversarial neural network until both the generation loss function and the discriminant loss function converge to obtain a fault prediction model; use the fault prediction model to predict the occurrence of pressure-free device failures in sequence according to the fault-related feature distribution sequence, and output a historical predicted fault probability sequence.

[0063] Furthermore, the pressure-free device detection system is also used to: fit the historical predicted fault probability sequence in the two-dimensional coordinate system according to the chronological order of monitoring time to generate a historical predicted fault probability curve; configure a future time zone, wherein the future time zone includes a number of consecutive monitoring time nodes; within the two-dimensional coordinate system, extend according to the historical predicted fault probability curve, predict and obtain a number of predicted fault probabilities of a number of monitoring time nodes, and construct a predicted fault probability sequence; perform fluctuation error analysis on the historical predicted fault probability sequence, and output a fluctuation error ratio; expand the predicted fault probability sequence according to the fluctuation error ratio, and output a predicted fault probability interval sequence.

[0064] Furthermore, the pressure-free device detection system is also used to: perform mean calculation on multiple historical predicted failure probabilities in the historical predicted failure probability sequence to generate a mean of historical predicted failure probabilities; based on the mean of historical predicted failure probability, perform deviation amplitude analysis on the multiple historical predicted failure probabilities respectively, and perform mean calculation on multiple deviation amplitudes to obtain the fluctuation error ratio.

[0065] Embodiment 3: Based on the same inventive concept as a pressure-free device detection method in the aforementioned embodiment, the present invention further provides a pressure-free device detection device, which can be executed by a pressure-free device detection method described in any one of Embodiment 1.

[0066] The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0067] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention belong to the scope of the present invention and its equivalent technologies, the present invention is also intended to include these changes and variations.

Claims

1. A method for detecting a pressure-free device, characterized in that: Methods include: Regularly collect images of the pressure-free device at the cable at preset time intervals to obtain a sequence of device images; Extracting key frames from the device image sequence to obtain a device key image sequence; Using a convolutional neural network, extracting fault-related features from a key image sequence of the device to obtain a fault-related feature distribution sequence; Predicting the occurrence of a pressure-free device failure based on the failure-related feature distribution sequence, and outputting a historical prediction failure probability sequence; Based on the historical predicted fault probability sequence, fault analysis in the future time zone is performed, and a predicted fault probability interval sequence is output as a fault detection result of the pressure-free device.

2. A pressure-free device detection method according to claim 1, characterized in that: The image acquisition of the pressure-free device at the cable is carried out regularly at preset time intervals, including: The key parts of the pressure-free device are configured, wherein the key parts include but are not limited to the terminal connection part, the locking component, the positioning cylinder and the driving component; Images of multiple key parts of the pressure-free device at the cable are collected regularly at preset time intervals, and are fused into a complete image according to the position coordinates of the parts as the device image, thereby obtaining a device image sequence.

3. A pressure-free device detection method according to claim 1, characterized in that: Extracting key frames from the device image sequence to obtain a device key image sequence includes: Selecting the device image at the earliest monitoring time point in the device image sequence as the first image, setting the first image as the first key image, and using an image adjacent to the first image as the second image; According to a preset comparison strategy, a similarity comparison is performed on the first image and the second image, and a similarity degree of the first image is output; If the similarity of the first image is greater than or equal to a preset similarity threshold, the second image is discarded, and the first image is used as a reference to perform iterative similarity comparison of subsequent images; If the similarity of the first image is less than a preset similarity threshold, the second image is set as a second key image, and the second image is used as a benchmark to perform iterative similarity comparison of subsequent images until all images in the device image sequence are compared, and multiple key images are obtained, which are combined to construct a device key image sequence.

4. A pressure-free device detection method according to claim 3, characterized in that: The configuration method of the preset comparison strategy includes: Selecting a first similarity comparison algorithm according to the pixel similarity metric; Selecting a second similarity comparison algorithm according to the feature similarity measure; Selecting a third similarity comparison algorithm according to the structural similarity metric; A preset comparison strategy is obtained according to the combination of the first similarity comparison algorithm, the second similarity comparison algorithm and the third similarity comparison algorithm.

5. A pressure-free device detection method according to claim 2, characterized in that: Using a convolutional neural network, fault-related features are extracted from the key image sequence of the device to obtain a fault-related feature distribution sequence, including: configuring fault-related features, wherein the fault-related features at least include displacement features, deformation features, and surface corrosion degree; Taking the fault-related features as constraints, query the historical detection records of similar pressure-free devices, collect sample device image sets and sample fault-related feature distribution sets, wherein the fault-related feature distribution includes fault-related features of multiple key parts, and the key parts are marked with position coordinates; Using the sample device image set and the sample fault-related feature distribution set, supervised training and testing of the convolutional neural network is performed until the network converges to obtain a feature extractor; The feature extractor is used to extract fault-related features from a plurality of device key images in the device key image sequence in sequence, and a fault-related feature distribution sequence is output.

6. A pressure-free device detection method according to claim 1, characterized in that: Predicting the occurrence of a voltage-free device failure based on the fault-related feature distribution sequence and outputting a historical prediction failure probability sequence includes: According to the historical detection records of similar pressure-free devices, a sample fault correlation feature distribution set is collected, and the failure frequency of the pressure-free device under different sample fault correlation feature distributions is counted as the sample failure probability to obtain a sample failure probability set; The sample fault associated feature distribution set and the sample fault probability set are used to train the generator and the discriminator of the adversarial neural network until both the generation loss function and the discriminant loss function converge to obtain a fault prediction model; The fault prediction model is used to predict the occurrence of faults in the pressure-free device in sequence according to the fault-related feature distribution sequence, and a historical prediction fault probability sequence is output.

7. A pressure-free device detection method according to claim 1, characterized in that: Based on the historical predicted fault probability sequence, a fault analysis in a future time zone is performed to output a predicted fault probability interval sequence, including: In a two-dimensional coordinate system, the historical predicted fault probability sequence is fitted according to the monitoring time sequence to generate a historical predicted fault probability curve; Configuring a future time zone, wherein the future time zone includes a number of consecutive monitoring time nodes; In a two-dimensional coordinate system, the historical predicted fault probability curve is extended to predict and obtain a number of predicted fault probabilities at a number of monitoring time nodes, and a predicted fault probability sequence is constructed; Performing fluctuation error analysis on the historical predicted fault probability sequence and outputting a fluctuation error ratio; The predicted fault probability sequence is expanded according to the fluctuation error ratio, and a predicted fault probability interval sequence is output.

8. A pressure-free device detection method according to claim 7, characterized in that: Performing fluctuation error analysis on the historical predicted fault probability sequence and outputting the fluctuation error ratio includes: Calculating the mean of multiple historical predicted failure probabilities in the historical predicted failure probability sequence to generate a mean of the historical predicted failure probabilities; Based on the mean value of the historical predicted failure probabilities, the deviation amplitudes of the multiple historical predicted failure probabilities are analyzed respectively, and the mean values ​​of the multiple deviation amplitudes are calculated to obtain the fluctuation error ratio.

9. A pressure-free device detection system, characterized in that: The steps for implementing the pressure-free device detection method according to any one of claims 1 to 8 include: An image acquisition module is used to regularly acquire images of the pressure-free device at the cable at preset time intervals to obtain a sequence of device images; A key frame extraction module, used for extracting key frames from the device image sequence to obtain a device key image sequence; A fault feature extraction module is used to extract fault-related features from a key image sequence of the device using a convolutional neural network to obtain a fault-related feature distribution sequence; A fault occurrence prediction module is used to predict the occurrence of a voltage-free device fault according to the fault-related feature distribution sequence and output a historical prediction fault probability sequence; The detection result obtaining module is used to perform fault analysis in a future time zone based on the historical predicted fault probability sequence, and output a predicted fault probability interval sequence as a fault detection result of the pressure-free device.

10. A pressure-free device detection device, characterized in that: The pressure-free device detection device can be implemented by a pressure-free device detection method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Vehicle track prediction method and device

    CN115060280A

  • Circuit breaker fault operation and maintenance monitoring method and system based on image recognition analysis

    CN115131325A

  • Transformer fault prediction method and device and electronic equipment

    CN115640895A

  • Oil well equipment fault detection method and system based on Internet of Things

    CN117473429A

  • Medical instrument fault detection management system and method based on data analysis

    CN118213058A