Power equipment image extraction method

Abstract

The embodiment of the invention provides a power equipment image extraction method, and belongs to the technical field of power equipment image extraction. The extraction method comprises the following steps: acquiring image data of each power device in a power grid system; constructing a power equipment image extraction model; and training the electrical equipment image extraction model by using the image data of each electrical equipment in the power grid system. According to the power equipment image extraction method provided by the invention, the image data of each power equipment in the power grid system is obtained and then is used as the training data of the power equipment image extraction model for training, so that the complete power equipment image extraction model is obtained, and the real-time image shot by the unmanned aerial vehicle is extracted by the real-time image. The current electrical equipment image is sent to the electrical equipment image extraction model to obtain related information in the electrical equipment, so that intelligent inspection of the electrical equipment is realized, the inspection efficiency is improved, and subjective errors are reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of power equipment image extraction, and in particular to a method for extracting a power equipment image. Background Art

[0002] Substation equipment is an important part of the power system, and regular inspection of equipment in the substation is an important condition for maintaining the safety and stability of the substation.

[0003] At present, with the update and iteration of intelligent inspection, substation drone inspection is gradually applied to substation equipment inspection. However, the existing drone inspection method still requires inspection personnel to make judgments with the real-time images of drones, which has low inspection efficiency and subjective errors.

[0004] The inventors of the present application discovered during the process of implementing the present invention that the above-mentioned solutions in the prior art have the defects of low inspection efficiency and subjective errors. Summary of the invention

[0005] The purpose of the embodiment of the present invention is to provide a method for extracting an image of an electric power device, which has the functions of high inspection efficiency and small error.

[0006] In order to achieve the above object, an embodiment of the present invention provides a method for extracting an image of a power device, comprising:

[0007] Obtain image data of each power device in the power grid system;

[0008] Construct an image extraction model for power equipment;

[0009] Using the image data of each electric power device in the power grid system to train the electric power device image extraction model;

[0010] Get the current power equipment image;

[0011] The current electric power equipment image is input into the trained electric power equipment image extraction model to obtain relevant information in the electric power equipment image.

[0012] Optionally, acquiring image data of each electric power device in the power grid system includes:

[0013] Obtain images of components in each power device in the power grid system;

[0014] Classifying and labeling each of the component images;

[0015] The component images and categories of each of the electric power devices are aggregated to form image data of each of the electric power devices.

[0016] Optionally, using the image data of each electric power device in the power grid system to train the electric power device image extraction model includes:

[0017] Preprocessing the image in the image data;

[0018] Extracting the preprocessed image;

[0019] The features are input into a classification model to train the classification model.

[0020] Optionally, preprocessing the image in the image data includes processing the image using a spatial domain denoising method or a frequency domain denoising method.

[0021] Optionally, extracting features from the preprocessed image includes:

[0022] Grayscale the image;

[0023] The gradient of each pixel in the image is calculated according to formula (1) and formula (2):

[0024] G x (x,y)=H(x+1,y)-H(x-1,y), (1)

[0025] G y (x,y)=H(x,y+1)-H(x,y-1), (2)

[0026] Among them, G x (x, y) is the horizontal gradient at the pixel point (x, y), G y (x,y) is the vertical gradient at the pixel point (x,y), H(x+1,y) is the pixel value at the pixel point (x+1,y), H(x-1,y) is the pixel value at the pixel point (x-1,y), H(x,y+1) is the pixel value at the pixel point (x,y+1), and H(x,y-1) is the pixel value at the pixel point (x,y-1).

[0027] Optionally, extracting features from the preprocessed image further includes:

[0028] The gradient magnitude of each pixel in the image is calculated according to formula (3):

[0029]

[0030] Among them, G(x,y) is the gradient amplitude at the pixel point (x,y);

[0031] The gradient direction of each pixel in the image is calculated according to formula (4):

[0032]

[0033] Among them, α(x,y) is the gradient direction at the pixel point (x,y).

[0034] Optionally, extracting features from the preprocessed image further includes:

[0035] Dividing the image into a plurality of windows of preset sizes;

[0036] Obtaining the pixel gradient of each of the windows and forming a gradient histogram;

[0037] The features of the image are obtained according to the multiple gradient histograms.

[0038] Optionally, the classification model includes a SVM classifier.

[0039] Optionally, the classification model includes a random forest model.

[0040] Through the above technical scheme, the method for extracting the image of electric power equipment provided by the present invention obtains the image data of each electric power equipment in the power grid system, and then uses it as the training data for training the electric power equipment image extraction model, thereby obtaining a complete electric power equipment image extraction model, and sending the real-time image taken by the drone, that is, the current electric power equipment image, to the electric power equipment image extraction model to obtain relevant information in the electric power equipment, thereby realizing intelligent inspection of the electric power equipment, improving inspection efficiency, and reducing subjective errors.

[0041] Other features and advantages of the embodiments of the present invention will be described in detail in the subsequent detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The accompanying drawings are used to provide a further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the embodiments of the present invention, but do not constitute a limitation on the embodiments of the present invention. In the accompanying drawings:

[0043] Figure 1 is a flowchart of a method for extracting an image of an electric power device according to an embodiment of the present invention;

[0044] Figure 2 is a flow chart of obtaining power equipment image data in a method for extracting power equipment image according to one embodiment of the present invention;

[0045] Figure 3 is a flowchart of model training in a method for extracting an image of electric power equipment according to an embodiment of the present invention;

[0046] Figure 4The present invention is a flowchart of extracting features from an image in a method for extracting an image of electric power equipment according to an embodiment of the present invention. DETAILED DESCRIPTION

[0047] The specific implementation of the embodiment of the present invention is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described here is only used to illustrate and explain the embodiment of the present invention, and is not used to limit the embodiment of the present invention.

[0048] Figure 1 FIG. 1 is a flowchart of a method for extracting an image of an electric power device according to an embodiment of the present invention. Figure 1 In the method, the extraction method may include:

[0049] In step S10, image data of each electric power device in the power grid system is obtained, wherein the image data of the electric power device includes device images, device classifications, and the like.

[0050] In step S11, a power equipment image extraction model is constructed.

[0051] In step S12, the image data of each electric power device in the power grid system is used to train the electric power device image extraction model.

[0052] In step S13, the current electric power equipment image is acquired.

[0053] In step S14, the current power equipment image is input into the trained power equipment image extraction model to obtain relevant information in the power equipment image, wherein the relevant information in the power equipment image includes component names, temperatures, real-time parameters, etc.

[0054] In step S10 to step S14, the image data of each power device in the power grid system is first obtained, and then a power device image extraction model is constructed, and the power device image extraction model is trained using the image data to obtain a trained device image extraction model. The current power device image taken by the drone is obtained, and the current power device image is input into the trained power device image extraction model to extract the power device related information in the power device image.

[0055] Traditional substation inspection methods generally use drone inspections, but inspection personnel still need to cooperate with drone real-time images for judgment, which has low inspection efficiency and subjective errors. In this embodiment of the present invention, by constructing a power equipment image extraction model, the characteristic information of the power equipment can be reliably extracted, thereby realizing intelligent inspection of the power equipment, improving inspection efficiency and reducing subjective errors.

[0056] In this embodiment of the present invention, the steps for acquiring image data of power equipment in the power grid system may be as follows: Figure 2 Specifically, Figure 2 In the extraction method, the extraction method may further include:

[0057] In step S20, images of components in each electric power device in the power grid system are obtained.

[0058] In step S21, each component image is classified and labeled.

[0059] In step S22, the component images and categories of each electric device are aggregated to form image data of each electric device.

[0060] In this embodiment of the present invention, the training steps for the power equipment image extraction model can be as follows: Figure 3 Specifically, Figure 3 In the extraction method, the extraction method may further include:

[0061] In step S30, the image in the image data is preprocessed, wherein the preprocessing of the image may include processing the image using a spatial domain denoising method or a frequency domain denoising method.

[0062] In step S31, feature extraction is performed on the preprocessed image.

[0063] In step S32, the features are input into the classification model to train the classification model. The specific form of the classification model may include a binary SVM classifier as the classification model, or a multi-classification random forest model as the classification model.

[0064] In step S30 to step S32, after the image of the power equipment is acquired, the image is preprocessed, and feature extraction is performed on the preprocessed image. After the feature in the image is extracted, the feature is input into the classification model for classification training.

[0065] In this embodiment of the present invention, after acquiring the image, it is necessary to extract the features of the image. The specific extraction step can be as follows: Figure 4 Specifically, Figure 4 In the extraction method, the extraction method may further include:

[0066] In step S40, the image is grayscaled.

[0067] In step S41, the gradient of each pixel in the image is calculated according to formula (1) and formula (2):

[0068] G x(x,y)=H(x+1,y)-H(x-1,y), (1)

[0069] G y (x,y)=H(x,y+1)-H(x,y-1), (2)

[0070] Among them, G x (x, y) is the horizontal gradient at the pixel point (x, y), G y (x, y) is the vertical gradient at the pixel point (x, y), H(x+1, y) is the pixel value at the pixel point (x+1, y), H(x-1, y) is the pixel value at the pixel point (x-1, y), H(x, y+1) is the pixel value at the pixel point (x, y+1), J(x, y-1) is the pixel value at the pixel point (x, y-1), and x and y are integer numbers. Specifically, the pixel gradient is obtained by synthesizing the pixel values ​​(horizontally and vertically) of adjacent pixels, which can accurately reflect the gradient of the current pixel and improve the accuracy of pixel gradient acquisition.

[0071] In step S42, the gradient magnitude of each pixel in the image is calculated according to formula (3):

[0072]

[0073] Among them, G(x,y) is the gradient amplitude at the pixel point (x,y).

[0074] In step S43, the gradient direction of each pixel in the image is calculated according to formula (4):

[0075]

[0076] Among them, α(x,y) is the gradient direction at the pixel point (x,y).

[0077] In step S44, the image is divided into a plurality of windows of preset sizes.

[0078] In step S45, the pixel gradient of each window is obtained and a gradient histogram is formed, wherein each window corresponds to a gradient histogram.

[0079] In step S46, the features of the image are obtained based on multiple gradient histograms. The multiple windows are then combined into a block, and the descriptor of the block is obtained. Finally, all the blocks in the image are spliced ​​to obtain the features of the image. The features are input into the SVM classifier to classify the image.

[0080] In step S40 to step S46, the image is first grayed, and then the gradient, gradient amplitude and gradient direction of each pixel in the image are calculated respectively. The image is divided into a plurality of windows of preset sizes, and a gradient histogram is formed according to the pixel gradient of each window, and then the features in the image are extracted according to the gradient histogram. Specifically, the method of extracting features from the image using the gradient histogram can more accurately express the image information using fewer features.

[0081] Through the above technical scheme, the method for extracting the image of electric power equipment provided by the present invention obtains the image data of each electric power equipment in the power grid system, and then uses it as the training data for training the electric power equipment image extraction model, thereby obtaining a complete electric power equipment image extraction model, and sending the real-time image taken by the drone, that is, the current electric power equipment image, to the electric power equipment image extraction model to obtain relevant information in the electric power equipment, thereby realizing intelligent inspection of the electric power equipment, improving inspection efficiency, and reducing subjective errors.

[0082] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0083] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0084] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0085] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0086] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0087] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0088] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0089] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0090] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A method for extracting an image of a power equipment, characterized in that: include: Obtain image data of each power device in the power grid system; Construct an image extraction model for power equipment; Using the image data of each electric power device in the power grid system to train the electric power device image extraction model; Get the current power equipment image; The current electric power equipment image is input into the trained electric power equipment image extraction model to obtain relevant information in the electric power equipment image.

2. The extraction method according to claim 1, characterized in that Acquiring image data of each power device in the power grid system includes: Obtain images of components in each power device in the power grid system; Classify and label each of the component images; The component images and categories of each of the electric power devices are aggregated to form image data of each of the electric power devices.

3. The extraction method according to claim 1, characterized in that Using the image data of each electric power device in the power grid system to train the electric power device image extraction model includes: Preprocessing the image in the image data; Performing feature extraction on the preprocessed image; The features are input into a classification model to train the classification model.

4. The extraction method according to claim 3, characterized in that Preprocessing the image in the image data includes processing the image using a spatial domain denoising method or a frequency domain denoising method.

5. The extraction method according to claim 3, characterized in that Extracting features from the preprocessed image includes: Grayscale the image; The gradient of each pixel in the image is calculated according to formula (1) and formula (2): G x (x,y)=H(x+1,y)-H(x-1,y), (1) G y (x,y)=H(x,y+1)-H(x,y-1), (2) Among them, G x (x, y) is the horizontal gradient at the pixel point (x, y), G y (x,y) is the vertical gradient at the pixel point (x,y), H(x+1,y) is the pixel value at the pixel point (x+1,y), H(x-1,y) is the pixel value at the pixel point (x-1,y), H(x,y+1) is the pixel value at the pixel point (x,y+1), and H(x,y-1) is the pixel value at the pixel point (x,y-1).

6. The extraction method according to claim 5, characterized in that Extracting features from the preprocessed image further comprises: The gradient magnitude of each pixel in the image is calculated according to formula (3): Among them, G(x,y) is the gradient amplitude at the pixel point (x,y); The gradient direction of each pixel in the image is calculated according to formula (4): Among them, α(x,y) is the gradient direction at the pixel point (x,y).

7. The extraction method according to claim 6, characterized in that Extracting features from the preprocessed image further comprises: Dividing the image into a plurality of windows of preset sizes; Obtaining the pixel gradient of each of the windows and forming a gradient histogram; The features of the image are obtained according to the multiple gradient histograms.

8. The extraction method according to claim 3, characterized in that The classification model includes a SVM classifier.

9. The extraction method according to claim 3, characterized in that The classification model includes a random forest model.

Images