Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Semantic segmentation method and system for bolt in power transmission line

A transmission line and semantic segmentation technology, applied in image analysis, image data processing, image enhancement, etc., can solve problems such as unbalanced bolt and background size, aggravated identification difficulty, and misjudgment of bolts as missing bolts. Achieve the effects of reducing image background interference, enhancing feature expression ability, and improving positioning accuracy

Pending Publication Date: 2021-11-30
STATE GRID INTELLIGENCE TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] For a small-sized target such as a bolt, the area in the image is relatively small, and the feature information such as brightness, chromaticity, and edge is relatively small, and the size of the bolt and the background is not balanced. If the neuron uses a small receptive field, it is difficult to capture the overall situation. information, with a large receptive field, it is easy to lose the characteristics of the bolts. Therefore, it is difficult to perceive the characteristic information of the bolts during neural network learning, resulting in poor recognition results; in addition, the inventors found that the defect recognition of bolts belongs to fine-grained images Recognition problems, fine-grained targets are more difficult to identify because most of the features are similar. For example, a bolt with a pin and a bolt without a pin. The difference between the two is only on the small pin. When the pair of bolts is missing When identifying this defect, it is easy to misjudge a bolt with a pin as a bolt without a pin
Therefore, for the defect identification of bolts, it is difficult to achieve the desired effect only by relying on the traditional deep learning target detection algorithm. It is necessary to consider how to enrich the characteristics of bolts.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semantic segmentation method and system for bolt in power transmission line
  • Semantic segmentation method and system for bolt in power transmission line

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] According to an embodiment of the present invention, an embodiment of a method for semantic segmentation of transmission line bolts is provided, referring to figure 1 A flowchart of a transmission line bolt semantic segmentation method, including the following steps:

[0030] Step S101: For the acquired image of the transmission line to be recognized, locate the area where the bolt is located, and obtain a positioning image of the area where the target is located;

[0031] Specifically, directly locating bolts from the entire image is difficult to achieve good results due to its low feature resolution. The bolts of transmission lines are mostly located in certain components or specific areas, and the key position bolts are basically in the connection area of ​​line components. Therefore, first identify the connection area of ​​the transmission line where the bolt is located, and obtain the approximate range of the bolt. The extracted bolt location area discards a large ...

Embodiment 2

[0058] According to an embodiment of the present invention, an embodiment of a transmission line bolt semantic segmentation system is also provided, refer to figure 2 , including:

[0059] The transmission line bolt area positioning module is used to locate the area where the bolt is located for the acquired image of the transmission line to be recognized, and obtain the positioning image of the area where the bolt is located;

[0060] The positioning image feature map extraction module is used to separately obtain the low-level feature map with detailed features and the high-level feature map with semantic information of the positioning image;

[0061] A feature fusion module, configured to fuse the low-level feature map and the high-level feature map;

[0062] The transmission line bolt semantic segmentation module is used to obtain the pixel-level semantic segmentation result of the location image of the bolt area based on the fused feature map.

[0063] What needs to be...

Embodiment 3

[0065] In one or more embodiments, a terminal device is disclosed, including a server, the server includes a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor executes the The program implements the method for semantic segmentation of transmission line bolts in Embodiment 1. For the sake of brevity, details are not repeated here.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a semantic segmentation method and system for a bolt in a power transmission line. The method comprises the following steps: positioning a region where a bolt is located in an obtained to-be-recognized image of a power transmission line so as to acquire a positioning image of the region where the bolt is located; separately acquiring a low-level feature map with detail features and a high-level feature map with semantic information of the positioning image; fusing the low-level feature map and the high-level feature map; and acquiring a pixel-level semantic segmentation result of the positioning image based on the fused feature map so as to realize defect classification of the bolt in the power transmission line. The method has the advantages that most of the background of the image is filtered out through the bolt area positioning image, background interference is effectively reduced, and bolt recognition precision is improved; and by fusing multi-scale cavity convolution pooling features and multi-dimensional high-low layer feature information, the classification refinement degree of the bolt is improved, and semantic segmentation of the bolts of the power transmission line is realized.

Description

technical field [0001] The invention relates to the technical field of digital image processing, in particular to a method and system for semantically segmenting power transmission line bolts. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] With the rapid development of deep learning technology, object detection algorithms based on neural networks have been widely used. The neural network realizes the classification and recognition of the target by self-learning the characteristics of the target. [0004] There are many components in the transmission line. For large objects such as clamps, anti-vibration hammers, insulators, etc., due to the large proportion of the image in the image, the characteristics are more obvious, and the neural network can easily learn the characteristics of large-scale objects during training. Significant featu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00G06T7/11G06K9/46G06K9/62G06N3/04
CPCG06T7/0004G06T7/11G06T2207/20081G06N3/045G06F18/253G06F18/24G06F18/214
Inventor 付以贤李振宇韩正新李敏张飞王万国刘广秀刘丕玉刘越田源张旭刘凯王琦刘斌周洋
Owner STATE GRID INTELLIGENCE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products