A method for detecting tire defects
By constructing the DMA Unet model, combining parallel cavity convolution and dense links, the problems of low efficiency and low accuracy of tire defect detection are solved, and efficient and accurate tire defect recognition is achieved, which is suitable for real-time detection of smart vehicles.
Patent Information
- Application Number
- CN202510660324.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-22
- Publication Date
- 2025-07-18
- Estimated Expiration
- 2045-05-22
AI Technical Summary
In the prior art, tire defect detection efficiency is low and the accuracy is not high, especially when the tire pattern is complex, it is difficult to accurately identify cracks and other defects.
The DMA Unet model based on the parallel cavity convolution module is adopted to replace the pooling operation in the Unet model, and a tire defect detection model is built, combining dense links and jump connections. The feature information is extracted at different hole rates through the four-way cavity convolution module, which enhances the feature expression ability, and combines the image clarity determination module to perform real-time detection.
It realizes high efficiency and high accuracy tire defect detection, which can identify defects of different sizes and shapes in complex backgrounds, reduces detection costs and improves real-time performance, and is suitable for real-time detection of smart vehicles.
Smart Images

Figure CN120182275B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of image recognition, and specifically to a method for detecting tire defects. Background Art
[0002] The tire is one of the important components of an automobile, and it bears the weight of the entire vehicle body. Therefore, the quality of the tire is directly related to the overall safety of the automobile. There may be relatively serious defects in the tread part of the automobile tire. Common defects include: severe wear, rubber chunks missing, severe cracks or fissures. These defects may cause a tire blowout under high-speed driving or emergency braking. Therefore, before the tire is manufactured and shipped from the factory, as well as during the daily inspection and maintenance of the automobile, the defects on the tire will be detected.
[0003] In the prior art, many repair shops or factories detect tire defects based on physical methods, and detect whether there are defects on the tire through tests of light transmittance, airtightness or water tightness. When implementing this physical method, the tire must be taken out separately and placed on a special detection device, which is very inconvenient and the detection efficiency is low. With the popularization of image recognition algorithms and neural network models, there are many image recognition algorithms based on neural networks in the field of civil engineering for identifying defects such as cracks on road surfaces, bridge decks or mine cave walls. However, in order to increase the grip and anti-slip drainage, many patterns are designed on the tire surface. These patterns and defects have three-dimensional dimensions, and the occurrence positions of the tire defects on the tire are irregular, and the sizes are also irregular. The difficulty of tire defect recognition lies in distinguishing these defect problems among a large number of patterns. Therefore, if the crack recognition algorithms in other fields are directly applied to the crack recognition on the tire surface, the recognition accuracy is very low. Summary of the Invention
[0004] In order to solve the problems of low efficiency or inaccurate detection results of the existing methods for detecting tire defects, the present invention provides a method for detecting tire defects, which can identify the defects on the tire surface with high efficiency and accuracy.
[0005] The technical solution of the present invention is as follows: A method for detecting tire defects, characterized in that it includes the following steps:
[0006] S1: Construct a MAC module;
[0007] The MAC module includes: an input module, four parallel atrous convolution modules, a convolution module and an output module connected in sequence;
[0008] Four parallel dilated convolution modules are respectively set with dilation rates. The input feature map is simultaneously fed into the four parallel dilated convolution modules, and the output channels are adjusted and the feature information of the input feature map is extracted through different dilation rates. Then, the feature information extracted by the four-way parallel dilated convolution is stacked together based on the Concat operation, and then fed into a 1*1 convolution module to adjust the number of channels of the feature map. Finally, the feature map is output based on the output module;
[0009] S2: Based on the Unet model, replace the original pooling operation in the Unet model with the MAC module to construct the DMAUnet model;
[0010] S3: Build a tire defect detection model based on the DMA Unet model;
[0011] The tire defect detection model includes: a feature input module, a DMA Unet model, and a detection result output module connected in sequence;
[0012] The DMA Unet model detects and enhances the defects in the input feature map to obtain an enhanced feature map. The output of the DMA Unet model includes: the enhanced feature map and the feature value corresponding to each pixel point in the enhanced feature map;
[0013] The detection result output module judges the defect features existing in the enhanced feature map. The specific judgment method is as follows:
[0014] Compare the feature value corresponding to each pixel point with a preset defect judgment threshold. When the feature value of the pixel point is greater than the defect judgment threshold, it is judged that the pixel point has a defect;
[0015] S4: Build a training data set and a validation data set based on various tire shooting data;
[0016] Use the training data set to train the tire defect detection model to obtain the trained tire defect detection model;
[0017] S5: Based on the image acquisition device, collect tire images in real time and feed them into the trained tire defect detection model. The tire defect detection model outputs the detection results for each input image;
[0018] The detection results include: the enhanced feature map and the feature value corresponding to each pixel point in the enhanced feature map.
[0019] Its further feature lies in:
[0020] The DMA Unet model includes: an encoder and a decoder, and the encoder and the decoder are connected through a bottleneck layer;
[0021] The encoder includes N downsampling modules, and each downsampling module includes: a densely connected convolutional block, a convolutional layer, and a MAC Module connected in sequence; the decoder includes N upsampling modules, and each upsampling module includes: an UpSampling layer and a convolutional layer connected in sequence, and the UpSampling layer is implemented based on transposed convolution; where N≥1; a cross-layer skip connection is established between the convolutional layer in the same-level upsampling module and the convolutional layer in the downsampling module;
[0022] The bottleneck layer is implemented based on M consecutive convolutional layers, where M≥1;
[0023] The original input image is sent into the encoder to gradually extract features through multiple convolutional layers and pooling layers, obtaining N-level feature maps. At the same time, each downsampling module uses the densely connected method based on the densely connected convolutional block to transfer each level of feature map to the next layer, so that the input obtained by each layer in the encoder is not only the output of the previous layer, but the output of all network layers before the current level; the bottleneck layer is after the encoder, and further extracts the feature information of the deepest level through M convolutional operations; the decoder uses the UpSampling layer to gradually restore the spatial size of the image, and at the same time uses skip connections to fuse the feature information from the encoder;
[0024] In step S5, the image acquisition device is implemented based on an in-vehicle camera;
[0025] The trained tire defect detection model is pre-set in the intelligent vehicle system;
[0026] The feature input module includes: an image sharpness determination module; in the image sharpness determination module, the timing of receiving the image transmitted by the in-vehicle camera is determined according to the real-time vehicle speed, and whether the received input image is available is determined according to the sharpness of the tire tread; if it is determined that the image is available, the image collected by the camera with the tire surface is sent into the tire defect detection model in real time to detect the defects on the tire surface in real time;
[0027] The detection result output module further includes a defect determination condition, and the defect determination condition is: the defective pixel points are continuous, and the number of pixel points is greater than a preset continuous threshold; when the defect determination condition is met, it is determined that there are defects on the tire surface corresponding to the input image;
[0028] The dilation rates of the four dilated convolutional modules in the MAC module are respectively set to: 6, 12, 18, 24;
[0029] The value of N in the decoder and the encoder is 3; the value of M in the bottleneck layer is 2;
[0030] The defect judgment threshold is set to 0.5;
[0031] The defects include: wear, rubber chunks missing, and cracks;
[0032] The detection result output module further includes: a marking module, which, once detecting pixel points with defects, will intensively display the positions of the defects in the enhanced feature map.
[0033] A tire defect detection method provided by this application constructs a MAC module based on four parallel atrous convolution modules, uses the MAC module to replace the original pooling operation in the Unet model, and constructs a DMA Unet model to detect defects on the tire surface; Atrous convolution can retain more detailed information. Compared with the original pooling layer in the Unet model, it can better process fine crack features; Since defects such as cracks in tire crack detection may be highly similar to the features of the tread pattern, different atrous rates are set for the four-way atrous convolution in this application to expand the receptive field. The performance of defects such as cracks may vary at different scales. Therefore, through the four-way parallel atrous convolution, the network can perform feature extraction simultaneously at multiple scales, which helps to detect tire surface defects of different sizes and shapes; The detection of defects such as cracks may be interfered by background noise. The four-way parallel atrous convolution can combine context information at multiple scales and improve the recognition ability of cracks in complex backgrounds; After the four-way atrous convolution in the MAC module, a 1*1 convolution is used once to integrate the obtained feature information and adjust the number of channels at the same time, effectively avoiding the loss of feature information caused by the pooling layer in the network structure, enhancing the feature expression ability, and ensuring that the model can identify defects on the tire surface with high efficiency and accuracy. Description of the Drawings
[0034] Figure 1 It is a schematic structural diagram of the MAC module;
[0035] Figure 2 It is an architecture diagram of the DMA Unet network;
[0036] Figure 3 It is a comparison diagram of tire crack detection effects;
[0037] Figure 4 It is an application structure example of the tire defect detection model on an intelligent vehicle;
[0038] Figure 5 It is a diagram of the in-vehicle alarm prompt screen. Detailed Embodiments
[0039] This application includes a tire defect detection method, which includes the following steps.
[0040] S1: Construct a MAC (multiple addition convolution) module; as Figure 1 shown, the MAC module includes: an input module (represented as an input feature image in the figure), four parallel dilated convolution modules, a convolution module, and an output module (represented as an output feature image in the figure) connected in sequence.
[0041] In tire crack detection, the patterns on the tire itself pose a significant challenge to the detection accuracy. The features of tire patterns and cracks are highly similar, and a single dilation rate cannot effectively extract crack feature information or distinguish cracks and other defects from tire patterns. In this application, the input feature image (InputFeature Map) is fed into four parallel dilated convolution modules simultaneously. The four parallel dilated convolution modules are set with different dilation rates to adjust the output channels and extract the feature information of the input feature map through different dilation rates.
[0042] The area of the input image that a neuron in a certain layer of a convolutional neural network (or a point on a feature map) can "see" is called the receptive field. Using dilated convolution to increase the spacing of the convolutional kernel directly expands the receptive field, and on the basis of not losing feature information, captures more extensive context information.
[0043] While dilated convolution increases the receptive field, its computational cost is relatively small compared to traditional convolution. However, as the dilation rate increases, the network may lose some sensitivity to details because the core of dilated convolution may "skip" some important local information within the perception range. Therefore, in this application, a balance is made between the accuracy of crack detection and computational efficiency by choosing different dilated convolution rates. Specifically, the parallel dilated convolution blocks Conv2d in the MAC module all use 3*3 convolutional kernels, and the dilation rates are set to 6, 12, 18, and 24 respectively. In this application, the dilated convolution module is set to 4 channels, which can avoid the loss of feature information caused by the pooling layer within an appropriate computational cost and meet the computational performance requirements of intelligent vehicles. Setting the four dilated convolution modules in parallel can save computational time, improve computational efficiency, and enhance the real-time performance of this method.
[0044] Then, the feature information extracted by the four-way parallel dilated convolution is stacked together based on the Concat operation and fed into a 1*1 convolution module Conv2d to adjust the number of channels of the feature map to the number of channels required for the next layer, and finally the output feature image (Output Feature Map) is obtained.
[0045] In tire defect detection, high-precision detection of fine cracks is often required. Dilated convolution can retain more detailed information and preserve detailed features. That is, using dilated convolution in a tire defect detection model can help the network better capture the shape and structure of cracks and better handle subtle crack features. Cracks may appear differently at different scales. Through four-way parallel dilated convolution, the network can perform feature extraction simultaneously at multiple scales, which helps detect cracks of different sizes and shapes. In the detection task, defects such as cracks may be interfered by background noise. Four-way parallel dilated convolution can combine context information at multiple scales, improve the ability to identify cracks in complex backgrounds, and enhance context understanding.
[0046] S2: Based on the Unet model, replace the original pooling operation in the Unet model with the MAC module to construct the DMA (direct multiple addition) Unet model.
[0047] Considering that multiple pooling layers in the Unet network will cause loss of features and information, which affects the network itself for the detection task. Using the MAC Module to replace the pooling layer, the original design intention lies in the selection of the dilation rate of the four-way dilated convolution, and considering that the cracks in tire crack detection may be highly similar to the features of the tread. Therefore, different dilation rates are selected to expand the receptive field, so as to more accurately extract the crack feature information that the network is expected to learn. After the four-way dilated convolution, a 1*1 convolution is used once to integrate the obtained feature information and adjust the number of channels at the same time. Although the computational cost will increase, the loss of feature information caused by the pooling layer is avoided in the network structure. Compared with the pooling operation, the MAC Module with 4-way dilated convolution can retain the spatial resolution, expand the receptive field, and at the same time can perform feature extraction at multiple scales, avoid the loss of feature information, and enhance the feature expression ability.
[0048] As Figure 2 shown, the DMA Unet model includes: an encoder and a decoder, and the encoder and decoder are connected by a bottleneck layer.
[0049] The encoder is used to extract features. The encoder includes N downsampling modules, and each downsampling module includes: a densely connected convolutional block, a convolutional layer, and a MAC Module connected in sequence.
[0050] The encoder contains multiple Dense Blocks. Each Dense Block has multiple convolutional layers. The convolutional kernel size for the convolution operation is 3*3, the stride is 1, and the padding method is "same". In the figure, p stands for padding in full, s stands for stride in full, k stands for kernel in full. The meaning of p = same is that after the convolution operation, the size of the feature map is padded to be the same as the input feature. Figure 1 After each Dense Block, the MAC Module is used to reduce the image size.
[0051] In this method, the dense connections implemented based on Dense Blocks are introduced into the model, and then the feature maps obtained after dense connections at different levels in the encoder are skipped and linked to the decoder.
[0052] In this embodiment, the value of N is 3, that is, the encoder includes 3 downsampling modules. The first downsampling module includes: Dense Block1, Conv2d1, and MAC Module1 connected in sequence. The second downsampling module includes: DenseBlock2, Conv2d2, and MAC Module2 connected in sequence. The third downsampling module includes: Dense Block3, Conv2d3, and MAC Module3 connected in sequence.
[0053] The decoder uses a transposed convolutional layer (upsampling layer, UpSampling layer) to gradually restore the spatial size of the image, and at the same time uses skip connections to fuse the feature information from the encoder. The decoder includes N upsampling modules; each upsampling module includes: an UpSampling layer and a convolutional layer connected in sequence. The UpSampling layer is implemented based on transposed convolution; where N≥1; a cross-layer skip connection is established between the convolutional layer in each level of the upsampling module and the convolutional layer in the corresponding level of the downsampling module. Specifically, the UpSampling layer can be implemented based on the techniques that can achieve upsampling in the prior art.
[0054] Specifically, the decoder includes 3 upsampling modules. The first upsampling module includes: UpSampling1 and Conv2d6. The second upsampling module includes: UpSampling2 and Conv2d7. The third upsampling module includes: UpSampling3 and Conv2d8. The feature map after being processed by the decoder is output after being processed by convolution Conv2d9.
[0055] The bottleneck layer is implemented based on M consecutive convolutional layers, where M ≥ 1. The bottleneck layer is located between the encoder and the decoder. In this embodiment, the value of M is 2. Specifically, it consists of two 3*3 convolutional layers, Conv2d4 and Conv2d5, with a stride of 1 and a padding method of same. The bottleneck layer is set after the encoder to further extract the feature information of the deepest level.
[0056] In the V-shaped network structure constructed based on the Unet model, the upsampling module 1 and the downsampling module 3 are at the same level, the upsampling module 2 and the downsampling module 2 are at the same level, and the upsampling module 3 and the downsampling module 1 are at the same level.
[0057] The decoder is used to restore the image size and perform the segmentation task. By using the UpSampling layer for upsampling, the detailed feature information in the corresponding layer of the encoder is skipped and transferred to the decoder, so as to improve the spatial resolution of the feature map, restore the size of the feature map, and then use the convolutional layer for feature extraction. After passing through the UpSampling layer, the corresponding layer in the decoder can be concatenated (Concat) with the output of the corresponding layer in the encoder due to the consistency of the feature map size, in order to restore the spatial information of the image.
[0058] Figure 2 For the three skip connections in [reference], due to their same feature dimensions in the network output results and the inspiration from the Unet results, the convolutional output results after the dense convolutional blocks: Dense Block1, Dense Block 2, and Dense Block 3 in the encoder can be skip-linked to the deep convolutional layers Conv2d6, Conv2d7, and Conv2d8 in the decoder. Through this skip-linking method, the network can obtain more detailed information, especially in terms of the edge information and structural details of the image. By combining dense links and skip links, each layer of the DenseUnet network can receive the features from both the encoder part and the previous layers in the decoder simultaneously, thus better fusing multi-scale features.
[0059] The original input image is fed into the encoder to gradually extract features through multiple convolutional layers and pooling layers, obtaining N-level feature maps. Each downsampling module in each layer uses the dense link method based on the dense convolutional block to transfer each level of feature map to the next layer, so that the input obtained by each layer in the encoder is not only the output of the previous layer, but the output of all network layers before the current level. The bottleneck layer is after the encoder and further extracts the feature information of the deepest level through M convolutional operations. The decoder uses the UpSampling layer to gradually restore the spatial size of the image, and at the same time uses skip links to fuse the feature information from the encoder.
[0060] The DMA Unet introduces the dense connection idea of DenseNet, passing the output of each layer to all subsequent network layers. That is, the input obtained by each layer is not only the output of the previous layer, but the output of all network layers before the current layer. This allows the feature map to accumulate more low-level and high-level features at each layer. At the same time, this dense connection method improves the information flow of the feature network, enabling each layer to benefit from deeper features, avoiding the problem of gradient disappearance, and reducing a certain amount of parameter redundancy.
[0061] S3: Construct a tire defect detection model based on the DMA Unet model;
[0062] Such as Figure 4 As shown, the tire defect detection model includes a feature input module, a DMA Unet model, and a detection result output module connected in sequence;
[0063] The DMA Unet model detects and enhances the defects in the input feature map to obtain an enhanced feature map. The output of the DMA Unet model includes: the enhanced feature map and the feature values corresponding to each pixel point in the enhanced feature map.
[0064] The defects in this application include: wear, rubber chunks missing, and cracks. The detection result output module judges the defect features existing in the enhanced feature map. The specific judgment method is:
[0065] Compare the feature value corresponding to each pixel point with a preset defect judgment threshold. When the feature value of the pixel point is greater than the defect judgment threshold, it is judged that there is a defect at that place. In this embodiment, the defect judgment threshold is set to 0.5.
[0066] The specific display method of the feature value is as follows. In this embodiment, the feature values of the enhanced feature map with pixels of 4*3 (width * height) are displayed as follows: [0.2 0.3 0.3 0.2 0.5 0.6 0.7 0.6 0.4 0.3 0.2 0.4];
[0068] Compare the feature value of each pixel with the defect judgment threshold, and the defect judgment result is: there are defects at the points with pixel values of 0.6, 0.7, and 0.6.
[0069] In another example, the feature values of the enhanced feature map with pixels of 5*3 are displayed as follows:
[0070] [0.2 0.3 0.4 0.3 0.2 0.5 0.6 0.5 0.6 0.7 0.3 0.2 0.4 0.3 0.2].
[0071] Compare the eigenvalue of each pixel with the defect judgment threshold, and the defect judgment result is: there are defects at the points with pixel values of 0.6, 0.6, and 0.7.
[0072] In specific implementation, for better visualization effects, a marking module can also be set in the detection result output module. Once a defective pixel point is detected, the position of the defect can be highlighted and marked red on the enhanced feature map and then output after enhanced display, obtaining an enhanced feature map with markings.
[0073] S4: Based on various tire shooting data, label the cracks on the tire to construct training sample data;
[0074] Construct a training data set and a validation data set based on various training sample data; use the training data set to train the tire defect detection model to obtain a trained tire defect detection model. The specific construction method of the training data set and the validation data set, as well as the training method of the model, can be implemented based on existing technologies.
[0075] S5: Based on the tire images collected in real time by the image acquisition device, send them into the trained tire defect detection model, and the tire defect detection model outputs the detection results for each input image;
[0076] The detection results include: defect judgment results, enhanced feature maps, and the eigenvalues corresponding to each pixel point in the enhanced feature maps.
[0077] This method is based on image recognition and machine learning models to detect the defects on the tire surface. Only need to save the trained model in the processor, and send the images collected by the image acquisition device into the model to complete the detection. There is no need to specifically manufacture exclusive detection equipment, and the implementation efficiency is high and the cost is relatively low compared with the existing physical detection methods. It can be applied to various scenarios such as tire defect detection in repair shops or factories.
[0078] Especially worth mentioning is that this method has good real-time performance and can be applied to intelligent vehicles to detect vehicle tires in real time.
[0079] Such as Figure 4 As shown, the image acquisition device uses a surround-view camera in the in-vehicle camera, or installs an image acquisition camera specifically for each tire, pre-set the trained tire defect detection model in the in-vehicle system, and receive the images including the tire surface sent by the in-vehicle camera in real time to detect the defects on the tire surface in real time. Set an image clarity determination module in the feature input module, and determine the timing of receiving the image according to the real-time vehicle speed. For example, when the vehicle speed is lower than 5 km / h, the camera can capture a clear and available image of the tire surface.
[0080] In actual application, a defect determination condition is also set in the detection result output module to avoid the interference of noise points in the image on the judgment. For example, the defect determination condition is set as follows: the number of pixel points of the defective image is greater than or equal to 8, and the defective pixel points are continuous, that is, any defective pixel point has an adjacent relationship with at least one other defective pixel point. When all defective pixel points are successively adjacent, it indicates the existence of a thin linear crack; when the defective pixel points are not successively adjacent, it indicates the existence of a defect of a non-linear crack, such as a crack with a complex shape, a block defect, or a flake wear. If the defect determination condition is met, it is determined that there is a defect in the tire position corresponding to the original input image, and the detection result is output, and at the same time, the determination result is output for the original input image. The determination result includes: there is a defect and there is no defect.
[0081] For the tire surface image with tire defects, the output of the corresponding tire defect detection model includes: the determination result, the enhanced feature map with marks, and the feature value corresponding to each pixel point in the enhanced feature map.
[0082] Determine whether the image is available according to the tire pattern. If it is determined that the image is available, the image collected by the camera with the tire surface is sent to the model for detection. Once the determination result is that there are tire defects in the input image, a defect notification is sent to the intelligent vehicle system. The intelligent vehicle system can, according to the determination result, remind the driver to pay attention to defects such as cracks in the tire through text and voice warnings. For the specific prompt screen, refer to the appendix Figure 5 。Through the real-time defect detection of the tire surface by this method, the probability of vehicle accidents caused by tire defects can be effectively reduced. The specific installation position of the camera and the image processing method can be implemented based on the existing technology.
[0083] In order to verify the effectiveness of this method for tire surface defect detection, the recognition results of the DMA Unet model in this application are compared with the detection results of other image detection models. The comparison methods include:
[0084] Canny operator, Sobel operator, SegNet model, Mask R-CNN model.
[0085] As Figure 3 shown, the first column is 3 original input images, the second column is the enhanced feature maps respectively output by the DMA Unet model in this application for the 3 original input images, and then the enhanced feature maps output by other comparison models.
[0086] The first set of horizontal detection results are the enhanced feature maps corresponding to the detection results output by each method for the first original input image. From the five detection result maps in the first horizontal group, it can be seen that compared with the other four, DMA-Unet extracts richer crack details and the detected crack features are more obvious. From the second horizontal group of detection result maps, it can be seen that although DMA-Unet's performance in detecting cracks on the tire cross-section is slightly inferior to CANNY and SOBEL, its detection effect has less noise than SegNet and has stronger anti-interference ability for vertical stripes on the tire cross-section. On the tire side, especially for fine and dense cracks, the detection ability of DMA-Unet is significantly better than CANNY and SOBEL, and it further demonstrates its anti-interference ability compared with SegNet. Generally speaking, DMA-Unet can have better detection accuracy than other algorithms when facing complex and fine and dense cracks.
[0087] After using the technical solution of the present invention, by introducing a four-way parallel dilated convolution module into the Unet model in this application, a DMA Unet model can be constructed to achieve a balance between detail and macroscopic information. At a lower dilated convolution rate (i.e., the spacing between convolutional kernels is smaller), the network can usually better capture the detailed information of the image, such as the fine parts of cracks. While a higher dilated convolution rate helps to capture more macroscopic feature information in the image, such as the long-term trend of cracks or large-scale damaged areas. Therefore, different dilated convolution rates will affect the degree of attention of the network to detail and macroscopic information during crack detection. In the DMA Unet model of this method, the dilation rates of the four-way dilated convolution are set to 6, 12, 18, and 24 respectively. At the same time, setting different dilation rates for the four-way dilated convolution module can also extract local features and global features simultaneously; the convolution with a lower dilation rate is more inclined to extract local features, while the convolution with a higher dilation rate helps to extract global features. In the crack detection task, the convolution with a low dilation rate is more suitable for detecting local cracks; but if the cracks show a long-distance distribution or there are larger damaged areas, the convolution with a high dilation rate may perform better because it can capture more global information.
Claims
1. A tire defect detection method, characterized in that, It includes the following steps: S1: Construct a MAC module; The MAC module includes: an input module, four parallel atrous convolution modules, a convolution module, and an output module that are connected in sequence; The four parallel atrous convolution modules are respectively set with dilation rates. The input feature map is simultaneously fed into the four parallel atrous convolution modules. The output channels are adjusted and the feature information of the input feature map is extracted through different dilation rates. Then, the feature information extracted by the four-way parallel atrous convolution is superimposed together based on the Concat operation, and then fed into a 1*1 convolution module to adjust the number of channels of the feature map. Finally, the feature map is output based on the output module; S2: Based on the Unet model, replace the original pooling operation in the Unet model with the MAC module to construct a DMA Unet model; S3: Construct a tire defect detection model based on the DMA Unet model; The tire defect detection model includes: a feature input module, a DMA Unet model, and a detection result output module that are connected in sequence; The DMA Unet model detects and enhances the defects in the input feature map to obtain an enhanced feature map. The output of the DMA Unet model includes: the enhanced feature map and the feature value corresponding to each pixel point in the enhanced feature map; The detection result output module judges the defect features existing in the enhanced feature map to determine whether there are defects; S4: Construct a training data set and a validation data set based on various tire capture data; Use the training data set to train the tire defect detection model to obtain the trained tire defect detection model; S5: Based on an image acquisition device, a tire image is captured in real time and fed into the trained tire defect detection model. The tire defect detection model outputs the detection result for each input image; The detection result includes: a defect judgment result, an enhanced feature map, and the feature value corresponding to each pixel point in the enhanced feature map; The DMA Unet model includes: an encoder and a decoder, and the encoder and the decoder are connected through a bottleneck layer; The encoder includes N downsampling modules. Each downsampling module includes: a dense convolution block, a convolution layer, and a MAC Module that are connected in sequence; the decoder includes N upsampling modules. Each upsampling module includes: an UpSampling layer and a convolution layer that are connected in sequence. The UpSampling layer is implemented based on transposed convolution; where N≥1; a cross-layer skip connection is established between the convolution layer in the same-level upsampling module and the convolution layer in the downsampling module; The bottleneck layer is implemented based on M consecutive convolution layers, M≥1; The original input image is fed into the encoder, and features are gradually extracted through multiple convolutional layers and pooling layers to obtain N-level feature maps. At the same time, each downsampling module in each layer uses a densely connected manner based on the dense convolutional block to transfer each level of feature map to the next layer, so that the input obtained in each layer of the encoder is not only the output of the previous layer, but the output of all network layers before the current layer; the bottleneck layer is after the encoder, and further extracts the feature information of the deepest layer through M convolutional operations; the decoder uses the UpSampling layer to gradually restore the spatial size of the image, and at the same time uses skip connections to fuse the feature information from the encoder.
2. The tire defect detection method according to claim 1, wherein: In step S5, the image acquisition device is implemented based on an in-vehicle camera. The trained tire defect detection model is preset in the intelligent vehicle system. The feature input module includes: an image clarity determination module; in the image clarity determination module, the timing of receiving the image transmitted by the in-vehicle camera is determined according to the real-time vehicle speed, and whether the received input image is available is determined according to the clarity of the tire tread; if it is determined that the image is available, the image captured by the camera with the tire surface is sent into the tire defect detection model in real time to detect the defects on the tire surface in real time. The detection result output module also includes a defect determination condition, and the defect determination condition is: the defective pixel points are continuous, and the number of pixel points is greater than a preset continuous threshold; when the defect determination condition is met, it is determined that there are defects on the tire surface corresponding to the input image.
3. The tire defect detection method according to claim 1, characterized in that: The dilation rates of the four dilated convolution modules in the MAC module are set to: 6, 12, 18, 24.
4. The tire defect detection method according to claim 1, wherein: The value of N in the decoder and the encoder is 3; the value of M in the bottleneck layer is 2.
5. The tire defect detection method according to claim 1, wherein: The defect judgment threshold is set to 0.
5.
6. The tire defect detection method according to claim 1, characterized in that: The defects include: wear, rubber chunks missing, and cracks.
7. The tire defect detection method according to claim 1, wherein: The detection result output module also includes: a marking module. Once defective pixel points are detected, the positions of the defects will be highlighted in the enhanced feature map.
8. The method for detecting tire defects according to claim 1, characterized in that: In step S3, the detection result output module judges the defect features existing in the enhanced feature map. The specific judgment method is as follows: The feature value corresponding to each pixel point is compared with a preset defect judgment threshold. When the feature value of the pixel point is greater than the defect judgment threshold, it is determined that the pixel point has a defect.
Citation Information
Patent Citations
Image recognition method, device, storage medium and system
CN115908173A
Automobile tire tread pattern defect detection system and method
CN115908304A