7420 results about "Backbone network" patented technology

A small-size vehicle detection deep learning model based on feature fusion of multi-scale modules is provided, which solves the problem of small-size vehicle image detection. The model includes a Backbone network, a Neck layer and a Head network, wherein a C2f_DCNv3 module based on the combination of deformable convolution v3 (DCNv3) and a cross stage feature fusion (C2f) module and an SPPF_LSKA module based on the combination of a spatial pyramid pooling fast (SPPF) layer and a large separable kernel attention (LSKA) module are introduced into the Backbone network; a C2f_SCConv module based on the combination of spatial and channel reconstruction convolution (SCConv) and a C2f module is introduced into the Neck layer; and a multi-scale kernel detection (MSK_Detect) module is introduced into the Head network.

The invention discloses a remote sensing image building extraction method fusing double-space attention features, and belongs to the technical field of image processing. The method comprises the following steps: firstly, inputting a training set of an Inria aviation data set into a ConvNeXt backbone network to extract shallow feature information; then, carrying out feature information enhancement processing on the feature information through a double-space attention feature fusion module (DAFF); and finally, a multi-modal dynamic enhancement module (FAM) is used in the last time of feature information up-sampling operation to carry out channel alignment operation of different levels of features, and feature information fusion errors are reduced. According to the method, the accuracy of building extraction in the remote sensing image is remarkably improved.

The invention relates to a remote sensing target detection method and device and a medium, and the method comprises the steps: inputting a feature map to a backbone network for feature extraction, inputting an extracted feature tensor into a multi-branch expansion convolution structure, and extracting multi-scale features through convolution kernels with different expansion rates. Then, multi-scale features are fused through a space and channel double-path attention mechanism, and enhanced features are generated; and the enhanced features are further input into a cascade pooling module to generate multi-level reconstruction features, and weight coefficients are calculated through a gating fusion network to carry out weighted fusion, so that multi-scale fusion features are obtained. Next, these features are input into an asymmetric decomposition convolutional layer for downsampling, and dynamic channel attention calibration is performed to generate channel enhanced features. And finally, inputting the feature map processed by the backbone network and the neck network into a detection head network, and outputting a target bounding box and category prediction. According to the method, high-precision detection of multi-scale rotating targets and high-density small targets is realized in a complex remote sensing scene.

The invention relates to the technical field of image target detection, and discloses a complex scene small target detection system and method based on mask attention and context feature optimization, and the system comprises a backbone network integrating a mask attention mechanism, a backbone network in which an original image is input into the integrated mask attention mechanism, and a background network in which the original image is input into the integrated mask attention mechanism. Redundant background information is filtered through a mask mechanism, and a multi-scale feature map is output; the context-aware enhanced feature refining encoder is used for carrying out multi-branch processing on the multi-scale feature map, and finally weighted fusion is carried out to generate a multi-scale fusion feature sequence; and the deformable Transform decoder inputs the multi-scale fusion feature sequence, processes the multi-scale fusion feature sequence through a cross attention and self-attention module, constructs a target query, and generates a detection result containing bounding box coordinates, category labels and confidence scores. According to the method, the performance of small target detection is improved by introducing efficient feature extraction, a fusion mechanism and a sampling and attention strategy.

The invention discloses a steel surface defect detection method and device based on YOLO11n improvement, and relates to the technical field of defect detection.The method comprises the steps that a to-be-detected steel surface image collected by an image collection device is obtained; inputting the to-be-detected steel surface image into a defect detection model obtained by training the improved YOLO11n model architecture to obtain surface defect detection information of the to-be-detected steel surface image; wherein a backbone network of the improved YOLO11n model architecture comprises a C3k2NAM module formed by a C3k2 module integrated with an NAM dynamic attention mechanism, and an Neck network introduces an NCB convolution block, an MSDA attention mechanism and a CoT Attention module. The problem that accurate identification of a multi-scale target cannot be realized in steel surface defect detection in the prior art is solved.

The invention discloses an underwater small target detection method based on YOLOv8 improvement, and aims to solve the problem of small target detection caused by illumination variation, background complexity and target scale difference in an underwater environment. According to the method, optimization is carried out based on a YOLOv8 architecture, firstly, a star convolution StarsBlock in a StarNet backbone network is combined with a C2F module of the YOLOv8, an improved C2FStarsBlock module is obtained, and the diversity and robustness of feature extraction are remarkably improved. Secondly, a CARAFEEnhanced module is adopted to replace up-sampling operation of a YOLOv8 neck, and dynamic convolution, grouping convolution and a nonlinear feature enhancement strategy are introduced, so that the calculation efficiency and adaptability of the model are optimized; and finally, integrating a gradient-guided multi-scale convolution attention mechanism GMSAA, introducing the gradient-guided attention mechanism in a back propagation stage, accurately focusing on a target area, and reducing background interference. The method effectively improves the detection precision of the underwater small target, and is especially suitable for efficient automatic detection of small underwater targets such as marine organisms.

The invention relates to the technical field of industrial automatic quality inspection, and provides a PCBA surface defect detection method and system based on deep learning and a medium, and the method is used for carrying out defect detection on a preset PCBA board. Comprising the following steps: acquiring a surface image of a PCBA board according to a preset multi-angle light source and a high-resolution camera, and performing adaptive illumination compensation and noise removal processing on the surface image to generate a standardized image; performing multi-scale segmentation on the standardized image to obtain image blocks including local details and a global structure; constructing a double-branch deep learning model, wherein the double-branch deep learning model comprises a backbone network, a multi-scale feature fusion module and a defect detection branch; inputting the image blocks into a double-branch deep learning model, and outputting a thermodynamic diagram and probability distribution by the double-branch deep learning model; performing binarization processing on the thermodynamic diagram by using a dynamic threshold segmentation algorithm to generate a defect mask; and outputting a defect detection result of the PCBA board according to the defect mask and the probability distribution, and completing the defect detection of the PCBA board.

The embodiment of the invention provides an unmanned aerial vehicle aerial photography target detection method and device based on deep learning. The method is applied to the technical field of target detection, and comprises the following steps: acquiring aerial image data of an unmanned aerial vehicle, and preprocessing the image data; inputting the preprocessed image data into a deep learning-based feature extraction network, wherein the deep learning-based feature extraction network comprises a backbone network, a small target frequency domain enhancement module, a lightweight multi-scale modeling module, a hierarchical context sensing module and a convolution gating linear module; and the preprocessed image data is analyzed and processed through the feature extraction network based on deep learning, and a target detection result is output, so that the real-time performance and precision of target detection are improved.

The invention belongs to the field of image data processing, and relates to an improved YOLOv10-based PCB surface defect detection system and method, the system is obtained by improving a YOLOv10 network model, a C2f module in a backbone network of the model is replaced by a multi-scale cross-stage fusion module, and the multi-scale cross-stage fusion module is used for extracting deep features of an image and capturing multi-scale information in input data; a dynamic perception feature information enhancement module is introduced into the neck network and applied to processing of P4 and P5 feature maps; a detection head of a YOLOv10 network model is replaced by a Lag module, the Lag module carries out channel adjustment through a grouping normalization convolution module and then passes through a shared convolution group, and data output by the shared convolution group is distributed to a positioning convolution module and a classification convolution module. The system can realize the detection of small defects under the interference of complex background noise, and has the advantages of high detection precision and efficiency and the like.

The invention discloses an unmanned aerial vehicle image small target detection method based on dynamic filtering and an adaptive sparse Transform. According to the method, an end-to-end target detection framework is adopted, a dynamic filtering module is introduced into a backbone network, global feature interaction is achieved through data-dependent frequency domain operation, and linear calculation complexity is maintained. For feature interaction in a scale, an adaptive sparse Transform module is introduced to enhance the capability of focusing key information on high semantic hierarchy features of a model, and noise interference and feature redundancy are effectively suppressed at the same time. Through the combination of dynamic filtering and adaptive sparse Transform, the model can extract image foreground information more effectively on the premise of not significantly increasing the calculation burden, and the problem that a traditional target detection model is susceptible to complex background interference is significantly relieved.

The invention discloses a real-time single-stage remote sensing image correction target detection method based on YOLOV8, and relates to the technical field of remote sensing image processing. According to the method, a deformable convolution dynamic prediction local geometric distortion parameter is embedded based on a YOLOv8 backbone network, an adaptive deformation field is generated, pixel-level real-time correction is realized, shallow details and high-level semantic features are fused through a bidirectional path aggregation network, and channel attention and a space gating mechanism are combined, so that the real-time correction of the image is realized. The small target detection capability is enhanced, background noise is suppressed, angle prediction is divided into discrete classification and continuous residual error regression tasks through a decoupling type rotation detection head, angle periodic errors are eliminated in combination with a direction sensitive loss function, and the rotation frame positioning precision is improved. And constructing a dynamic multi-task collaborative loss function, introducing gradient distribution consistency constraint to jointly optimize correction and detection tasks, and realizing feature semantic alignment and model self-enhancement through end-to-end closed-loop training. And the rotating target detection precision and the complex scene robustness are obviously improved.

The invention provides an improved underwater target detection system and method based on RT-DETR, and belongs to the technical field of underwater target detection based on computer vision. The system comprises a backbone network module, a hybrid encoder module, an InerMPDIOU sensing module and a decoder module, the backbone network module performs large separable kernel attention calculation after extracting features based on the large separable kernel attention, and outputs a multi-layer feature map; the hybrid encoder module design comprises a deformable large kernel attention-based in-scale feature interaction unit and an improved cross-scale feature fusion unit; the sensing module introduces a scale factor and an auxiliary bounding box into IoU calculation of an original IoU sensing module, and target query initialization is improved by using query selection sensed by InerMPDIOU. According to the model improvement, adaptation is carried out aiming at the particularity of the underwater environment, the underwater operation efficiency is improved, and the accuracy is improved while the parameter lightweight is realized.

The invention discloses a space-time consistent multi-modal feature fusion-based aerial target detection method. The method comprises the steps of 1, obtaining a visible light and infrared image pair sequence of an aerial target; 2, constructing a space-time consistent air target detection network, wherein the space-time consistent air target detection network comprises a time domain enhanced backbone network, a space domain fusion module, a bidirectional feature pyramid and a Head module; 3, constructing a total loss function; and 4, training to obtain an optimal target detection network model, carrying out multi-scale detection on the space-time consistency characteristics, finally outputting the position and the category of the target, and returning a result with a detection frame. According to the invention, through space-time consistency modeling and cross-modal attention fusion, the detection precision and robustness of the aerial target in a complex scene are effectively improved, and meanwhile, a lightweight design is adopted to meet the real-time requirement, and the method is suitable for the fields of unmanned aerial vehicle supervision, low-altitude security and protection and the like.

The invention relates to a remote sensing image change detection system and method based on multi-modal deep learning. According to the system, the detection precision is improved by constructing a twin network fusing a CNN, a Transform and an attention mechanism; a lightweight backbone network is constructed by adopting multi-size depth separable convolution, and noise is adaptively suppressed and feature expression is enhanced in combination with a soft thresholding channel space attention mechanism; harr wavelet transform downsampling is innovatively introduced to reserve high-frequency details, and traditional pooling operation is replaced to reduce information loss; the twinborn branch semantic deviation is relieved through cross-channel feature exchange, and a Transform codec is used for modeling a long-range dependency relationship; in the decoding stage, edge feature recovery is enhanced by adopting feature splicing and a progressive up-sampling strategy; according to the system, model parameters are reduced, meanwhile, the precision and the anti-interference capability of remote sensing building change detection are remarkably improved, and the system has the advantages of high efficiency and detail keeping.

The invention discloses a photovoltaic panel surface defect detection method based on a pruning multi-scale feature fusion network, and belongs to the technical field of photovoltaic panel defect detection, and the method comprises the following steps: S1, data set processing; s2, constructing a network; s3, model training; and S4, defect detection. According to the method, a feature fusion pruning efficient multi-scale attention (FFPEMA) module is introduced into a backbone network to improve the feature representation capability, and network structure global pruning is combined with a feature fusion technology to enhance feature representation so as to improve the model detection precision; a dilated convolution content awareness (DCCARAFE) module is designed, a dilated convolution strategy is adopted, the receptive field is increased by adjusting the voidage, and the flexibility of model feature extraction is improved; a pruning efficient self-adaptive feature integration fusion strategy (PAFIFN) is provided, and the feature extraction and learning ability of the model for defects of different sizes and scales is improved.

The invention discloses a double-branch edge detection method and system based on CNN and Transform deep interactive fusion, and relates to the technical field of computer vision and deep learning, and the method comprises the steps: extracting multi-scale local features through a CNN-based fine semantic edge branch by employing an OfficientNet-B2 backbone network, and carrying out the deep supervision in combination with a side output structure; meanwhile, through a global context branch based on lightweight Transform, an efficient local attention mechanism is adopted to capture a long-distance dependency relationship of the image; the core of the invention lies in that a cross-attention module is designed and realized, local features extracted by a CNN branch are used as a Key and a Value, and features of a Transform branch are used as Query, so that deep interaction and fusion of the two branches on the feature level are realized, instead of simple feature splicing; in addition, the method also adopts a uniform loss function for balancing dynamic weighted combination of binary cross entropy loss, focus loss, Dice loss and the like to perform model optimization.

The invention discloses a heterogeneous perceptual attention fusion network-based multi-modal image target detection method, which aims at the target detection problem in a complex scene, utilizes a double-backbone network to respectively perform multi-scale feature extraction on visible light and infrared images, generates a feature pyramid containing different levels of details and semantic information, and performs feature extraction on the visible light and infrared images. Through a heterogeneous perception enhancement module, a channel-space bidirectional attention mechanism is constructed, cross-modal heterogeneous enhancement is carried out on features of different levels, key region information is highlighted, by means of a refined channel attention fusion module, discriminative features are effectively amplified, modal specific noise is suppressed at the same time, and in a target detection link, an elliptical dynamic CIoU loss function is adopted, so that the target detection accuracy is improved. According to the method, the external connection ellipse or the inconnection ellipse is dynamically selected according to the proportion of the target to calculate the intersection-to-union ratio, geometric alignment of the anchor frame and the target is optimized, the detection precision and robustness of the multi-modal image target are effectively improved, and the method has wide application prospects in the fields of automatic driving, anomaly detection and the like.

The invention relates to an unmanned aerial vehicle aerial image small target detection method and a computer readable storage medium. The method comprises the steps of obtaining unmanned aerial vehicle aerial image data, and dividing the data into a training set and a verification set after processing; yOLOv8n is used as a basic model, traditional convolution structures of a shallow layer and a middle layer are replaced by full-dimensional dynamic convolution in a backbone network of the YOLOv8n model, an enhanced space attention mechanism based on routing is introduced into the backbone network of the YOLOv8n model, and an original SPPF structure of the backbone network is replaced by a multi-scale context modulation module. Performing collaborative design of a multi-scale structure and a detection head in a neck network and a head network of the YOLOv8n model to obtain an improved YOLOv8n model; training and verifying the improved YOLOv8n model by using the training set and the verification set to obtain a trained unmanned aerial vehicle aerial image small target detection model; and inputting a to-be-detected unmanned aerial vehicle aerial image into the trained unmanned aerial vehicle aerial image small target detection model to obtain a detection result. According to the invention, the small target detection precision and speed are improved.

The invention discloses a two-way visual saliency detection method and device combining difference guidance and texture enhancement, and the method comprises the following steps: 1, obtaining an image to be subjected to saliency detection, and carrying out the marking and preprocessing of a data set; 2, constructing a visual saliency detection model which comprises a dual-path encoder (a saliency detection path and an image reconstruction path), an adaptive interaction network, a decoder network and an output network; a significance detection path in the dual-path encoder network uses a pre-trained ConvNeXt encoder, and an image reconstruction path uses VQ-VAE as a backbone network; the adaptive interactive network comprises a multi-scale convolution module and a gating fusion module; the decoder network comprises a mutual conversion attention module and a double-gating fusion module; the output network comprises a multi-level feature fusion module; 3, training the saliency detection model to obtain a trained saliency detection model; and 4, carrying out saliency detection on the image data by adopting the trained saliency detection model.

The invention discloses an unmanned aerial vehicle aerial image target detection method based on PSO-DETR, and belongs to the technical field of unmanned aerial vehicle aerial image target detection. Firstly, a parallel patch perception attention feature extraction module is constructed, and an efficient multi-branch backbone network C3KCSPnet is designed by fusing a CSPDarknet53 structure; according to the network, gradient flow is improved through deep optimization, and the capturing capacity of high-level semantic information is enhanced. And secondly, an enhanced channel offset hybrid operator is provided, the dependency relationship between channels is enhanced through a channel shuffling mechanism, and cross-channel interaction of local space information is realized in combination with channel offset operation, so that the feature recovery quality and fusion efficiency in an up-sampling stage are improved, and the problem of missed detection of a shielded target is further relieved. And finally, a re-parameterization hierarchical aggregation network is designed, effective integration of shallow details and deep semantics is realized through an efficient hierarchical fusion mechanism on the premise of ensuring controllable calculation complexity, and the detection performance of the small target is further enhanced.

The invention discloses a multi-modal target detection method based on feature enhancement and alignment fusion. The method mainly comprises the following steps: (1) extracting features of a visible light image and an infrared image by using a backbone network, and better guiding the backbone network to extract related features from two modes and enhance feature representation by using an FEM in multiple stages of extracting the image features by the backbone network; (2) performing global-to-local alignment on the feature maps of the two modalities after feature enhancement by using FAM (Frequency Administration and Maintenance); (3) utilizing FFM to fuse the aligned feature maps from the two modalities; (4) using SFFM to further fuse the deeper feature map after cross-modal fusion in the step (3); and (5) inputting the fused feature maps under different scales into a detection head to obtain a target detection result. The method is mainly applied to the technical field of target detection in computer vision, and has wide application prospects in the fields of video monitoring, automatic driving and the like.

The road crack detection method based on the improved RT-DETR comprises the following steps: shooting a road at a preset flight height by using an unmanned aerial vehicle to obtain an original road image containing a crack; a pre-trained crack detection model is utilized to carry out crack detection based on an original road image to obtain crack parameters, and the crack detection model is obtained through improvement and training based on an RT-DETR (Real-Time Detecting Transformer) model; the method for improving the RT-DETR model to obtain the crack detection model comprises the following steps: replacing a basic residual block at the tail end of a ResNet18 backbone network in the RT-DETR model with a dynamic snakelike convolution residual block (DSCRBlock); a cross-scale feature fusion module (CCFM) in a hybrid encoder in an RT-DETR model is replaced by a bidirectional diffusion focusing pyramid network (BDFPN), and the bidirectional diffusion focusing pyramid network comprises a primary focusing sub-network and a secondary focusing sub-network. The method can efficiently and accurately identify the road crack, can be applied to the unmanned aerial vehicle, and is easier to implement.

The invention relates to a landslide detection method based on an improved YOLOv10n model, and belongs to the technical field of computer vision and geological disaster monitoring. The method comprises the following steps: firstly, collecting high-resolution remote sensing image data, and preprocessing by using a data enhancement technology; then, dividing the preprocessed remote sensing image data into a training set, a verification set and a test set, and carrying out real frame marking and category marking; then, an improved YOLOv10n model is constructed and trained on the basis of a Swin Transform backbone network, a depth separable convolution module and a context aggregation attention mechanism; and finally, outputting a landslide detection result by using the trained improved YOLOv10n model. According to the method, high efficiency and real-time performance are kept when high-resolution remote sensing images are processed, the method is particularly suitable for landslide real-time monitoring in a resource limited environment, the accuracy and efficiency of landslide detection are improved, the method can better adapt to complex terrains and background conditions, and efficient and reliable technical support is provided for landslide disaster monitoring.

The invention discloses a coal rock fracture intelligent extraction method based on improved U-Net. The method comprises the following steps: S1, constructing a coal rock fracture CT image data set; s2, constructing an improved U-Net segmentation model, specifically comprising the following steps: S2.1, taking VGG16 as a backbone network, and introducing a depth separable convolution module; s2.2, a PPA attention module is added after each layer of depth separable convolution of the decoder, the PPA attention module is introduced after each up-sampling stage of the decoder, and the output of the PPA attention module is subjected to batch normalization and Dropout layer processing; s2.3, defining a composite loss function; s3, training and optimizing a segmentation model, wherein the specific steps comprise: S3.1, setting hyper-parameters; and S3.2, training the model by using the training set, adjusting hyper-parameters by using the verification set, and evaluating the performance by using the test set, wherein the evaluation indexes comprise MIoU, MAcc and FWIoU. According to the method, the problems of difficult identification of small fractures, large model calculation amount, poor multi-scale information fusion and class imbalance in the coal rock fracture image can be solved, and the robustness, segmentation precision and practicability of the model are improved.

The invention discloses a water surface target detection method based on a visual language large model, which mainly solves the problem of inaccurate water surface target detection in the prior art, and the implementation scheme comprises the following steps: constructing a water surface target detection data set; extracting multi-scale features of the image by using the backbone network; constructing a dynamic feature aggregation network to fuse the multi-scale features of the image; extracting language features of the target category text; constructing a cross-modal cross attention fusion network, and fusing the visual dynamic aggregation features and the language features; utilizing a dynamic target detection head to obtain a prediction target category and a target frame; forming a water surface target detection model based on visual language multi-modal fusion by using the backbone network, the dynamic feature aggregation network, the text encoder, the cross-modal cross attention fusion network and the dynamic target detection head, and training the water surface target detection model; and obtaining a water surface target detection result by using the trained detection model. The method can effectively detect the water surface target, is high in accuracy and robustness, and can be used for intelligent ship driving.

The invention provides a signal optimization transmission system and method based on HPLC and HRF dual-mode communication, a signal acquisition and processing module of the signal optimization transmission system based on HPLC and HRF dual-mode communication is used for acquiring signals of two communication modes of HPLC and HRF in real time, preprocessing the signals and extracting key signal parameters; the dual-mode switching module is used for dynamically switching an HPLC mode and an HRF mode based on channel quality; the access module is used for constructing a longitudinal backbone network and a transverse Mesh network, forming a hybrid topology, optimizing a routing path and coordinating resource allocation and conflict avoidance of HPLC and HRF; the intelligent decision module is used for predicting future interference intensity according to the historical interference data and adjusting channel parameters; the central coordinator module is used for network initialization and resource allocation; according to the system and the method, the HPLC mode and the HRF mode are automatically switched according to the channel quality, the longitudinal HPLC backbone network is combined with the transverse HRF Mesh network to form a four-dimensional communication network, and the robustness in a complex scene is remarkably improved.