Process perception type cable joint visual identification method based on deep learning

Abstract

The invention relates to the technical field of computer vision and automatic assembly, in particular to a process perception type cable connector visual identification method based on deep learning, and the method comprises the steps: collecting a cable connector on an assembly station through an industrial camera; constructing a network model based on an attention mechanism and process modulation; the network model sequentially comprises a trunk feature extraction layer, a feature enhancement layer, a process feature modulation layer and an anchor-frame-free detection layer; constructing a loss function for training, and training the network model by using the cable joint image data set to obtain a trained network model; outputting a detection result of the cable joint through the trained network model for a to-be-identified cable joint image; according to the invention, through combination of hierarchical feature extraction, multi-scale attention fusion and a process feature modulation mechanism, the industrial visual detection robustness and precision under complex illumination, background interference and shielding conditions are significantly improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of computer vision and automatic assembly, and particularly relates to a process perception type cable joint visual identification method based on deep learning. BACKGROUND

[0002] With the continuous improvement of the level of mechanical manufacturing automation, as an important carrier for device interconnection and signal transmission, the detection and assembly quality of the cable directly affects the stability and safety of the entire production system. In the cable assembly link, the appearance, form and assembly precision of the cable joint are one of the most critical detection items. The traditional manual detection method is low in efficiency and large in error, and is difficult to adapt to the requirements of high precision and high consistency of mechanical assembly. In recent years, with the development of convolutional neural networks and computer vision, the automatic detection method based on deep learning gradually replaces the traditional manual visual inspection and traditional image algorithm, and shows the advantages of high detection precision, strong adaptability and good scalability.

[0003] The prior art discloses a fast target detection method based on a convolutional neural network, as shown in Figure 9 The method constructs a FastDet network as a target detection framework, introduces channel splitting, cross-stage splicing and residual connection in the backbone network for improving feature extraction capability; adopts an improved cross-type FPN in the neck network, and fuses an ECA attention module to enhance the attention to key information; on the detection head structure, the decoupling idea of YOLOX is used to separate the classification and regression tasks, and an improved SimOTA matching strategy is used to make the model have good stability in the training stage. In addition, the method introduces SIOU geometric metric in the loss function part to improve the accuracy of the boundary box regression, and shows good generalization performance in multiple visual tasks.

[0004] However, the above detection method mainly faces the target recognition of general scenes, and still has certain limitations in the identification task of industrial cable type fine-grained targets. Although the network structure is light and efficient, when facing the target of cable joint with fine texture, large scale difference and high appearance similarity, the ordinary attention mechanism is difficult to fully capture the key geometric details; at the same time, the convolutional neural network is not specially designed for industrial process data or specific assembly scene, and it is difficult to handle the interference brought by the cluttered cable background, the severe change of light and the complex work station environment. In addition, the feature fusion strategy of the method still has room for improvement in the performance of multi-scale small targets, which leads to the problems of missed detection or positioning deviation in the dense cable joint scene.

[0005] Therefore, a new method capable of realizing high-precision and high-robustness cable joint recognition in a complex industrial scene is needed, which can fully fuse a multi-scale attention mechanism, consider spatial and channel feature responses, and introduce process-related information to improve the pertinence of feature expression, so as to realize accurate recognition and stable detection of different types of cable joints. SUMMARY

[0006] In order to solve the problems in the background art, the main problem of the traditional image algorithm based on threshold or edge detection is that it is not stable in the face of uneven light, cluttered background and other complex situations. Although some existing deep learning methods have realized the rapid detection of general objects, there are still deficiencies in tasks such as fine-grained shape differentiation and multi-scale cable joint positioning. The present application provides a process-aware cable joint visual recognition method based on deep learning, which can perform deep optimization detection on cable joint features and has real-time performance and deployability while ensuring high precision.

[0007] The first object of the present application is to provide a process-aware cable joint visual recognition method based on deep learning, comprising: Collecting the cable joint on the assembly station by an industrial camera, and configuring a corresponding structured text annotation for each collected image to obtain a cable joint image dataset; Constructing a network model based on attention mechanism and process modulation; the network model comprises a backbone feature extraction layer, a feature enhancement layer, a process feature modulation layer and an anchor-free detection layer in sequence; Constructing a loss function for training and training the network model using the cable joint image dataset to obtain a trained network model; Outputting the detection result of the cable joint by the trained network model for the cable joint image to be recognized; The backbone feature extraction layer adopts an improved convolutional neural network as the backbone network, which is coupled with a multi-scale attention module and used for extracting multi-scale feature representation; The feature enhancement layer adopts a feature pyramid network equipped with a simplified self-attention module, which is used for adaptively enhancing the saliency of cable joint edges and local details in the spatial and channel dimensions; The process feature modulation layer adopts a process feature linear modulation module, which is used for embedding production line processes and process information into visual representation and modulating them layer by layer according to the channel, so that the visual reasoning of the network is consistent with the expected assembly process constraint; The anchor-free detection layer is an anchor-free detection head constructed by an anchor-free one-stage object detection algorithm, which outputs the detection result of the cable joint by predicting the class probability, the bounding box coordinates and the center degree score.

[0008] In an embodiment, the backbone feature extraction layer is to perform feature extraction on the input cable joint image by using ConvNeXt V2 as a backbone network, wherein the ConvNeXt V2 backbone network is composed of five consecutive down-sampling feature extraction stages, and a multi-scale attention module is introduced between adjacent feature extraction stages of the ConvNeXt V2, which is used to enhance the output features of the previous stage and take the enhanced features as the input of the next stage.

[0009] In an embodiment, the backbone feature extraction layer takes three groups of features of different semantic levels of the ConvNeXt V2 as the final output of the backbone network.

[0010] In an embodiment, the feature enhancement layer is based on a feature pyramid network, and a simplified self-attention module is introduced at the feature interaction position of each layer of the pyramid, which is used to adaptively enhance each layer of features before transmission and fusion, obtain multi-scale features, and take the multi-scale features as the input basis of the subsequent feature expression construction and determination module.

[0011] In an embodiment, the process feature linear modulation module includes a double-branch input structure of a visual feature branch and a process feature branch, and an independent parameter generation branch. The independent parameter generation branch is used to generate modulation parameters from process description information in the production process, the visual feature branch is used to form a visual feature embedding sequence from the multi-scale features output by the feature enhancement layer, and the process feature branch is used to generate a process embedding sequence corresponding to the visual feature embedding sequence. The process feature linear modulation module is to splice the visual feature embedding sequence and the process embedding sequence, and generate joint features through linear mapping. Based on the modulation parameters, a channel-by-channel linear modulation operation is performed on the joint features to obtain a feature sequence after modulation, and the feature sequence after modulation is processed by a lightweight feature modeling module to obtain process-aware features, wherein the lightweight feature modeling module includes a self-attention layer and a feedforward network.

[0012] In an embodiment, the process feature linear modulation module further includes: remapping the process-aware features back to the feature map space according to their corresponding scales to restore them to a multi-scale feature representation form, and obtaining process-aware multi-scale features.

[0013] In an embodiment, the anchor-free bounding box detection head is provided with three independent prediction branches, namely a classification branch, a regression branch and a center degree branch; each branch is composed of a plurality of convolution operators in series, and outputs the corresponding prediction result at the end; wherein the classification branch is used to predict the cable joint category corresponding to the current position; the regression branch is used to predict the distance from the current position to the target boundary; and the center degree branch is used to measure whether the current position is close to the geometric center of the target.

[0014] In an embodiment, the loss function used for training is constructed by constructing a joint loss function composed of a classification loss, a boundary regression loss and a center degree loss.

[0015] In an embodiment, during the training process, based on the multi-scale feature maps output by the feature pyramid network, the spatial positions on each scale feature layer are sampled, and when any feature position is located inside the real cable joint annotation box, the position is regarded as a positive sample, and the remaining positions are regarded as negative samples; the positive sample positions are used to participate in the loss calculation of category prediction, boundary regression and center degree prediction.

[0016] The second object of the present application is to provide a system for a deep learning-based process-aware cable joint visual recognition method, comprising: A data acquisition module is configured to acquire cable joints on an assembly station through an industrial camera, and configure corresponding structured text annotations for each acquired image to obtain a cable joint image dataset. A network construction module is configured to construct a network model based on an attention mechanism and process modulation; the network model comprises, in sequence, a backbone feature extraction layer, a feature enhancement layer, a process feature modulation layer and an anchor-free bounding box detection layer; wherein the backbone feature extraction layer adopts an improved convolutional neural network as a backbone network, which is coupled with a multi-scale attention module and used to extract multi-scale feature representations; the feature enhancement layer adopts a feature pyramid network equipped with a simplified self-attention module, which is used to adaptively enhance the saliency of cable joint edges and local details in the spatial and channel dimensions; the process feature modulation layer adopts a process feature linear modulation module, which is used to embed production line processes and process information into visual representations and modulate them layer by layer in the channel, so that the visual reasoning of the network is consistent with the expected assembly process constraints; and the anchor-free bounding box detection layer is an anchor-free bounding box detection head constructed by using an anchor-free single-stage object detection algorithm, which outputs the detection result of the cable joint through the prediction of the category probability, the boundary box coordinates and the center degree score. A network training module is configured to construct a loss function used for training and train the network model using the cable joint image dataset to obtain a trained network model. An identification module is configured to output the detection result of the cable joint through the trained network model for a cable joint image to be identified.

[0017] The present application has at least the following beneficial effects: The present application provides a process-aware cable joint visual recognition method based on deep learning. The present application enhances the bottom layer geometric feature perception ability through the ConvNeXt V2 backbone network, so that the system can still capture the complete edge morphology and structure transition zone when facing the situation of cable joint surface fine texture and high structural similarity. At the same time, combined with the efficient multi-scale attention (EMA) module, the features are adaptively enhanced and re-calibrated on different scales and channels, further improving the network's expression ability of key local structures. Due to the use of improved convolution units and feature normalization strategies in each layer of the backbone network, the system can maintain stable response to the cable joint target under different shooting positions and lighting conditions, thereby reducing the recognition deviation caused by shooting angle or environmental changes. In addition, this backbone structure balances the reasoning efficiency while maintaining high representation ability, allowing fast and stable feature extraction on low-to-medium power platforms, which is conducive to long-term operation and deployment in industrial production environments.

[0018] The present application uses feature pyramid network (FPN) and SimAM parameter-free attention module to cooperate in the multi-scale feature fusion stage, effectively improving the problem of "over-concentration or over-dispersion of attention" of traditional models in complex backgrounds. FPN realizes the fusion of features at different depths through the cross-layer information integration mechanism of top-down and horizontal connection, balancing high-resolution spatial details and deep semantic information, thereby balancing the expression of texture details and semantic features. The SimAM module adaptively adjusts the key pixel regions inside the fused feature map, automatically enhancing the response of key structures such as cable joint end face structure, crimping position, and wire edge without additional labeling. In the presence of noise, oil stains, and reflection interference, this mechanism can maintain stable feature activation and high-precision positioning ability, thereby significantly improving the performance of fine-grained cable joint detection tasks, outperforming traditional convolution feature fusion methods.

[0019] The PFNM process feature modulation mechanism proposed by the present application establishes a closer connection between visual features and production rules. Industrial cable joint assembly has a relatively fixed structure mode, and PFNM can embed these rules in the form of linear weights into the visual channel, so that the features are already constrained by "process expected structure" during the formation stage. This way effectively reduces false positives and false negatives caused by unknown working conditions, especially in production lines with long process flow and many types of cable joints. For example, when different types of cable joints have no obvious differences in appearance, the process bias signal introduced by PFNM can help the system correctly judge whether the structure form conforms to the batch process information, thereby reducing interference between similar structures and making detection more in line with actual assembly logic.

[0020] The FCOS anchor-free frame structure is adopted, so that the training and deployment difficulty of the detection model is greatly reduced. The FCOS completes classification, regression and center degree prediction at the pixel level, without manually setting anchor frame size and aspect ratio, avoiding a large number of artificially preset parameters in the traditional anchor frame method, so that the model is more flexible when migrating across platforms. When facing different camera resolutions, different field of view ranges or work station distance changes, the anchor frame mode does not need to be recalibrated, and the new detection environment can be quickly adapted. This feature is particularly suitable for modern assembly lines with multiple workstations and multiple device cooperation, reducing operation and maintenance costs and improving assembly efficiency.

[0021] The present application strengthens the cooperation between modules from the overall structure, making the system more robust. In terms of detection speed, the backbone network and the attention module are designed to be lightweight, allowing the entire model to maintain high accuracy while maintaining fast inference speed; in terms of generalization ability, the structural consistency is enhanced through the process modulation mechanism, allowing the model to maintain stable performance in new scenarios that have not been seen before; in terms of assembly implementation, the present application supports common industrial cameras and GPU platform deployment, without the need for additional hardware, facilitating quick integration into existing assembly systems.

[0022] In long-term running assembly scenarios, the present application also has strong adaptability to problems such as light, pollution and occlusion. The synergy of the attention module and the PFNM allows the model to no longer rely excessively on a single visual signal, but rather makes comprehensive judgments based on structural morphology, process logic and contextual information, reducing detection fluctuations caused by short-term environmental fluctuations. The anchor-free detection method reduces the model's sensitivity to inconsistent scales, allowing the system to output stable detection results when faced with cable joints of various sizes and angles.

[0023] Compared with traditional convolution-based target detection methods, the present application not only significantly improves recognition ability and positioning accuracy, but also exhibits higher stability, flexibility and maintainability in practical industrial applications. The feature extraction, attention regulation, process information fusion and anchor-free detection strategies form a close complementary relationship, allowing the detection system to maintain reliable performance in a changing environment, providing a mature, stable and generalizable technical solution for automated cable joint identification. BRIEF DESCRIPTION OF DRAWINGS

[0024] Figure 1 is a schematic diagram of the overall structural framework in the present application; Figure 2 is a structure diagram of the EMA (Efficient Multi-scale Attention) multi-scale attention module in the present application; Figure 3This is a diagram of the ConvNeXt V2 backbone network structure with the EMA module added in this invention; Figure 4 This is a diagram of the Feature Pyramid (FPN) structure with the SimAM module added in this invention; Figure 5 This is a structural diagram of the SimAM module in this invention; Figure 6 This is a schematic diagram of the PFNM (Process Feature Numerical Modulation) linear modulation module in this invention; Figure 7 This is a structural diagram of the FCOS frameless detection head used in this invention; Figure 8 This is a visual schematic diagram of the cable connector detection method of the present invention; Figure 9 This is a flowchart illustrating a fast target detection method based on convolutional neural networks in the background technology. Detailed Implementation

[0025] In order to illustrate the technical means and effects adopted by the present invention to achieve the intended purpose, the following detailed description is provided in conjunction with the embodiments.

[0026] This invention addresses the challenges of automated assembly lines in modern industry, where cable connection quality directly impacts equipment stability and safe operation. With increasingly rapid production pace, manual inspection of cable connectors is insufficient to meet efficiency and accuracy requirements. Traditional image algorithms based on threshold or edge detection often struggle with complex situations such as uneven lighting and cluttered backgrounds. While some existing deep learning methods achieve rapid detection of general objects, they fall short in tasks such as fine-grained morphological differentiation and multi-scale cable connector localization. Therefore, a detection method capable of deep optimization based on cable connector features is needed, ensuring high accuracy while also offering real-time performance and deployability.

[0027] The purpose of this invention is to provide a deep learning-based process-aware cable connector visual recognition method. By introducing the ConvNeXt V2 backbone network with stronger local modeling capabilities, and coordinating it with an efficient multi-scale attention (EMA) module, the network can extract geometrically meaningful structural cues at a shallow level. Furthermore, with the help of the SimAM module, the Feature Pyramid Network (FPN) can automatically focus on key regions during the fusion process. At the same time, a Process Feature Linear Modulation (PFNM) module is designed to inject process information from the production process into the visual model, making the feature representation closer to the real operation scenario. Finally, combined with the FCOS anchorless frame detection structure, the detection process can achieve accurate localization without a large number of prior frames, simplifying the deployment and parameter tuning difficulty.

[0028] To achieve the above objectives, a deep learning-based process-aware cable connector visual recognition method includes: S1. Use an industrial camera to capture images of cable connectors at the assembly station. Simultaneously, configure corresponding structured text annotations for each captured image to obtain a cable connector image dataset. This invention constructs a customized dataset for visual recognition and process analysis of cable connectors. The dataset originates from actual industrial assembly environments, acquired by photographing cable connectors at assembly stations using industrial cameras. The collected images have high resolution, meeting the needs for analyzing the appearance details of cable connectors. In this embodiment, a total of 8000 cable connector images were collected, covering samples of various models and different assembly states.

[0029] Simultaneously with image acquisition, each image is assigned a corresponding structured text annotation. The text annotation describes process-related attributes that are typically difficult to obtain directly from visual images. This includes cable connector type information, internal structural features, and key assembly parameters related to assembly quality. Specifically, cable connector type information describes interface specifications and coding methods; internal structural features describe structural attributes such as conductor quantity and shielding type; and assembly parameters reflect features closely related to process quality, such as crimping height and shielding contact status.

[0030] For example, for a sample image of a cable connector, the corresponding text annotation could be described as "M12-A coded female connector, four-core shielded cable, currently in the crimping process stage, target crimping height range is 2.2–2.4 mm, shielding layer adopts 360-degree ring crimping method, ambient temperature 28℃, humidity 65%". Through this method, the process annotation not only clarifies the electrical standards and structural form of the cable connector, but also records dynamic information such as the current assembly stage, target process range, and environmental conditions, thereby providing the visual model with process constraint information closely related to the assembly state.

[0031] After image acquisition and text annotation, the dataset was divided into training, validation, and test sets according to a preset ratio. The training set contains 5600 image samples for training the parameters of the deep learning model; the validation set contains 1200 image samples for parameter tuning and performance evaluation during model training; and the test set contains 1200 image samples for independent validation of the trained model. Each subset includes corresponding structured text annotations to ensure consistency in the distribution of process attributes across different datasets.

[0032] By associating cable connector images with corresponding process text information, the constructed dataset can simultaneously reflect the appearance features and assembly process characteristics of cable connectors, providing multi-source information support for subsequent deep learning-based methods. Thus, even when the appearances are similar, different cable connectors can still be distinguished by combining process attributes, and the assembly status can be determined.

[0033] S2. Construct a network model based on attention mechanism and process modulation; the network model consists of a backbone feature extraction layer, a feature enhancement layer, a process feature modulation layer, and an anchorless detection layer; see [link to documentation]. Figure 1 As shown, the network model includes, in sequence, a backbone feature extraction network, a feature fusion network, a process feature modulation network, a detection head, and an output.

[0034] This invention constructs a complete network model: backbone—multi-scale attention—feature fusion—process modulation—anchorless detection head. The overall network uses ConvNeXt V2 as the backbone, combined with EMA, SimAM, and PFNM, as well as an anchorless detection head based on FCOS, forming an end-to-end pipeline from image to detection output. The specific processing procedures of each layer in the network model are as follows: 2.1 The backbone feature extraction layer adopts an improved convolutional neural network as the backbone network, coupled with a multi-scale attention module, to extract multi-scale feature representations; The backbone feature extraction layer uses ConvNeXt V2 as the backbone network to extract features from the input cable connector image. The ConvNeXt V2 backbone network consists of five consecutive downsampling feature extraction stages. A multi-scale attention module is introduced between adjacent feature extraction stages of ConvNeXt V2 to enhance the output features of the previous stage and use the enhanced features as the input of the next stage.

[0035] The backbone feature extraction layer uses three sets of features from different semantic levels of ConvNeXt V2 as the final output of the backbone network.

[0036] In this invention, ConvNeXt V2 is used as the backbone network to extract features from the input cable connector image. ConvNeXt V2 is a hierarchical feature extraction structure based on convolutional neural networks. It introduces depthwise separable convolution, inverted bottleneck structure, and learnable scale modulation parameters on the basis of traditional convolutional networks, thereby reducing computational complexity while ensuring feature representation ability. It is suitable for modeling targets with small size and many texture details in cable connectors.

[0037] The ConvNeXt V2 backbone network consists of five feature extraction stages. Each stage sequentially downsamples the input feature map to progressively reduce spatial resolution while simultaneously increasing channel dimensions. Each stage contains several convolutional units to extract semantic features at different scales. An efficient multi-scale attention (EMA) module is introduced between adjacent feature extraction stages in ConvNeXt V2 to enhance the output features of the previous stage and use the enhanced features as input for the next stage. This guides the network to focus more on key spatial locations and channel responses during the progressive downsampling and semantic abstraction process.

[0038] See Figure 2 As shown, the processing procedure of the EMA module includes: Let the feature map output by the previous network stage be...

[0039] in, This represents the feature map input to the EMA module; Indicates the number of channels in the feature map; and These represent the height and width of the feature map in the spatial dimension, respectively.

[0040] First, the input feature map A pointwise convolutional transformation is performed to obtain a unified feature representation. The calculation method is as follows:

[0041] in, This represents the feature map after pointwise convolution; This represents the kernel parameters corresponding to pointwise convolution; This represents the convolution operation.

[0042] Subsequently, feature maps The data is fed into parallel spatial feature processing paths. In one of these paths, spatial information is aggregated using global average pooling, calculated as follows:

[0043] in, Represents the global space context vector; Representation of feature map In the The first channel, the first line, number The value at the column position; and These represent spatial dimension indices.

[0044] The above calculations yielded the following results. Used to characterize the average response of each channel in the global space.

[0045] In another spatial feature processing path, the feature map... Depthwise convolution is applied to extract local spatial relationships; the calculation method is as follows:

[0046] in, Represents local spatial features after depthwise convolution; This represents the kernel parameters corresponding to depthwise convolution; This represents a depthwise convolution operation.

[0047] The outputs of the two spatial paths described above are linearly mapped and fused to generate spatial attention weights, calculated as follows:

[0048] in, Indicates spatial attention weights; and Indicates the corresponding linear transformation parameters; This represents the Sigmoid activation function.

[0049] Meanwhile, the EMA module also includes a channel feature processing path for modulating the importance of different channels. This path also obtains channel statistics through global average pooling, calculated as follows:

[0050] in, This represents the channel statistics vector, with dimensions of... .

[0051] The channel statistical vectors are then input into a nonlinear transformation structure composed of multiple linear mappings to generate channel attention weights, which are calculated as follows:

[0052] in, Indicates channel attention weights; and They represent the linear transformation parameters, respectively. Represents a non-linear activation function; This represents the Sigmoid activation function.

[0053] Obtain spatial attention weights With channel attention weights Then, they are applied to the original input feature maps respectively. The calculation method is as follows:

[0054]

[0055] in, This represents the feature map after spatial attention modulation. This represents the feature map after channel attention modulation; This indicates element-wise multiplication.

[0056] Subsequently, the two types of features mentioned above are concatenated along the channel dimension, and then... Convolutional processes are used to fuse features, resulting in a comprehensive feature representation, which is calculated as follows:

[0057] in, This represents the fused feature map; This indicates a channel-level concatenation operation; express Convolution operation.

[0058] Based on this, a multi-scale feature extraction operation is applied to the fused features to enhance the expressive power of features at different spatial scales. The calculation method is as follows:

[0059] in, This indicates the final output characteristics of the EMA module; This represents a multi-scale feature extraction operator composed of different convolution kernel sizes.

[0060] See Figure 3 As shown, combining the backbone network structure and the inter-stage attention enhancement mechanism, this embodiment uses three sets of features from different semantic levels of ConvNeXt V2 as the final output of the backbone network, and defines them as follows: This is used for subsequent multi-scale feature fusion and target detection, and its specific sources are as follows: This represents the direct output features of the third feature extraction stage of ConvNeXt V2. These features have high spatial resolution and can effectively preserve the local geometry and edge details of the cable connector. Considering that introducing attention modulation too early might weaken the original structural representation of lower-level features, this embodiment does not introduce EMA processing at this layer to ensure the integrity of the basic spatial information. This indicates that the output features from stage 3, after being enhanced by the EMA module, are input into the fourth feature extraction stage and output by that stage as mid-level semantic features. By introducing attention modulation before entering deeper semantic abstraction, the responsiveness of mid-scale features to key regions is effectively improved. This indicates that the output features from stage 4, after being enhanced by the EMA module, are input into stage 5, where they are output as high-level semantic features. These features possess the strongest semantic expressive power and are used to characterize the overall structure and category discrimination information of the cable connector.

[0061] Thus, the ConvNeXt V2 backbone network, while ensuring the semantic progression of multi-layer features, achieves attention-guided inter-layer feature enhancement, providing a clear structure and semantically complementary multi-scale input for the subsequent feature pyramid network.

[0062] 2.2 The feature enhancement layer employs a feature pyramid network equipped with a simplified self-attention module to adaptively enhance the saliency of cable connector edges and local details in both spatial and channel dimensions; The feature enhancement layer is based on a feature pyramid network, and a simplified self-attention module is introduced at the feature interaction position of each layer of the pyramid. This module is used to adaptively enhance the features of each layer before transmission and fusion, and obtain multi-scale features, which serve as the input basis for the subsequent feature representation construction and judgment module.

[0063] In this invention, after extracting multi-layer features from the input image, a feature fusion network is constructed between the backbone network output and the detection head to fully integrate spatial and semantic information from features at different scales. This feature fusion network is implemented based on a Feature Pyramid Network (FPN), and a simplified self-attention module (SimAM) is introduced at the feature interaction locations of each pyramid layer to improve the consistency and discriminative ability of multi-scale features.

[0064] Based on the ConvNeXt V2 backbone network structure and its output feature definition described in Section 2.1, this embodiment defines three sets of features at different semantic levels. As input to the feature fusion network. Among them, This is the direct output feature of the third feature extraction stage. and These are the mid-level and high-level semantic features obtained after being enhanced by the EMA module and entering the deeper feature extraction stage, respectively.

[0065] See Figure 4 As shown, to unify the channel dimensions and facilitate subsequent fusion processing, the features of each layer are first horizontally mapped:

[0066] In the formula, This represents the pyramid feature after channel alignment. Indicates the first corresponding to the layer Convolution weights; This represents the convolution operation.

[0067] Subsequently, a bidirectional feature transfer structure, employing both top-down and bottom-up approaches, is used to achieve a step-by-step fusion of high-level semantic information and low-level detailed information. During feature transfer, spatial dimensions are aligned through upsampling or downsampling operations, and feature superposition operations are performed.

[0068] In the formula, Indicates an upsampling operation; This represents the low-level features after being fused with high-level features.

[0069] To avoid information redundancy or response imbalance caused by the simple superposition of features at different scales in the traditional feature fusion process, this embodiment introduces the SimAM module at the feature fusion node of each pyramid level to perform adaptive weight modulation on the features before and after fusion.

[0070] See Figure 5 As shown, the SimAM module uses each neuron in the feature map as a basic processing unit, and measures the importance of the neuron by calculating its energy value in a local region. Let the input feature map be:

[0071] In the formula, Indicates the number of channels; , These represent the height and width of the feature map, respectively.

[0072] For any neuron in the feature map Its energy function is defined as:

[0073] In the formula, Indicates the first The values ​​of each neuron; This represents the mean of the corresponding channel in the spatial dimension; This represents the variance of the corresponding channel in the spatial dimension; This is the regularization coefficient, used to suppress the impact of noise on energy calculations.

[0074] Based on the above energy values, calculate the attention weights corresponding to the neurons:

[0075] In the formula, Represents neurons Attention weights; It is a very small constant used to avoid zero denominators and improve numerical stability.

[0076] Finally, attention weights are applied to the original feature map to obtain the enhanced feature representation:

[0077] In the formula, This represents the feature map after SimAM modulation; Indicates by all The weight matrix is ​​composed of; This indicates element-wise multiplication.

[0078] See Figure 4 As shown, in this embodiment, the SimAM module is positioned at key nodes between each level of the feature pyramid to adaptively enhance the features of each level before transmission and fusion. Its processing can be summarized as follows:

[0079] in, Indicates the characteristics of the original pyramids; This represents the features enhanced by SimAM.

[0080] The enhanced features then participate in feature fusion operations in the uplink and downlink paths, thereby forming a more coordinated response relationship across different scales. The multi-scale features obtained after the above fusion and enhancement processes... This serves as the input basis for subsequent feature representation construction and judgment modules.

[0081] This embodiment achieves effective fusion and saliency enhancement of multi-scale features without significantly increasing model parameters and computational load. This enables the feature pyramid to maintain stable and discriminative feature representation when facing cable joint targets with large size differences and high structural similarity, providing reliable input for subsequent detection and judgment.

[0082] 2.3 The process feature modulation layer adopts a process feature linear modulation module to embed the production line process and process information into the visual representation and modulate it layer by layer according to the channel, so that the network's visual reasoning is consistent with the expected assembly process constraints. To improve the ability of the detection results to judge the consistency of cable manufacturing process, this embodiment introduces a process feature linear modulation (PFNM) module after the feature fusion network. This module is used to explicitly integrate process semantic information into the visual feature expression process, thereby achieving adaptive adjustment of the cable joint feature response under different process conditions.

[0083] The process feature linear modulation module includes a dual-branch input structure with visual feature branch and process feature branch, as well as an independent parameter generation branch; Among them, the visual feature branch is used to form a visual feature embedding sequence from the multi-scale features output by the feature enhancement layer; the process feature branch is used to generate a process embedding sequence and participate in the construction of the visual-process joint feature as an explicit semantic feature to achieve information-level fusion; the independent parameter generation branch is used to generate modulation parameters to perform channel-by-channel linear modulation on the joint feature, and to perform conditional control and adaptive adjustment of the joint representation from the feature distribution level. The process feature linear modulation module concatenates the visual feature embedding sequence with the process embedding sequence and generates joint features through linear mapping. Based on the modulation parameters, a channel-wise linear modulation operation is performed on the joint features to obtain the modulated feature sequence. The modulated feature sequence is then processed by a lightweight feature modeling module to obtain process-aware features. The lightweight feature modeling module includes a self-attention layer and a feedforward network.

[0084] The process feature linear modulation module further includes: remapping the process-aware features back to the feature map space according to their corresponding scales, restoring them to a multi-scale feature representation, and obtaining the process-aware multi-scale features.

[0085] See Figure 6 As shown, the PFNM module adopts a dual-branch input structure, including a visual feature branch and a process feature branch, which maintain a one-to-one correspondence in the temporal or spatial dimensions. The visual feature branch receives multi-scale features output from the feature pyramid network and enhanced by the SimAM module. Since features at different scales differ in spatial resolution and channel dimension, this embodiment first flattens the features at each scale to eliminate spatial inconsistencies caused by scale differences. Then, channel alignment is used to uniformly adjust the number of feature channels at different scales to a preset dimension. Furthermore, a linear mapping method is employed to map the processed features at each scale to the same feature embedding space, thereby forming a visual feature embedding sequence, represented as:

[0086] The process feature branch is used to introduce process information related to the cable connector manufacturing process. Its input is a process embedding sequence that corresponds one-to-one with the aforementioned visual features. Specifically, the process embedding sequence consists of pre-acquired process feature data, which includes, but is not limited to, assembly process type, process parameter range, quality status label, or prior process description information. After discrete encoding or numerical normalization, the aforementioned process feature data is converted into a fixed-dimensional process feature embedding vector through a linear mapping method, thereby forming a process embedding sequence, represented as:

[0087] In the formula, Indicates the first Each visual feature embedding vector; Indicates the relationship with the first Embedded vectors of process features corresponding to each visual feature; Indicates the number of feature units.

[0088] To enable joint modeling of visual and process information within the same feature space, this embodiment concatenates the corresponding visual embeddings and process embeddings, and generates a joint feature representation through linear mapping:

[0089] In the formula, Indicates the first Visual-process joint embedding; Represents the linear projection weight matrix; Indicates the bias term; This indicates a vector concatenation operation.

[0090] Through the above mapping, the appearance features and the corresponding process attributes can participate in feature calculation simultaneously during the subsequent modulation process.

[0091] In this embodiment, the PFNM module has a dedicated parameter generation branch, used to generate modulation parameters via a mapping network based on key process description information from the cable connector process file. The process description information includes: process identification parameters. Used to distinguish different assembly process types; process coding parameters Used to characterize the current assembly step; process pressure parameters Used to describe crimping or locking conditions; environmental parameters It is used to describe environmental conditions such as temperature and humidity.

[0092] The above process parameters are embedded and then input into a multilayer perceptron (MLP), which outputs scaling and offset coefficients respectively.

[0093]

[0094] In the formula, Indicates the first The channel scaling factor corresponding to each feature unit; Indicates the first Channel offset corresponding to each feature unit; , This represents the mapping function used to generate modulation parameters.

[0095] After obtaining the modulation parameters, the PFNM module performs a channel-by-channel linear modulation operation on the joint embedding features, which is calculated as follows:

[0096] In the formula, This represents the feature embedding after process modulation; This indicates element-wise multiplication.

[0097] This linear modulation process enables the network to maintain its original visual structure information while adaptively adjusting the response intensity of each channel feature according to different process states, thereby enhancing the feature expression related to the current production conditions.

[0098] The modulated feature sequence:

[0099] The input is then fed into a lightweight feature modeling module for further processing. This module includes a self-attention layer and a feedforward network, and its computation process is as follows:

[0100] In the formula, This represents the self-attention operation, used to model the relationships between feature units; This represents a feedforward network used for feature nonlinear mapping. This represents the process-aware feature representation of the final output.

[0101] After completing feature modeling, embed the process-aware features. Remapped back to the feature map space according to its corresponding scale, restoring a multi-scale feature representation, which serves as the input form for subsequent detection heads, denoted as:

[0102] In the formula, Indicates the first The feature map after linear modulation of the process features maintains the same spatial resolution as the corresponding feature pyramid network output. Compared to the original feature map, Process semantic constraints are explicitly introduced into the channel response to provide process-aware multi-scale feature inputs for subsequent anchorless detection heads.

[0103] 2.4 The frameless detection layer is a frameless detection head constructed using a frameless single-stage target detection algorithm. It outputs the detection results of cable joints by predicting the class probability, bounding box coordinates, and centrality score. The anchorless detection head has three independent prediction branches: a classification branch, a regression branch, and a centrality branch. Each branch consists of multiple convolutional operators connected in series and outputs the corresponding prediction result at the end. The classification branch is used to predict the cable connector type corresponding to the current position; the regression branch is used to predict the distance from the current position to the target boundary; and the centrality branch is used to measure whether the current position is close to the geometric center of the target.

[0104] In this invention, after feature extraction, feature fusion, and process feature modulation are completed, this embodiment uses an anchorless detection head to make a final prediction of the cable joint target.

[0105] The anchorless detection head is built based on the FCOS concept, see [link / reference]. Figure 7 As shown, by directly predicting the target category, position offset, and centrality information at each spatial location of the multi-scale feature map, the matching ambiguity and parameter redundancy problems caused by the preset anchor box are avoided, thereby improving the stability and generalization ability of the detection process.

[0106] The anchorless detection head is positioned in the process-aware multi-scale feature layer output by the PFNM module. Above this, predictions are made for each feature layer separately. For any scale feature layer... Its spatial resolution is The detection head sets up three independent prediction branches on this feature layer, namely: 1) Classification branch, used to predict the cable connector type corresponding to the current location; 2) Regression branch, used to predict the distance from the current location to the target boundary; 3) Centrality branch, used to measure whether the current position is close to the geometric center of the target.

[0107] Each prediction branch consists of multiple concatenated convolution operators, and outputs the corresponding prediction result at the end.

[0108] Classification branch at the feature layer Output category probability map:

[0109] in, Indicates the number of cable connector types; , They represent the first The height and width of the layer feature map; Indicates the first Pixel positions of layer feature maps Belongs to the first Predicted probability of cable connectors.

[0110] The regression branch is used to predict the distance from each pixel in the feature map to its corresponding target boundary, and its output format is as follows:

[0111] in, Represents the pixel coordinates in the feature map; This indicates the distance from the pixel to the left boundary of the target. This indicates the distance from the pixel to the upper boundary of the target. This indicates the distance from the pixel to the right boundary of the target. This indicates the distance from the pixel to the bottom boundary of the target.

[0112] The bounding box position of the corresponding target can be uniquely determined using the four distance parameters mentioned above.

[0113] To suppress low-quality predicted points far from the target center, this embodiment introduces a centrality branch in the detection head to evaluate the proximity of the current position to the target's geometric center. The calculation method is as follows:

[0114] In the formula, Indicated in the feature layer Upper pixel position Centrality predictions; , These represent the minimum and maximum values, respectively; the centrality value range is... arrive The larger the value, the closer the location is to the center of the target area.

[0115] By employing the aforementioned anchorless detection head structure, the network can directly determine the category and regress the location of cable joint targets on multi-scale feature maps, avoiding missed or false detections caused by improper anchor frame size selection. Simultaneously, a centrality prediction mechanism is introduced to effectively suppress unstable responses in edge regions, improving the positioning accuracy and detection reliability of small-sized, partially occluded, or complex background cable joint targets.

[0116] The aforementioned anchorless detection head works in conjunction with the aforementioned feature extraction network, feature fusion network, and process feature modulation module to form a complete high-precision identification process for cable connectors.

[0117] S3. Construct the loss function for training and train the network model using the cable connector image dataset to obtain the trained network model; The loss function used for training is constructed by creating a joint loss function consisting of classification loss, boundary regression loss, and centrality loss. During training, based on the multi-scale feature map output by the feature pyramid network, the spatial locations on each scale feature layer are divided into samples. When any feature location is inside the actual cable connector annotation box, the location is regarded as a positive sample, and the rest are regarded as negative samples. The positive sample locations are used to participate in the loss calculation of category prediction, boundary regression and centrality prediction.

[0118] In this invention, a joint loss function matching the cable connector identification task is constructed to coordinately constrain the functional branches of the convolutional neural network, so that the network parameters gradually converge during backpropagation, thereby obtaining an identification network model that meets the accuracy requirements of industrial applications.

[0119] During training, based on the multi-scale feature maps output by the feature pyramid network, spatial locations at each scale feature layer are partitioned into samples. When a feature location lies within the actual cable connector bounding box, that location is considered a positive sample; other locations are considered negative samples. Positive sample locations are used in the loss calculations for class prediction, boundary regression, and centrality prediction. The total number of samples is... This quantity is used to normalize the overall loss to avoid adverse effects on the training process due to differences in the number of samples from different images or batches.

[0120] For the three types of output results of the anchorless detection head, this embodiment constructs a joint loss function consisting of classification loss, boundary regression loss, and centrality loss, the overall form of which is expressed as:

[0121] The meanings of each symbol are explained below: : Represents the total loss function during the training phase; : Indicates the number of positions of positive samples in the current training batch; : Represents the spatial coordinates on the feature map; : Represents the classification loss function used to constrain the category prediction results; : indicates the first The category prediction result output by the classification branch on the layer feature map; : Indicates the actual category label at the corresponding location; : Represents the boundary regression loss function based on the intersection-union ratio; : Represents the boundary distance parameter for regression branch prediction; : Represents the boundary distance parameter corresponding to the actual annotation box; : Indicates the centrality branch at position The prediction results at the location; : Represents the true centrality value corresponding to this position; , : Represents the weighting coefficient used to balance the contributions of different loss terms.

[0122] The classification loss is used to constrain the network's ability to distinguish cable connector types. This embodiment employs an improved focus loss form, assigning different weights to easily classified and difficult-to-classify samples, thereby alleviating the problem of imbalanced positive and negative sample numbers. Its calculation method can be expressed as:

[0123] in, : Represents the model's predicted probability of the true class; : Represents the class weight coefficient, used to balance samples from different classes; : Indicates a regulation factor used to reduce the impact of easily classified samples on the total loss.

[0124] Boundary regression loss is used to constrain the geometric consistency between the predicted bounding box and the ground truth bounding box. This embodiment uses a regression loss form based on intersection-over-union (IoU), which guides network optimization by directly measuring the degree of overlap between the predicted and ground truth boxes, and is defined as:

[0125] in, : Indicates the intersection-union ratio (IUU) between the predicted bounding box and the ground truth bounding box; : Represents the predicted bounding box parameters; : Represents the actual bounding box parameters.

[0126] At the same time, true centrality is introduced. The loss term is weighted to reduce the adverse impact of the location far from the target center on the regression results.

[0127] The centrality loss is used to constrain the centrality prediction results output by the network, ensuring that they reflect the proximity of feature locations to the geometric center of the target. This embodiment uses a binary cross-entropy loss, calculated as follows:

[0128] in, This represents the centrality value predicted by the model; This represents the centrality value calculated based on the actual annotations.

[0129] During training, the network parameters are optimized end-to-end using the aforementioned joint loss function. The backpropagation algorithm is employed to calculate gradients, and the network weights are iteratively updated using an optimizer. Parameters for each module, including the backbone network, feature fusion network, process feature linear modulation module, and anchorless detection head, are jointly updated during the same training process. This gradually aligns visual feature representation with process semantic information, thereby improving the accuracy and stability of cable connector recognition in complex industrial scenarios.

[0130] S4. Output the detection results of the cable connectors by passing the trained network model through the image of the cable connectors to be identified.

[0131] After completing network training and obtaining stable converged model parameters, the neural network is used to perform forward inference on the cable image to be detected, so as to realize the target localization, category recognition and quality judgment output of the cable connector.

[0132] 4.1 Preprocessing before inference. During the inference phase, the input cable assembly image undergoes the same preprocessing operations as in the training phase to ensure consistent input data distribution. Specifically, this includes: scaling the original image to ensure its shorter side meets the network input requirements; then normalizing the pixel values ​​and constructing the network input tensor according to a preset channel order. In industrial applications requiring real-time performance, the input resolution can be appropriately reduced or half-precision numerical representation can be used for inference calculations without significantly reducing recognition accuracy.

[0133] 4.2 Forward Inference and Candidate Box Recovery. The preprocessed image is input into the trained convolutional neural network, passing sequentially through a feature extraction network, a feature fusion network, and an anchorless detection head to obtain prediction results at each scale feature layer. For any scale feature layer, at each spatial location, the network outputs three types of prediction information: category prediction value, boundary regression parameters, and centrality prediction value.

[0134] The boundary regression results are represented as the distance from a pixel to the target boundary, and the corresponding candidate bounding boxes can be recovered according to the following relationship:

[0135] In the formula, Indicates the first One candidate detection box; This represents the pixel coordinates of the feature map corresponding to the candidate box; , , , These represent the predicted distances from the pixel to the left, top, right, and bottom boundaries of the target, respectively.

[0136] 4.3 Overall Confidence Score Calculation. To comprehensively measure the reliability of candidate targets in category determination and spatial localization, an overall confidence score is calculated for each candidate box. The calculation method is as follows:

[0137] In the formula, Indicates the first The overall confidence score of each candidate box; This represents the predicted probability value of the category corresponding to the candidate box; This represents the predicted centrality value corresponding to the candidate box, which reflects the degree of proximity between the location and the geometric center of the target.

[0138] By introducing a centrality factor, low-quality predictions that are far from the target center naturally receive lower scores, thereby improving the stability of the overall inference results.

[0139] 4.4 Post-processing screening and process constraint correction. All candidate boxes are sorted according to their overall confidence scores. The results are sorted from highest to lowest, and then non-maximum suppression is performed to remove redundant detection results with highly overlapping spatial locations. When the intersection-union ratio (IUU) of any two candidate boxes exceeds a preset threshold... At that time, only candidate boxes with higher confidence scores are retained.

[0140] After completing the geometric screening, the detection results are further corrected by combining process information: when the process vector input by the process feature linear modulation module indicates that the probability of a certain type of cable connector is low in the current station or process state, the candidate box score of the corresponding category is given a suppression weight, thereby reducing the risk of false detection caused by process inconsistency.

[0141] 4.5 Results Output and Deployment. The final test results after post-processing and filtering are output in a structured format. Each test result includes at least: target bounding box coordinates, cable connector category identifier, category confidence, centrality score, and compliance judgment mark based on process rules.

[0142] When deployed in industrial settings, the trained model can be exported in a format suitable for inference acceleration, and inference efficiency can be improved by combining optimization techniques such as quantization and tensor fusion. Process feature vectors can be input in real time by the manufacturing execution system or field control system via a communication interface, and a default process configuration can be activated in case of communication failure to ensure continuous system operation.

[0143] Through the reasoning and result output process in step four above, stable detection and accurate judgment of cable connector targets can be achieved in automated assembly scenarios, and the visual recognition results can be effectively integrated with the actual process status, thereby improving the availability and reliability of the detection results in real production scenarios.

[0144] The above detailed embodiments provide a comprehensive implementation path for the present invention, including network structure, module mathematical description, training and inference processes, and engineering considerations. Any substitutions, adjustments, or optimizations made to the above steps, parameters, or module forms without departing from the essential technical approach of the present invention should be considered equivalent implementations falling within the protection scope of the present invention.

[0145] After completing the cable joint detection process, the acquired cable images are processed according to the method of this invention to obtain detection results with significant stability. The processed detection images show that the method of this invention can output stable confidence information even under interference conditions such as partial occlusion, similar surface textures of the cable joints, or repetitive background patterns. The predicted bounding boxes fit the actual target boundaries more closely, while effectively suppressing false detections. See also... Figure 8 As shown, the detection boxes in key structural regions such as end face structures, metal textures, and sheath edges are accurate and continuous, indicating that the process feature linear modulation (PFNM) and feature fusion strategy can enhance the network's ability to recognize micro-structural features and improve the robustness and precision of detection.

[0146] This invention provides a system for a deep learning-based process-aware visual recognition method for cable connectors, comprising: The data acquisition module is used to acquire cable connectors on the assembly station using an industrial camera. At the same time, it configures corresponding structured text annotations for each acquired image to obtain a cable connector image dataset. A network construction module is used to build a network model based on attention mechanisms and process modulation. The network model consists of a backbone feature extraction layer, a feature enhancement layer, a process feature modulation layer, and an anchorless detection layer. The backbone feature extraction layer uses an improved convolutional neural network as the backbone network, coupled with a multi-scale attention module, to extract multi-scale feature representations. The feature enhancement layer uses a feature pyramid network equipped with a simplified self-attention module to adaptively enhance the saliency of cable connector edges and local details in spatial and channel dimensions. The process feature modulation layer uses a process feature linear modulation module to embed production line processes and flow information into the visual representation and modulate it layer by layer according to channel, ensuring that the network's visual inference is consistent with the expected assembly process constraints. The anchorless detection layer is an anchorless detection head built using a single-stage target detection algorithm, which outputs the detection results of the cable connector by predicting the class probability, bounding box coordinates, and centrality score. The network training module is used to construct the loss function for training and train the network model using a cable connector image dataset to obtain the trained network model. The recognition module is used to output the detection results of the cable connectors by passing the images of the cable connectors to be recognized through a trained network model.

[0147] In summary, this invention provides a deep learning-based visual recognition method for process-aware cable connectors. This method uses an improved ConvNeXt V2 network as its backbone structure, combined with an efficient multi-scale attention (EMA) module, to construct a rich and context-sensitive feature representation, thereby enhancing the network's ability to perceive subtle textures and complex backgrounds. In the feature fusion stage, a Feature Pyramid Network (FPN) with an added SimAM attention mechanism is employed. Through joint spatial and channel modeling, adaptive fusion of multi-scale information is achieved, effectively preserving the overall geometric shape and edge details of the cable connector. Subsequently, a newly designed Process Feature Linear Modulation (PFNM) module is introduced. This module injects semantic information related to the assembly process into the feature map through a linear modulation strategy, thereby achieving adaptive reshaping of the feature distribution during visual inference. This ensures that the detection results are consistent with the actual assembly process, improving the model's process awareness and localization accuracy. Finally, an anchorless prediction head based on an improved fully convolutional single-stage (FCOS) detection framework outputs the cable connector's category, bounding box coordinates, and centrality score, achieving efficient end-to-end detection and accurate localization. This invention significantly improves the robustness and accuracy of industrial visual inspection under complex lighting, background interference, and occlusion conditions by combining hierarchical feature extraction, multi-scale attention fusion, and process feature modulation mechanisms. The method is simple in structure and highly computationally efficient, and can be widely applied to high-precision visual recognition of cable connectors, pose detection, precise assembly control, and visual recognition of other precision components. It has good feasibility for automated assembly and significant application and promotion value.

[0148] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A deep learning-based process-aware cable connector visual recognition method, characterized in that, include: The cable connector images at the assembly station are captured using an industrial camera. At the same time, a corresponding structured text annotation is configured for each captured image to obtain a cable connector image dataset. A network model based on attention mechanism and process modulation is constructed; the network model includes, in sequence, a backbone feature extraction layer, a feature enhancement layer, a process feature modulation layer, and an anchorless detection layer; Construct the loss function for training and train the network model using a cable connector image dataset to obtain the trained network model; The image of the cable connector to be identified is processed by a trained network model to output the detection results of the cable connector. The backbone feature extraction layer uses an improved convolutional neural network as the backbone network, coupled with a multi-scale attention module, to extract multi-scale feature representations. The feature enhancement layer employs a feature pyramid network equipped with a simplified self-attention module to adaptively enhance the saliency of cable connector edges and local details in both spatial and channel dimensions. The process feature modulation layer uses a process feature linear modulation module to embed the production line process and process information into the visual representation and modulate it layer by layer according to the channel, so that the network's visual reasoning is consistent with the expected assembly process constraints. The frameless detection layer is a frameless detection head constructed using a frameless single-stage target detection algorithm. It outputs the detection results of cable connectors by predicting class probabilities, bounding box coordinates, and centrality scores.

2. The deep learning-based process-aware cable connector visual recognition method according to claim 1, characterized in that, The backbone feature extraction layer uses ConvNeXt V2 as the backbone network to extract features from the input cable connector image. The ConvNeXt V2 backbone network consists of five consecutive downsampling feature extraction stages. A multi-scale attention module is introduced between adjacent feature extraction stages of ConvNeXt V2 to enhance the output features of the previous stage and use the enhanced features as the input of the next stage.

3. The deep learning-based process-aware cable connector visual recognition method according to claim 2, characterized in that, The backbone feature extraction layer uses three sets of features from different semantic levels of ConvNeXt V2 as the final output of the backbone network.

4. The deep learning-based process-aware cable connector visual recognition method according to claim 1, characterized in that, The feature enhancement layer is based on a feature pyramid network, and a simplified self-attention module is introduced at the feature interaction position of each layer of the pyramid. This module is used to adaptively enhance the features of each layer before transmission and fusion, and obtain multi-scale features, which serve as the input basis for the subsequent feature representation construction and judgment module.

5. The deep learning-based process-aware cable connector visual recognition method according to claim 4, characterized in that, The process feature linear modulation module includes a dual-branch input structure with visual feature branch and process feature branch, as well as an independent parameter generation branch; The independent parameter generation branch is used to generate modulation parameters from the process description information in the production process; the visual feature branch is used to form a visual feature embedding sequence from the multi-scale features output by the feature enhancement layer; and the process feature branch is used to generate a process embedding sequence corresponding to the visual feature embedding sequence. The process feature linear modulation module concatenates the visual feature embedding sequence with the process embedding sequence and generates joint features through linear mapping. Based on the modulation parameters, a channel-wise linear modulation operation is performed on the joint features to obtain the modulated feature sequence. The modulated feature sequence is then processed by a lightweight feature modeling module to obtain process-aware features. The lightweight feature modeling module includes a self-attention layer and a feedforward network.

6. The deep learning-based process-aware cable connector visual recognition method according to claim 5, characterized in that, The process feature linear modulation module further includes: remapping the process-aware features back to the feature map space according to their corresponding scales, restoring them to a multi-scale feature representation, and obtaining the process-aware multi-scale features.

7. The deep learning-based process-aware cable connector visual recognition method according to claim 1, characterized in that, The anchorless detection head has three independent prediction branches: a classification branch, a regression branch, and a centrality branch. Each branch consists of multiple convolutional operators connected in series and outputs the corresponding prediction result at the end. The classification branch is used to predict the cable connector type corresponding to the current position; the regression branch is used to predict the distance from the current position to the target boundary; and the centrality branch is used to measure whether the current position is close to the geometric center of the target.

8. The deep learning-based process-aware cable connector visual recognition method according to claim 1, characterized in that, The loss function used for training is constructed by creating a joint loss function consisting of classification loss, boundary regression loss, and centrality loss.

9. The deep learning-based process-aware cable connector visual recognition method according to claim 8, characterized in that, During training, based on the multi-scale feature map output by the feature pyramid network, the spatial locations on each scale feature layer are divided into samples. When any feature location is inside the actual cable connector annotation box, the location is regarded as a positive sample, and the rest are regarded as negative samples. The positive sample locations are used to participate in the loss calculation of category prediction, boundary regression and centrality prediction.

10. A system for the deep learning-based process-aware cable connector visual recognition method as described in claim 1, characterized in that, include: The data acquisition module is used to acquire cable connectors on the assembly station using an industrial camera. At the same time, it configures corresponding structured text annotations for each acquired image to obtain a cable connector image dataset. A network construction module is used to build a network model based on attention mechanisms and process modulation. The network model sequentially includes a backbone feature extraction layer, a feature enhancement layer, a process feature modulation layer, and an anchorless detection layer. The backbone feature extraction layer uses an improved convolutional neural network as the backbone network, coupled with a multi-scale attention module, to extract multi-scale feature representations. The feature enhancement layer uses a feature pyramid network equipped with a simplified self-attention module to adaptively enhance the saliency of cable connector edges and local details in spatial and channel dimensions. The process feature modulation layer uses a process feature linear modulation module to embed production line processes and flow information into the visual representation and modulate it layer by layer according to channel, ensuring that the network's visual inference is consistent with the expected assembly process constraints. The anchorless detection layer is an anchorless detection head built using a single-stage target detection algorithm, which outputs the detection results of the cable connector by predicting the class probability, bounding box coordinates, and centrality score. The network training module is used to construct the loss function for training and train the network model using a cable connector image dataset to obtain the trained network model. The recognition module is used to output the detection results of the cable connectors by passing the images of the cable connectors to be recognized through a trained network model.

Images