Real-time monitoring method and system for PCB copper electroplating quality based on video image processing

Through video image processing technology, the PCB copper deposited electroplating model is used for feature recognition and comparison, which solves the problem of insufficient real-time and misjudgment of the quality of PCB copper deposited electroplating by artificial visual evaluation, and achieves high-precision real-time monitoring.

CN118671096BActive Publication Date: 2024-11-15SICHUAN HONGAN XINGSHENG ELECTRONIC TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411116954.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-15
Publication Date
2024-11-15
Estimated Expiration
2044-08-15

AI Technical Summary

Technical Problem

In the prior art, there is a risk of real-time inadequate and misjudgment in the quality of PCB deposited copper plating through manual visual assessment, making it difficult to achieve accurate and objective assessment.

Method used

Using a video image processing method, the copper plating feature identification and extraction process, the feature corresponding area comparison process is carried out through the PCB copper plating model, and a monitoring report is generated to achieve real-time monitoring of the PCB copper plating quality.

Benefits of technology

Real-time monitoring of the PCB copper plating quality is realized, the accuracy and reliability of detection are improved, the calculation and processing load of image signal data is reduced, and the reliability and accuracy of feature recognition are ensured.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118671096B_ABST
    Figure CN118671096B_ABST
Patent Text Reader

Abstract

The invention discloses a real-time monitoring method and system for PCB copper electroplating quality based on video image processing, comprising the following steps: acquiring PCB copper electroplating video image signal data information based on a time series, and preprocessing the copper electroplating image signal based on a PCB copper electroplating model; performing copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing result based on the PCB copper electroplating model; performing feature corresponding area comparison processing on the copper electroplating feature recognition and extraction processing result and the copper electroplating image signal of other time series based on the PCB copper electroplating model; performing PCB copper electroplating quality determination processing and generating a monitoring report based on the copper electroplating feature recognition and extraction processing result and the corresponding area comparison processing result; realizing copper electroplating feature recognition and feature corresponding area comparison processing based on the PCB copper electroplating model, and generating a monitoring report can monitor the PCB copper electroplating quality in real time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of circuit board quality detection, and in particular to a method and system for real-time monitoring of PCB copper electroplating quality based on video image processing. Background Art

[0002] At present, most of the PCB copper plating quality is evaluated by manual visual inspection. However, this method of evaluating the quality of PCB copper plating by manual visual inspection cannot detect the quality of PCB copper plating online in real time on the production line. In addition, due to long-term manual visual inspection of PCB copper plating quality, it is inevitable that there will be misjudgments in quality evaluation due to fatigue and lack of concentration, and the quality of PCB copper plating cannot be accurately and objectively evaluated. Summary of the invention

[0003] In order to overcome the shortcomings of the prior art, the present invention provides a real-time monitoring method and system for PCB copper electroplating quality based on video image processing, which realizes real-time monitoring of PCB copper electroplating quality by performing copper electroplating feature recognition and extraction processing based on a PCB copper electroplating model, feature corresponding area comparison processing, and generating a monitoring report.

[0004] In order to achieve the above-mentioned object of the invention, the present invention adopts the following technical solutions:

[0005] The first aspect of the present application provides a real-time monitoring method for PCB copper electroplating quality based on video image processing, comprising the following steps:

[0006] S101, acquiring PCB copper electroplating video image signal data information based on a time series, and performing copper electroplating image signal preprocessing based on a PCB copper electroplating model;

[0007] S102, performing copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing result based on the PCB copper electroplating model;

[0008] S103, based on the PCB copper electroplating model, the copper electroplating feature recognition and extraction processing results and the copper electroplating image signals of other time series are compared with the feature corresponding areas;

[0009] S104: Based on the copper plating feature recognition and extraction processing results and the corresponding area comparison processing results, PCB copper plating quality determination processing is performed and a monitoring report is generated.

[0010] Furthermore, the PCB copper plating model construction includes the following steps:

[0011] Obtain historical data information of PCB copper electroplating video image signals, and perform copper electroplating image signal preprocessing;

[0012] Perform copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing results;

[0013] Based on the copper electroplating feature recognition and extraction processing results, the copper electroplating image signals of other time series are obtained, and the feature corresponding area comparison processing is performed;

[0014] Based on the copper plating feature recognition and extraction processing results and the corresponding area comparison processing results, the PCB copper plating initial model is trained;

[0015] If the model training results are the same as the training sample results, the model training is completed; if the model training results are different from the training sample results, the model training is repeated.

[0016] Further, obtaining PCB copper electroplating video image signal data information based on the time series, and preprocessing the copper electroplating image signal based on the PCB copper electroplating model includes the following steps:

[0017] Image denoising is performed on PCB copper plating image signals based on the PCB copper plating model;

[0018] Perform image segmentation on the PCB copper plating image signal after image denoising to remove the background area;

[0019] Performing regional coordinate marking processing on the PCB copper plating image signal after the background area is removed;

[0020] The PCB copper plating image signal processed by the regional coordinate marking is subjected to regional local segmentation processing, the area without copper plating is removed, and the area only containing copper plating is retained.

[0021] Further, the copper plating feature recognition and extraction processing of the copper plating image signal preprocessing result based on the PCB copper plating model includes the following steps:

[0022] Perform continuous line segment feature recognition and serial number marking on the copper plating area;

[0023] Identify and extract the scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features of the continuous line segments marked with serial numbers;

[0024] The scratch features, disconnection features, electroplating pit features, roughness features, copper particle protrusion features, short circuit features, and copper color difference features that have been extracted and processed by feature recognition are subjected to feature area calculation.

[0025] Furthermore, based on the PCB copper electroplating model, the copper electroplating feature recognition and extraction processing results and the copper electroplating image signals of other time series are compared with the corresponding feature areas, including the following steps:

[0026] The PCB copper plating model selects the corresponding feature areas of the copper plating image signals of other time series based on the copper plating feature recognition and extraction processing results;

[0027] Perform feature recognition and feature area calculation on the selected feature corresponding area;

[0028] Compare the area of ​​the identified feature region with the result of copper plating feature recognition and extraction;

[0029] If the feature region area comparison value is greater than or equal to the feature region area setting threshold, it is determined that the copper electroplating feature recognition and extraction processing result contains the compared feature; otherwise, it is determined that the copper electroplating feature recognition and extraction processing result does not contain the compared feature.

[0030] Further, based on the copper plating feature recognition and extraction processing results and the corresponding area comparison processing results, the PCB copper plating quality determination processing and generation of a monitoring report include the following steps:

[0031] If the copper electroplating feature recognition and extraction results contain scratch features, electroplating pit features, rough features, and copper grain protrusion features, the PCB copper electroplating defect level is determined based on the number of features and the size of the area, and a report is generated;

[0032] If the copper electroplating feature recognition and extraction results show open circuit features, short circuit features, and copper color difference features, the PCB copper electroplating is judged to be unqualified and a report is generated;

[0033] If the compared features do not exist in the copper plating feature identification and extraction processing results, the PCB copper plating is judged to be qualified and a report is generated.

[0034] The second aspect of the present application provides a real-time monitoring system for PCB copper electroplating quality based on video image processing, comprising:

[0035] A data acquisition unit, used for acquiring PCB copper plating video image signal data information based on a time series;

[0036] Model building unit, used to build PCB copper electroplating model;

[0037] The first processing unit is used to perform copper electroplating image signal preprocessing on the PCB copper electroplating video image signal data information based on the PCB copper electroplating model;

[0038] The second processing unit is used to perform copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing result based on the PCB copper electroplating model;

[0039] The third processing unit is used to compare the copper electroplating feature recognition and extraction processing results and the copper electroplating image signals of other time series with the feature corresponding areas based on the PCB copper electroplating model;

[0040] The fourth processing unit is used to perform PCB copper plating quality determination processing and generate a monitoring report based on the copper plating feature identification and extraction processing results and the corresponding area comparison processing results.

[0041] Furthermore, the model building unit is used to build a PCB copper plating model, and the PCB copper plating model building includes:

[0042] Obtain historical data information of PCB copper electroplating video image signals, and perform copper electroplating image signal preprocessing;

[0043] Perform copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing results;

[0044] Based on the copper electroplating feature recognition and extraction processing results, the copper electroplating image signals of other time series are obtained, and the feature corresponding area comparison processing is performed;

[0045] Based on the copper plating feature recognition and extraction processing results and the corresponding area comparison processing results, the PCB copper plating initial model is trained;

[0046] If the model training results are the same as the training sample results, the model training is completed; if the model training results are different from the training sample results, the model training is repeated.

[0047] Further, the first processing unit performs copper plating image signal preprocessing on the PCB copper plating video image signal data information based on the PCB copper plating model, including:

[0048] Image denoising is performed on PCB copper plating image signals based on the PCB copper plating model;

[0049] Perform image segmentation on the PCB copper plating image signal after image denoising to remove the background area;

[0050] Performing regional coordinate marking processing on the PCB copper plating image signal after the background area is removed;

[0051] The PCB copper plating image signal processed by the regional coordinate marking is subjected to regional local segmentation processing, the area without copper plating is removed, and the area only containing copper plating is retained.

[0052] Furthermore, the second processing unit performs copper plating feature recognition and extraction processing on the copper plating image signal preprocessing result based on the PCB copper plating model, including:

[0053] Perform continuous line segment feature recognition and serial number marking on the copper plating area;

[0054] Identify and extract the scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features of the continuous line segments marked with serial numbers;

[0055] The scratch features, disconnection features, electroplating pit features, roughness features, copper particle protrusion features, short circuit features, and copper color difference features that have been extracted and processed by feature recognition are subjected to feature area calculation.

[0056] Furthermore, the third processing unit performs feature corresponding area comparison processing on the copper plating feature recognition and extraction processing result and the copper plating image signal of other time series based on the PCB copper plating model, including:

[0057] The PCB copper plating model selects the corresponding feature areas of the copper plating image signals of other time series based on the copper plating feature recognition and extraction processing results;

[0058] Perform feature recognition and feature area calculation on the selected feature corresponding area;

[0059] Compare the area of ​​the identified feature region with the result of copper plating feature recognition and extraction;

[0060] If the feature region area comparison value is greater than or equal to the feature region area setting threshold, it is determined that the copper electroplating feature recognition and extraction processing result contains the compared feature; otherwise, it is determined that the copper electroplating feature recognition and extraction processing result does not contain the compared feature.

[0061] Furthermore, the fourth processing unit performs PCB copper plating quality determination processing and generates a monitoring report based on the copper plating feature identification and extraction processing results and the corresponding area comparison processing results, including:

[0062] If the copper electroplating feature recognition and extraction results contain scratch features, electroplating pit features, rough features, and copper grain protrusion features, the PCB copper electroplating defect level is determined based on the number of features and the size of the area, and a report is generated;

[0063] If the copper electroplating feature recognition and extraction results show open circuit features, short circuit features, and copper color difference features, the PCB copper electroplating is judged to be unqualified and a report is generated;

[0064] If the compared features do not exist in the copper plating feature identification and extraction processing results, the PCB copper plating is judged to be qualified and a report is generated.

[0065] The beneficial effects of the present application are as follows: the copper plating quality of the PCB can be monitored in real time by performing copper plating feature identification and extraction processing based on the PCB copper plating model, feature corresponding area comparison processing, and generating a monitoring report.

[0066] By removing the background area in the PCB copper plating image signal, the image signal data calculation processing load can be reduced. By performing regional coordinate marking processing on the PCB copper plating image signal after the background area is removed, the PCB copper plating image can be coordinateized, thereby ensuring the accuracy of subsequent copper plating feature recognition and feature area calculation processing. By performing regional local segmentation processing on the PCB copper plating image signal after regional coordinate marking processing, the area without copper plating is removed and the area only containing copper plating is retained, which can further reduce the image signal data calculation processing load.

[0067] The continuous line segment feature recognition and serial number marking processing of the copper electroplating area is realized. When the copper electroplating feature recognition and extraction processing results are compared with the copper electroplating image signals of other time series based on the PCB copper electroplating model, the speed of feature corresponding area comparison processing is greatly improved. The scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features that have been processed by feature recognition and extraction are calculated and processed in the feature area, which greatly ensures the reliability of copper electroplating feature recognition.

[0068] By comparing the area of ​​the identified feature region with the result of copper plating feature recognition and extraction, the accuracy and reliability of the PCB copper plating model in identifying the copper plating features of the PCB copper plating image signal are greatly improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0070] Figure 1 It is a schematic diagram of the steps of the real-time monitoring method of PCB copper electroplating quality based on video image processing of the present invention. DETAILED DESCRIPTION

[0071] The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0072] The following describes the embodiments of the present invention through specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work belong to the scope of protection of the present invention.

[0073] Embodiment 1:

[0074] The real-time monitoring method of PCB copper electroplating quality based on video image processing includes the following steps:

[0075] S101, acquiring PCB copper electroplating video image signal data information based on a time series, and performing copper electroplating image signal preprocessing based on a PCB copper electroplating model;

[0076] The video image signal data information of PCB copper electroplating is obtained based on the time series, and a PCB copper electroplating model is constructed. The PCB copper electroplating image signal preprocessing is performed based on the PCB copper electroplating model to obtain the PCB copper electroplating image signal preprocessing result.

[0077] The construction of PCB copper plating model includes the following steps:

[0078] Obtain historical data information of PCB copper electroplating video image signals, and perform copper electroplating image signal preprocessing;

[0079] Perform copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing results;

[0080] Based on the copper electroplating feature recognition and extraction processing results, the copper electroplating image signals of other time series are obtained, and the feature corresponding area comparison processing is performed;

[0081] Based on the copper plating feature recognition and extraction processing results and the corresponding area comparison processing results, the PCB copper plating initial model is trained;

[0082] If the model training results are the same as the training sample results, the model training is completed; if the model training results are different from the training sample results, the model training is repeated.

[0083] Acquiring PCB copper electroplating video image signal data information based on time series, and preprocessing the copper electroplating image signal based on the PCB copper electroplating model includes the following steps:

[0084] Image denoising is performed on PCB copper plating image signals based on the PCB copper plating model;

[0085] Perform image segmentation on the PCB copper plating image signal after image denoising to remove the background area;

[0086] Performing regional coordinate marking processing on the PCB copper plating image signal after the background area is removed;

[0087] The PCB copper plating image signal processed by the regional coordinate marking is subjected to regional local segmentation processing, the area without copper plating is removed, and the area only containing copper plating is retained.

[0088] It should be noted that the PCB copper plating image signal that has been processed by image denoising is subjected to image segmentation processing to remove the background area. By removing the background area in the PCB copper plating image signal, the image signal data calculation processing load can be reduced. By performing regional coordinate marking processing on the PCB copper plating image signal after the background area is removed, the PCB copper plating image can be coordinateized, thereby ensuring the accuracy of subsequent copper plating feature recognition and feature area calculation processing. By performing regional local segmentation processing on the PCB copper plating image signal that has been processed by regional coordinate marking, the area without copper plating is removed, and the area containing only copper plating is retained, the image signal data calculation processing load can be further reduced.

[0089] S102, performing copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing result based on the PCB copper electroplating model;

[0090] Based on the time series, the video image signal data information of PCB copper electroplating is obtained, and the copper electroplating image signal preprocessing is performed on the video image signal data information of PCB copper electroplating through the PCB copper electroplating model to obtain the copper electroplating image signal preprocessing result, and the copper electroplating feature recognition processing is performed on the copper electroplating image signal preprocessing result through the PCB copper electroplating model. The copper electroplating feature recognition and extraction processing includes scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features.

[0091] Based on the PCB copper plating model, the copper plating feature recognition and extraction processing of the copper plating image signal preprocessing results includes the following steps:

[0092] Perform continuous line segment feature recognition and serial number marking on the copper plating area;

[0093] Identify and extract the scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features of the continuous line segments marked with serial numbers;

[0094] The scratch features, disconnection features, electroplating pit features, roughness features, copper particle protrusion features, short circuit features, and copper color difference features that have been extracted and processed by feature recognition are subjected to feature area calculation.

[0095] It should be noted that by performing continuous line segment feature recognition and serial number marking processing on the copper plating area, when the copper plating feature recognition and extraction processing results are compared with the copper plating image signals of other time series based on the PCB copper plating model, the speed of feature corresponding area comparison processing is greatly improved. By calculating the area of ​​the feature area of ​​the scratch features, disconnection features, electroplating pit features, roughness features, copper particle protrusion features, short circuit features, and copper color difference features that have been processed by feature recognition and extraction, the reliability of copper plating feature recognition is greatly guaranteed. The disconnection feature refers to the original continuous line segment being divided into two or more sub-strip continuous line segments, and the short circuit feature refers to the original continuous line segments without connection but with one or more connection phenomena. The copper color difference feature refers to the copper color difference caused by serious pollution in the copper plating process.

[0096] S103, based on the PCB copper electroplating model, the copper electroplating feature recognition and extraction processing results and the copper electroplating image signals of other time series are compared with the feature corresponding areas;

[0097] By performing copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing results based on the PCB copper electroplating model, the copper electroplating feature recognition and extraction processing results are obtained. By performing corresponding area comparison processing on the copper electroplating feature recognition and extraction processing results and other time series copper electroplating image signals based on the PCB copper electroplating model, the corresponding area comparison processing results are obtained.

[0098] Based on the PCB copper plating model, the copper plating feature recognition and extraction processing results and the copper plating image signals of other time series are compared with the corresponding feature areas, including the following steps:

[0099] The PCB copper plating model selects the corresponding feature areas of the copper plating image signals of other time series based on the copper plating feature recognition and extraction processing results;

[0100] Perform feature recognition and feature area calculation on the selected feature corresponding area;

[0101] Compare the area of ​​the identified feature region with the result of copper plating feature recognition and extraction;

[0102] If the feature region area comparison value is greater than or equal to the feature region area setting threshold, it is determined that the copper electroplating feature recognition and extraction processing result contains the compared feature; otherwise, it is determined that the copper electroplating feature recognition and extraction processing result does not contain the compared feature.

[0103] It should be noted that by comparing the area of ​​the identified feature region with the copper plating feature recognition and extraction processing results, the accuracy and reliability of the PCB copper plating model in identifying the copper plating features of the PCB copper plating image signal are greatly improved.

[0104] S104, based on the copper plating feature recognition and extraction processing results and the corresponding area comparison processing results, perform PCB copper plating quality determination processing and generate a monitoring report;

[0105] Based on the PCB copper electroplating model, the copper electroplating feature recognition and extraction processing results are compared with the copper electroplating image signals of other time series, and the feature corresponding area comparison processing results are obtained to determine whether the compared features exist in the copper electroplating feature recognition and extraction processing results. Based on the copper electroplating feature recognition and extraction processing and the corresponding area comparison processing results, the PCB copper electroplating quality judgment processing is performed and a monitoring report is generated.

[0106] Based on the copper plating feature recognition and extraction processing results and the corresponding area comparison processing results, the PCB copper plating quality determination processing and generation of a monitoring report include the following steps:

[0107] If the copper electroplating feature recognition and extraction results contain scratch features, electroplating pit features, rough features, and copper grain protrusion features, the PCB copper electroplating defect level is determined based on the number of features and the size of the area, and a report is generated;

[0108] If the copper electroplating feature recognition and extraction results show open circuit features, short circuit features, and copper color difference features, the PCB copper electroplating is judged to be unqualified and a report is generated;

[0109] If the compared features do not exist in the copper plating feature identification and extraction processing results, the PCB copper plating is judged to be qualified and a report is generated.

[0110] It should be noted that the poor copper plating level of the PCB is determined based on the number of features and the size of the area. The determination method of the poor copper plating level of the PCB can be specifically set according to the actual usage. Any determination method that determines the poor copper plating level of the PCB based on the number of features and the size of the area falls within the protection scope of the present invention.

[0111] Embodiment 2:

[0112] The above is a real-time monitoring method for PCB copper plating quality based on video image processing provided in an embodiment of the present application. The following is a real-time monitoring system for PCB copper plating quality based on video image processing provided in an embodiment of the present application.

[0113] The real-time monitoring system for PCB copper electroplating quality based on video image processing includes:

[0114] A data acquisition unit, used for acquiring PCB copper plating video image signal data information based on a time series;

[0115] Model building unit, used to build PCB copper electroplating model;

[0116] The first processing unit is used to perform copper electroplating image signal preprocessing on the PCB copper electroplating video image signal data information based on the PCB copper electroplating model;

[0117] The second processing unit is used to perform copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing result based on the PCB copper electroplating model;

[0118] The third processing unit is used to compare the copper electroplating feature recognition and extraction processing results and the copper electroplating image signals of other time series with the feature corresponding areas based on the PCB copper electroplating model;

[0119] The fourth processing unit is used to perform PCB copper plating quality determination processing and generate a monitoring report based on the copper plating feature identification and extraction processing results and the corresponding area comparison processing results.

[0120] The model building unit is used to build a PCB copper plating model. The PCB copper plating model building includes:

[0121] Obtain historical data information of PCB copper electroplating video image signals, and perform copper electroplating image signal preprocessing;

[0122] Perform copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing results;

[0123] Based on the copper electroplating feature recognition and extraction processing results, the copper electroplating image signals of other time series are obtained, and the feature corresponding area comparison processing is performed;

[0124] Based on the copper plating feature recognition and extraction processing results and the corresponding area comparison processing results, the PCB copper plating initial model is trained;

[0125] If the model training results are the same as the training sample results, the model training is completed; if the model training results are different from the training sample results, the model training is repeated.

[0126] The first processing unit is used to perform copper electroplating image signal preprocessing on PCB copper electroplating video image signal data information based on the PCB copper electroplating model, including:

[0127] Image denoising is performed on PCB copper plating image signals based on the PCB copper plating model;

[0128] Perform image segmentation on the PCB copper plating image signal after image denoising to remove the background area;

[0129] Performing regional coordinate marking processing on the PCB copper plating image signal after the background area is removed;

[0130] The PCB copper plating image signal processed by the regional coordinate marking is subjected to regional local segmentation processing, the area without copper plating is removed, and the area only containing copper plating is retained.

[0131] It should be noted that the PCB copper plating image signal that has been processed by image denoising is subjected to image segmentation processing to remove the background area. By removing the background area in the PCB copper plating image signal, the image signal data calculation processing load can be reduced. By performing regional coordinate marking processing on the PCB copper plating image signal after the background area is removed, the PCB copper plating image can be coordinateized, thereby ensuring the accuracy of subsequent copper plating feature recognition and feature area calculation processing. By performing regional local segmentation processing on the PCB copper plating image signal that has been processed by regional coordinate marking, the area without copper plating is removed, and the area containing only copper plating is retained, the image signal data calculation processing load can be further reduced.

[0132] The second processing unit is used to perform copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing result based on the PCB copper electroplating model. The PCB copper electroplating video image signal data information is obtained based on the time series, and the PCB copper electroplating video image signal data information is preprocessed by the PCB copper electroplating model to obtain the copper electroplating image signal preprocessing result, and the copper electroplating feature recognition processing is performed on the copper electroplating image signal preprocessing result by the PCB copper electroplating model. The copper electroplating feature recognition and extraction processing includes scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features.

[0133] The second processing unit is used to perform copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing result based on the PCB copper electroplating model, including:

[0134] Perform continuous line segment feature recognition and serial number marking on the copper plating area;

[0135] Identify and extract the scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features of the continuous line segments marked with serial numbers;

[0136] The scratch features, disconnection features, electroplating pit features, roughness features, copper particle protrusion features, short circuit features, and copper color difference features that have been extracted and processed by feature recognition are subjected to feature area calculation.

[0137] It should be noted that by performing continuous line segment feature recognition and serial number marking processing on the copper plating area, when the copper plating feature recognition and extraction processing results are compared with the copper plating image signals of other time series based on the PCB copper plating model, the speed of feature corresponding area comparison processing is greatly improved. By calculating the area of ​​the feature area of ​​the scratch features, disconnection features, electroplating pit features, roughness features, copper particle protrusion features, short circuit features, and copper color difference features that have been processed by feature recognition and extraction, the reliability of copper plating feature recognition is greatly guaranteed. The disconnection feature refers to the original continuous line segment being divided into two or more sub-strip continuous line segments, and the short circuit feature refers to the original continuous line segments without connection but with one or more connection phenomena. The copper color difference feature refers to the copper color difference caused by serious pollution in the copper plating process.

[0138] The third processing unit is used to compare the copper electroplating feature recognition and extraction processing results with the copper electroplating image signals of other time series based on the PCB copper electroplating model, and perform feature corresponding area comparison processing. The copper electroplating feature recognition and extraction processing results are obtained by performing feature recognition and extraction processing on the copper electroplating image signal preprocessing results based on the PCB copper electroplating model, and the corresponding area comparison processing is performed on the copper electroplating feature recognition and extraction processing results with the copper electroplating image signals of other time series based on the PCB copper electroplating model to obtain the corresponding area comparison processing results.

[0139] The third processing unit is used to compare the feature corresponding area of ​​the copper plating feature recognition and extraction processing results with the copper plating image signals of other time series based on the PCB copper plating model, including:

[0140] The PCB copper plating model selects the corresponding feature areas of the copper plating image signals of other time series based on the copper plating feature recognition and extraction processing results;

[0141] Perform feature recognition and feature area calculation on the selected feature corresponding area;

[0142] Compare the area of ​​the identified feature region with the result of copper plating feature recognition and extraction;

[0143] If the feature region area comparison value is greater than or equal to the feature region area setting threshold, it is determined that the copper electroplating feature recognition and extraction processing result contains the compared feature; otherwise, it is determined that the copper electroplating feature recognition and extraction processing result does not contain the compared feature.

[0144] It should be noted that by comparing the area of ​​the identified feature region with the copper plating feature recognition and extraction processing results, the accuracy and reliability of the PCB copper plating model in identifying the copper plating features of the PCB copper plating image signal are greatly improved.

[0145] The fourth processing unit is used to perform PCB copper electroplating quality judgment processing and generate a monitoring report based on the copper electroplating feature recognition extraction processing results and the corresponding area comparison processing results. Based on the PCB copper electroplating model, the copper electroplating feature recognition extraction processing results and the copper electroplating image signals of other time series are compared with the feature corresponding area to obtain the feature corresponding area comparison processing results to determine whether the copper electroplating feature recognition extraction processing results have the compared features. Based on the copper electroplating feature recognition extraction processing and the corresponding area comparison processing results, the PCB copper electroplating quality judgment processing is performed and a monitoring report is generated.

[0146] The fourth processing unit is used to perform PCB copper plating quality determination processing and generate a monitoring report based on the copper plating feature identification and extraction processing results and the corresponding area comparison processing results, including:

[0147] If the copper electroplating feature recognition and extraction results contain scratch features, electroplating pit features, rough features, and copper grain protrusion features, the PCB copper electroplating defect level is determined based on the number of features and the size of the area, and a report is generated;

[0148] If the copper electroplating feature recognition and extraction results show open circuit features, short circuit features, and copper color difference features, the PCB copper electroplating is judged to be unqualified and a report is generated;

[0149] If the compared features do not exist in the copper plating feature identification and extraction processing results, the PCB copper plating is judged to be qualified and a report is generated.

[0150] It should be noted that the poor copper plating level of the PCB is determined based on the number of features and the size of the area. The determination method of the poor copper plating level of the PCB can be specifically set according to the actual usage. Any determination method that determines the poor copper plating level of the PCB based on the number of features and the size of the area falls within the protection scope of the present invention.

[0151] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0152] The terms "first", "second" and "third" etc. in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0153] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0154] Each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0155] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A real-time monitoring method for PCB copper electroplating quality based on video image processing, characterized in that: The following steps are involved: S101, acquiring PCB copper electroplating video image signal data information based on a time series, and performing copper electroplating image signal preprocessing based on a PCB copper electroplating model; S102, performing copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing result based on the PCB copper electroplating model; S103, performing feature corresponding area comparison processing on the copper electroplating feature recognition and extraction processing results and the copper electroplating image signals of different time series based on the PCB copper electroplating model; S104, based on the copper plating feature recognition and extraction processing results and the corresponding area comparison processing results, perform PCB copper plating quality determination processing and generate a monitoring report; The method of acquiring PCB copper electroplating video image signal data information based on a time series and preprocessing the copper electroplating image signal based on a PCB copper electroplating model comprises the following steps: Based on the PCB copper electroplating model, the PCB copper electroplating image signal is subjected to image denoising; Perform image segmentation on the PCB copper plating image signal after image denoising to remove the background area; Performing regional coordinate marking processing on the PCB copper plating image signal after the background area is removed; Performing regional local segmentation processing on the PCB copper plating image signal processed by regional coordinate marking, removing the area without copper plating, and retaining the area with only copper plating; The copper electroplating feature recognition and extraction processing of the copper electroplating image signal preprocessing result based on the PCB copper electroplating model includes the following steps: Perform continuous line segment feature recognition and serial number marking on the copper plating area; Identify and extract the scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features of the continuous line segments marked with serial numbers; The scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features extracted and processed by feature recognition are processed for feature area calculation; The method of comparing the feature corresponding area of ​​the copper electroplating feature recognition and extraction processing results with the copper electroplating image signals of different time series based on the PCB copper electroplating model includes the following steps: The PCB copper plating model selects the corresponding feature areas of the copper plating image signals of different time series based on the copper plating feature recognition and extraction processing results; Perform feature recognition and feature area calculation on the selected feature corresponding area; Compare the area of ​​the identified feature region with the result of copper plating feature recognition and extraction; If the feature region area comparison value is greater than or equal to the feature region area setting threshold, it is determined that the copper electroplating feature recognition and extraction processing result contains the compared feature; otherwise, it is determined that the copper electroplating feature recognition and extraction processing result does not contain the compared feature.

2. The real-time monitoring method for PCB copper electroplating quality based on video image processing according to claim 1 is characterized in that: The PCB copper plating model construction includes the following steps: Obtain historical data information of PCB copper electroplating video image signals, and perform copper electroplating image signal preprocessing; Perform copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing results; Based on the copper electroplating feature recognition and extraction processing results, copper electroplating image signals of different time series are obtained, and feature corresponding area comparison processing is performed; Based on the copper plating feature recognition and extraction processing results and the corresponding area comparison processing results, the PCB copper plating initial model is trained; If the model training results are the same as the training sample results, the model training is completed; if the model training results are different from the training sample results, the model training is repeated.

3. The real-time monitoring method for PCB copper plating quality based on video image processing according to claim 1 is characterized in that: The method of performing PCB copper plating quality determination processing and generating a monitoring report based on the copper plating feature identification and extraction processing results and the corresponding area comparison processing results includes the following steps: If the copper electroplating feature recognition and extraction results contain scratch features, electroplating pit features, rough features, and copper grain protrusion features, the PCB copper electroplating defect level is determined based on the number of features and the size of the area, and a report is generated; If the copper electroplating feature recognition and extraction results show open circuit features, short circuit features, and copper color difference features, the PCB copper electroplating is judged to be unqualified and a report is generated; If the compared features are not found in the copper plating feature identification and extraction processing results, the PCB copper plating is judged to be qualified and a report is generated.

4. The real-time monitoring system for PCB copper electroplating quality based on video image processing is characterized by: include: A data acquisition unit, used for acquiring PCB copper plating video image signal data information based on a time series; Model building unit, used to build PCB copper electroplating model; The first processing unit is used to perform copper electroplating image signal preprocessing on the PCB copper electroplating video image signal data information based on the PCB copper electroplating model; The second processing unit is used to perform copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing result based on the PCB copper electroplating model; The third processing unit is used to compare the feature corresponding area of ​​the copper electroplating feature recognition and extraction processing results with the copper electroplating image signals of different time series based on the PCB copper electroplating model; A fourth processing unit, for performing PCB copper plating quality determination processing and generating a monitoring report based on the copper plating feature identification and extraction processing results and the corresponding area comparison processing results; The first processing unit performs copper plating image signal preprocessing on the PCB copper plating video image signal data information based on the PCB copper plating model, including: Based on the PCB copper electroplating model, the PCB copper electroplating image signal is subjected to image denoising; Perform image segmentation on the PCB copper plating image signal after image denoising to remove the background area; Performing regional coordinate marking processing on the PCB copper plating image signal after the background area is removed; Performing regional local segmentation processing on the PCB copper plating image signal processed by regional coordinate marking, removing the area without copper plating, and retaining the area with only copper plating; The second processing unit performs copper electroplating feature recognition and extraction processing on the copper electroplating image signal preprocessing result based on the PCB copper electroplating model, including: Perform continuous line segment feature recognition and serial number marking on the copper plating area; Identify and extract the scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features of the continuous line segments marked with serial numbers; The scratch features, disconnection features, electroplating pit features, roughness features, copper grain protrusion features, short circuit features, and copper color difference features extracted and processed by feature recognition are processed for feature area calculation; The third processing unit performs feature corresponding area comparison processing on the copper plating feature recognition and extraction processing result and the copper plating image signal of different time series based on the PCB copper plating model, including: The PCB copper plating model selects the corresponding feature areas of the copper plating image signals of different time series based on the copper plating feature recognition and extraction processing results; Perform feature recognition and feature area calculation on the selected feature corresponding area; Compare the area of ​​the identified feature region with the result of copper plating feature recognition and extraction; If the feature region area comparison value is greater than or equal to the feature region area setting threshold, it is determined that the copper electroplating feature recognition and extraction processing result contains the compared feature; otherwise, it is determined that the copper electroplating feature recognition and extraction processing result does not contain the compared feature.