Metrology Qualification of Non-Destructive Testing Systems

Abstract

To provide a method for performing metrology qualification of a non-destructive inspection (NDI) ultrasonic system.SOLUTION: A method includes performing, by the NDI ultrasonic system, an ultrasonic scanning operation on a calibration coupon. The ultrasonic scanning operation generates a scan signal. The method also includes superimposing a time-domain qualification mask on the scan signal, and determining whether the scan signal is within the time-domain qualification mask. The method also includes validating a porosity sensitivity of the NDI ultrasonic system using a frequency-domain qualification mask. The method additionally includes qualifying the NDI ultrasonic system in response to the scan signal being within the time-domain qualification mask for a portion of the calibration coupon without a defect and the scan signal being above the time-domain qualification mask for another portion of the calibration coupon including the defect, as well as the porosity sensitivity of the NDI ultrasonic system being validated.SELECTED DRAWING: None

Description

[Technical field]

[0001] The present disclosure relates to non-destructive testing (NDI) systems, and more particularly, to a method and system for metrology qualification of NDI ultrasonic systems. [Background technology]

[0002] NDI ultrasonic inspection systems are qualified via an experimental method that uses an NDI reference standard to calibrate and qualify the NDI ultrasonic inspection system. This experimental method has a low first pass quality rate due to variability in the physical reference standard and the NDI ultrasonic system. All NDI ultrasonic inspection qualifications are custom. Linear array transducers for NDI ultrasonic inspection systems cost $5,000 to $10,000 each and are custom-made. There are limited suppliers of these systems and lead times for development can exceed a year. Improved methods and systems for qualification of NDI inspection systems are needed. Summary of the Invention

[0003] According to one embodiment, a method for performing metrology qualification of a non-destructive testing (NDI) ultrasonic system and / or an NDI ultrasonic transducer includes performing an ultrasonic scanning operation on a calibration coupon by the NDI ultrasonic system. The ultrasonic scanning operation generates a scan signal. The method also includes overlaying a time domain qualification mask on the scan signal and evaluating the scan signal using the time domain qualification mask. The method further includes verifying a porosity sensitivity of the NDI ultrasonic system and / or the NDI ultrasonic transducer using the frequency domain qualification mask. The method further includes qualifying the NDI ultrasonic system and / or the NDI ultrasonic transducer in response to the scan signal being below the time domain qualification mask for a portion of the calibration coupon that is free of defects and the scan signal being above the time domain qualification mask for another portion of the calibration coupon that includes defects, and the porosity sensitivity of the NDI ultrasonic system being verified.

[0004] According to another embodiment, a system for performing metrology qualification of a non-destructive testing (NDI) ultrasonic system and / or an NDI ultrasonic transducer includes a processor and a memory coupled to the processor. The memory includes computer readable program instructions that, when executed by the processor, cause the processor to perform a set of functions. The set of functions includes performing an ultrasonic scanning operation on a calibration coupon. The ultrasonic scanning operation generates a scan signal. The set of functions also includes overlaying a time domain qualification mask on the scan signal and evaluating the scan signal using the time domain qualification mask. The set of functions also includes verifying a porosity sensitivity of the NDI ultrasonic system using a frequency domain qualification mask. The set of functions further includes qualifying the NDI ultrasonic system in response to the scan signal being within the time domain qualification mask for a portion of the calibration coupon that is free of defects and the scan signal being above the time domain qualification mask for another portion of the calibration coupon that includes defects, and the porosity sensitivity of the NDI ultrasonic system being verified.

[0005] According to one embodiment and any of the above-mentioned embodiments, the method and system also includes calibrating at least one of the NDI ultrasound system or the NDI ultrasound transducer of the NDI ultrasound system in response to the scan signal being above the time domain qualification mask for any portion of the calibration coupon that is free of defects or the scan signal being below the time domain qualification mask for any other portion of the calibration coupon that includes defects. The method and system further includes repeating at least one of performing an ultrasound scanning operation to generate a new scan signal, overlaying the time domain qualification mask on the new scan signal, evaluating the new scan signal using the time domain qualification mask, and calibrating the NDI ultrasound system or the NDI ultrasound transducer until the new scan signal is below the time domain qualification mask for the portion of the calibration coupon that is free of defects and the new scan signal is above the time domain qualification mask for the other portion of the calibration coupon that includes defects.

[0006] According to one embodiment and any of the previous embodiments, the method and system further includes, in response to the porosity sensitivity of the NDI ultrasonic system not being confirmed, calibrating at least one of the NDI ultrasonic system or an NDI transducer of the NDI ultrasonic system. The system and method further includes repeating the steps of performing an ultrasonic scanning operation to generate a new scan signal, verifying that the new scan signal passes a time-domain qualification mask, and calibrating at least one of the NDI ultrasonic system or an NDI ultrasonic transducer of the NDI ultrasonic system until the porosity sensitivity of the NDI ultrasonic system is confirmed.

[0007] According to one embodiment and any of the previous embodiments, the scan signal is an A-scan ultrasound signal.

[0008] According to one embodiment and any of the above embodiments, the method and system further includes creating a time domain qualification mask using at least one of the workpiece specifications and the process specification requirements, the time domain qualification mask being calibrated to test noise floor, calibration coupon depth, and signal sensitivity for different types of defects.

[0009] According to one embodiment and any of the previous embodiments, the different types of defects include voids, delaminations, and inclusions.

[0010] According to one embodiment and any of the above embodiments, the method and system further includes performing a validation of the time domain qualification mask.

[0011] According to one embodiment and any of the above-mentioned embodiments, performing verification of the time domain qualification mask includes generating a C-scan signal by performing a scan operation on the measurement specimen, selecting an A-scan signal from the C-scan signal, and drawing the time domain qualification mask around the A-scan signal.

[0012] According to one embodiment and any of the above embodiments, verifying the porosity sensitivity of an NDI ultrasonic system and / or an NDI ultrasonic transducer includes predicting the system response of the NDI ultrasonic system by Fast Fourier Transform (FFT), dynamic range, and noise level testing and evaluation, presenting a number of different material types for selection, and generating a porosity sensitivity curve for the selected materials using a frequency domain qualification mask.

[0013] According to one embodiment and any of the above embodiments, the method and system further includes creating a frequency domain qualification mask for the particular workpiece.

[0014] According to one embodiment and any of the above embodiments, creating a frequency domain qualification mask for a particular workpiece includes generating an ultrasonic signal by performing an ultrasonic scanning operation on the metrology specimen, converting the ultrasonic signal from a time domain signal to a frequency domain signal, and applying a bandwidth mask that covers the frequency domain signal.

[0015] According to one embodiment and any of the previous embodiments, the system and method includes verifying that the frequency domain signal is entirely within a bandwidth mask, and in response to a portion of the frequency domain signal being outside the bandwidth mask, applying a notch filter or using a different transducer such that the frequency domain signal is entirely within the bandwidth mask. In that case, the bandwidth mask where the frequency domain signal is entirely within the bandwidth mask corresponds to a frequency domain qualification mask.

[0016] According to one embodiment and any of the previous embodiments, applying the bandwidth mask includes the bandwidth mask being less than or equal to approximately fifty percent (50%) of a peak amplitude of the frequency domain signal.

[0017] According to one embodiment and any of the above-described embodiments, determining the porosity sensitivity of the NDI ultrasonic system is based on the thickness of the calibration coupon, the frequency of the NDI ultrasonic transducer of the NDI ultrasonic system, and the bandwidth of the frequency domain signal.

[0018] The foregoing features, functions, and advantages may be realized individually in various embodiments or may be combined in yet further embodiments, further details of which may be understood by reference to the following description and drawings. [Brief description of the drawings]

[0019] [Figure 1A] 1A and 1B are a flow chart of an embodiment of a method for performing metrology qualification of an NDI ultrasound system and / or an NDI ultrasound transducer, according to an embodiment of the present disclosure. [Figure 1B] 1A and 1B are a flow chart of an embodiment of a method for performing metrology qualification of an NDI ultrasound system and / or an NDI ultrasound transducer, according to an embodiment of the present disclosure. [Diagram 2] FIG. 1C illustrates an embodiment of a smart metrology system for performing metrology qualification of an NDI ultrasound system and / or an NDI ultrasound transducer in accordance with the exemplary methods of FIGS. 1A and 1B. [Diagram 3] 1 is an example of validation of a linear regression model for an NDI ultrasound system, according to an embodiment of the present disclosure. [Figure 4A] 1 is an example of a frequency domain qualification mask for verifying porosity sensitivity of an NDI ultrasound system and / or an NDI ultrasound transducer before lower frequency content filtering, according to an embodiment of the present disclosure. [Figure 4B] 1 is an example of a frequency domain qualification mask for verifying porosity sensitivity of an NDI ultrasound system and / or an NDI ultrasound transducer after lower frequency content filtering, according to an embodiment of the present disclosure. [Diagram 5] 1 is a flow chart of an embodiment of a method for creating a time domain qualification mask and performing validation of the mask, according to an embodiment of the present disclosure. [Figure 6] FIG. 13 is a diagram of an example of a time domain qualification mask, according to an embodiment of the present disclosure. [Figure 7] 1 is a flow chart of an embodiment of a method for creating a frequency domain qualification mask, according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] The following detailed description of the embodiments refers to the accompanying drawings, which illustrate examples of the present disclosure. Other embodiments having different structures and steps do not depart from the scope of the present disclosure. Similar reference numbers may represent the same elements or components in different drawings.

[0021] The present disclosure may be a system, a method, and / or a computer program product. The computer program product may include computer-readable storage medium(s) having stored thereon computer-readable program instructions for causing a processor to execute aspects of the present disclosure.

[0022] A computer-readable storage medium may be a tangible device capable of holding and storing instructions for use by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. A non-exhaustive list of more specific examples of computer-readable storage media includes portable computer diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), static random access memories (SRAMs), portable compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), memory sticks, floppy disks, mechanically encoded devices (such as punch cards or ridge-in-groove structures having instructions recorded thereon), and any suitable combination thereof. In this specification, a computer-readable storage medium should not be construed as being, per se, a transitory signal such as an electric wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or another transmission medium (e.g., light pulses passing through a fiber optic cable), or an electrical signal transmitted through a wire.

[0023] The computer readable program instructions described herein may be downloaded from a computer readable storage medium into each computing / processing device, or may be downloaded to an external computer or storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network may comprise copper transmission cables, optical conductive fiber, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer readable program instructions from the network and transfers the computer readable program instructions for storage in a computer readable storage medium in the respective computing / processing device.

[0024] Computer readable program instructions for carrying out the operations of the present disclosure may be assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state setting data, or may be implemented using standard programming languages ​​such as Smalltalk or C. ++The computer-readable program instructions may be source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as , and conventional procedural programming languages ​​such as the "C" programming language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer may be connected to the user's computer through any type of network (including a local area network (LAN) or a wide area network (WAN)), or a connection may be made to an external computer (e.g., through the Internet using an Internet service provider). In some examples, an electronic circuit (including, for example, a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA)) may execute the computer-readable program instructions by utilizing state information of the computer-readable program instructions to customize the electronic circuit for carrying out aspects of the present disclosure.

[0025] Aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to examples of the present disclosure. It will be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer readable program instructions.

[0026] The computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, whereby the instructions, executed by the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in one or more blocks of the flowcharts and / or block diagrams. The computer readable program instructions may also be stored on a computer readable storage medium capable of instructing a computer, programmable data processing apparatus, and / or other device to function in a particular manner, whereby the computer readable storage medium on which the instructions are stored includes an article of manufacture, the article of manufacture including instructions for implementing aspects of the functions / acts specified in one or more blocks of the flowcharts and / or block diagrams.

[0027] The computer readable program instructions may also be loaded into a computer, other programmable data processing apparatus, or other device to cause the computer, other programmable apparatus, or other device to execute a series of operational steps to produce a computer-implemented process, such that the instructions executed on the computer, other programmable apparatus, or other device implement the functions / acts defined in the block(s) of the flowcharts and / or block diagrams.

[0028] 1A and 1B are a flow chart of an example of a method 100 for performing metrology qualification of an NDI ultrasound system and / or an NDI ultrasound transducer, according to an embodiment of the present disclosure. With further reference to FIG. 2, FIG. 2 is a diagram of an example of a smart metrology system 200 for performing metrology qualification 201 of an NDI ultrasound system 202 and / or an NDI ultrasound transducer 204 according to the exemplary method of FIG. 1A and 1B. According to an embodiment, the NDI ultrasound system 202 includes a processor 206 and a memory 208 coupled to the processor 206. The processor 206 is configured to control a robot 210 to perform an ultrasound scanning operation. The robot 210 includes an end effector 212 configured to hold the NDI ultrasound transducer 204 for performing the ultrasound scanning operation, as described herein. The processor 206 is also connected to a display 214 for presenting the results of the ultrasound scanning operation and qualification of the NDI ultrasound system 202 and / or the NDI ultrasound transducer 204. The NDI ultrasound system 202 also includes a transmitter 215 for transmitting an ultrasound signal and a receiver 216 for receiving a return signal or scan signal 104 (FIG. 1A). According to one embodiment, the scan signal 104 is an A-scan signal.

[0029] In block 102 of FIG. 1A, an ultrasonic scanning operation is performed by the NDI ultrasonic system 202 on the calibration coupon 217. According to one embodiment, the calibration coupon 217 is a composite panel including multiple layers of laminated composite material. In other embodiments, layers of different types of materials, such as layers of metal or alloys, may be included within the composite panel. The calibration coupon 217 includes one or more portions that are free of any defects and one or more portions that have defects 106 (FIG. 6). This is to ensure that the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 can accurately detect where defects 106 are present and where defects are not present, as described in more detail herein. Examples of defects 106 include, but are not necessarily limited to, voids, delaminations, and foreign object entrapment, such as foreign objects or foreign object damage (FOB) within the calibration coupon 217. The ultrasonic scanning operation generates a scan signal 104 or return signal from the calibration coupon 217.

[0030] At block 108, a graph of the scan signal 104 is presented. According to one embodiment, the scan signal 104 is presented on a display, such as display 214 of FIG.

[0031] At block 110, a time domain qualification mask 112 is superimposed on the scan signal 104. Referring also to Figure 6, Figure 6 is a diagram of an example of a time domain qualification mask 112 superimposed on the scan signal 104, according to an example embodiment of the present disclosure. Creating the time domain qualification mask 112 and performing validation of the time domain qualification mask 112 will be described in more detail with reference to Figures 5 and 6.

[0032] In block 114, the scan signal 104 is evaluated using the time domain qualification mask 112. Evaluating the scan signal 104 using the time domain qualification mask 112 includes verifying that the scan signal 104 is below the time domain qualification mask 112 for a portion of the calibration coupon 217 where the defect 106 is not present, and verifying that the scan signal 104 is above the time domain qualification mask 112 for another portion of the calibration coupon 217 where the defect 106 is present, as shown in one embodiment in FIG.

[0033] At block 116, a determination is made whether the scanned signal 104 is below the time domain qualification mask 112 for the portion of the calibration coupon 217 that is free of the defect 106. If the scanned signal 104 is above the time domain qualification mask 112 for the portion of the calibration coupon 217 that is free of the defect 106, the method 100 proceeds to block 118. If the scanned signal 104 is below the time domain qualification mask 112 for the portion of the calibration coupon 217 that is free of the defect 106, the method 100 proceeds to block 120.

[0034] In block 120, a determination is made whether the scan signal 104 is above the time domain qualification mask 112 for another portion of the calibration coupon 217 that includes the defect 106. If the scan signal 104 is above the time domain qualification mask 112, the method 100 proceeds to block 122 of FIG. 1B. If the scan signal 104 is below the time domain qualification mask 112 for another portion of the calibration coupon 217 that includes the defect 106, the method 100 proceeds to block 118.

[0035] In block 118, at least one of the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 of the NDI ultrasonic system 202 is calibrated in response to the scan signal 104 being above the time domain qualification mask 112 for any portion of the calibration specimen 217 that is free of the defect 106, or the scan signal 104 being below the time domain qualification mask 112 for any other portion of the calibration specimen 217 that includes the defect 106.

[0036] From block 118, the method 100 returns to block 102 where another ultrasound scanning operation is performed by the NDI ultrasound system 202 to generate a new scan signal 104. Blocks 102-120 of the method 100 are repeated as previously described until a new scan signal 104 is generated that satisfies the conditions of the time domain qualification mask 112. "Satisfying the conditions" means, for example, that the new scan signal 104 is below the time domain qualification mask 112 for any portion of the calibration coupon 217 that is free of defects 106, and that the new scan signal 104 is above the time domain qualification mask 112 for other portions of the calibration coupon 217 that include defects 106. At least one of performing an ultrasound scanning operation to generate a new scan signal 104 in block 102, overlaying a time domain qualification mask 112 on the new scan signal 104 in block 110, and calibrating the NDI ultrasound system 202 and / or the NDI ultrasound transducer 204 in block 118 is repeated until a new scan signal 104 is generated that meets the conditions of the time domain qualification mask 112.

[0037] In block 116, in response to the scan signal 104 or the new scan signal 104 being below the time domain qualification mask 112 for a portion of the calibration specimen 217 that does not have a defect 106, and in block 120, in response to the scan signal 104 or the new scan signal 104 being above the time domain qualification mask 112 for a portion of the calibration specimen 217 that has a defect 106, the method 100 proceeds to block 122 of FIG. 1B.

[0038] In block 122, the porosity sensitivity 218 (FIG. 2) of the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 is confirmed using the frequency domain qualification mask 124 and the linear regression model 300 (FIG. 3) with a slope M that matches the equation Y = Mx + b. In one embodiment of the porosity sensitivity curve 302 shown in FIG. 3, a zero slope (Y = 0x) indicates that there is no sensitivity to porosity within the range of the thickness of the calibration specimen 217 from zero (0) ply to about sixty (60) plies 303. Confirming the porosity sensitivity 218 of the NDI ultrasonic system 202 is based on the thickness of the calibration specimen 217, the frequency of the NDI ultrasonic transducer 204 of the NDI ultrasonic system 202, and the bandwidth 230 of the frequency domain signal 232.

[0039] As will be described in more detail with reference to blocks 126-138, the porosity sensitivity 218 is identified by analyzing the slope and R-squared value 306 (FIG. 3) of a set of measured porosity curves 220 to determine how well the set of measured porosity curves 220 fits the linear regression model 300 of the porosity library model 224. The measured porosity curves 220 are also referred to as porosity sensitivity curves. According to one embodiment, the porosity library model 224 is stored inside the memory 208 by the NDI ultrasonic system 202.

[0040] One embodiment of the frequency domain qualification mask 124 is shown in FIGS. 4A and 4B respectively. FIG. 4A is an embodiment of the frequency domain qualification mask 124a for confirming the porosity sensitivity 218 of the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 before lower frequency component filtering according to one embodiment of the present disclosure. FIG. 4B is an embodiment of the frequency domain qualification mask 124b for confirming the porosity sensitivity 218 of the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 after lower frequency component filtering according to one embodiment of the present disclosure. One embodiment of the frequency domain qualification mask 124 will be described in more detail with reference to FIG. 7.

[0041] In block 126, determining the porosity sensitivity 218 of the NDI ultrasonic system 202 and / or NDI ultrasonic transducer 204 includes predicting the system frequency response 226 (FIG. 2) of the NDI ultrasonic system 202 by Fast Fourier Transform (FFT), including dynamic range 219 (FIG. 2) and noise level 219b and 602 (FIG. 6) testing and evaluation.

[0042] In block 128, a dynamic range algorithm is performed on the frequency response 226 to provide a decibel range or dynamic range 219 between saturation 219a and noise level 219b and 602. The dynamic range algorithm is verified against the thinnest calibration coupon 217a and the thickest coupon 217b at the selected frequency. The signal from the thickest coupon 217b will be above the noise level 219b and 602. To satisfy the conditions of the frequency domain qualification mask 124, it may be necessary to properly select an ultrasonic transducer 204 with a narrow frequency band to provide a frequency response 226 or scan signal 104 that fits within the frequency domain qualification mask 124, or to provide a frequency response 226 that fits within the frequency domain qualification mask 124 by applying a notch software filter or by placing a physical filter in line with the receiver 216 of the NDI ultrasound system 202. The dynamic range 219 test will be determined based on the generated measured porosity curve 220 that is frequency and thickness dependent. As shown in Figure 6, the noise levels 219b and 602 are tested against the time domain qualification mask 112. As shown in Figure 6, the noise levels 219b and 602 are identified by the scan signal 104 in the frequency domain qualification mask 124 that are attributed to electrical noise or inside ply noise or both.

[0043] At block 130, a number of different material types 228 (FIG. 2) are presented for selection. At block 132, a porosity sensitivity curve 302 (FIG. 3) is generated for the selected material type 228 using the frequency domain qualification mask 124. At block 134, outliers 304 are removed from the porosity sensitivity curve 302. Referring also to FIG. 3, FIG. 3 is an example of validating a linear regression model 300 of an NDI ultrasonic system according to one embodiment of the present disclosure. FIG. 3 illustrates an example of removing outliers 304 from the porosity sensitivity curve 302. The smart metrology system 200 is configured to analyze the slope and R-squared value 306 of the set of measured porosity curves 220 to determine how well the porosity sensitivity curve 302 fits the linear regression model 300 of the porosity library model 224. A predetermined slope and R-squared value 306 filters the frequency spectrum, removing outliers 304, until the proper porosity sensitivity 218 is achieved. According to one embodiment, the slope and R-squared value 306 of the porosity sensitivity curve 302 for the porosity library model 224 are experimentally identified based on the material type and optimized for best system response. According to another embodiment, the slope and R-squared value 306 of the porosity sensitivity curve 302 for the porosity library model 224 are identified by software modeling when the ultrasonic properties of the composite material are known.

[0044] In block 136, the slope of the porosity sensitivity curve 302 is adjusted by the automatic filter algorithm to set the library. For example, the lower frequency of FIG. 4B is reduced until the optimal slope of the porosity sensitivity curve 302 of FIG. 3 is achieved. By increasing the slope of the measured porosity curve 220 or porosity sensitivity curve via lower frequency filtering of the frequency response 226, greater sensitivity to porosity may be achieved.

[0045] At block 138, a determination is made whether the porosity sensitivity 218 of the NDI ultrasonic system 202 has been verified. If the porosity sensitivity 218 of the NDI ultrasonic system 202 has been verified, the method 100 proceeds to block 140. At block 140, the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 are qualified. According to one embodiment, a message is presented that the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 have been qualified.

[0046] If the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 are not qualified, the method 100 returns to block 118. In block 118, in response to the porosity sensitivity 218 of the NDI ultrasonic system 202 not being confirmed, at least one of the NDI ultrasonic system 202 or the NDI ultrasonic transducer 204 of the NDI ultrasonic system 202 is calibrated. The method 100 would then continue through blocks 102-120 similar to those previously described to determine whether at least one of the NDI ultrasonic system 202 or the NDI ultrasonic transducer 204 affected the qualification by the time domain qualification mask 112. Thus, the steps of performing an ultrasound scanning operation to generate a new scan signal 104 in block 102, verifying that the new scan signal 104 satisfies the conditions of the time domain qualification mask 112 in blocks 110-120, verifying the porosity sensitivity 218 using the frequency domain qualification mask in block 122, and calibrating at least one of the NDI ultrasound system 202 or the NDI ultrasound transducer 204 in block 118 are repeated until the porosity sensitivity 218 of the NDI ultrasound system 202 is confirmed in block 140.

[0047] At block 140, the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 are qualified in response to the porosity sensitivity 218 of the NDI ultrasonic system 202 being confirmed as described herein, and in response to the scan signal 104 or the new scan signal 104 being below the time domain qualification mask 112 for any portion of the calibration coupon 217 that is free of the defect 106 ( FIG. 6 ), and the scan signal 104 or the new scan signal 104 being above the time domain qualification mask 112 for any other portion of the calibration coupon 217 that includes the defect 106, as previously described. The smart metrology system 200 is configured to generate an output including an indication that the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 are qualified in response to the porosity sensitivity 218 of the NDI ultrasonic system 202 being confirmed. The output then enables the NDI ultrasound system 202 and / or the NDI ultrasound transducer 204 to be used and / or operated for the desired inspection.

[0048] Referring to FIG. 5, FIG. 5 is a flow chart of an embodiment of a method 500 for creating a time domain qualification mask 112 and performing validation of the mask 112 according to an embodiment of the present disclosure. Referring also to FIG. 6, FIG. 6 is a diagram of an embodiment of a time domain qualification mask 112 according to an embodiment of the present disclosure. In block 502, the time domain qualification mask 112 is created using at least one of a workpiece specification 504 and a process specification requirement 506 for processing the workpiece 240 (FIG. 2). According to an embodiment, the workpiece 240 is a composite panel including multiple layers of materials similar to those previously described. However, the exemplary methods and systems described herein are applicable to any type of workpiece 240 and are not limited to components made from composite materials or any particular type of material or structure. The time domain qualification mask 112 is configured to test the noise level 602 (FIG. 6), the depth of the calibration coupon 217, and the signal sensitivity for different types of defects 106 (FIG. 6). Examples of different types of defects 106 include, but are not limited to, voids, delaminations, and foreign object entrapment.

[0049] The time domain qualification mask 112 includes horizontal break points 606a-606c and vertical break points 608a-608b. The time domain qualification mask 112 may include staircase sections, slope sections with linear or curved sections, or any combination of these types of sections. In the example of FIG. 6, the time domain qualification mask 112 is a combination function of linear sections. The voltage V 0 is equal to the conditioned reference signal. V 1 is equal to the first breakpoint 606a. 2 is equal to the second breakpoint 606b, and V 3 is equal to the third breakpoint 606c. In the example of FIG. 6, the third breakpoint 606c is the noise level 602. 0 is equal to the front surface of the measurement coupon 511 at zero thickness relative to the base. 1 is equal to the first breakpoint 608, and T 2is equal to the second breakpoint 608b.

[0050] 5, a validation of the time domain qualification mask 112 is performed. According to one embodiment, an empirical validation of the time domain qualification mask 112 is performed. According to one embodiment, performing the validation of the time domain qualification mask 112 in block 508 includes operations described with reference to blocks 510-524.

[0051] In block 510, a C-scan signal is generated by performing an ultrasonic scanning operation on metrology coupon 511 using an NDI ultrasonic transducer, such as NDI ultrasonic transducer 204 of Figure 2. According to one embodiment, metrology coupon 511 corresponds to a qualification workpiece that meets or is known to satisfy workpiece specifications 504.

[0052] At block 512, an A-scan signal 104 (FIG. 6) is selected from the C-scan signal for the selected point. An A-scan is a method of presenting ultrasonic signal data using a horizontal baseline that indicates distance or time, and vertical deflection from the baseline that indicates the amplitude of the return ultrasonic signal. A C-scan is a method of presenting ultrasonic signal data that provides a plan view of a test object, such as the calibration coupon 217, the metrology coupon 511 or the workpiece 240, and discontinuities in the test object. At block 514, a graph of the A-scan signal is presented.

[0053] In block 516, the front wall 604 (FIG. 6) of the metrology coupon 511 and the back wall (not shown in FIG. 6) of the metrology coupon 511 are detected from local maxima in the A-scan signal 104. In block 518, a post-process time-corrected gain (TCG) is performed. The post-process time-corrected gain is a process that adds gain to the scan signal to normalize the natural attenuation of composite materials based on thickness. The time-corrected gain (TCG) compensates for the difference in gain as a function of time for the difference in amplitude of reflections from equal reflectors (such as the defect 106) at different sound travel distances within the test object.

[0054] At block 520, the time domain qualification mask 112 (FIG. 6) is drawn around the A-scan signal 104. The time domain qualification mask 112 is represented by the cross-hatched area in FIG.

[0055] At block 522, a graph of the time domain qualification mask 112 drawn around the A-scan signal 104 is presented, as shown in Figure 6. At block 524, the time domain qualification mask 112 is verified from the graph of the time domain qualification mask 112 drawn around the A-scan signal 104.

[0056] In block 526, the time domain qualification mask 112 is used to develop and qualify NDI ultrasound systems, standardize requirements for ultrasound transducer manufacturers, verify the performance of new ultrasound transducers, and the like.

[0057] 7 is a flow chart of an embodiment of a method 700 for creating a frequency domain qualification mask 124 according to an embodiment of the present disclosure. With reference also to FIG. 4A and FIG. 4B, FIG. 4A is an embodiment of a frequency domain qualification mask 124a for verifying the porosity sensitivity 218 of the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 before lower frequency content filtering according to an embodiment of the present disclosure. FIG. 4B is an embodiment of a frequency domain qualification mask 124b for verifying the porosity sensitivity 218 of the NDI ultrasonic system 202 and / or the NDI ultrasonic transducer 204 after lower frequency content filtering according to an embodiment of the present disclosure.

[0058] In block 702, a frequency domain qualification mask 124 is created for a particular workpiece 240. According to one embodiment, the particular workpiece 240 is a composite material including multiple layers of laminated composite material similar to those previously described. According to other embodiments, a frequency domain qualification mask 124 may be created for other types of workpieces using the techniques described herein. According to the embodiment of FIG. 6, creating the frequency domain qualification mask 124 in block 702 includes operations described with reference to blocks 704-720.

[0059] In block 704, creating a frequency domain qualification mask 124 for a particular workpiece 240 includes generating an ultrasonic scan signal by performing an ultrasonic scanning operation on a metrology coupon 511 using an NDI ultrasonic transducer of an NDI ultrasonic system, such as the NDI ultrasonic system 202 of FIG. 2. As previously described, the metrology coupon 511 corresponds to a qualification workpiece 240 that meets or is known to satisfy the workpiece specifications 504. According to one embodiment, the ultrasonic scan signal generated is a C-scan ultrasonic signal.

[0060] At block 706, an ultrasound scan signal or a C-scan ultrasound signal is received by the NDI ultrasound system 202. At block 708, the ultrasound signal is converted from a time domain signal to a frequency domain signal 402 (FIGS. 4A and 4B). According to one embodiment, the ultrasound scan signal is converted from the time domain to the frequency domain by performing a Fast Fourier Transform (FTT) of the time domain ultrasound scan signal.

[0061] At block 712, the frequency domain signal 402 of the ultrasound scan signal or A-scan signal is presented. According to one embodiment, the frequency domain signal of the A-scan of the ultrasound scan signal is presented on a display, such as display 214 of FIG.

[0062] At block 714, a bandwidth mask 404 (FIGS. 4A and 4B) is applied to cover the frequency domain signal 402. At block 716, a verification that the frequency domain signal 402 is entirely within the bandwidth mask 404 is performed.

[0063] At block 718, according to one embodiment, in response to a portion of the frequency domain signal 402 being outside the bandwidth mask 404, a notch filter is applied within the NDI ultrasound system 202 (FIG. 2) or a different NDI ultrasound transducer 204 is used such that the frequency domain signal 402 is entirely within the bandwidth mask 404. A bandwidth mask 404 that completely covers the frequency domain signal 402 corresponds to the frequency domain qualification mask 124. According to one embodiment, applying the bandwidth mask 404 includes the bandwidth mask 404 being approximately fifty percent (50%) or less of the peak amplitude of the frequency domain signal 402 or six decibels below the peak amplitude of the time domain ultrasound scan signal.

[0064] At block 720, a verification is performed that the changes at block 718 do not affect the time domain response of the NDI ultrasound system 202 and / or the NDI ultrasound transducer 204. According to one embodiment, the verification that the changes at block 718 do not affect the time domain response is performed in a similar manner as described with reference to blocks 102-120 of FIG.

[0065] In block 722, the frequency domain qualification mask 124 is used to develop and qualify NDI ultrasound systems, standardize requirements for NDI ultrasound transducer manufacturers, verify the performance of new NDI ultrasound transducers, and the like.

[0066] Referring back to FIG. 2, as previously described, FIG. 2 is a diagram of an embodiment of a smart metrology system 200 for performing metrology qualification 201 of an NDI ultrasound system 202 and / or an NDI ultrasound transducer 204 in accordance with the exemplary method of FIGS. 1A and 1B. The smart metrology system 200 includes a processor 206 and a memory 208 coupled to the processor 206. The memory 208 includes computer readable program instructions 250 that, when executed by the processor 206, cause the processor 206 to perform a set of functions 252. According to an embodiment, the instructions 250 include instructions 250 for performing the methods described herein, including metrology qualification 201 of the NDI ultrasound system 202 and / or the NDI ultrasound transducer 204. According to an embodiment, the method 100 of FIGS. 2A and 2B, the method 500 of FIG. 5, and the method 700 of FIG. 7 are embodied and performed by a smart metrology system 200 including an NDI ultrasound system 202. The set of functions 252 includes blocks of a method 100 , a method 500 , and a method 700 .

[0067] The flowcharts and block diagrams in the drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of instructions, including one or more executable instructions for implementing a particular logical function(s). In some alternative implementations, the functions described in the blocks may occur out of the order described in the figures. For example, two blocks shown in succession may in fact be executed substantially simultaneously or may sometimes be executed in reverse order, depending on the functionality involved. It should also be noted that each block of the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a special-purpose hardware-based system that performs a particular function or function, or may be executed by a combination of special-purpose hardware and computer instructions.

[0068] The terms used herein are merely for the purpose of describing particular examples and are not intended to limit the examples of the present disclosure. As used herein, the singular forms "a," "an," and "this," "it," and "the" are intended to include the plural (unless the context clearly indicates otherwise). Furthermore, it will be understood that the terms "include," "includes," "comprises," and / or "comprising," when used herein, specify the presence of stated features, entities, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, entities, steps, operations, elements, components, and / or groups thereof.

[0069] Corresponding structures, materials, acts, and equivalents of all means or steps, and functional elements in the following claims are intended to include any structures, materials, or acts that are specifically claimed or that perform functions in combination with other claimed elements. The description of the present embodiment has been presented for purposes of illustration and description, and is not intended to be exhaustive or to limit the embodiments to the disclosed form. Those skilled in the art will recognize that numerous modifications and variations can be made without departing from the scope and spirit of the embodiments.

[0070]

[0001] Furthermore, the present disclosure includes embodiments according to the following clauses: Article 1. 1. A method (100) for performing metrology qualification (201) of a non-destructive testing (NDI) ultrasonic system (202) and / or an NDI ultrasonic transducer (204), comprising: performing (102) an ultrasonic scanning operation on a calibration coupon (217) with the NDI ultrasonic system (202) to generate a scan signal (104); overlaying (110) the scan signal (104) with a time domain qualification mask (112); evaluating (114) the scan signal (104) using the time domain qualification mask (112); verifying (122) the porosity sensitivity (218) of the NDI ultrasonic system (202) and / or the NDI ultrasonic transducer (204) using a frequency domain qualification mask (124); and The method (100) includes qualifying (140) the NDI ultrasonic system (202) and / or the NDI ultrasonic transducer (204) in response to the scan signal (104) being under the time domain qualification mask (112) for a portion of the calibration coupon (217) that is free of defects (106) and the scan signal (104) being over the time domain qualification mask (112) for another portion of the calibration coupon (217) that includes the defects (106), and the porosity sensitivity (218) of the NDI ultrasonic system (202) being confirmed (138). Article 2. calibrating (118) at least one of the NDI ultrasound system (202) or the NDI ultrasound transducer (204) of the NDI ultrasound system (202) in response to the scan signal (104) being above the time domain qualification mask (112) for any of the portions of the calibration coupon (217) that are free of the defect (106) or the scan signal (104) being below the time domain qualification mask (112) for any of the other portions of the calibration coupon (217) that include the defect (106); and 2. The method (100) of claim 1, further comprising repeating the steps of: performing the ultrasound scanning operation to generate (102) the new scan signal (104), overlaying (110) the time domain qualification mask (112) on the new scan signal (104), evaluating (114) the new scan signal (104) using the time domain qualification mask (112), and calibrating (118) the NDI ultrasound system (202) or the NDI ultrasound transducer (204) until the new scan signal (104) is under the time domain qualification mask (112) for the portion of the calibration specimen (217) that is free of the defect (106) and the new scan signal (104) is above the time domain qualification mask (112) for another portion of the calibration specimen (217) that includes the defect (106). Article 3. calibrating (118) at least one of the NDI ultrasonic system (202) or the NDI ultrasonic transducer (204) of the NDI ultrasonic system (202) in response to the porosity sensitivity (218) of the NDI ultrasonic system (202) not being confirmed; and The method (100) of clause 1, further comprising repeating (102) performing the ultrasonic scanning operation to generate a new scan signal (104), verifying (114) that the new scan signal (104) satisfies the conditions of the time-domain qualification mask (112), and calibrating (118) at least one of the NDI ultrasonic system (202) or the NDI ultrasonic transducer (204) of the NDI ultrasonic system (202) until the porosity sensitivity (218) of the NDI ultrasonic system (202) is confirmed (138). Article 4. 2. The method (100) of claim 1, wherein the scan signal (104) is an A-scan ultrasound signal. Article 5. The method (100) of clause 1, further comprising creating (502) the time domain qualification mask (112) using at least one of specifications (504) for the workpiece (240) and process specification requirements (506), the time domain qualification mask (112) being configured to test noise levels (219b, 602), depth of the calibration specimen (217), and signal sensitivity for different types of defects (106). Article 6. 6. The method (100) of claim 5, wherein the different types of defects (106) include voids, delaminations, and foreign object entrapment. Article 7. 2. The method (100) of clause 1, further comprising performing (508) a validation of the time domain qualification mask (112). Article 8. Performing (508) the validation of the time domain qualification mask (112) may include: generating (510) a C-scan signal by performing an ultrasonic scanning operation on a measurement coupon (511); selecting (512) an A-scan signal from the C-scan signals; and 8. The method (100) of claim 7, comprising drawing (520) the time domain qualification mask (112) to surround the A-scan signal. Article 9. Ascertaining (122) the porosity sensitivity (218) of the NDI ultrasonic system (202) and / or the NDI ultrasonic transducer (204) may include: predicting (126) a system response of the NDI ultrasound system (202) by Fast Fourier Transform (FFT), dynamic range (219), and noise level (219b, 602) testing and evaluation; presenting (130) a plurality of different material types (228) for selection; and 2. The method (100) of claim 1, comprising generating (132) a porosity sensitivity curve (302) for the selected material type (228) using the frequency domain qualification mask (124). Article 10. 2. The method (100) of claim 1, further comprising creating (702) the frequency domain qualification mask (124) for a particular workpiece (240). Article 11. Creating (702) the frequency domain qualification mask (124) for the particular workpiece (240) includes: generating (704) an ultrasonic signal by performing an ultrasonic scanning operation on the measurement coupon (511); converting (710) the ultrasound signal from a time domain signal to a frequency domain signal (232, 402); and 11. The method (100) of clause 10, comprising applying (714) a bandwidth mask (404) that covers the frequency domain signal (232, 402). Article 12. Verifying (716) that the frequency domain signal (232, 402) is entirely within the bandwidth mask (404); and 12. The method (100) of claim 11, further comprising, in response to a portion of the frequency domain signal (232, 402) being outside the bandwidth mask (404), applying (718) a notch filter or using a different transducer such that the frequency domain signal (232, 402) is entirely within the bandwidth mask (404), the bandwidth mask (404) in which the frequency domain signal (232, 402) is entirely within the bandwidth mask (404) corresponds to the frequency domain qualification mask (124). Article 13. 12. The method (100) of claim 11, wherein applying (714) the bandwidth mask (404) includes the bandwidth mask (404) being less than or equal to approximately fifty percent (50%) of a peak amplitude of the frequency domain signal (232, 402). Article 14. The method (100) of claim 1, wherein determining (122) the porosity sensitivity (218) of the NDI ultrasonic system (202) is based on a thickness of the calibration specimen (217), a frequency of the NDI ultrasonic transducer (204) of the NDI ultrasonic system (202), and a bandwidth (230) of a frequency domain signal (232, 402). Article 15. 1. A system (200) for performing metrology qualification (201) of a non-destructive testing (NDI) ultrasonic system (202) and / or an NDI ultrasonic transducer (204), comprising: A processor (206), and a memory (208) coupled to the processor (206), the memory (208) including computer readable program instructions (250) that, when executed by the processor (206), cause the processor (206) to perform a set of functions (252), the set of functions (252) comprising: performing (102) an ultrasonic scanning operation on a calibration coupon (217) to generate a scan signal (104); overlaying (110) the scan signal (104) with a time domain qualification mask (112); evaluating (114) the scan signal (104) using the time domain qualification mask (112); verifying (122) the porosity sensitivity (218) of said NDI ultrasonic system (202) using a frequency domain qualification mask (124); and A system (200) comprising: qualifying (140) the NDI ultrasonic system (202) in response to the scan signal (104) being under the time domain qualification mask (112) for a portion of the calibration specimen (217) that is free of defects (106) and the scan signal (104) being over the time domain qualification mask (112) for another portion of the calibration specimen (217) that includes the defects (106), and the porosity sensitivity (218) of the NDI ultrasonic system (202) being confirmed. Article 16. The set of functions (252) includes: calibrating (118) at least one of the NDI ultrasound system (202) or the NDI ultrasound transducer (204) of the NDI ultrasound system (202) in response to the scan signal (104) being above the time domain qualification mask (112) for any of the portions of the calibration coupon (217) that are free of the defect (106) or the scan signal (104) being below the time domain qualification mask (112) for any of the other portions of the calibration coupon (217) that include the defect (106); and 16. The system (200) of claim 15, further comprising repeating the steps of: performing the ultrasound scanning operation to generate (102) the new scan signal (104), overlaying (110) the time domain qualification mask (112) on the new scan signal (104), evaluating (114) the new scan signal (104) using the time domain qualification mask (112), and calibrating (118) the NDI ultrasound system (202) or the NDI ultrasound transducer (204) until the new scan signal (104) is under the time domain qualification mask (112) for the portion of the calibration specimen (217) that is free of the defect (106) and the new scan signal (104) is above the time domain qualification mask (112) for another portion of the calibration specimen (217) that includes the defect (106). Article 17. The set of functions (252) includes: calibrating (118) at least one of the NDI ultrasonic system (202) or the NDI ultrasonic transducer (204) of the NDI ultrasonic system (202) in response to the porosity sensitivity (218) of the NDI ultrasonic system (202) not being confirmed; and The system (200) of clause 15 further comprising repeating the steps of performing the ultrasonic scanning operation to generate (102) a new scan signal (104), verifying (114) that the new scan signal (104) satisfies the conditions of the time domain qualification mask (112), and calibrating (118) at least one of the NDI ultrasonic system (202) or the NDI ultrasonic transducer (204) of the NDI ultrasonic system (202) until the porosity sensitivity (218) of the NDI ultrasonic system (202) is confirmed. Article 18. The system (200) described in clause 15, wherein the set of functions (252) further includes creating (502) the time domain qualification mask (112) using at least one of specifications (504) for the workpiece (240) and process specification requirements (506), the time domain qualification mask (112) being configured to test noise levels (219b, 602), depth of the calibration specimen (217), and signal sensitivity for different types of defects (106). Article 19. 20. The system (200) of claim 18, wherein the different types of defects (106) include voids, delaminations, and foreign object entrapment. Article 20. The set of functions (252) further includes generating (702) the frequency domain qualification mask (124) for a particular workpiece (240), the generating (702) the frequency domain qualification mask (124) for the particular workpiece (240) comprising: generating (704) an ultrasonic signal by performing an ultrasonic scanning operation on the measurement coupon (511); converting (710) the ultrasound signal from a time domain signal to a frequency domain signal (232, 402); and 16. The system (200) of claim 15, comprising applying (714) a bandwidth mask (404) that covers the frequency domain signal (232, 402).

[0071] Although specific embodiments have been illustrated and described herein, those skilled in the art will recognize that the specific embodiments shown may be substituted with any configuration designed to achieve the same purpose, and that the embodiments have other uses in other environments. This application is intended to cover any modifications or variations of the present disclosure. The following claims are in no way intended to limit the scope of the disclosed examples to the specific embodiments described herein.

Claims

1. 1. A method (100) for performing metrology qualification (201) of a non-destructive testing (NDI) ultrasonic system (202) and / or an NDI ultrasonic transducer (204), comprising: performing (102) an ultrasonic scanning operation on a calibration coupon (217) by the NDI ultrasonic system (202) including the NDI ultrasonic transducer (204) to generate a scan signal (104); overlaying (110) the scan signal (104) with a time domain qualification mask (112); evaluating (114) the scan signal (104) using the time domain qualification mask (112); verifying (122) the porosity sensitivity (218) of the NDI ultrasonic system (202) and / or the NDI ultrasonic transducer (204) using a frequency domain qualification mask (124); and The method (100) includes qualifying (140) the NDI ultrasonic system (202) and / or the NDI ultrasonic transducer (204) in response to the scan signal (104) being below the time domain qualification mask (112) for a portion of the calibration specimen (217) that is free of defects (106) and the scan signal (104) being above the time domain qualification mask (112) for another portion of the calibration specimen (217) that includes the defects (106), and the porosity sensitivity (218) of the NDI ultrasonic system (202) being confirmed (138).

2. calibrating (118) at least one of the NDI ultrasound system (202) or the NDI ultrasound transducer (204) in response to the scan signal (104) being above the time domain qualification mask (112) for any of the portions of the calibration coupon (217) that are free of the defect (106) or the scan signal (104) being below the time domain qualification mask (112) for any of the other portions of the calibration coupon (217) that include the defect (106); and 2. The method of claim 1, further comprising repeating the steps of: performing the ultrasound scanning operation to generate the new scan signal; overlaying the time domain qualification mask on the new scan signal; evaluating the new scan signal using the time domain qualification mask; and calibrating the NDI ultrasound system or the NDI ultrasound transducer until the new scan signal is below the time domain qualification mask for the portion of the calibration specimen that is free of the defect and the new scan signal is above the time domain qualification mask for the other portion of the calibration specimen that includes the defect.

3. calibrating (118) at least one of the NDI ultrasonic system (202) or the NDI ultrasonic transducer (204) in response to the porosity sensitivity (218) of the NDI ultrasonic system (202) not being confirmed; and 2. The method (100) of claim 1, further comprising repeating the steps of performing the ultrasound scanning operation to generate a new scan signal (104) (102), verifying that the new scan signal (104) satisfies the conditions of the time-domain qualification mask (112) (114), and calibrating (118) at least one of the NDI ultrasound system (202) or the NDI ultrasound transducer (204) until the porosity sensitivity (218) of the NDI ultrasound system (202) is confirmed (138).

4. The method (100) of claim 1 , wherein the scan signal (104) is an A-scan ultrasound signal.

5. 2. The method of claim 1, further comprising: creating (502) the time domain qualification mask (112) using at least one of specifications (504) for the workpiece (240) and process specification requirements (506), the time domain qualification mask (112) being configured to test noise levels (219b, 602), depth of a calibration specimen (217), and signal sensitivity for different types of defects (106).

6. The method (100) of claim 5, wherein the different types of defects (106) include voids, delaminations, and foreign object entrapment.

7. The method of claim 1 , further comprising: performing a validation of the time domain qualification mask.

8. Performing (508) the validation of the time domain qualification mask (112) may include: generating a C-scan signal (510) by performing an ultrasonic scanning operation on a measurement coupon (511); selecting (512) an A-scan signal from the C-scan signals; and 8. The method of claim 7, comprising drawing (520) the time-domain qualification mask (112) around the A-scan signal.

9. Ascertaining (122) the porosity sensitivity (218) of the NDI ultrasonic system (202) and / or the NDI ultrasonic transducer (204) may include: predicting (126) a system response of the NDI ultrasound system (202) by Fast Fourier Transform (FFT), dynamic range (219), and noise level (219b, 602) testing and evaluation; presenting (130) a plurality of different material types (228) for selection; and 2. The method of claim 1, comprising generating a porosity sensitivity curve for a selected material type using the frequency domain qualification mask.

10. The method (100) of claim 1, further comprising creating (702) the frequency domain qualification mask (124) for a particular workpiece (240).

11. Creating (702) the frequency domain qualification mask (124) for the particular workpiece (240) comprises: generating (704) an ultrasonic signal by performing an ultrasonic scanning operation on the measurement coupon (511); converting (710) the ultrasound signal from a time domain signal to a frequency domain signal (232, 402); and 11. The method (100) of claim 10, comprising applying (714) a bandwidth mask (404) that covers the frequency domain signal (232, 402).

12. Verifying (716) that the frequency domain signal (232, 402) is entirely within the bandwidth mask (404); and 12. The method of claim 11, further comprising, in response to a portion of the frequency domain signal being outside the bandwidth mask, applying a notch filter or using a different transducer such that the frequency domain signal is entirely within the bandwidth mask, the bandwidth mask being such that the frequency domain signal is entirely within the bandwidth mask, the bandwidth mask being equivalent to the frequency domain qualification mask.

13. 12. The method of claim 11, wherein applying the bandwidth mask includes the bandwidth mask being less than or equal to approximately fifty percent (50%) of a peak amplitude of the frequency domain signal.

14. 2. The method (100) of claim 1, wherein determining (122) the porosity sensitivity (218) of the NDI ultrasonic system (202) is based on a thickness of the calibration specimen (217), a frequency of the NDI ultrasonic transducer (204), and a bandwidth (230) of a frequency domain signal (232, 402).

15. A system (200) for performing metrology qualification (201) of a non-destructive testing (NDI) ultrasound system (202) and / or an NDI ultrasound transducer (204), comprising: The NDI ultrasound system (202) comprises: The NDI ultrasonic transducer (204), A processor (206), and a memory (208) coupled to the processor (206), the memory (208) including computer readable program instructions (250) that, when executed by the NDI ultrasound system (202), cause the processor (206) to perform a set of functions (252); The set of functions (252) includes: performing (102) an ultrasonic scanning operation on a calibration coupon (217) to generate a scan signal (104); overlaying (110) the scan signal (104) with a time domain qualification mask (112); evaluating (114) the scan signal (104) using the time domain qualification mask (112); verifying (122) the porosity sensitivity (218) of the NDI ultrasound system (202) using a frequency domain qualification mask (124); and The system (200) includes qualifying (140) the NDI ultrasonic system (202) and / or the NDI ultrasonic transducer (204) in response to the scan signal (104) being below the time domain qualification mask (112) for a portion of the calibration specimen (217) that is free of defects (106) and the scan signal (104) being above the time domain qualification mask (112) for another portion of the calibration specimen (217) that includes the defects (106), and the porosity sensitivity (218) of the NDI ultrasonic system (202) being confirmed.

16. The set of functions (252) includes: calibrating (118) at least one of the NDI ultrasound system (202) or the NDI ultrasound transducer (204) in response to the scan signal (104) being above the time domain qualification mask (112) for any of the portions of the calibration coupon (217) that are free of the defect (106) or the scan signal (104) being below the time domain qualification mask (112) for any of the other portions of the calibration coupon (217) that include the defect (106); and 16. The system (200) of claim 15, further comprising repeating the steps of: performing the ultrasonic scanning operation to generate the new scan signal (104), overlaying the time domain qualification mask (112) on the new scan signal (104), evaluating the new scan signal (104) using the time domain qualification mask (112) (114), and calibrating the NDI ultrasonic system (202) or the NDI ultrasonic transducer (204) (118) until the new scan signal (104) is below the time domain qualification mask (112) for the portion of the calibration specimen (217) that is free of the defect (106) and the new scan signal (104) is above the time domain qualification mask (112) for another portion of the calibration specimen (217) that includes the defect (106).

17. The set of functions (252) includes: calibrating (118) at least one of the NDI ultrasonic system (202) or the NDI ultrasonic transducer (204) in response to the porosity sensitivity (218) of the NDI ultrasonic system (202) not being confirmed; and 16. The system (200) of claim 15, further comprising repeating the steps of performing the ultrasonic scanning operation to generate a new scan signal (104) (102), verifying that the new scan signal (104) satisfies the conditions of the time-domain qualification mask (112) (114), and calibrating (118) at least one of the NDI ultrasonic system (202) or the NDI ultrasonic transducer (204) until the porosity sensitivity (218) of the NDI ultrasonic system (202) is confirmed.

18. 16. The system of claim 15, wherein the set of functions further includes creating the time domain qualification mask using at least one of a specification for the workpiece and a process specification requirement, the time domain qualification mask being configured to test noise levels, a depth of the calibration specimen, and signal sensitivity for different types of defects.

19. The system (200) of claim 18, wherein the different types of defects (106) include voids, delaminations, and foreign object entrapment.

20. The set of functions (252) further includes creating (702) the frequency domain qualification mask (124) for a particular workpiece (240), the creating (702) the frequency domain qualification mask (124) for the particular workpiece (240) comprising: generating (704) an ultrasonic signal by performing an ultrasonic scanning operation on the measurement coupon (511); converting (710) the ultrasound signal from a time domain signal to a frequency domain signal (232, 402); and The system (200) of claim 15, comprising applying (714) a bandwidth mask (404) that covers the frequency domain signal (232, 402).

Images