Foreign matter detection method, system and device, storage medium and program product

Abstract

The invention provides a foreign matter detection method, system and device, a storage medium and a program product. The method comprises the following steps: acquiring a first sound signal of a to-be-tested device during vibration, and determining whether a foreign matter exists in the to-be-tested device at least according to the first sound signal. According to the method, when the foreign matter is contained in the to-be-tested device and the to-be-tested device is shaken at a certain frequency, the foreign matter can generate displacement in the to-be-tested device and collides with the internal device of the to-be-tested device to make a sound. Therefore, whether the foreign matter exists in the to-be-detected device or not can be accurately determined through the sound signal generated when the to-be-detected device vibrates, the to-be-detected device does not need to be manually disassembled, manual inspection and visual inspection of the to-be-detected device are not needed either, and therefore the detection efficiency can be improved.

Description

Technical Field

[0001] The present application relates to foreign body detection technology, and in particular to a foreign body detection method, system, device, storage medium and program product. Background Art

[0002] During the manufacturing and use of electronic devices, tiny metal chips, dust or other impurities may remain inside. If there are foreign objects inside electronic devices, it will have a huge impact on the reliability of the electronic devices. By detecting whether there are foreign objects inside electronic devices, potential problems can be discovered in time to prevent electronic device failures caused by foreign objects.

[0003] Taking relays as an example of electronic devices, currently, the main method of determining whether there are foreign objects inside the relays is to disassemble the relays and then visually inspect them, which results in low detection efficiency and poor accuracy. Summary of the invention

[0004] The present application provides a foreign matter detection method, system, device, storage medium and program product to solve the problem of low efficiency and poor accuracy in detecting internal foreign matters of electronic devices.

[0005] In a first aspect, the present application provides a foreign body detection method, the method comprising:

[0006] Acquiring a first sound signal of the device under test when it vibrates;

[0007] Whether there is a foreign object in the device under test is determined at least based on the first sound signal.

[0008] Optionally, the method further comprises:

[0009] Acquiring a second sound signal of a target device when it is vibrating, wherein the target device and the device under test are devices of the same type;

[0010] The step of determining whether there is a foreign object in the device under test at least according to the first sound signal includes:

[0011] Determining the sound similarity between the device under test and the target device according to the first sound signal and the second sound signal;

[0012] Whether there is a foreign object in the device under test is determined at least according to the sound similarity.

[0013] Optionally, the sound similarity includes a first similarity and / or a second similarity, the first similarity being the similarity between the first sound signal and the second sound signal, and the second similarity being the similarity between a first signal feature sequence of the first sound signal and a second signal feature sequence of the second sound signal.

[0014] Optionally, the target device is a device without foreign matter, and when the sound similarity includes a first similarity, determining whether there is a foreign matter in the device under test at least according to the sound similarity includes:

[0015] If the first similarity is less than or equal to a preset first preset value, it is determined that a foreign object exists in the device under test.

[0016] Optionally, the target device is a device without foreign matter, and when the sound similarity includes a second similarity, determining whether there is a foreign matter in the device under test at least according to the sound similarity includes:

[0017] If the second similarity is less than or equal to a preset second preset value, it is determined that a foreign object exists in the device under test.

[0018] Optionally, the second similarity includes:

[0019] When the first signal feature sequence includes a first time domain signal feature sequence and the second signal feature sequence includes a second time domain signal feature sequence, the second similarity includes a time domain similarity between the first time domain signal feature sequence and the second time domain signal feature sequence; and / or

[0020] When the first signal feature sequence includes a first frequency domain signal feature sequence and the second signal feature sequence includes a second frequency domain signal feature sequence, the second similarity includes a frequency domain similarity between the first frequency domain signal feature sequence and the second frequency domain signal feature sequence;

[0021] If the second similarity is less than or equal to a preset second preset value, determining that there is a foreign object in the device under test includes:

[0022] If the time domain similarity and / or the frequency domain similarity is less than or equal to a preset second preset value, it is determined that a foreign object exists in the device under test.

[0023] Optionally, the determining whether there is a foreign object in the device under test at least according to the sound similarity includes:

[0024] If both the time domain similarity and the frequency domain similarity are greater than the preset second preset value, it is determined that there is no foreign matter in the device under test.

[0025] Optionally, the determining whether there is a foreign object in the device under test at least according to the first sound signal further includes:

[0026] If both the time domain similarity and the frequency domain similarity are greater than the preset second preset value, at least one of the first sound signal, the first time domain signal feature sequence and the first frequency domain signal feature sequence is input into a pre-trained foreign body detection model to obtain a detection result output by the foreign body detection model, and the detection result is used to characterize whether there is a foreign body in the device under test.

[0027] Optionally, when the device under test contains foreign matter, the detection result is also used to characterize the type of foreign matter present in the device under test.

[0028] Optionally, before determining whether there is a foreign object in the device under test according to the first sound signal, the method further includes:

[0029] The first sound signal is preprocessed to remove noise in the first sound signal.

[0030] Optionally, obtaining a first sound signal of the device under test when it vibrates includes:

[0031] A first sound signal is obtained when the device under test vibrates at a set frequency and a set amplitude.

[0032] Optionally, before obtaining the first sound signal of the device under test when it vibrates at a set frequency and a set amplitude, the method further includes:

[0033] Obtaining an actual amplitude of the device under test when it vibrates at a set frequency and a set amplitude;

[0034] It is determined that the difference between the set amplitude and the actual amplitude is within a preset difference range.

[0035] Optionally, the device under test is arranged on a vibration device, and the method further comprises:

[0036] A control instruction is sent to a vibration device, wherein the vibration device is capable of vibrating in response to the control instruction so as to make the device under test vibrate at the set frequency and the set amplitude.

[0037] In a second aspect, the present application provides a test system, the test system comprising: a detection device, a vibration device, and a sound collection device;

[0038] The device under test is located on the vibration device and can vibrate under the drive of the vibration device;

[0039] The sound collection device is used to collect a first sound signal of the device under test when it vibrates;

[0040] The detection device is used to execute the method as described in any one of the first aspects.

[0041] Optionally, the vibration device is used to receive a control instruction sent by the detection device, and drive the device under test to vibrate at a set frequency and a set amplitude according to the control instruction.

[0042] Optionally, the system further comprises: an amplitude acquisition device;

[0043] The amplitude acquisition device is used to acquire the actual amplitude of the device under test when it vibrates at a set frequency and a set amplitude;

[0044] The detection device is also used to obtain a first sound signal of the device under test when it vibrates at a set frequency and a set amplitude when the difference between the set amplitude and the actual amplitude is within a preset difference range.

[0045] Optionally, the system further comprises: a fixing device;

[0046] The fixing device is used to fix the device under test on the vibration device.

[0047] Optionally, the system further comprises: a data acquisition device;

[0048] The data acquisition device is connected to the detection device and the sound acquisition device respectively, and is used to obtain the first sound signal of the device under test collected by the sound acquisition device when it vibrates, and send the first sound signal to the detection device.

[0049] In a third aspect, the present application provides an electronic device, the electronic device comprising: a processor, and a memory communicatively connected to the processor;

[0050] The memory stores computer-executable instructions;

[0051] The processor executes the computer-executable instructions stored in the memory to implement the method as described in any one of the first aspects.

[0052] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the method as described in any one of the first aspects.

[0053] In a fifth aspect, the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the method as described in any one of the first aspects.

[0054] The foreign body detection method, system, device, storage medium and program product provided by the present application, when there is foreign matter inside the device under test, when the device under test is shaken at a certain frequency, the foreign matter will be displaced inside the device under test, and collide with the internal components of the device under test to produce sound. Therefore, the present application can accurately determine whether there is foreign matter inside the device under test through the sound signal when the device under test vibrates. This method does not require manual disassembly of the device under test, nor does it require manual visual inspection of the device under test, so the detection efficiency can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0056] Figure 1 A schematic diagram of the structure of a test system provided in an embodiment of the present application;

[0057] Figure 2 A schematic diagram of a process for detecting foreign matter provided in an embodiment of the present application;

[0058] Figure 3 A schematic flow chart of a method for determining whether a device under test contains foreign matter provided in an embodiment of the present application;

[0059] Figure 4 A schematic flow chart of a first method for determining whether a device under test contains foreign matter provided in an embodiment of the present application;

[0060] Figure 5 A schematic flow chart of a second method for determining whether a device under test contains foreign matter provided in an embodiment of the present application;

[0061] Figure 6 A schematic flow chart of a third method for determining whether a device under test contains foreign matter provided in an embodiment of the present application;

[0062] Figure 7 A schematic diagram of a flow chart of relay foreign body detection steps provided in an embodiment of the present application;

[0063] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0064] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments.

[0065] Reference numerals:

[0066] 11-detection device; 12-vibration device; 13-sound collection device; 14-device under test; 15-amplitude collection device; 16-fixing device; 17-data collection device. DETAILED DESCRIPTION

[0067] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0068] During the manufacturing and use of electronic devices, tiny metal chips, dust or other impurities may remain inside. If there are foreign objects inside electronic devices, it will have a huge impact on the reliability of the electronic devices. By detecting whether there are foreign objects inside electronic devices, potential problems can be discovered in time. Prevent electronic device failures caused by foreign objects.

[0069] Taking relays as an example of electronic devices, currently, the main method of determining whether there are foreign objects inside the relays is to manually disassemble the relays and then visually inspect the disassembled relays, which results in low efficiency and poor accuracy in detecting foreign objects inside the relays.

[0070] The inventor has found that when there is foreign matter inside an electronic device, when the electronic device is shaken at a certain frequency, the foreign matter will be displaced inside the electronic device, and collide with the internal components of the electronic device to produce sound. Therefore, the present application proposes a method for determining whether there is foreign matter inside an electronic device through the sound signal when the electronic device vibrates. This method does not require manual disassembly of the electronic device, nor does it require manual visual inspection of the electronic device, so the detection efficiency can be improved.

[0071] In view of this, an embodiment of the present application provides a testing system, which is as follows:

[0072] Figure 1 A schematic diagram of the structure of a test system provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the test system includes: a detection device 11, a vibration device 12, and a sound collection device 13.

[0073] The vibration device 12 is used to carry the device under test 14 and drive the device under test 14 to vibrate. That is, the device under test 14 is located on the vibration device 12 and can vibrate under the drive of the vibration device 12. In some embodiments, the vibration device 12 can be, for example, a vibration table.

[0074] This embodiment does not limit the manner in which the device under test 14 is arranged on the vibration device 12. For example, the test system may further include a fixing device 16, which is used to fix the device under test 14 on the vibration device 12. The fixing device may be, for example, any device such as a clamp that can fix the device under test 14 on the vibration device 12. By fastening the device under test 14 with the fixing device, the accuracy of the vibration effect of the vibration device 12 driving the device under test 14 can be improved.

[0075] For another example, the vibration device 12 itself has a component that can fix the device under test 14, so the device under test 14 can be fixed by the component. For another example, the vibration device 12 is provided with a cavity for accommodating the device under test 14, so the device under test 14 can be located in the cavity and can vibrate under the drive of the vibration device 12.

[0076] The sound collection device 13 is used to collect the sound signal of the device under test 14 when it vibrates. The sound collection device 13 can be, for example, a sound sensor or a microphone, etc., and is used to collect the sound signal of the device under test 14 when it vibrates.

[0077] Exemplarily, the sound collection device 13 may be located within a preset range of the device under test 14. That is, the sound collection device 13 is placed near the device under test 14, and the position of the sound collection device 13 is not limited, as long as it can collect the sound signal when the device under test 14 vibrates.

[0078] The detection device 11 is used to execute the foreign body detection method provided in the embodiment of the present application. In this embodiment, the detection device 11 can be any device with processing and control functions, for example, a host computer.

[0079] In this embodiment, the vibration device 12 may drive the device under test 14 to vibrate at any amplitude and / or frequency, or may vibrate at a set frequency and / or amplitude.

[0080] Taking the setting of frequency and / or amplitude vibration as an example, illustratively, the vibration device 12 can control the device under test 14 to vibrate at the set frequency and / or amplitude based on the control instructions input by the user, or can control the device under test 14 to vibrate at the set frequency and / or amplitude based on the control instructions issued by the detection device 11.

[0081] The set frequency and / or amplitude may be pre-set in the vibration device 12, or may be issued together with the control instruction, or may be carried in the control instruction, or may be issued through other instructions, etc., which will not be described in detail. For example, the detection device 11 sends a control instruction to the vibration device 12, and the control instruction is used to control the vibration device 12 to apply vibration to the device under test 14 according to the set vibration frequency and vibration amplitude.

[0082] It should be noted that the interaction between the vibration device 12 and the detection device 11 described above can be achieved through the controller of the vibration device 12. The controller of the vibration device 12 can be a device independent of the vibration device 12 or a part of the vibration device 12, and there is no limitation on this.

[0083] Taking the example that the vibration device 12 can drive the device under test 14 to vibrate at a set frequency and / or amplitude, the above-mentioned test system can also include an amplitude acquisition device 15. The amplitude acquisition device 15 can be used to collect the actual amplitude of the device under test 14 when it vibrates at the set frequency. Exemplarily, the amplitude acquisition device 15 can also be used to collect the actual frequency of the device under test 14 when it vibrates at the set frequency. The amplitude acquisition device 15 can be located on the device under test 14, for example, fixed on the housing of the device under test 14.

[0084] The amplitude acquisition device 15 may be, for example, an acceleration sensor, which is used to acquire the acceleration of the device under test 14 when it vibrates. The acceleration can represent the vibration amplitude of the device under test 14 .

[0085] The test system may further include a data acquisition device 17, which is respectively connected to the detection device 11 and the sound acquisition device 13 and the amplitude acquisition device 15, and is used to convert the collected data of the amplitude acquisition device 15 and the sound acquisition device 13 from analog signals to digital signals and transmit them to the detection device 11.

[0086] In some embodiments, the detection device 11 may also be integrated with a data acquisition function, that is, it may be able to directly obtain the collected data from the amplitude acquisition device 15 and the sound acquisition device 13. In this implementation, the detection device 11 may be directly connected to the amplitude acquisition device 15 and the sound acquisition device 13 to collect the collected data.

[0087] Below Figure 1 Taking the test system shown as an example, the method provided by the embodiment of the present application is described in detail. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0088] Figure 2 A flow chart of a foreign body detection method provided in an embodiment of the present application is shown as follows: Figure 2 As shown, the execution subject of this embodiment may be the detection device 11 mentioned above, and the method includes the following steps:

[0089] S201 : Acquire a first sound signal of a device under test when it vibrates.

[0090] The first sound signal is a sound signal collected when the device under test 14 vibrates. The sound signal can reflect whether there is foreign matter in the device under test 14.

[0091] For another example, when the vibration device 12 applies vibration to the device under test 14, the detection device 11 can directly use the sound collection device 13 to collect sound signals, and the collected signals can be directly used as the first sound signals.

[0092] In this embodiment, the sound signal may be a sound signal when the vibration device 12 drives the device under test 14 to vibrate with any amplitude and / or frequency, or a sound signal when the device under test 14 is driven to vibrate with a set amplitude and / or frequency.

[0093] In addition, this embodiment does not limit the acquisition method of the above-mentioned first sound signal. For example, the detection device 11 can be a sound signal collected by the sound collection device 13 when the vibration device 12 applies vibration to the device under test 14, or it can be a sound signal collected by the sound collection device 13 after screening by other devices or equipment and then sent to the detection device 11. In this implementation, the operation of applying vibration to the device under test 14 and determining whether the device under test 14 contains foreign matter based on the first sound signal of the device under test 14 can be asynchronous.

[0094] Taking the sound signal collected when the device under test 14 is driven to vibrate by a set amplitude and / or frequency as an example, for example, the detection device 11 can obtain the actual amplitude and / or actual frequency of the device under test 14 when it is vibrating when the vibration device 12 applies vibration to the device under test 14. That is, the actual amplitude and / or actual frequency of the device under test 14 when it is vibrating is obtained through the amplitude and / or frequency signal collected by the amplitude acquisition device 15. Then, based on the relationship between the actual amplitude and / or actual frequency and the set amplitude and / or set frequency, it is determined whether the sound signal collected by the sound acquisition device 13 is valid, that is, whether it can be used as the first sound signal.

[0095] For example, when the difference between the set amplitude and / or the set frequency and the actual amplitude and / or the actual frequency is within the preset difference range, the sound signal collected after the collection time corresponding to the actual amplitude and / or the actual frequency is used as the first sound signal. In this way, it can be ensured that the first sound signal obtained is a sound signal collected when the device under test 14 vibrates at the set frequency and amplitude, and it will not be collected too early, so as to ensure that the sound signal can truly reflect the internal situation of the device under test 14. In this implementation, the operation of applying vibration to the device under test 14 and determining whether the device under test 14 contains foreign matter based on the first sound signal of the device under test 14 can be real-time.

[0096] Accordingly, in this implementation, the vibration device 12 may apply vibration to the device under test 14 based on user control, or may be controlled by the detection device 11, or may be initialized by the vibration device 12. For example, the detection device 11 may send a control instruction to the vibration device 12, and the control instruction is used to control the vibration device 12 to apply vibration to the device under test 14 according to the set vibration frequency and / or vibration amplitude. Exemplarily, the set frequency and / or amplitude may be specifically set according to the model of the device under test 14, as well as actual needs. For example, it may be a frequency and / or amplitude that can vibrate foreign matter inside the device under test 14, but will not vibrate the internal components of the device under test 14. The frequency and / or amplitude may be obtained in advance through experimental testing, or may be obtained based on historical experience, etc.

[0097] S202: Determine whether there is a foreign object in the device under test at least according to the first sound signal.

[0098] For example, the detection device 11 can determine whether there is a foreign object in the device under test based on the first sound signal and a pre-trained foreign object detection model.

[0099] For another example, the detection device 11 can obtain a second sound signal when a target device of the same type as the device under test is vibrating, and determine whether there is a foreign object in the device under test based on the second sound signal and the first sound signal. The target device and the device under test 14 are of the same type. The target device can be a device with foreign objects or a device without foreign objects, which is not limited in this embodiment.

[0100] Exemplarily, when the target device is a device without foreign matter. For example, the first sound signal and the sound signal of the target device can be used to determine whether the device under test 14 contains foreign matter. For example, the similarity of the two sound signals can be compared. When the similarity is higher, it means that the two are closer, and thus the probability that there is no foreign matter in the device under test 14 is higher. When the similarity is smaller, it means that the two are farther apart, and thus the probability that the device under test 14 contains foreign matter is higher.

[0101] Exemplarily, the above similarity can be determined by calculating the distance between two sound signals, or by obtaining the similarity between the two through a pre-trained model, etc., which will not be elaborated herein.

[0102] Optionally, before determining whether the device under test 14 contains foreign matter based on the first sound signal, the first sound signal may be preprocessed to improve the quality of the first sound signal. For example, noise in the first sound signal may be removed. That is, the sound signal that does not belong to the device under test 14 is filtered out. Exemplarily, the first sound signal may be preprocessed using algorithms such as median filtering and Kalman filtering.

[0103] Optionally, after determining whether the device under test 14 contains foreign matter, the detection result can be output, or when it is determined that the device under test 14 contains foreign matter, an alarm message that the device under test 14 contains foreign matter can be output. The specific subsequent processing can be set according to actual needs and is not limited in this embodiment.

[0104] In the foreign body detection method provided by the embodiment of the present application, when there is foreign matter inside the device under test, when the device under test is shaken at a certain frequency, the foreign matter will be displaced inside the device under test, and collide with the internal components of the device under test to produce sound. Therefore, the present application can accurately determine whether there is foreign matter inside the device under test through the sound signal when the device under test vibrates. This method does not require manual disassembly of the device under test, nor does it require manual visual inspection of the device under test, so the detection efficiency can be improved.

[0105] The following uses the example of a target device being a device without foreign matter to illustrate how to determine whether the device under test 14 contains foreign matter based on the first sound signal and the second sound signal.

[0106] Figure 3 A schematic flow chart of a method for determining whether a device under test contains foreign matter is provided in an embodiment of the present application. Figure 3 As shown, the above step S202 may include, for example:

[0107] S301 : Determine the sound similarity between the device under test and the target device according to the first sound signal and the second sound signal.

[0108] S302: Determine whether there is a foreign object in the device under test at least based on the sound similarity.

[0109] In some embodiments, the sound similarity may include, for example, a first similarity and / or a second similarity.

[0110] The first similarity is the similarity between the first sound signal and the second sound signal. The similarity can be obtained, for example, by calculating the distance between the two.

[0111] The second similarity is the similarity between the first signal feature sequence of the first sound signal and the second signal feature sequence of the second sound signal.

[0112] Exemplarily, when the first signal feature sequence includes a first time domain signal feature sequence and the second signal feature sequence includes a second time domain signal feature sequence, the second similarity includes the time domain similarity between the first time domain signal feature sequence and the second time domain signal feature sequence; and / or when the first signal feature sequence includes a first frequency domain signal feature sequence and the second signal feature sequence includes a second frequency domain signal feature sequence, the second similarity includes the frequency domain similarity between the first frequency domain signal feature sequence and the second frequency domain signal feature sequence.

[0113] The following describes how to determine whether there is a foreign object in the device under test based on the sound similarity to perform foreign object detection.

[0114] Detection method 1: Use the first similarity to detect foreign objects.

[0115] Figure 4 The first method for determining whether a device under test contains foreign matter is provided in the embodiment of the present application. Figure 4 As shown, step S302 may include the following steps:

[0116] S401: Calculate a first similarity between a first sound signal and a second sound signal.

[0117] The calculation of the first similarity may be, for example, Euclidean distance, Manhattan distance or Minkowski distance. The closer the distance, the more similar the two are, and the farther the distance, the less similar the two are.

[0118] S402: Determine whether the first similarity is less than or equal to a preset first preset value. If yes, execute S403; if no, execute S404.

[0119] S403: Determine whether the device under test contains foreign matter.

[0120] S404: Determine that there is no foreign matter in the device under test.

[0121] Detection method 2: Use the second similarity to detect foreign objects.

[0122] As mentioned above, the second similarity may include: the time domain similarity between the first time domain signal feature sequence of the first signal feature sequence and the second time domain signal feature sequence of the second signal feature sequence, and / or the frequency domain similarity between the first frequency domain signal feature sequence of the first signal feature sequence and the second frequency domain signal feature sequence of the second signal feature sequence.

[0123] The time domain signal feature sequence mentioned here can be, for example, the zero-crossing rate of the signal, the number of peak points of the signal, the statistical value of the signal, the skewness of the signal, the kurtosis of the signal, and the correlation of the signal. By way of example, one or more of the above time domain signal features can be used to form a time domain signal feature sequence.

[0124] Among them, the zero-crossing rate of the signal is an important feature in signal processing, which indicates the number of times the signal changes from a positive value to a negative value or from a negative value to a positive value within a certain period of time.

[0125] The peak points of a signal refer to the total number of local maximum and local minimum values ​​in a signal sequence.

[0126] The statistical value of the signal, for example, may include the maximum value X of the signal max , minimum value X min , mean X mean , median mid , standard deviation, mean deviation, or one or more of them.

[0127] The skewness of the signal is the third-order matrix of the signal, which reflects the asymmetry of the signal probability density function and can well reflect the slight changes of the signal. That is, the skewness of the signal can reflect the slight sound generated by the foreign matter of the device under test 14.

[0128] The kurtosis of a signal reflects the height of the peak of the signal's density function distribution at the mean.

[0129] The correlation of the signal includes an unbiased estimate of autocorrelation and a biased estimate of autocorrelation. Correlation analysis can show the tendency of the signal to repeat its own characteristics. When the device under test 14 contains foreign matter, the up and down vibration of the foreign matter will reflect autocorrelation.

[0130] The frequency domain signal feature sequence can be, for example, the power density spectrum of the frequency domain, the median frequency of the power spectrum, the mean frequency of the signal, the statistical value of the spectrum, the kurtosis of the spectrum, the skewness of the spectrum, the energy concentration, and the entropy of the spectrum. By way of example, one or more of the above frequency domain signal features can be used to form a frequency domain signal feature sequence.

[0131] Among them, the power density spectrum in the frequency domain is the density representation of the power spectrum, which is usually used to describe the power distribution of the signal within a unit frequency bandwidth. It is a normalized form of the power spectrum, indicating the power per unit frequency bandwidth.

[0132] The power spectrum is the power distribution of a signal in the frequency domain, usually the square of the amplitude of the Fourier transform of the signal. It represents the power of the signal at each frequency component. The power spectrum can help analyze the distribution of the signal's energy at different frequencies. The median frequency of the power spectrum can be calculated based on the frequency point k where the power spectrum area is equal.

[0133] The statistical value of the spectrum may reflect the characteristics of the spectrum, for example, may include one or more of the frequency standard deviation, the density of the spectrum, and the standard deviation of the spectrum.

[0134] The kurtosis of the spectrum can reflect the distribution of the sound signal on the spectrum.

[0135] The skewness of the spectrum can reflect the slight changes in the sound signal on the spectrum.

[0136] Energy concentration can reflect the concentration of spectrum energy near the peak.

[0137] The spectrum entropy can reflect the disorder of the spectrum. When there is a foreign object in the device under test 14, the disorder of its sound will increase under vibration conditions.

[0138] It should be noted that the time domain signal feature sequence and the frequency domain signal feature sequence of this embodiment are not limited to the above features, and may also include any sound feature that can reflect the sound characteristics, so as to identify whether the device under test 14 contains foreign matter.

[0139] Method 21: Use time domain similarity to detect foreign objects.

[0140] Figure 5 A schematic flow chart of a second method for determining whether a device under test contains foreign matter provided in an embodiment of the present application. Figure 5 As shown, step S302 may include the following steps:

[0141] S501. Calculate a second similarity between a first signal feature sequence and a second signal feature sequence.

[0142] The second similarity may be calculated, for example, using Euclidean distance, Manhattan distance, or Minkowski distance. The closer the distance, the more similar the two are, and the farther the distance, the less similar the two are.

[0143] S502: Determine whether the second similarity is less than or equal to a preset second preset value. If yes, execute S503; if no, execute S504.

[0144] S503: Determine whether the device under test contains foreign matter.

[0145] S504: Determine that there is no foreign matter in the device under test.

[0146] Method 22: Use frequency domain similarity for foreign body detection.

[0147] The method of using frequency domain similarity to detect foreign objects is similar to method 21, and the preset second preset values ​​used therein can be the same or different, which will not be described in detail.

[0148] Method 23: foreign body detection is performed by combining time domain similarity and frequency domain similarity.

[0149] Figure 6 A schematic flow chart of a third method for determining whether a device under test contains foreign matter provided in an embodiment of the present application. Figure 6 As shown, step S302 may include the following steps:

[0150] S601. Calculate the time domain similarity between a first time domain signal feature sequence and a second time domain signal feature sequence.

[0151] S602: Determine whether the time domain similarity is less than or equal to a preset second preset value. If yes, execute S603; if no, it means that the current use of the time domain similarity cannot determine whether the device under test contains foreign matter, and further execute S604.

[0152] S603: Determine whether the device under test contains foreign matter.

[0153] S604: Calculate the frequency domain similarity between the first frequency domain signal feature sequence and the second frequency domain signal feature sequence. S605: Determine whether the frequency domain similarity is less than or equal to a preset second preset value. If so, execute S603.

[0154] If not, it is determined that the device under test has no foreign matter. Alternatively, S606 may be further executed.

[0155] S606: Use a foreign matter detection model to determine whether the device under test contains foreign matter.

[0156] For example, at least one of the first sound signal, the first time domain signal feature sequence and the first frequency domain signal feature sequence is input into a pre-trained foreign body detection model to obtain a detection result output by the foreign body detection model, and the detection result is used to characterize whether there is a foreign body in the device under test.

[0157] That is, the representation form of the input to the above-mentioned foreign matter detection model is related to the form of the sample data used when training the model.

[0158] Taking the input of the first sound signal as an example, the above-mentioned foreign matter detection model can be pre-trained using the sound signal of the device under test 14 when it vibrates, so that the trained foreign matter detection model can draw a conclusion on whether the device under test 14 contains foreign matter based on the sound signal.

[0159] It should be understood that the models mentioned in the above embodiments may be, for example, any machine learning model capable of achieving classification, such as a back propagation (BP) neural network, an autoregressive model, an adaptive boosting (Adaboost) model, a decision tree model, a support vector machine (SVM), a Bayesian method or other machine learning models, etc. In some embodiments, the foreign body detection model may also be referred to as a classifier.

[0160] Exemplarily, the foreign body detection model is a neural network, in which the input of the neuron is x = [x0, x1, ..., xn-1], such as the time domain feature sequence, frequency domain feature sequence or sound signal of the device under test 14 as the input value, the corresponding neuron weight is w = [w0, w1, ..., wn-1], and the bias of the weighted sum is b. Among them, each neuron can be output directly or through an activation function. The activation function includes various forms such as maximum value and sigmoid function, which are not limited in this embodiment. Multiple neurons can form a hidden layer of a neural network, and the neural network can have multiple hidden layers.

[0161] The detection result obtained based on the foreign body detection model can only indicate that the device under test 14 contains foreign matter, or does not contain foreign matter. In some embodiments, some relays with foreign matter, such as fiber foreign matter, plastic foreign matter, etc., can be artificially made to establish corresponding data sets and feature sets, and then these data sets and feature sets are used to train the model, so that the model can not only determine whether the device under test 14 contains foreign matter, but also detect the type of foreign matter when it contains foreign matter, so as to assist the user in identifying the problem of the device under test 14. For example, the type of foreign matter can be fiber foreign matter, plastic foreign matter, etc.

[0162] It should be understood that although the above example uses time domain similarity first and then frequency domain similarity for judgment, in specific implementation, frequency domain similarity may be used first and then time domain similarity for judgment, or both may be used for judgment at the same time.

[0163] In addition, not only can the time domain similarity and the frequency domain similarity be combined for judgment, but also any two or three of the first similarity, the time domain similarity and the frequency domain similarity can be used for judgment. Alternatively, any one, two or three of the above three can be further combined with the foreign body detection model for comprehensive judgment. By combining multi-dimensional detection methods, the accuracy of detection can be improved.

[0164] The method provided in this embodiment can determine whether there is foreign matter inside the device under test 14 according to the characteristic sequence of the sound signal obtained when the device under test 14 vibrates. Since these characteristics can reflect the characteristics of the sound, it is possible to accurately determine whether the device under test 14 contains foreign matter based on the characteristics of these sounds.

[0165] It should be understood that the second sound signal of the target device when vibrating may be collected in advance by the user in other ways, or may be obtained by using the test system provided in the embodiment of the present application.

[0166] For example, before testing the device under test 14, the second sound signal of the target device when it is vibrating and the second signal characteristic sequence can also be obtained through the testing system.

[0167] In a possible implementation, taking applying vibration with a set frequency and / or amplitude as an example, the process of establishing the second sound signal of the target device when vibrating is as follows:

[0168] (1) The detection device 11 sends a control instruction to the vibration device 12, or the user inputs a control instruction to the vibration device 12, so as to control the vibration device 12 to vibrate the foreign object-free relay according to the set vibration frequency and / or amplitude, or the vibration device 12 vibrates according to the initially set vibration frequency and / or amplitude.

[0169] (2) The vibration device 12 applies vibration to the target device.

[0170] (3) The sound collecting device 13 sends the collected sound signal to the data collecting device 17 .

[0171] (4) The amplitude acquisition device 15 sends the acquired acceleration signal to the data acquisition device 17 .

[0172] (5) The data acquisition device 17 sends the received sound signal and amplitude and / or frequency signal to the detection device 11.

[0173] (6) The detection device 11 obtains the actual amplitude and / or actual frequency of the device under test 14 during vibration based on the amplitude and / or frequency signal.

[0174] (7) The detection device 11 determines whether the difference between the set amplitude and / or set frequency and the actual amplitude and / or actual frequency is within a preset difference range. The specific steps are shown in S707 and will not be described in detail here.

[0175] (8) The detection device 11 extracts the sound signal collected after the collection time corresponding to the actual amplitude and / or actual frequency.

[0176] (9) Repeat the above steps to measure multiple target devices multiple times to obtain sound signals of the multiple target devices.

[0177] (10) The detection device 11 can extract the time domain signal features and / or frequency domain signal features of the sound signals of the multiple target devices, and select typical values ​​therefrom to ultimately form a second sound signal and a second signal feature sequence.

[0178] Since the sound signal of the target device obtained above can be in the same manner as the sound signal of the device under test 14 , the difference caused by different sound collection devices can be avoided or reduced, thereby improving the accuracy of foreign body detection of the device under test 14 .

[0179] The following uses the device under test 14 as a target relay and the test system including the data acquisition device 17 as an example to illustrate how to implement the detection of the device under test 14.

[0180] After the target relay is manually fixed on the fixing device 16 of the vibration device 12 , the amplitude collection device 15 is arranged on the device under test 14 , and the sound collection device 13 is arranged near the device under test 14 .

[0181] Then, the detection device 11 can realize foreign body detection in the following manner:

[0182] Figure 7 A schematic diagram of a relay foreign body detection process provided in an embodiment of the present application, such as Figure 7 As shown, the method may include the following steps:

[0183] S701. The detection device sends a control instruction to the vibration device, where the control instruction is used to control the vibration device to apply vibration to the target relay according to the set vibration frequency and vibration amplitude.

[0184] S702: The vibration device applies vibration to the target relay according to the set vibration frequency and / or vibration amplitude.

[0185] S703: The sound collection device sends the collected sound signal to the data collection device.

[0186] S704: The amplitude acquisition device sends the acquired amplitude and / or frequency signal to the data acquisition device.

[0187] S705: The data acquisition device sends the received sound signal and amplitude and / or frequency signal to the detection device.

[0188] S706: The detection device obtains the actual amplitude and / or actual frequency of the target relay when it vibrates based on the amplitude and / or frequency signal.

[0189] S707: The detection device determines whether the difference between the set amplitude and / or the set frequency and the actual amplitude and / or the actual frequency is within a preset difference range.

[0190] If not, a prompt message is output to prompt the user to recheck and adjust the fixing device 16 (for example, re-fix the target relay on the fixing device 16, or replace the fixing device 16, which can be determined according to the tightening condition between the fixing device 16 and the target relay). After the inspection of the fixing device 16 is completed, the process returns to S701 to start execution. If yes, it means that the vibration device 12 applies vibration to the target relay to reach the set amplitude, and then step S708 is executed.

[0191] S708. The detection device uses the sound signal collected after the collection time corresponding to the actual amplitude and / or actual frequency as the first sound signal to obtain the first sound signal.

[0192] S709: The detection device preprocesses the first sound signal to remove noise in the first sound signal.

[0193] S710: The detection device determines whether the target relay contains foreign matter according to the first sound signal.

[0194] According to the method provided in this embodiment, when there is foreign matter inside the relay, when the relay is shaken at a certain frequency, the foreign matter will be displaced inside the relay, and will collide with the internal components of the relay to produce sound. Therefore, the present application can accurately determine whether there is foreign matter inside the relay through the sound signal when the relay vibrates. This method does not require manual disassembly of the relay, nor does it require manual visual inspection of the relay, so the detection efficiency can be improved.

[0195] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 8 As shown, the electronic device 800 may include: a memory 801 and a processor 802. Optionally, the electronic device may further include a transceiver 803, wherein the memory 801 and the processor 802 communicate; illustratively, the memory 801, the processor 802 and the transceiver 803 may communicate via a communication bus 806, the memory 801 is used to store a computer program, and the processor 802 executes the computer program to implement the method of the above embodiment.

[0196] Optionally, the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc. The steps in the method embodiments disclosed in the present application may be directly implemented as being executed by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.

[0197] The present application also provides a method such as Figure 1 The test system shown in the figure can be found in the above content for a detailed description, which will not be repeated here.

[0198] An embodiment of the present application further provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, a method in any of the above method embodiments is implemented.

[0199] An embodiment of the present application also provides a computer program product, including a computer program, which implements the method in any of the above method embodiments when the computer program is executed by a processor.

[0200] All or part of the steps of the above-mentioned method embodiments can be completed by hardware related to program instructions. The above-mentioned program can be stored in a readable memory. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the above-mentioned memory (storage medium) includes: read-only memory (ROM), RAM, flash memory, hard disk, solid state drive, magnetic tape, floppy disk, optical disc and any combination thereof.

[0201] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processing unit of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1A device that provides the functions specified in a block or multiple blocks.

[0202] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0203] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0204] Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

[0205] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0206] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A foreign body detection method, characterized in that: The method comprises: Acquiring a first sound signal of the device under test when it vibrates; Whether there is a foreign object in the device under test is determined at least based on the first sound signal.

2. The method according to claim 1, characterized in that The method further comprises: Acquiring a second sound signal of a target device when it is vibrating, wherein the target device and the device under test are devices of the same type; The step of determining whether there is a foreign object in the device under test at least according to the first sound signal includes: Determining the sound similarity between the device under test and the target device according to the first sound signal and the second sound signal; Whether there is a foreign object in the device under test is determined at least according to the sound similarity.

3. The method according to claim 2, characterized in that The sound similarity includes a first similarity and / or a second similarity, the first similarity is the similarity between the first sound signal and the second sound signal, and the second similarity is the similarity between a first signal feature sequence of the first sound signal and a second signal feature sequence of the second sound signal.

4. The method according to claim 3, characterized in that The target device is a device without foreign matter, and when the sound similarity includes a first similarity, determining whether there is a foreign matter in the device under test at least according to the sound similarity includes: If the first similarity is less than or equal to a preset first preset value, it is determined that a foreign object exists in the device under test.

5. The method according to claim 3, characterized in that: The target device is a device without foreign matter, and when the sound similarity includes a second similarity, determining whether there is a foreign matter in the device under test at least based on the sound similarity includes: If the second similarity is less than or equal to a preset second preset value, it is determined that a foreign object exists in the device under test.

6. The method according to claim 5, characterized in that The second similarity includes: When the first signal feature sequence includes a first time domain signal feature sequence and the second signal feature sequence includes a second time domain signal feature sequence, the second similarity includes a time domain similarity between the first time domain signal feature sequence and the second time domain signal feature sequence; and / or When the first signal feature sequence includes a first frequency domain signal feature sequence and the second signal feature sequence includes a second frequency domain signal feature sequence, the second similarity includes a frequency domain similarity between the first frequency domain signal feature sequence and the second frequency domain signal feature sequence; If the second similarity is less than or equal to a preset second preset value, determining that a foreign object exists in the device under test includes: If the time domain similarity and / or the frequency domain similarity is less than or equal to a preset second preset value, it is determined that a foreign object exists in the device under test.

7. The method according to claim 6, characterized in that The step of determining whether there is a foreign object in the device under test at least according to the sound similarity comprises: If both the time domain similarity and the frequency domain similarity are greater than the preset second preset value, it is determined that there is no foreign matter in the device under test.

8. The method according to claim 6, characterized in that The determining whether there is a foreign object in the device under test at least according to the first sound signal further includes: If both the time domain similarity and the frequency domain similarity are greater than the preset second preset value, at least one of the first sound signal, the first time domain signal feature sequence and the first frequency domain signal feature sequence is input into a pre-trained foreign body detection model to obtain a detection result output by the foreign body detection model, and the detection result is used to characterize whether there is a foreign body in the device under test.

9. The method according to claim 8, characterized in that When the device under test contains foreign matter, the detection result is also used to characterize the type of the foreign matter present in the device under test.

10. The method according to any one of claims 1 to 9, characterized in that Before determining whether there is a foreign object in the device under test according to the first sound signal, the method further includes: The first sound signal is preprocessed to remove noise in the first sound signal.

11. The method according to any one of claims 1 to 9, characterized in that The step of obtaining a first sound signal of the device under test when it vibrates includes: A first sound signal is obtained when the device under test vibrates at a set frequency and a set amplitude.

12. The method according to claim 11, characterized in that Before obtaining the first sound signal of the device under test when vibrating at a set frequency and a set amplitude, the method further includes: Obtaining an actual amplitude of the device under test when it vibrates at a set frequency and a set amplitude; It is determined that the difference between the set amplitude and the actual amplitude is within a preset difference range.

13. The method according to claim 11, characterized in that The device under test is arranged on a vibration device, and the method further comprises: A control instruction is sent to a vibration device, wherein the vibration device is capable of vibrating in response to the control instruction so as to make the device under test vibrate at the set frequency and the set amplitude.

14. A testing system, characterized in that: The test system comprises: a detection device, a vibration device, and a sound collection device; The vibration device is used to carry the device under test and drive the device under test to vibrate; The sound collection device is used to collect a first sound signal of the device under test when it vibrates; The detection device is used to perform the method as described in any one of claims 1-13.

15. The system according to claim 14, characterized in that The vibration device is used to receive the control instruction sent by the detection device, and drive the device under test to vibrate according to the set frequency and set amplitude according to the control instruction.

16. The system according to claim 15, characterized in that The system further comprises: an amplitude acquisition device; The amplitude acquisition device is used to acquire the actual amplitude of the device under test when it vibrates at a set frequency and a set amplitude; The detection device is also used to obtain a first sound signal of the device under test when it vibrates at a set frequency and a set amplitude when the difference between the set amplitude and the actual amplitude is within a preset difference range.

17. The system according to any one of claims 14 to 16, characterized in that: The system further comprises: a fixing device; The fixing device is used to fix the device under test on the vibration device.

18. The system according to any one of claims 14 to 16, characterized in that: The system also includes: a data acquisition device; The data acquisition device is connected to the detection device and the sound acquisition device respectively, and is used to obtain the first sound signal of the device under test collected by the sound acquisition device when it vibrates, and send the first sound signal to the detection device.

19. An electronic device, characterized in that: The electronic device comprises: a processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 13.

20. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 13 when executed by a processor.

21. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 13 when being executed by a processor.

Images