A loudspeaker anomaly detection method and device, a storage medium and an electronic device

Abstract

Embodiments of the present application disclose a loudspeaker anomaly detection method and device, a storage medium and an electronic device. The method comprises: collecting first waveform information of the environment around the loudspeaker in a non-broadcast mode of the loudspeaker; collecting second waveform information of the loudspeaker and the environment around the loudspeaker in a broadcast mode of the loudspeaker; determining a target waveform fitting interval matching the first waveform information; wherein the target waveform fitting interval is determined by the degree of interference of noise in the environment around the loudspeaker in the non-broadcast mode of the loudspeaker on waveform changes; and if the waveform fitting degree of the second waveform information and preset original waveform information is not in the target waveform fitting interval, it is determined that the loudspeaker function is abnormal; wherein the original waveform information is determined by collecting loudspeaker broadcast sound waves without noise interference sound waves. The technical solution can realize automatic detection of loudspeaker anomalies and improve the fault detection rate of the loudspeaker.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of loudspeaker detection, and particularly relate to a loudspeaker anomaly detection method and device, a storage medium and an electronic device. BACKGROUND

[0002] Currently, a surveillance camera product generally configures a Mic (Microphone) and a loudspeaker to realize a surveillance voice broadcast function. The loudspeaker, as an important carrier of the surveillance voice broadcast, is particularly important in reliability. The loudspeaker may be damaged due to factors such as a device itself defect, long use time, aging, and human factors, and thus the surveillance voice function is abnormal or even fails.

[0003] In the prior art, a feature value of a mixed sound emitted by a sound emitting device and an environment is calculated after the mixed sound is subtracted from environmental noise, and the feature value is compared with a preset value to determine whether the sound emitting device has a fault.

[0004] Nowadays, many sound emitting devices need to rotate, and the position of the loudspeaker changes when the device rotates. The change in the position of the loudspeaker causes the sound to be affected by a structure or the surrounding environment, resulting in a large difference between the collected sound and the system preset. The prior art is likely to cause misjudgment, and thus the safety level of the surveillance camera system is reduced. SUMMARY

[0005] Embodiments of the present application provide a loudspeaker anomaly detection method and device, a storage medium and an electronic device, which realize automatic detection of loudspeaker anomalies, improve the fault detection rate of the loudspeaker, and thus improve the safety level of the surveillance camera system.

[0006] In a first aspect, embodiments of the present application provide a loudspeaker anomaly detection method, which includes:

[0007] In a non-broadcast mode of the loudspeaker, first waveform information of a surrounding environment of the loudspeaker is collected; in a broadcast mode of the loudspeaker, second waveform information of the loudspeaker and the surrounding environment is collected.

[0008] A target waveform fitting interval matched with the first waveform information is determined; wherein the target waveform fitting interval is determined by an interference degree of noise of the surrounding environment of the loudspeaker on waveform change in the non-broadcast mode of the loudspeaker.

[0009] If a waveform fitting degree of the second waveform information and preset original waveform information is not in the target waveform fitting interval, it is determined that the loudspeaker function is abnormal; wherein the original waveform information is determined by collecting a broadcast sound wave of the loudspeaker without noise interference.

[0010] In a second aspect, the embodiments of the present application provide a loudspeaker anomaly detection device, which comprises:

[0011] a waveform information collection module, configured to collect first waveform information of a surrounding environment of the loudspeaker in a non-announcing mode of the loudspeaker, and collect second waveform information of the loudspeaker and the surrounding environment in an announcing mode of the loudspeaker;

[0012] a target waveform fitting interval determination module, configured to determine a target waveform fitting interval matched with the first waveform information, wherein the target waveform fitting interval is determined by an interference degree of noise of the surrounding environment of the loudspeaker on waveform change in the non-announcing mode of the loudspeaker;

[0013] a loudspeaker function determination module, configured to determine that a function of the loudspeaker is abnormal if a waveform fitting degree of the second waveform information and preset original waveform information is not in the target waveform fitting interval, wherein the original waveform information is determined by collecting an announcing sound wave of the loudspeaker without noise interference.

[0014] In a third aspect, the embodiments of the present application provide a computer readable storage medium, which stores a computer program, and the program is executed by a processor to implement the loudspeaker anomaly detection method provided by the embodiments of the present application.

[0015] In a fourth aspect, the embodiments of the present application provide an electronic device, which comprises a memory, a processor, and a computer program stored in the memory and executable by the processor, and the processor implements the loudspeaker anomaly detection method provided by the embodiments of the present application when executing the computer program.

[0016] The technical scheme provided by the embodiments of the present application collects first waveform information of a surrounding environment of a loudspeaker in a non-announcing mode of the loudspeaker, collects second waveform information of the loudspeaker and the surrounding environment in an announcing mode of the loudspeaker, determines a target waveform fitting interval matched with the first waveform information, and judges whether a waveform fitting degree of the second waveform information and preset original waveform information is in the target waveform fitting interval, and determines that a function of the loudspeaker is abnormal if the waveform fitting degree is not in the target waveform fitting interval. The technical scheme can realize automatic detection of loudspeaker anomaly, can improve a fault detection rate of the loudspeaker, improves reliability of an announcing function of the loudspeaker, and further improves safety of a monitoring system. BRIEF DESCRIPTION OF DRAWINGS

[0017] Figure 1 is a flowchart of the loudspeaker anomaly detection method provided by the first embodiment of the present application;

[0018] Figure 2 is a waveform diagram of the second waveform information provided by the first embodiment of the present application;

[0019] Figure 3FIG. 1 is a structural schematic diagram of a warning ball according to an embodiment of the present application;

[0020] Figure 4 FIG. 2 is a schematic diagram of a warning ball installation scene according to an embodiment of the present application;

[0021] Figure 5 FIG. 3 is a schematic diagram of another warning ball installation scene according to an embodiment of the present application;

[0022] Figure 6 FIG. 4 is a schematic diagram of another warning ball installation scene according to an embodiment of the present application;

[0023] Figure 7 FIG. 5 is a circuit block diagram of a loudspeaker abnormality detection circuit according to an embodiment of the present application;

[0024] Figure 8 FIG. 6 is a schematic diagram of a loudspeaker abnormality detection process according to an embodiment of the present application;

[0025] Figure 9 FIG. 7 is a structural schematic diagram of a loudspeaker abnormality detection device according to an embodiment of the present application;

[0026] Figure 10 FIG. 8 is a structural schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0027] The present application will be further described by examples in conjunction with the accompanying drawings. It is to be understood that the following examples are only used to explain the present application, and not to limit the present application. In addition, it should be noted that, for the convenience of description, only the parts related to the present application are shown in the drawings, and not all the structures.

[0028] Before the example embodiments are discussed in more detail, it should be mentioned that some of the example embodiments are described as processes or methods depicted as flow diagrams. While the steps of the processes are depicted in a sequential order, many of the steps can be performed in parallel, concurrently or at the same time, without departing from the scope of the example embodiments. In addition, the order of the steps can be re-arranged. The processes can be terminated when their operations are completed, but can also have additional steps not included in the figure, which can also be performed after the operations of the processes are completed. The processes can correspond to methods, functions, routines, subroutines, subprograms, etc.

[0029] Embodiment One

[0030] Figure 1is a flowchart of a loudspeaker anomaly detection method provided by Embodiment One of the present application. The present embodiment can be applied to the case of detecting anomalies in the voice broadcast function of the loudspeaker of a surveillance camera product. The method can be executed by a loudspeaker anomaly detection device provided by the present application. The device can be implemented in software and / or hardware and can be integrated into a smart terminal or other device for voice broadcast function anomaly detection.

[0031] As shown in Figure 1 the loudspeaker anomaly detection method comprises:

[0032] S110, in the loudspeaker non-broadcast mode, collecting first waveform information of the environment around the loudspeaker; in the loudspeaker broadcast mode, collecting second waveform information of the loudspeaker and the environment around the loudspeaker;

[0033] In the present solution, the first waveform information can be the waveform information composed of noise interference sound waves in the environment around the loudspeaker; and the second waveform information can be the waveform information composed of noise interference sound waves in the environment around the loudspeaker and loudspeaker broadcast sound waves.

[0034] In the present embodiment, the echo cancellation function is turned off after the device is powered on, so as to avoid automatically eliminating the sound collected by the Mic from the loudspeaker broadcast. The environment around the loudspeaker for a certain duration can be recorded by the Mic to determine the first waveform information and the second waveform information. After the detection of whether the loudspeaker function is abnormal is completed, the echo cancellation function needs to be turned on.

[0035] In the present technical solution, optionally, collecting the first waveform information of the environment around the loudspeaker comprises:

[0036] collecting noise interference sound waves in the environment around the loudspeaker in a first time period to obtain the first waveform information;

[0037] Correspondingly, collecting the second waveform information of the environment around the loudspeaker comprises:

[0038] collecting noise interference sound waves and loudspeaker broadcast sound waves in the environment around the loudspeaker in a second time period to obtain the second waveform information; and the time difference between the first time period and the second time period is less than a preset time difference.

[0039] In the present solution, a signal generator can be used to output a large number of different noise signals to simulate the noise interference sound waves in the environment. The noise interference sound waves in the environment around the loudspeaker for a certain duration can be recorded by the Mic in the case of no loudspeaker broadcast to determine the first waveform information. In the case of loudspeaker broadcast, the Mic collects the broadcast sound waves of the loudspeaker. At the same time of collecting the broadcast sound waves of the loudspeaker, the noise interference sound waves in the environment can also be collected. At this time, the second waveform information of the environment around the loudspeaker contains noise interference sound waves and loudspeaker broadcast sound waves.

[0040] The time difference between the first time period and the second time period is less than a preset time difference, which can ensure that the noise interference sound wave in the second waveform information is consistent with the noise interference sound wave collected by the first waveform information, and avoid inaccurate abnormal detection results of the loudspeaker due to changes in the noise interference sound wave.

[0041] Exemplarily, Figure 2 is a waveform schematic diagram of the second waveform information provided by the embodiment one of the present application, and the second waveform information is formed by the loudspeaker broadcast sound wave and the noise interference sound wave.

[0042] By collecting the noise interference sound wave and the loudspeaker broadcast sound wave, it can be judged whether the loudspeaker function is abnormal based on the interference degree of the noise interference sound wave.

[0043] S120, determining a target waveform fitting interval matched with the first waveform information; wherein the target waveform fitting interval is determined by the interference degree of the noise of the environment around the loudspeaker on the waveform change in the un-broadcast mode of the loudspeaker;

[0044] In the embodiment, the fitting interval is determined by the interference degree of the noise of the environment around the loudspeaker on the waveform change in the un-broadcast mode of the loudspeaker. For example, the fitting interval can be set as [65%, 100%], [75%, 100%], [85%, 100%]. The greater the noise interference sound wave of the environment around the loudspeaker in the un-broadcast mode of the loudspeaker, the greater the degree of waveform change of the loudspeaker broadcast sound wave, and at this time, the greater the setting range of the fitting interval. Specifically, the preset fitting interval of the collected sound can be set through massive data simulation.

[0045] In the present scheme, the fitting interval matched with the first waveform information can be searched from the preset fitting interval as the target fitting interval.

[0046] In the present technical scheme, optionally, determining the target waveform fitting interval matched with the first waveform information comprises:

[0047] Analog-digital conversion is performed on the first waveform information including the noise sound wave information of the environment around the loudspeaker, and the waveform amplitude root mean square of the first waveform information after analog-digital conversion is determined;

[0048] The preset fitting interval matched with the waveform amplitude root mean square is taken as the target waveform fitting interval;

[0049] The waveform amplitude root mean square is used to reflect the interference degree of the noise sound wave information of the environment around the loudspeaker on the change of the first waveform information.

[0050] In the embodiment, the waveform amplitude root mean square interval can be determined according to the number of bits of the analog-to-digital conversion unit. For example, if the number of bits of the analog-to-digital conversion unit is 8 bits, the waveform amplitude root mean square interval can be set to [0, 255].

[0051] In the scheme, after obtaining the first waveform information, the analog-to-digital conversion can be performed based on the ADC (analog-to-digital converter) analog-to-digital conversion unit of the Soc (System on Chip), and the digitized first waveform information is output to the RMS calculation processing unit of the Soc to calculate the waveform amplitude root mean square of the first waveform information after analog-to-digital conversion.

[0052] The waveform amplitude root mean square is used to reflect the interference degree of the noise sound wave information around the loudspeaker on the change of the first waveform information. The greater the waveform amplitude root mean square, the stronger the interference degree. According to the matching relationship between the waveform amplitude root mean square and the preset fitting interval determined in advance, the fitting interval corresponding to the first waveform information can be determined, and the fitting interval is taken as the target waveform fitting interval.

[0053] By obtaining the preset fitting interval matched with the waveform amplitude root mean square, the interference degree of the noise interference sound wave on the loudspeaker broadcast sound wave can be determined, and the automatic detection of the loudspeaker anomaly can be realized, and the fault detection rate of the loudspeaker is improved.

[0054] In the technical scheme, the preset fitting interval matched with the waveform amplitude root mean square is taken as the target waveform fitting interval, which includes:

[0055] Based on the waveform amplitude root mean square, a preset environmental interference level matched with the waveform amplitude root mean square is determined from the preset environmental interference level mapping information.

[0056] The preset fitting interval matched with the associated preset environmental interference level is determined as the target waveform fitting interval. The environmental interference level is used to represent the interference degree of the noise around the loudspeaker on the waveform change.

[0057] The environmental interference level is used to represent the interference degree of the noise sound wave information around the loudspeaker on the waveform change. Optionally, the environmental interference level can be represented by extremely high, high, medium, low and extremely low.

[0058] In the scheme, the matching relationship between the waveform amplitude root mean square and the environmental interference level, and the matching relationship between the environmental interference level and the fitting interval are obtained through a large amount of data experiments in advance.

[0059] Exemplarily, taking the bit number of the analog-digital conversion unit as 8 bits for example, the matching relationship between the waveform amplitude root mean square and the environmental interference level is shown in Table 1. The matching relationship between the waveform amplitude root mean square and the environmental interference level can be set according to the interference degree of the noise sound wave information on the waveform, and can be set according to Table 1, but is not unique, and is not specifically limited in the embodiment.

[0060] Table 1

[0061] Root Mean Square (RMS) of waveform amplitude Ambient interference level 255 > RMS > 128 Very high 128 > RMS > 64 High 64 > RMS > 32 Medium 32 > RMS > 16 Low 16 > RMS > 0 Very low

[0062] In the embodiment, the setting of the fitting interval can be reasonably set according to the actual device simulation use environment, and the setting of the fitting interval for the loudspeaker system can greatly improve the practicability and accuracy of the scheme.

[0063] Exemplarily, the matching relationship between the environmental interference level and the fitting interval is shown in Table 2.

[0064] Table 2

[0065] Ambient interference level Fitting interval Very high 65％-100％ High 75％-100％ Medium 85％-100％ Low 90％-100％ Very low 95％-100％

[0066] In the scheme, after the waveform amplitude root mean square is determined, the environmental interference level can be determined according to the matching relationship between the waveform amplitude root mean square and the environmental interference level, and the fitting interval can be determined based on the matching relationship between the environmental interference level and the fitting interval, and the fitting interval is taken as the target waveform fitting interval matched with the waveform amplitude root mean square.

[0067] By obtaining the fitting interval matched with the waveform amplitude root mean square, the interference degree of the noise interference sound wave on the loudspeaker broadcast sound wave can be determined, and the automatic detection of the loudspeaker abnormality can be realized, and the fault detection rate of the loudspeaker is improved.

[0068] In the technical scheme, optionally, the preset fitting interval includes a waveform fitting interval associated with a waveform amplitude root mean square of preset waveform information in a pre-debugging stage; and the preset waveform information includes noise sound waves of an environment around the loudspeaker collected when the loudspeaker is in a non-broadcast mode and controls a device to which the loudspeaker belongs to rotate to at least one preconfigured position.

[0069] In the scheme, the fitting interval of the collected sound can be set through massive data simulation, and the waveform fitting interval associated with the waveform amplitude root mean square is determined according to the waveform amplitude root mean square.

[0070] The preconfigured positions can be set according to actual product shapes and in combination with actual installation environments. The preconfigured positions can be coordinates or angles, and the setting rules can reduce the interference of the speaker positions with the surrounding environment and structural members as much as possible. For example, the preconfigured coordinates can be φ1(X1, Y1, Z1), φ2(X2, Y2, Z2), and φ3(X3, Y3, Z3); or the preconfigured angles w1, w2, and w3 can be set according to the dimensions of the angles.

[0071] Exemplarily, Figure 3 is a structural schematic diagram of a warning ball provided by the first embodiment of the present application, as Figure 3 indicated, the speaker position of the warning ball is only affected by the angle, the speaker position is located at the position indicated by the middle arrow, the speaker can rotate in two planes, and at this time, the coordinate setting scheme should be used.

[0072] By controlling the device to which the speaker belongs to rotate to at least one preconfigured position, the interference of the speaker position with the surrounding environment and structural members can be reduced, and the accuracy of the abnormal detection of the speaker can be improved.

[0073] In the technical solution, before the first waveform information and the second waveform information of the surrounding environment of the speaker are collected, the following further includes:

[0074] The device to which the speaker belongs is controlled to rotate to the at least one preconfigured position.

[0075] In the solution, the interference of the position of the speaker with the surrounding environment and the structural members of the speaker itself can cause the result of the abnormal detection of the speaker to be inaccurate, and at this time, the device to which the speaker belongs is controlled to rotate to different preconfigured positions for the abnormal detection of the speaker.

[0076] Exemplarily, Figure 4 is a schematic diagram of a warning ball installation scene provided by the first embodiment of the present application, assuming that the position of the warning ball installation scene is as Figure 4 indicated, the sound emitted by the speaker is reflected and interfered by the wall A and the wall B at the same time when the sound broadcasted by the speaker is detected at this position. At this time, the speaker needs to be rotated and then detected again. For example, the number of selected rotation angles can be four, and the angles are 90°, 180°, 270°, and 360°. Through the setting of the four angles, the position of the speaker of the warning ball can be ensured to be not interfered by the wall surface for sound detection.

[0077] Exemplarily, Figure 5 is a schematic diagram of another warning ball installation scene provided by the first embodiment of the present application, Figure 6 is a schematic diagram of another warning ball installation scene provided by the first embodiment of the present application. By setting the rotation angle, the position of the speaker of the warning ball can be ensured to be not interfered by the wall surface for sound detection. Figure 5 or Figure 6The sound is detected at a position where the loudspeaker is not interfered by a wall surface.

[0078] By controlling the device to which the loudspeaker belongs to rotate to at least one preconfigured position, interference of the loudspeaker position with the surrounding environment and structural members can be reduced, and the accuracy of the loudspeaker anomaly detection can be improved.

[0079] In S130, if the waveform fitting degree of the second waveform information and the preset original waveform information is not in the target waveform fitting interval, it is determined that the loudspeaker function is abnormal; wherein the original waveform information is determined by collecting the loudspeaker broadcast sound wave without noise interference sound wave.

[0080] In the present scheme, a plurality of amplitudes in the original waveform information and the second waveform information can be extracted, and the waveform fitting degree of the original waveform information and the second waveform information can be calculated.

[0081] The original waveform information can be obtained by collecting the loudspeaker broadcast sound wave without noise interference sound wave, or the original waveform information can be calculated according to the loudspeaker broadcast theoretical value.

[0082] In the present embodiment, if the waveform fitting degree of the original waveform information and the second waveform information is in the target waveform fitting interval, it is determined that the loudspeaker function is normal; if the waveform fitting degree of the original waveform information and the second waveform information is not in the target waveform fitting interval, it is determined that the loudspeaker function is abnormal.

[0083] The timing function and the loudspeaker anomaly alarm mode can also be configured on the webpage. When the loudspeaker function is detected to be abnormal, the linkage alarm notifies the staff and reports to the webpage, and saves the log. The timing function can detect the loudspeaker function at any time, or can detect the loudspeaker function at a fixed time. The loudspeaker anomaly alarm mode can be set as an email or a short message, etc. The automatic detection and alarm setting can reduce the time and labor cost of regular maintenance, and realize intelligence and automation at low cost.

[0084] In the present scheme, the method for determining whether the loudspeaker function is abnormal can be applied to actual scenes, and covers rotating devices.

[0085] Exemplarily, Figure 7 is a circuit block diagram of loudspeaker anomaly detection provided by the first embodiment of the present application, as shown in Figure 7As shown, the noise simulation generator outputs environmental noise to form first waveform information, and the first waveform information is converted into digital information by an ADC unit based on the Soc, and the waveform amplitude root mean square of the converted first waveform information is calculated by an RMS calculation processing unit of the Soc, and the environmental interference level is determined based on the waveform amplitude root mean square, and the target waveform fitting interval matched with the environmental interference level is determined by the interference level and fitting interval matching setting unit; the noise simulation generator outputs environmental noise and the warning sound emitted by the loudspeaker to form second waveform information, and the waveform fitting degree of the original waveform information and the second waveform information is determined by a waveform fitting degree calculation processing unit based on the Soc, and whether the loudspeaker function is abnormal is determined by the interference level and fitting interval matching setting unit.

[0086] The technical scheme provided by the embodiments of the present application can collect first waveform information of the environment around the loudspeaker in the non-announcing mode of the loudspeaker, collect second waveform information of the loudspeaker and the environment around the loudspeaker in the announcing mode of the loudspeaker, determine a target waveform fitting interval matched with the first waveform information, and determine that the loudspeaker function is abnormal if the waveform fitting degree of the second waveform information and the preset original waveform information is not in the target waveform fitting interval. By executing the technical scheme, automatic detection of loudspeaker abnormalities can be realized, the fault detection rate of the loudspeaker can be improved, the reliability of the loudspeaker announcing function is improved, and the safety of the monitoring system is improved.

[0087] Embodiment Two

[0088] Figure 8 is a schematic diagram of the loudspeaker abnormality detection process provided by Embodiment Two of the present application. Embodiment Two is further optimized on the basis of Embodiment One. The specific optimization is that after collecting the second waveform information of the loudspeaker and the environment around the loudspeaker, it further includes: collecting third waveform information of the environment around the loudspeaker in the non-announcing mode of the loudspeaker; if the environmental interference level when the first waveform information is collected is the same as the environmental interference level when the third waveform information is collected, the following operation is started: judging whether the waveform fitting degree of the second waveform information and the preset original waveform information is in the target waveform fitting interval to determine whether the loudspeaker function is abnormal; if the environmental interference level when the first waveform information is collected is different from the environmental interference level when the third waveform information is collected, the operation of collecting the first waveform information and the second waveform information is returned. The contents not described in detail in this embodiment are described in detail in Embodiment One.

[0089] As shown in Figure 8 , the method comprises the following steps:

[0090] S810, in the speaker non-announcing mode, collecting first waveform information of the environment around the speaker; in the speaker announcing mode, collecting second waveform information of the speaker and the environment around the speaker;

[0091] S820, in the speaker non-announcing mode, collecting third waveform information of the environment around the speaker;

[0092] In the present scheme, the environmental noise is not constant, and when the noise interference sound wave is collected to determine the first waveform information and the noise interference sound wave and the speaker announcing sound wave are collected to determine the second waveform information, there is a possibility that the environmental interference level changes, thereby affecting the speaker determination result. Therefore, after the second waveform information is collected, the third waveform information of the environment around the speaker in the speaker non-announcing mode is collected again. It is judged whether the environmental interference level at which the third waveform information is collected is the same as the environmental interference level at which the first waveform information is collected.

[0093] S830, if the environmental interference level at which the first waveform information is collected is the same as the environmental interference level at which the third waveform information is collected, then the following operation is started: judging whether the waveform fitting degree of the second waveform information and the preset original waveform information is in a target waveform fitting interval to determine whether the speaker function is abnormal;

[0094] In the present scheme, by analog-digital conversion of the first waveform information, then calculating the waveform amplitude root mean square of the analog-digital converted first waveform information, the environmental interference level matched with the waveform amplitude root mean square of the first waveform information can be determined; the same method can be used to determine the environmental interference level matched with the waveform amplitude root mean square of the third waveform information.

[0095] In the present embodiment, if the environmental interference level at which the first waveform information is collected is the same as the environmental interference level at which the third waveform information is collected, at this time, the environmental interference level does not change, then based on the waveform fitting degree of the collected original waveform information and the second waveform information and the target waveform fitting interval, it is judged whether the waveform fitting degree of the second waveform information and the preset original waveform information is in the target waveform fitting interval, if it is, it is determined that the speaker function is normal; if it is not, it is determined that the speaker function is abnormal.

[0096] S840, if the environmental interference level at which the first waveform information is collected is not the same as the environmental interference level at which the third waveform information is collected, then returning to the operation of re-collecting the first waveform information and the second waveform information.

[0097] In the embodiment, if the environment interference level when the first waveform information is collected is different from the environment interference level when the third waveform information is collected, that is, the environment interference level changes, the first waveform information and the second waveform information are re-collected until the environment interference level when the first waveform information is collected is the same as the environment interference level when the third waveform information is collected, and whether the speaker function is abnormal is determined based on the waveform fitting degree of the original waveform information and the second waveform information and the target waveform fitting interval.

[0098] The technical scheme provided in the embodiment of the application comprises the following steps: collecting first waveform information of a surrounding environment of a speaker in a non-broadcast mode of the speaker; collecting second waveform information of the speaker and the surrounding environment in a broadcast mode of the speaker; collecting third waveform information of the surrounding environment of the speaker in the non-broadcast mode of the speaker; if the environment interference level when the first waveform information is collected is the same as the environment interference level when the third waveform information is collected, determining whether the waveform fitting degree of the second waveform information and preset original waveform information is in a target waveform fitting interval to determine whether the speaker function is abnormal; and if the environment interference level when the first waveform information is collected is different from the environment interference level when the third waveform information is collected, returning to the operation of re-collecting the first waveform information and the second waveform information. By executing the technical scheme, automatic detection of speaker abnormalities can be realized, the fault detection rate of the speaker can be improved, the reliability of the speaker broadcast function is improved, and thus the safety of the monitoring system is improved. Moreover, the influence of changes in noise interference sound waves on the determination result of the speaker can be avoided.

[0099] Embodiment Three

[0100] Figure 9 is a structural schematic diagram of a speaker abnormality detection device provided in Embodiment Three of the application, as shown in Figure 9 The speaker abnormality detection device comprises:

[0101] The waveform information collection module 910 is configured to collect first waveform information of a surrounding environment of a speaker in a non-broadcast mode of the speaker, and collect second waveform information of the speaker and the surrounding environment in a broadcast mode of the speaker.

[0102] The target waveform fitting interval determination module 920 is configured to determine a target waveform fitting interval matched with the first waveform information, wherein the target waveform fitting interval is determined by the interference degree of noise of the surrounding environment of the speaker in the non-broadcast mode of the speaker on waveform changes.

[0103] The loudspeaker function determination module 930 is configured to determine that the loudspeaker function is abnormal if the waveform fitting degree of the second waveform information and the preset original waveform information is not in the target waveform fitting interval; wherein the original waveform information is determined by collecting the loudspeaker broadcast sound wave without noise interference sound wave. In the technical solution, the waveform information collection module 910 can be configured to include:

[0104] The first waveform information obtaining unit is configured to collect noise interference sound waves around the loudspeaker in a first time period to obtain first waveform information.

[0105] The second waveform information obtaining unit is configured to collect noise interference sound waves and loudspeaker broadcast sound waves around the loudspeaker in a second time period to obtain second waveform information; the time difference between the first time period and the second time period is less than a preset time difference.

[0106] In the technical solution, the target waveform fitting interval determination module 920 can be configured to include:

[0107] The waveform amplitude root mean square determination unit is configured to perform analog-to-digital conversion on the first waveform information including noise sound wave information around the loudspeaker, and determine the waveform amplitude root mean square of the first waveform information after analog-to-digital conversion.

[0108] The target waveform fitting interval determination unit is configured to determine a preset fitting interval matched with the waveform amplitude root mean square as the target waveform fitting interval.

[0109] The waveform amplitude root mean square is used to reflect the interference degree of noise sound wave information around the loudspeaker on the change of the first waveform information.

[0110] In the technical solution, the target waveform fitting interval determination unit can be configured to:

[0111] Determine a preset environmental interference level matched with the waveform amplitude root mean square from preset environmental interference level mapping information based on the waveform amplitude root mean square.

[0112] Determine a preset fitting interval matched with the associated preset environmental interference level as the target waveform fitting interval; wherein the environmental interference level is used to represent the interference degree of noise around the loudspeaker on waveform change.

[0113] In the technical solution, the preset fitting interval includes a waveform fitting interval associated with the waveform amplitude root mean square of the preset waveform information in the pre-debugging phase; the preset waveform information includes noise sound waves around the loudspeaker collected when the loudspeaker is in a non-broadcast mode and the device to which the loudspeaker belongs is rotated to at least one preconfigured position.

[0114] In the technical solution, the device further comprises:

[0115] The third waveform information collection module is configured to collect third waveform information of the environment around the loudspeaker in the non-announcing mode of the loudspeaker.

[0116] The environment interference level same module is configured to, if the environment interference level when collecting the first waveform information is the same as the environment interference level when collecting the third waveform information, start to perform the following operation: judging whether the waveform fitting degree of the second waveform information and the preset original waveform information is in the target waveform fitting interval, to determine whether the function of the loudspeaker is abnormal. The environment interference level different module is configured to, if the environment interference level when collecting the first waveform information is different from the environment interference level when collecting the third waveform information, return to the operation of re-collecting the first waveform information and the second waveform information.

[0117] The product can perform the method provided in the embodiments of the application, and has the corresponding function modules and beneficial effects of the method.

[0118] Embodiment Four

[0119] The embodiments of the application further provide a storage medium containing computer executable instructions, which, when executed by a computer processor, are used to perform a loudspeaker abnormality detection method, the method comprising:

[0120] In the non-announcing mode of the loudspeaker, first waveform information of the environment around the loudspeaker is collected; and in the announcing mode of the loudspeaker, second waveform information of the loudspeaker and the environment around the loudspeaker is collected.

[0121] A target waveform fitting interval matched with the first waveform information is determined; wherein the target waveform fitting interval is determined by the interference degree of the noise of the environment around the loudspeaker in the non-announcing mode of the loudspeaker on the waveform change.

[0122] If the waveform fitting degree of the second waveform information and preset original waveform information is not in the target waveform fitting interval, it is determined that the function of the loudspeaker is abnormal; wherein the original waveform information is determined by collecting the announcing sound wave of the loudspeaker without noise interference sound wave.

[0123] Storage medium – any type of memory device or storage device. The term “storage medium” is intended to include: mounting media, such as CD-ROM, floppy disk, or magnetic tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. Storage medium may also include other types of memory or combinations thereof. Furthermore, storage medium may reside in a computer system in which a program is executed, or it may reside in a different second computer system connected to the computer system via a network (such as the Internet). The second computer system can provide program instructions to the computer for execution. The term “storage medium” can include two or more storage media that may reside in different locations (e.g., in different computer systems connected via a network). Storage medium may store program instructions (e.g., specifically implemented as a computer program) that can be executed by one or more processors.

[0124] Of course, the computer-executable instructions provided in the embodiments of this application are not limited to the speaker malfunction detection operation as described above, but can also execute related operations in the speaker malfunction detection method provided in any embodiment of this application.

[0125] Example 5

[0126] This application provides an electronic device that can integrate a speaker malfunction detection device provided in this application. Figure 10 This is a schematic diagram of the structure of an electronic device provided in Embodiment 5 of this application. Figure 10 As shown, this embodiment provides an electronic device 1000, which includes: one or more processors 1020; and a storage device 1010 for storing one or more programs. When the one or more programs are executed by the one or more processors 1020, the one or more processors 1020 implement the speaker malfunction detection method provided in this application embodiment. The method includes:

[0127] In speaker-not-broadcasting mode, first waveform information of the environment surrounding the speaker is acquired; in speaker-broadcasting mode, second waveform information of the speaker and the surrounding environment is acquired.

[0128] Determine the target waveform fitting interval that matches the first waveform information; wherein the target waveform fitting interval is determined by the degree of interference of the noise in the environment around the speaker on the waveform change in the speaker-not-playing mode;

[0129] If the waveform fitting degree of the second waveform information and preset original waveform information is not in the target waveform fitting interval, it is determined that the speaker function is abnormal; wherein the original waveform information is determined by collecting the speaker broadcast sound wave without noise interference sound wave.

[0130] Of course, those skilled in the art can understand that the processor 1020 also implements the technical solutions of the speaker abnormality detection method provided by any embodiment of the present application.

[0131] Figure 10 The electronic device 1000 shown is only an example and should not impose any limitations on the functions and use range of the embodiments of the present application.

[0132] As shown in Figure 10 The electronic device 1000 includes a processor 1020, a storage device 1010, an input device 1030, and an output device 1040; the number of processors 1020 in the electronic device can be one or more, Figure 10 The processor 1020 in the electronic device is taken as an example; the processor 1020, the storage device 1010, the input device 1030, and the output device 1040 in the electronic device can be connected through a bus or other means, Figure 10 The connection through the bus 1050 is taken as an example.

[0133] The storage device 1010 as a kind of computer readable storage medium can be used to store software programs, computer executable programs and module units, such as the program instructions corresponding to the speaker abnormality detection method in the embodiments of the present application.

[0134] The storage device 1010 can mainly include a storage program area and a storage data area, wherein the storage program area can store an operating system, at least one application required by a function; the storage data area can store data created according to the use of the terminal and the like. In addition, the storage device 1010 can include a high-speed random access memory, and can also include a non-volatile memory, for example, at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some examples, the storage device 1010 can further include a memory disposed remotely with respect to the processor 1020, and these remote memories can be connected through a network. Examples of the above network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0135] The input device 1030 can be used to receive input digital, character information or voice information, and generate key signal input related to user settings and function control of the electronic device. The output device 1040 can include a display screen, a speaker, and other electronic devices.

[0136] The electronic device provided by the embodiments of the present application can achieve the purpose of automatically detecting speaker abnormalities and improving the failure detection rate of the speaker.

[0137] The speaker abnormality detection device, the storage medium and the electronic device provided in the above embodiments can execute the speaker abnormality detection method provided by any of the embodiments of the present application, and have the corresponding function modules and beneficial effects of executing the method. Technical details not described in detail in the above embodiments can be referred to the speaker abnormality detection method provided by any of the embodiments of the present application.

[0138] Note that the above are only preferred embodiments of the present application and the technical principles applied. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and those skilled in the art can make various obvious changes, re-adjustments and substitutions without departing from the scope of the present application. Therefore, although the present application has been described in more detail through the above embodiments, the present application is not limited to the above embodiments, and can include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A method for detecting loudspeaker malfunctions, characterized in that, include: In the mode where the speaker is not broadcasting, the first waveform information of the environment around the speaker is collected; In speaker broadcast mode, second waveform information of the speaker and the surrounding environment is acquired; Determine the target waveform fitting interval that matches the first waveform information; The target waveform fitting range is determined by the degree of interference of the noise in the surrounding environment of the speaker on the waveform change in the speaker's non-broadcast mode; If the waveform fitting degree between the second waveform information and the preset original waveform information is not within the target waveform fitting range, then it is determined that the speaker function is abnormal; wherein, the original waveform information is determined by collecting the speaker broadcast sound wave under the condition of no noise interference; Among them, determining the target waveform fitting interval that matches the first waveform information includes: The first waveform information, which includes noise sound wave information of the environment around the speaker, is converted from analog to digital, and the root mean square value of the waveform amplitude of the first waveform information after analog-to-digital conversion is determined. Based on the root mean square of the waveform amplitude, a preset environmental interference level matching the root mean square of the waveform amplitude is determined from the preset environmental interference level mapping information. The preset fitting interval that matches the preset environmental interference level is determined as the target waveform fitting interval; wherein, the environmental interference level is used to characterize the degree of interference of the noise in the environment around the speaker on the waveform change; wherein, the root mean square of the waveform amplitude is used to reflect the degree of interference of the noise sound wave information in the environment around the speaker on the change of the first waveform information.

2. The method according to claim 1, characterized in that, Acquire the first waveform information of the environment surrounding the speaker, including: The noise interference sound waves around the speaker are collected during the first time period to obtain the first waveform information; Accordingly, second waveform information of the environment surrounding the speaker is acquired, including: The noise interference sound waves around the speaker and the sound waves broadcast by the speaker are collected during the second time period to obtain the second waveform information; the time difference between the first time period and the second time period is less than the preset time difference.

3. The method according to claim 1, characterized in that, The preset fitting interval includes the waveform fitting interval associated with the root mean square of the waveform amplitude of the preset waveform information in the pre-debugging stage. The preset waveform information includes noise waves from the surrounding environment of the speaker, collected when the device to which the speaker belongs is rotated to at least one preset position in the speaker's non-broadcast mode.

4. The method according to claim 3, characterized in that, Before acquiring the first and second waveform information of the environment surrounding the speaker, the process also includes: Control the device to which the speaker belongs to rotate to the at least one pre-configured position.

5. The method according to claim 1, characterized in that, After acquiring the second waveform information of the speaker and the surrounding environment, the process also includes: In the mode where the speaker is not broadcasting, the third waveform information of the environment around the speaker is collected; If the environmental interference level when acquiring the first waveform information is the same as the environmental interference level when acquiring the third waveform information, then the following operation will be initiated: determine whether the waveform fitting degree between the second waveform information and the preset original waveform information is within the target waveform fitting range, so as to determine whether the speaker function is abnormal; If the environmental interference level when acquiring the first waveform information is different from the environmental interference level when acquiring the third waveform information, then return to the operation of reacquiring the first and second waveform information.

6. A device for detecting loudspeaker malfunctions, characterized in that, include: The waveform information acquisition module is used to acquire the first waveform information of the environment around the speaker when the speaker is not playing. In speaker broadcast mode, second waveform information of the speaker and the surrounding environment is acquired; The target waveform fitting interval determination module is used to determine the target waveform fitting interval that matches the first waveform information; The target waveform fitting range is determined by the degree of interference of the noise in the surrounding environment of the speaker on the waveform change in the speaker's non-broadcast mode; A speaker function determination module is used to determine that the speaker function is abnormal if the waveform fitting degree between the second waveform information and the preset original waveform information is not within the target waveform fitting range; wherein, the original waveform information is determined by collecting the speaker broadcast sound wave in the absence of noise interference. The target waveform fitting interval determination module includes: The waveform amplitude root mean square determination unit is used to perform analog-to-digital conversion on the first waveform information, which includes noise sound wave information of the environment around the loudspeaker, and determine the waveform amplitude root mean square of the first waveform information after analog-to-digital conversion. An environmental interference level determination unit is used to determine a preset environmental interference level that matches the waveform amplitude root mean square from preset environmental interference level mapping information based on the waveform amplitude root mean square. The target waveform fitting interval matching unit is used to determine the preset fitting interval that matches the preset environmental interference level as the target waveform fitting interval; wherein, the environmental interference level is used to characterize the degree of interference of the noise in the environment around the speaker on the waveform change; wherein, the root mean square of the waveform amplitude is used to reflect the degree of interference of the noise sound wave information in the environment around the speaker on the change of the first waveform information.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method for detecting speaker malfunctions as described in any one of claims 1-5.

8. An electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the speaker malfunction detection method as described in any one of claims 1-5.

Images