An elevator door abnormality detection method, device, equipment and storage medium

Abstract

The application discloses an elevator door abnormality detection method, device and equipment and a storage medium. The application collects audio data of elevator door opening and closing by using an existing intercom in a car, does not need to additionally add an audio collection device, and does not need to rearrange a line in the car, thereby reducing cost. In addition, a gain coefficient of the intercom to the audio data of elevator door opening and closing is obtained in advance. In an actual detection process, the gain coefficient is used to compensate the audio data of elevator door opening and closing, and detection accuracy is improved.

Description

Technical Field

[0001] This invention relates to audio processing technology, and more particularly to a method, apparatus, device, and storage medium for detecting abnormalities in elevator doors. Background Technology

[0002] With the continuous development of society, economy, and technology, urban buildings are becoming increasingly taller. To facilitate people's access, these buildings are equipped with elevators. However, with the significant increase in elevator usage, the frequency of elevator door malfunctions is also increasing. Therefore, abnormal detection of elevator doors is crucial for the safe operation of elevators.

[0003] Currently, existing technologies include methods for collecting and analyzing audio from elevator doors to detect door malfunctions. However, most of these methods require additional audio acquisition equipment inside the elevator car and a redesign of the wiring, increasing costs. Summary of the Invention

[0004] This invention provides a method, apparatus, equipment, and storage medium for detecting elevator door anomalies, in order to reduce detection costs and improve detection accuracy.

[0005] In a first aspect, the present invention provides a method for detecting elevator door anomalies, comprising: The first audio data of the elevator door opening and closing abnormally is input into the speaker, and the frequency response of the speaker to the first audio data is determined. When the speaker plays the first audio data, the sound signal collected by the intercom in the car is acquired, and the frequency response of the intercom to the first audio data is determined; Based on the frequency response of the loudspeaker to the first audio data and the frequency response of the walkie-talkie to the first audio data, the gain coefficient of the walkie-talkie to the elevator door opening and closing audio data is determined. During the actual operation of the elevator car, the second audio data collected by the intercom when the elevator doors open and close is acquired, and the second audio data is compensated using the gain coefficient. The elevator door is determined to be abnormal based on the compensated second audio data.

[0006] Optionally, based on the frequency response of the speaker to the first audio data and the frequency response of the walkie-talkie to the first audio data, the gain coefficient of the walkie-talkie to the elevator door opening / closing audio data is determined, including: Calculate the transformation coefficients that transform the frequency response of the walkie-talkie to the first audio data into the frequency response of the speaker to the first audio data, and use the transformation coefficients as the gain coefficients of the walkie-talkie.

[0007] Optionally, elevator door anomaly detection methods also include: Pure tone data is input into the loudspeaker to determine the loudspeaker's frequency response to the pure tone data; While the speaker is playing the pure tone data, the sound signal collected by the intercom in the car is acquired, and the frequency response of the intercom to the pure tone data is determined.

[0008] Optionally, based on the frequency response of the speaker to the first audio data and the frequency response of the walkie-talkie to the first audio data, the gain coefficient of the walkie-talkie to the elevator door opening / closing audio data is determined, including: The frequency response of the speaker to the first audio data is spliced ​​with the frequency response of the speaker to the pure tone data to obtain the first spliced ​​frequency response; The frequency response of the walkie-talkie to the first audio data is spliced ​​with the frequency response of the walkie-talkie to the pure tone data to obtain the second spliced ​​frequency response. Calculate the transformation coefficients that transform the second splicing frequency response into the first splicing frequency response, and use the transformation coefficients as the gain coefficients of the walkie-talkie.

[0009] Optionally, the frequency response of the speaker to the first audio data is spliced ​​with the frequency response of the speaker to the pure tone data to obtain a first spliced ​​frequency response, including: Multiple response values ​​are extracted from the frequency response of the speaker to the first audio data according to a preset frequency interval to form a first vector; Multiple response values ​​are extracted from the frequency response of the loudspeaker to the pure tone data according to a preset frequency interval to form a second vector; By concatenating the first vector and the second vector, a first concatenated frequency response is obtained.

[0010] Optionally, the frequency response of the walkie-talkie to the first audio data is spliced ​​with the frequency response of the walkie-talkie to the pure tone data to obtain a second spliced ​​frequency response, including: Multiple response values ​​are extracted from the frequency response of the walkie-talkie to the first audio data according to a preset frequency interval to form a third vector; Multiple response values ​​are extracted from the frequency response of the walkie-talkie to the pure tone data according to a preset frequency interval to form a fourth vector; By concatenating the third vector and the fourth vector, a second concatenated frequency response is obtained.

[0011] Optionally, the second audio data is compensated using the gain coefficient, including: The second audio data is divided into multiple audio slices in chronological order, and the frequency response of the walkie-talkie to each audio slice is determined. The gain coefficient is calculated as a product of the frequency response of the walkie-talkie to each audio slice, thereby compensating for the second audio data.

[0012] Optionally, determining whether the elevator door is abnormal based on the compensated second audio data includes: Using the first preset duration as the width, the low-frequency characteristics of the preset bandwidth are statistically analyzed to determine the target low-frequency characteristics in the compensated second audio data whose intensity is greater than the preset intensity. Using a second preset duration as a sliding window, determine whether the target low-frequency features in the compensated second audio data are continuous; If so, then the elevator door is confirmed to be malfunctioning.

[0013] Optionally, after determining whether the elevator door is abnormal based on the compensated second audio data, the method further includes: Record the number of times the elevator doors on each floor experienced abnormalities; For each floor, calculate the percentage of the number of times the elevator door on that floor experienced abnormalities relative to the total number of recorded door openings and closings; The floors whose proportion is greater than the first preset value are taken as the target floors; Calculate the second percentage of the target floor's number relative to the total number of floors; If the second percentage is greater than the second preset value, then it is determined that the car door is malfunctioning; If the second percentage is less than or equal to the second preset value, then it is determined that the lobby door of the target floor is malfunctioning.

[0014] Secondly, the present invention also provides an elevator door status anomaly detection device, comprising: The first frequency response determination module is used to input the first audio data when the elevator door opening and closing is abnormal into the speaker, and determine the frequency response of the speaker to the first audio data. The second frequency response determination module is used to acquire the sound signal collected by the intercom in the car when the speaker plays the first audio data, and to determine the frequency response of the intercom to the first audio data. A gain coefficient determination module is used to determine the gain coefficient of the walkie-talkie for the elevator door opening and closing audio data based on the frequency response of the speaker to the first audio data and the frequency response of the walkie-talkie to the first audio data. An audio compensation module is used to acquire second audio data collected by the intercom when the elevator doors open and close during the actual operation of the car, and to compensate the second audio data using the gain coefficient. An anomaly detection module is used to determine whether the elevator door is abnormal based on the compensated second audio data.

[0015] Thirdly, the present invention also provides an electronic device, comprising: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the elevator door anomaly detection method as provided in the first aspect of the present invention.

[0016] Fourthly, the present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the elevator door anomaly detection method as provided in the first aspect of the present invention.

[0017] The elevator door anomaly detection method provided by this invention inputs first audio data of an abnormal elevator door opening / closing into a speaker, determines the speaker's frequency response to the first audio data, acquires the sound signal collected by an intercom inside the car while the speaker plays the first audio data, and determines the intercom's frequency response to the first audio data. Based on the frequency responses of the speaker and the intercom to the first audio data, a gain coefficient of the intercom for the elevator door opening / closing audio data is determined. During actual car operation, second audio data of the elevator door opening / closing collected by the intercom is acquired, and the gain coefficient is used to compensate for the second audio data. Based on the compensated second audio data, it is determined whether the elevator door is abnormal. This invention utilizes the existing intercom inside the car to collect audio data of the elevator door opening / closing, eliminating the need for additional audio acquisition equipment and rewiring within the car, thus reducing costs. Furthermore, by pre-calculating the gain coefficient of the intercom for the elevator door opening / closing audio data and using it to compensate for the audio data during actual detection, the detection accuracy is improved.

[0018] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 A flowchart of an elevator door anomaly detection method provided in an embodiment of the present invention; Figure 2 A flowchart of another elevator door anomaly detection method provided in an embodiment of the present invention; Figure 3 This is a schematic diagram of the structure of an elevator door status anomaly detection device provided in an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention.

[0021] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0022] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0023] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0024] Figure 1This is a flowchart of an elevator door anomaly detection method provided in an embodiment of the present invention. This embodiment is applicable to situations where an intercom inside the elevator car is used to collect the audio of the elevator door opening and closing, and elevator door anomaly detection is performed based on this audio. This method can be executed by an elevator door anomaly detection device provided in this embodiment of the present invention. This device can be implemented by software and / or hardware, and is typically configured in an electronic device, such as... Figure 1 As shown, the elevator door anomaly detection method includes the following steps: S101. Input the first audio data when the elevator door opens or closes abnormally into the speaker, and determine the frequency response of the speaker to the first audio data.

[0025] In this embodiment of the invention, the audio data when the elevator door malfunctions is referred to as the first audio data. The first audio data under various operating conditions is input into a speaker with good frequency response performance. The speaker plays the first audio data, and the frequency response of the speaker to the first audio data under various operating conditions is determined. Frequency response refers to the phenomenon that when an audio signal is connected to a speaker, the sound pressure generated by the speaker increases or decreases with frequency, and the phase changes with frequency. This correlation between sound pressure and phase and frequency is called frequency response. This frequency response can be obtained using existing frequency response calculation methods, which are not limited in this embodiment of the invention.

[0026] S102. When the speaker plays the first audio data, acquire the sound signal collected by the intercom in the car and determine the frequency response of the intercom to the first audio data.

[0027] While the speaker plays the first audio data, the intercom inside the car collects the sound signal played by the speaker and determines the frequency response of the intercom to the first audio data. The frequency response of the intercom refers to the phenomenon that when the microphone in the intercom receives sound of different frequencies, the output signal will be amplified or attenuated as the frequency changes. This frequency response can be obtained by existing frequency response calculation methods, and this embodiment of the invention is not limited thereto.

[0028] S103. Based on the frequency response of the loudspeaker to the first audio data and the frequency response of the walkie-talkie to the first audio data, determine the gain coefficient of the walkie-talkie to the elevator door opening and closing audio data.

[0029] As is well known, the intercom inside the elevator car is designed for voice communication and is typically configured to filter background noise and enhance the signal-to-noise ratio of human voice. This involves reducing the microphone's sensitivity to wavelength division multiplexing (WDM) frequencies, which conflicts with the data acquisition requirements for door status detection. Therefore, in practice, it is necessary to gain the audio data from the elevator door opening and closing to improve the accuracy of subsequent anomaly detection. Thus, it is necessary to pre-calculate the gain coefficient of the intercom for the elevator door opening and closing audio data.

[0030] In this embodiment of the invention, the gain coefficient of the walkie-talkie for the elevator door opening / closing audio data is determined based on the frequency response of the speaker to the first audio data and the frequency response of the walkie-talkie to the first audio data. For example, a transformation coefficient is calculated to convert the frequency response of the walkie-talkie to the first audio data into the frequency response of the speaker to the first audio data, and this transformation coefficient is used as the gain coefficient of the walkie-talkie for the elevator door opening / closing audio data.

[0031] For example, the frequency response described above is usually a continuous frequency response curve. For ease of calculation, multiple response values ​​can be extracted from the frequency response of the speaker to the first audio data at preset frequency intervals to form a vector, and multiple response values ​​can be extracted from the frequency response of the walkie-talkie to the first audio data at preset frequency intervals to form another vector. The transformation coefficient between the two vectors is calculated as the gain coefficient of the walkie-talkie to the elevator door opening and closing audio data.

[0032] S104. During the actual operation of the elevator car, acquire the second audio data collected by the intercom when the elevator doors open and close, and use the gain coefficient to compensate for the second audio data.

[0033] In the actual anomaly detection process, during the operation of the elevator car, the audio data collected by the intercom when the elevator doors open and close is called the second audio data, and the second audio data is compensated using a gain coefficient.

[0034] For example, in one embodiment of the present invention, the second audio data is divided into multiple audio slices in chronological order, and the frequency response of the walkie-talkie to each audio slice is determined. The product of the gain coefficient and the frequency response of the walkie-talkie to each audio slice is calculated to compensate the second audio data. Similarly, for ease of calculation, multiple response values ​​can be extracted from the frequency response of the walkie-talkie to each audio slice at preset frequency intervals to form a vector. The product of the gain coefficient and this vector is calculated to compensate for that audio slice. In this way, compensation is performed on each audio slice to compensate the second audio data.

[0035] S105. Determine whether the elevator door is abnormal based on the compensated second audio data.

[0036] In this embodiment of the invention, the abnormality of the elevator door opening and closing is determined based on the compensated second audio data. For example, preset features can be extracted from the compensated second audio data, and the abnormality of the elevator door opening and closing is determined based on these preset features. The preset features may include feature intensity, continuity, etc., and are not limited thereto in this embodiment of the invention.

[0037] For example, in some embodiments of the present invention, a first preset duration is used as the width to statistically analyze the low-frequency features of the preset bandwidth, and a target low-frequency feature with an intensity greater than a preset intensity in the compensated second audio data is determined. The second preset duration is used as a sliding window to determine whether the target low-frequency feature in the compensated second audio data has continuity. If it does, the elevator door opening and closing is determined to be abnormal; if not, the elevator door opening and closing is determined to be normal.

[0038] In the above embodiments, although it is possible to determine whether the elevator door opening and closing is abnormal based on the compensated second audio data, the elevator door includes the car door and the landing door. Therefore, it is impossible to determine whether the abnormality is specifically the car door or the landing door. To address this issue, in some embodiments of the present invention, the number of times the elevator door on each floor is abnormal is recorded. For each floor, the first percentage of the number of times the elevator door on that floor is abnormal relative to the total number of door openings and closings recorded for that floor is calculated. If the first percentage is greater than a first preset value, it indicates that the elevator car door or the landing door on that floor is abnormal. Floors with the first percentage greater than the first preset value are designated as target floors where the landing door may be abnormal. The number of target floors is counted, and the second percentage of the number of target floors relative to the total number of floors is calculated. If the second percentage is greater than a second preset value, it indicates that the elevator door is abnormal on most or all floors, and the car door is determined to be faulty. If the second percentage is less than or equal to the second preset value, it indicates that the elevator door is abnormal only on a few target floors, and the landing door on the target floors is determined to be faulty.

[0039] The elevator door anomaly detection method provided in this invention involves inputting first audio data of an abnormal elevator door opening / closing into a speaker, determining the speaker's frequency response to the first audio data, acquiring the sound signal collected by an intercom inside the car while the speaker plays the first audio data, and determining the intercom's frequency response to the first audio data. Based on the frequency responses of the speaker and the intercom to the first audio data, a gain coefficient for the intercom's response to the elevator door opening / closing audio data is determined. During actual car operation, second audio data of the elevator door opening / closing collected by the intercom is acquired, and the gain coefficient is used to compensate for the second audio data. Based on the compensated second audio data, it is determined whether the elevator door is abnormal. This invention utilizes the existing intercom inside the car to collect audio data of the elevator door opening / closing, eliminating the need for additional audio acquisition equipment and rewiring within the car, thus reducing costs. Furthermore, by pre-calculating the gain coefficient for the intercom's response to the elevator door opening / closing audio data and using it to compensate for the audio data during actual detection, the detection accuracy is improved.

[0040] In some embodiments of the present invention, in order to improve the accuracy of the gain coefficient of the intercom for the elevator door opening and closing audio data and improve the detection accuracy, pure tone data, i.e., the data corresponding to the pure tone, can be introduced as a reference when calculating the gain coefficient. A pure tone refers to a sound with a single frequency.

[0041] Figure 2 A flowchart of another elevator door anomaly detection method provided in an embodiment of the present invention is shown, for example, as follows: Figure 2 As shown, the elevator door anomaly detection method of this embodiment includes: S201. Input the pure tone data into the speaker and determine the speaker's frequency response to the pure tone data.

[0042] In this embodiment of the invention, pure tone data of various frequencies are input into the loudspeaker, and the frequency response of the loudspeaker to each pure tone data is determined.

[0043] For example, the frequency response is usually a continuous frequency response curve. For ease of calculation, multiple response values ​​can be extracted from the frequency response of the speaker to the audio data according to a preset frequency interval to form a vector. The frequency response of the speaker to pure tone data of a certain frequency can be expressed as: Where n is the total number of extracted response values.

[0044] Therefore, the frequency response of the loudspeaker to pure tone data of different frequencies can be expressed as: Where k is the number of pure tone data of different frequencies.

[0045] S202. Input the first audio data when the elevator door opens or closes abnormally into the speaker, and determine the frequency response of the speaker to the first audio data.

[0046] In this embodiment of the invention, first audio data under various operating conditions is input into a loudspeaker with good frequency response performance, the loudspeaker plays the first audio data, and the frequency response of the loudspeaker to the first audio data under various operating conditions is determined.

[0047] For example, for ease of calculation, multiple response values ​​can be extracted from the frequency response of the speaker to the audio data according to a preset frequency interval to form a vector. The frequency response of the speaker to the first audio data under a certain operating condition can be expressed as: Therefore, the frequency response of the loudspeaker to the first audio data under various operating conditions can be expressed as: S203. When the speaker plays pure tone data, acquire the sound signal collected by the intercom in the car and determine the frequency response of the intercom to the pure tone data.

[0048] While the loudspeaker plays each pure tone data, the audio signal collected by the intercom in the car is acquired, and the frequency response of the intercom to each pure tone data is determined.

[0049] For example, the frequency response of a walkie-talkie to a certain pure tone data can be expressed as: The frequency response of a walkie-talkie to pure tone data of various frequencies can be expressed as: S204. When the speaker plays the first audio data, acquire the sound signal collected by the intercom in the car and determine the frequency response of the intercom to the first audio data.

[0050] When the speaker plays each first audio data, the sound signal collected by the intercom in the car is acquired, and the frequency response of the intercom to the first audio data under various different operating conditions is determined.

[0051] For example, the frequency response of a walkie-talkie to the first audio data under a certain operating condition can be expressed as: The frequency response of a walkie-talkie to the first audio data under various operating conditions can be expressed as: S205. The frequency response of the speaker to the first audio data is spliced ​​with the frequency response of the speaker to the pure tone data to obtain the first spliced ​​frequency response.

[0052] In this embodiment of the invention, the frequency response of the speaker to the first audio data is spliced ​​with the frequency response of the speaker to the pure tone data to obtain a first spliced ​​frequency response. For example, this involves splicing the frequencies from the above embodiments. and The frequency response of the first splicing can be expressed as: S206. The frequency response of the walkie-talkie to the first audio data is spliced ​​with the frequency response of the walkie-talkie to the pure tone data to obtain the second spliced ​​frequency response.

[0053] In this embodiment of the invention, the frequency response of the walkie-talkie to the first audio data is spliced ​​with the frequency response of the walkie-talkie to the pure tone data to obtain a second spliced ​​frequency response. For example, this involves splicing the frequencies from the above embodiments. and The second splicing frequency response can be expressed as: S207. Calculate the transformation coefficients that transform the second splicing frequency response into the first splicing frequency response, and use the transformation coefficients as the gain coefficients of the walkie-talkie.

[0054] For example, in this embodiment of the invention, the first splicing frequency response Z is converted into a column vector: Convert the second spliced ​​frequency response Y into a column vector: calculate arrive Let the transformation function be: Its coefficients are represented as a vector as follows: Find: Thus, As the gain coefficient of a walkie-talkie.

[0055] S208. During the actual operation of the elevator car, acquire the second audio data collected by the intercom when the elevator doors open and close, and use the gain coefficient to compensate for the second audio data.

[0056] In the actual anomaly detection process, during the operation of the elevator car, the audio data collected by the intercom when the elevator doors open and close is called the second audio data, and the second audio data is compensated using a gain coefficient.

[0057] In this embodiment of the invention, the second audio data is divided into multiple audio slices in chronological order, and the frequency response of the walkie-talkie to each audio slice is determined. The product of the gain coefficient and the frequency response of the walkie-talkie to each audio slice is calculated to compensate for the second audio data.

[0058] For example, the frequency response of a walkie-talkie to each audio slice can be expressed as: Will Multiply by the gain factor The compensated audio segment is obtained as follows: In this way, compensation is performed on each audio slice to achieve compensation for the second audio data.

[0059] S209. Determine whether the elevator door is abnormal based on the compensated second audio data.

[0060] For example, in some embodiments of the present invention, a first preset duration is used as the width to statistically analyze the low-frequency features of the preset bandwidth, and a target low-frequency feature with an intensity greater than a preset intensity in the compensated second audio data is determined. The second preset duration is used as a sliding window to determine whether the target low-frequency feature in the compensated second audio data has continuity. If it does, the elevator door opening and closing is determined to be abnormal; if not, the elevator door opening and closing is determined to be normal.

[0061] In the above embodiments, although it is possible to determine whether the elevator door opening and closing is abnormal based on the compensated second audio data, the elevator door includes the car door and the landing door. Therefore, it is impossible to determine whether the abnormality is specifically the car door or the landing door. To address this issue, in some embodiments of the present invention, the number of times the elevator door on each floor is abnormal is recorded. For each floor, the first percentage of the number of times the elevator door on that floor is abnormal relative to the total number of door openings and closings recorded for that floor is calculated. If the first percentage is greater than a first preset value, it indicates that the elevator car door or the landing door on that floor is abnormal. Floors with the first percentage greater than the first preset value are designated as target floors where the landing door may be abnormal. The number of target floors is counted, and the second percentage of the number of target floors relative to the total number of floors is calculated. If the second percentage is greater than a second preset value, it indicates that the elevator door is experiencing abnormal opening and closing on most or all floors, and the elevator door is determined to be faulty. If the second percentage is less than or equal to the second preset value, it indicates that the elevator door is experiencing abnormal opening and closing on only a few target floors, and the landing door on the target floors is determined to be faulty.

[0062] This invention also provides an elevator door status anomaly detection device. Figure 3 This is a schematic diagram of the structure of an elevator door status anomaly detection device provided in an embodiment of the present invention, as shown below. Figure 3 As shown, the elevator door status anomaly detection device includes: The first frequency response determination module 301 is used to input the first audio data when the elevator door opening and closing is abnormal into the speaker, and determine the frequency response of the speaker to the first audio data. The second frequency response determination module 302 is used to acquire the sound signal collected by the intercom in the car when the speaker plays the first audio data, and to determine the frequency response of the intercom to the first audio data. Gain coefficient determination module 303 is used to determine the gain coefficient of the walkie-talkie for the elevator door opening and closing audio data based on the frequency response of the speaker to the first audio data and the frequency response of the walkie-talkie to the first audio data. The audio compensation module 304 is used to acquire the second audio data collected by the intercom when the elevator doors open and close during the actual operation of the car, and to compensate the second audio data using the gain coefficient. The anomaly detection module 305 is used to determine whether the elevator door is abnormal based on the compensated second audio data.

[0063] In some embodiments of the present invention, the gain coefficient determination module 303 includes: The gain coefficient determination submodule is used to calculate the transformation coefficients that transform the frequency response of the walkie-talkie to the first audio data into the frequency response of the speaker to the first audio data, and use the transformation coefficients as the gain coefficients of the walkie-talkie.

[0064] In some embodiments of the present invention, the elevator door status abnormality detection device further includes: The third frequency response determination module is used to input pure tone data into the loudspeaker and determine the frequency response of the loudspeaker to the pure tone data. The fourth frequency response determination module is used to acquire the sound signal collected by the intercom in the car when the speaker plays the pure tone data, and to determine the frequency response of the intercom to the pure tone data.

[0065] In some embodiments of the present invention, the gain coefficient determination module 303 includes: The first splicing submodule is used to splice the frequency response of the speaker to the first audio data with the frequency response of the speaker to the pure tone data to obtain the first spliced ​​frequency response. The second splicing submodule is used to splice the frequency response of the walkie-talkie to the first audio data with the frequency response of the walkie-talkie to the pure tone data to obtain a second spliced ​​frequency response. The calculation submodule is used to calculate the transformation coefficients that transform the second splicing frequency response into the first splicing frequency response, and to use the transformation coefficients as the gain coefficients of the walkie-talkie.

[0066] In some embodiments of the present invention, the first splicing submodule includes: The first vector construction unit is used to extract multiple response values ​​from the frequency response of the speaker to the first audio data according to a preset frequency interval to form a first vector. The second vector construction unit is used to extract multiple response values ​​from the frequency response of the loudspeaker to the pure tone data according to a preset frequency interval to form a second vector. The first splicing unit is used to splice the first vector and the second vector to obtain the first splicing frequency response.

[0067] In some embodiments of the present invention, the second splicing submodule includes: The third vector construction unit is used to extract multiple response values ​​from the frequency response of the walkie-talkie to the first audio data according to a preset frequency interval to form a third vector. The fourth vector construction unit is used to extract multiple response values ​​from the frequency response of the walkie-talkie to the pure tone data according to a preset frequency interval to form a fourth vector; The second splicing unit is used to splice the third vector and the fourth vector to obtain the second splicing frequency response.

[0068] In some embodiments of the present invention, the audio compensation module 304 includes: The frequency response determination submodule is used to divide the second audio data into multiple audio slices in chronological order and determine the frequency response of the walkie-talkie to each audio slice. The compensation submodule is used to calculate the product of the gain coefficient and the frequency response of the walkie-talkie to each audio slice, thereby compensating for the second audio data.

[0069] In some embodiments of the present invention, the anomaly detection module 305 includes: The target low-frequency feature determination submodule is used to statistically analyze the low-frequency features of the preset bandwidth using a first preset duration as the width, and determine the target low-frequency features in the compensated second audio data whose intensity is greater than the preset intensity. The continuity judgment submodule is used to determine whether the target low-frequency features in the compensated second audio data have continuity, using a second preset duration as a sliding window. The anomaly determination submodule is used to determine that the elevator door is abnormal if the condition is met.

[0070] In some embodiments of the present invention, the elevator door status abnormality detection device further includes: The recording module is used to record the number of times the elevator door malfunctions on each floor after determining whether the elevator door is abnormal based on the compensated second audio data. The first percentage calculation module is used to calculate, for each floor, the first percentage of the number of times the elevator door on that floor experienced abnormalities relative to the total number of recorded door openings and closings. The target floor confirmation module is used to identify the floors whose proportion is greater than the first preset value as target floors. The second percentage calculation module is used to calculate the second percentage of the number of the target floors to the total number of floors. The car door fault determination module is used to determine that the car door has malfunctioned if the second proportion is greater than a second preset value. The hall door fault determination module is used to determine that the hall door of the target floor is faulty if the second proportion is less than or equal to the second preset value.

[0071] The aforementioned elevator door anomaly detection device can execute the elevator door anomaly detection method provided in the foregoing embodiments of the present invention, and has the corresponding functional modules and beneficial effects for executing the elevator door anomaly detection method.

[0072] Figure 4 This is a schematic diagram of an electronic device provided for an embodiment of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0073] like Figure 4 As shown, the electronic device includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer programs stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 can also store various programs and data required for the operation of the electronic device. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0074] Multiple components in the electronic device are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, optical disk, etc.; and a communication unit 19, such as a network card, modem, wireless transceiver, etc. The communication unit 19 allows the electronic device to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0075] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, central processing unit (CPU), graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as elevator door anomaly detection methods.

[0076] In some embodiments, the elevator door anomaly detection method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded into and / or installed on an electronic device via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the elevator door anomaly detection method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the elevator door anomaly detection method by any other suitable means (e.g., by means of firmware).

[0077] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0078] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0079] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0080] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0081] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0082] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0083] This invention also provides a computer program product, including a computer program that, when executed by a processor, implements the elevator door anomaly detection method provided in any embodiment of this application.

[0084] In implementing the computer program product, computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof. Programming languages ​​include object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0085] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0086] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for detecting elevator door anomalies, characterized in that, include: The first audio data of the elevator door opening and closing abnormally is input into the speaker, and the frequency response of the speaker to the first audio data is determined. When the speaker plays the first audio data, the sound signal collected by the intercom in the car is acquired, and the frequency response of the intercom to the first audio data is determined. Based on the frequency response of the loudspeaker to the first audio data and the frequency response of the walkie-talkie to the first audio data, the gain coefficient of the walkie-talkie to the elevator door opening and closing audio data is determined. During the actual operation of the elevator car, the second audio data collected by the intercom when the elevator doors open and close is acquired, and the second audio data is compensated using the gain coefficient. The elevator door is determined to be abnormal based on the compensated second audio data.

2. The elevator door anomaly detection method according to claim 1, characterized in that, Based on the frequency response of the speaker to the first audio data and the frequency response of the walkie-talkie to the first audio data, the gain coefficient of the walkie-talkie to the elevator door opening / closing audio data is determined, including: Calculate the transformation coefficients that transform the frequency response of the walkie-talkie to the first audio data into the frequency response of the speaker to the first audio data, and use the transformation coefficients as the gain coefficients of the walkie-talkie.

3. The elevator door anomaly detection method according to claim 1, characterized in that, Also includes: Pure tone data is input into the loudspeaker to determine the loudspeaker's frequency response to the pure tone data; While the speaker is playing the pure tone data, the sound signal collected by the intercom in the car is acquired, and the frequency response of the intercom to the pure tone data is determined.

4. The elevator door anomaly detection method according to claim 3, characterized in that, Based on the frequency response of the speaker to the first audio data and the frequency response of the walkie-talkie to the first audio data, the gain coefficient of the walkie-talkie to the elevator door opening / closing audio data is determined, including: The frequency response of the speaker to the first audio data is spliced ​​with the frequency response of the speaker to the pure tone data to obtain the first spliced ​​frequency response; The frequency response of the walkie-talkie to the first audio data is spliced ​​with the frequency response of the walkie-talkie to the pure tone data to obtain the second spliced ​​frequency response. Calculate the transformation coefficients that transform the second splicing frequency response into the first splicing frequency response, and use the transformation coefficients as the gain coefficients of the walkie-talkie.

5. The elevator door anomaly detection method according to claim 4, characterized in that, The frequency response of the loudspeaker to the first audio data is spliced ​​with the frequency response of the loudspeaker to the pure tone data to obtain a first spliced ​​frequency response, including: Multiple response values ​​are extracted from the frequency response of the speaker to the first audio data according to a preset frequency interval to form a first vector; Multiple response values ​​are extracted from the frequency response of the loudspeaker to the pure tone data according to a preset frequency interval to form a second vector; By concatenating the first vector and the second vector, a first concatenated frequency response is obtained.

6. The elevator door anomaly detection method according to claim 4, characterized in that, The frequency response of the walkie-talkie to the first audio data is spliced ​​with the frequency response of the walkie-talkie to the pure tone data to obtain a second spliced ​​frequency response, including: Multiple response values ​​are extracted from the frequency response of the walkie-talkie to the first audio data according to a preset frequency interval to form a third vector; Multiple response values ​​are extracted from the frequency response of the walkie-talkie to the pure tone data according to a preset frequency interval to form a fourth vector; By concatenating the third vector and the fourth vector, a second concatenated frequency response is obtained.

7. The elevator door anomaly detection method according to any one of claims 1-6, characterized in that, Compensating the second audio data using the gain coefficient includes: The second audio data is divided into multiple audio slices in chronological order, and the frequency response of the walkie-talkie to each audio slice is determined. The gain coefficient is calculated as a product of the frequency response of the walkie-talkie to each audio slice, thereby compensating for the second audio data.

8. The elevator door anomaly detection method according to any one of claims 1-6, characterized in that, Determining whether the elevator door is abnormal based on the compensated second audio data includes: Using the first preset duration as the width, the low-frequency characteristics of the preset bandwidth are statistically analyzed to determine the target low-frequency characteristics in the compensated second audio data whose intensity is greater than the preset intensity. Using a second preset duration as a sliding window, determine whether the target low-frequency features in the compensated second audio data are continuous; If so, then the elevator door is confirmed to be malfunctioning.

9. The elevator door anomaly detection method according to claim 8, characterized in that, After determining whether the elevator door is abnormal based on the compensated second audio data, the process also includes: Record the number of times the elevator doors on each floor experienced abnormalities; For each floor, calculate the percentage of the number of times the elevator door on that floor experienced abnormalities relative to the total number of recorded door openings and closings; The floors whose proportion is greater than the first preset value are taken as the target floors; Calculate the second percentage of the target floor's number relative to the total number of floors; If the second percentage is greater than the second preset value, then it is determined that the car door is malfunctioning; If the second percentage is less than or equal to the second preset value, then it is determined that the lobby door of the target floor is malfunctioning.

10. An elevator door status anomaly detection device, characterized in that, include: The first frequency response determination module is used to input the first audio data when the elevator door opening and closing is abnormal into the speaker, and determine the frequency response of the speaker to the first audio data. The second frequency response determination module is used to acquire the sound signal collected by the intercom in the car when the speaker plays the first audio data, and to determine the frequency response of the intercom to the first audio data. A gain coefficient determination module is used to determine the gain coefficient of the walkie-talkie for the elevator door opening and closing audio data based on the frequency response of the speaker to the first audio data and the frequency response of the walkie-talkie to the first audio data. An audio compensation module is used to acquire second audio data collected by the intercom when the elevator doors open and close during the actual operation of the car, and to compensate the second audio data using the gain coefficient. An anomaly detection module is used to determine whether the elevator door is abnormal based on the compensated second audio data.

11. An electronic device, characterized in that, include: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the elevator door anomaly detection method as described in any one of claims 1-9.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by the processor, the program implements the elevator door anomaly detection method as described in any one of claims 1-9.

Images