Elevator fault early warning method and system based on voiceprint recognition

Abstract

The invention discloses an elevator fault early warning method and system based on voiceprint recognition, and relates to the field of elevator detection.The method comprises the steps that traction machine operation voiceprints of a to-be-detected elevator under the full-period operation working condition under different elevator loads are obtained; extracting voiceprint features through wavelet transform; constructing a first point cloud space by taking the operation condition as an X axis, the elevator load as a Y axis and the voiceprint feature as a Z axis, inputting the first point cloud space into an elevator fault risk assessment model, extracting a transverse time sequence feature along an X-Z plane, extracting a vertical space feature along a Y-Z plane, and extracting a joint distribution feature along an X-Y-Z space; fusing the transverse time sequence feature, the vertical space feature and the joint distribution feature to generate a first fusion feature, and determining a fault risk value; and if the fault risk value is greater than a preset fault threshold value, giving out early warning. According to the invention, the limitation that a traditional machine learning method only learns a voiceprint and fault relationship is solved, and the fault recognition accuracy is improved.

Description

Technical Field

[0001] This invention relates to the field of elevator inspection, and in particular to an elevator fault early warning method and system based on voiceprint recognition. Background Technology

[0002] In recent years, with the acceleration of urbanization, elevators, as an indispensable vertical transportation tool in high-rise buildings, have received widespread attention for their safety and reliability. Among the many types of elevators, traction elevators have become the mainstream choice for residential buildings, shopping malls, and other places due to their stable performance, efficient operation, and large load capacity.

[0003] Traction elevators mainly consist of key components such as the traction machine, car, wire ropes, and control cabinet. Among these, the traction machine, as the elevator's power core, directly affects the elevator's safety and stability. To promptly detect potential traction machine malfunctions, fault warning technology based on voiceprint recognition has emerged. Currently, most existing fault warning solutions based on voiceprint recognition use traditional machine learning methods to build predictive models. After collecting the voiceprint data of the traction machine, these solutions first extract features from the data and then directly establish a mapping relationship between voiceprint features and fault types to achieve fault warning.

[0004] However, in actual elevator operation scenarios, many dynamic variables exist. For example, different load conditions can cause changes in the load torque of the traction machine motor and the tension of the wire rope, thus causing a shift in the energy baseline and frequency distribution of the acoustic signature. Furthermore, the acoustic signature characteristics generated by the elevator vary depending on its operating conditions, such as starting, acceleration, constant speed, deceleration, and braking. Traditional machine learning methods, when building models, only focus on learning the correspondence between acoustic signatures and faults, neglecting the crucial issue of the impact of load changes and operating condition differences on acoustic signature characteristics. Summary of the Invention

[0005] This invention provides an elevator fault early warning method and system based on voiceprint recognition, which can overcome the limitation of traditional machine learning methods that only learn the relationship between voiceprint and fault, and improve the accuracy of fault recognition.

[0006] An embodiment of the present invention provides an elevator fault early warning method based on voiceprint recognition, comprising: Acquire the traction machine operating sound patterns of the elevator under test under different elevator loads throughout the entire operating cycle; the entire operating cycle includes: starting, acceleration, constant speed, deceleration and braking; Wavelet transform was performed on the acoustic fingerprint of the traction machine to extract its features; Based on the acoustic characteristics of the traction machine's operating acoustics under different elevator loads throughout the entire operating cycle, the first point cloud space is constructed with the operating conditions as the X-axis, the elevator load as the Y-axis, and the acoustic characteristics as the Z-axis. The first point cloud space is input into the trained elevator fault risk assessment model, so that the elevator fault risk assessment model extracts lateral temporal features along the XZ plane of the first point cloud space through the built-in temporal convolutional network; extracts vertical spatial features along the YZ plane of the first point cloud space through the built-in perceptual convolutional network; extracts joint distribution features along the XYZ space of the first point cloud space through the built-in first 3D convolutional network; broadcast multiplication is performed on the lateral temporal features and vertical spatial features to generate spatiotemporal interactive features; after concatenating the spatiotemporal interactive features and joint distribution features along the channel dimension, local feature aggregation is performed through the built-in second 3D convolutional network to generate the first fusion feature; and the fault risk value is determined based on the first fusion feature. When the fault risk value exceeds the preset fault threshold, a fault warning signal is issued.

[0007] Furthermore, after obtaining the traction machine operating sound signature of the elevator under different elevator loads throughout its entire operating cycle, the process also includes: Based on the elevator load and operating conditions, the probability distribution of the corresponding noise parameter is retrieved from the preset noise parameter probability distribution library; For each operating condition, based on the probability distribution of noise parameters, a combination of noise parameters conforming to the probability distribution is generated through random sampling; the combination of noise parameters includes: amplitude, frequency, phase, and bandwidth; The spectral shape of the noise signal is determined based on the frequency and bandwidth obtained from the sampling. Based on the amplitude obtained from sampling, the shape of the spectrum is adjusted to obtain the frequency domain signal; Perform an inverse Fourier transform on the frequency domain signal to obtain the time domain signal; Based on the sampled phase, the time-domain signal is phase-adjusted to generate a noise segment for this operating condition; Noise segments from all operating conditions are spliced ​​together to obtain a continuous noise signal; The noise signal is subjected to a short-time Fourier transform to obtain the noise spectrum; The acoustic waveform of the traction machine is subjected to a short-time Fourier transform to obtain the acoustic waveform spectrum. The noise spectrum is subtracted from the speaker spectrum using spectral subtraction to obtain the noise-reduced speaker spectrum; The denoised acoustic signature spectrum is subjected to inverse short-time Fourier transform to obtain the denoised traction machine operating acoustic signature.

[0008] Furthermore, wavelet transform is performed on the traction machine's operating acoustic signature to extract acoustic signature features, including: The traction machine's operating acoustic signature is divided according to the operating conditions to obtain corresponding acoustic signature segments; For each voiceprint segment, the corresponding wavelet basis function is determined according to the operating condition of the voiceprint segment; Calculate the load factor based on the elevator load and rated load; Based on the modified wavelet basis function using the loading coefficient, the modified wavelet basis function is obtained; Wavelet transform is performed on the voiceprint segments based on the modified wavelet basis function to obtain the corresponding voiceprint features.

[0009] Furthermore, through the built-in temporal convolutional network, lateral temporal features are extracted along the XZ plane of the first point cloud space, including: Multi-scale data slicing was performed on the Y-axis direction of the first point cloud space to obtain several first slice data that characterize the temporal variation law during the switching of different operating conditions of the same elevator load. Perform temporal convolution processing on each first slice of data to obtain the first trend feature; By concatenating all primary trend features, we obtain the lateral time series features.

[0010] Furthermore, through the built-in perceptual convolutional network, vertical spatial features are extracted along the YZ plane of the first point cloud space, including: Multi-scale data slicing was performed on the X-axis direction of the first point cloud space to obtain several second slice data for characterizing the variation law of voiceprint features under different elevator loads under the same operating conditions. Dilated convolution is performed on each second slice of data to obtain the second trend feature; By concatenating all the second-trend features, the vertical spatial features are obtained.

[0011] Furthermore, through the built-in first 3D convolutional network, joint distribution features are extracted along the XYZ space of the first point cloud space, including: Multi-scale data space cutting processing is performed on the Z-axis direction of the first point cloud space to obtain several associated spatial data that characterize the operating conditions and elevator load distribution within the same voiceprint feature range. Perform 3D convolution on each associated spatial data to obtain associated features; By concatenating all associated features, a joint distribution feature is obtained.

[0012] Furthermore, broadcast multiplication is performed on the horizontal temporal features and vertical spatial features to generate spatiotemporal interactive features, including: Align the horizontal temporal features and vertical spatial features according to the feature dimensions to obtain the adapted horizontal temporal features and adapted vertical spatial features; Tensor outer product operation is performed on the adapted horizontal temporal features and the adapted vertical spatial features to obtain spatiotemporal interaction features.

[0013] Furthermore, the preset fault threshold is determined in the following way: Obtain the design parameters and current service life of the elevator to be tested; Determine the initial threshold based on the design parameters; Calculate the degradation coefficient under the current service life based on the preset life distribution of the elevator to be tested; Determine the preset fault threshold based on the degradation coefficient and the initial threshold.

[0014] Based on the above method embodiments, the present invention provides corresponding system embodiments, including: a voiceprint acquisition module, a voiceprint feature extraction module, a point cloud space construction module, a risk assessment module, and a fault early warning module; The acoustic signature acquisition module is used to acquire the traction machine operating acoustic signature of the elevator under different elevator loads throughout the entire operating cycle. The entire operating cycle includes: starting, acceleration, constant speed, deceleration and braking. The voiceprint feature extraction module is used to perform wavelet transform on the voiceprint of the traction machine to extract voiceprint features; The point cloud space construction module is used to construct the first point cloud space based on the acoustic features of the traction machine's operating acoustic features under different elevator loads and the full-cycle operating conditions, with the operating conditions as the X-axis, the elevator load as the Y-axis, and the acoustic features as the Z-axis. The risk assessment module is used to input the first point cloud space into the trained elevator fault risk assessment model. This allows the elevator fault risk assessment model to extract lateral temporal features along the XZ plane of the first point cloud space using a built-in temporal convolutional network; extract vertical spatial features along the YZ plane of the first point cloud space using a built-in perceptual convolutional network; extract joint distribution features along the XYZ space of the first point cloud space using a built-in first 3D convolutional network; perform broadcast multiplication on the lateral temporal features and vertical spatial features to generate spatiotemporal interactive features; concatenate the spatiotemporal interactive features and joint distribution features along the channel dimension; and then perform local feature aggregation using a built-in second 3D convolutional network to generate a first fusion feature; finally, determine the fault risk value based on the first fusion feature. The fault warning module is used to issue a fault warning signal when the fault risk value exceeds the preset fault threshold.

[0015] Furthermore, the elevator fault early warning system based on voiceprint recognition also includes: a voiceprint noise reduction module; The voiceprint noise reduction module includes: a noise signal generation unit, a noise frequency domain transformation unit, a voiceprint frequency domain transformation unit, a spectral subtraction noise reduction unit, and a voiceprint time domain reconstruction unit; The noise signal generation unit is used to call the probability distribution of the corresponding noise parameter from the preset noise parameter probability distribution library according to the elevator load and operating conditions, and to generate a noise signal by random sampling. The noise frequency domain transformation unit is used to perform a short-time Fourier transform on the noise signal to obtain the noise spectrum; The acoustic signature frequency domain transformation unit is used to perform short-time Fourier transform on the acoustic signature of the traction machine to obtain the acoustic signature spectrum; The spectral subtraction noise reduction unit is used to subtract the noise spectrum from the acoustic spectrum through spectral subtraction processing to obtain the noise-reduced acoustic spectrum. The acoustic signature time-domain reconstruction unit is used to perform inverse short-time Fourier transform on the denoised acoustic signature spectrum to obtain the denoised traction machine operation acoustic signature.

[0016] Compared with the prior art, the beneficial effects of this embodiment are as follows: This invention acquires the traction machine's operating acoustic signatures for the entire operating cycle of an elevator under different elevator loads. The entire operating cycle includes starting, accelerating, maintaining constant speed, decelerating, and braking. Under different loads and operating conditions, the traction machine's operating state differs, resulting in different acoustic signatures. Next, wavelet transform is performed on the traction machine's operating acoustic signatures to extract acoustic signature features. Based on the acoustic signature features corresponding to the traction machine's operating acoustic signatures for the entire operating cycle under different elevator loads, a first point cloud space is constructed with the operating condition as the X-axis, the elevator load as the Y-axis, and the acoustic signature features as the Z-axis, thereby structurally integrating the load, operating condition, and acoustic signature features. The first point cloud space is input into the trained elevator fault risk assessment model. During the feature extraction stage, the built-in temporal convolutional network extracts lateral temporal features along the XZ plane of the first point cloud space. Since the full-cycle operating conditions are arranged in chronological order, the temporal convolutional network can capture the temporal variation patterns of voiceprint features during different operating condition transitions. The built-in perceptual convolutional network extracts vertical spatial features along the YZ plane of the first point cloud space. Different elevator loads correspond to different positions on the Y-axis, and the perceptual convolutional network can uncover the variation patterns of voiceprint features under different loads. Finally, the built-in first 3D convolutional network extracts joint features along the XYZ space of the first point cloud space. The 3D convolutional network comprehensively considers the joint distribution of operating conditions, load, and acoustic features in three-dimensional space, capturing the complex interactions among them. In the feature fusion stage, broadcast multiplication is performed on the horizontal temporal features and vertical spatial features to generate spatiotemporal interactive features. After concatenating the spatiotemporal interactive features and joint distribution features along the channel dimension, local feature aggregation is performed through the built-in second 3D convolutional network to generate the first fused feature, which integrates information from multiple aspects such as time, space, and their synergistic effects, and can more comprehensively describe the elevator's operating status. Based on the first fused feature, the fault risk value is determined. When the fault risk value exceeds the preset fault threshold, a fault warning signal is issued.

[0017] In summary, this invention integrates operating conditions, loads, and acoustic signature features by constructing a three-dimensional point cloud space, and performs multi-dimensional feature extraction and coupling through a model. This enables the model to learn the dynamic influence of loads and operating conditions on acoustic signature features, thereby overcoming the limitation of traditional machine learning methods that only learn the relationship between acoustic signatures and faults, and improving the accuracy of fault identification. Attached Figure Description

[0018] Figure 1 This is a flowchart illustrating an elevator fault early warning method based on voiceprint recognition provided in an embodiment of the present invention. Figure 2 This is a schematic diagram of the structure of an elevator fault early warning system based on voiceprint recognition provided in an embodiment of the present invention. Detailed Implementation

[0019] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0020] In the description of this invention, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.

[0021] Traditional machine learning methods have significant limitations in elevator fault early warning. They focus solely on the relationship between sound patterns and faults, neglecting the impact of key physical factors during elevator operation on the acoustic characteristics of faults. Specifically, the output torque of the traction machine increases with load. If the traction machine has hidden problems such as slight gear wear or excessive bearing clearance, there may be no obvious abnormal noise under low loads, but under high loads, the increased stress will significantly reveal the acoustic characteristics of the fault. Furthermore, the speed and force patterns of the elevator traction machine differ during startup, acceleration, constant speed, deceleration, and braking. For example, during startup, the traction machine needs to overcome static friction, causing a sudden increase in speed from 0; during braking, the brake contacts the traction sheave, generating instantaneous friction. Different fault types will exhibit different acoustic characteristics under these different operating conditions. Therefore, traditional methods cannot comprehensively capture these complex situations, limiting the accuracy and reliability of fault early warning.

[0022] like Figure 1 As shown, in order to overcome the limitation of traditional machine learning methods that only learn the relationship between voiceprints and faults, an embodiment of the present invention provides an elevator fault early warning method based on voiceprint recognition, which includes at least the following steps: Step S1: Obtain the traction machine operating sound pattern of the elevator under different elevator loads during the entire cycle of operation; the entire cycle of operation includes: starting, acceleration, constant speed, deceleration and braking; For step S1, in order to accurately capture the acoustic characteristics of the elevator traction machine in actual operation, the traction machine's operating sound patterns are collected by microphones at the periphery of the traction machine under different elevator loads throughout the entire cycle of operation.

[0023] In this embodiment, considering the diversity of loads during actual elevator operation, two or more different elevator loads are set. This is because the output characteristics of the traction machine change with the load; the stress and vibration of its internal components differ under different loads, resulting in different sound characteristics. For example, the interaction between components is relatively mild under low loads, while abnormal noises may occur due to excessive force under high loads. By setting multiple different loads, the acoustic performance of the traction machine under various load scenarios can be captured more comprehensively.

[0024] The full-cycle operating conditions include the starting phase, acceleration phase, constant speed phase, deceleration phase, and braking phase. It should be noted that for some elevators with shorter operating times, the full-cycle operating conditions can be simplified to include only the starting phase, acceleration phase, deceleration phase, and braking phase to suit actual conditions. In this case, the duration of the constant speed phase is 0.

[0025] In a preferred embodiment, after obtaining the traction machine operating sound signature of the elevator under different elevator loads throughout its entire operating cycle, the method further includes: Based on the elevator load and operating conditions, the probability distribution of the corresponding noise parameter is retrieved from the preset noise parameter probability distribution library; For each operating condition, based on the probability distribution of noise parameters, a combination of noise parameters conforming to the probability distribution is generated through random sampling; the combination of noise parameters includes: amplitude, frequency, phase, and bandwidth; The spectral shape of the noise signal is determined based on the frequency and bandwidth obtained from the sampling. Based on the amplitude obtained from sampling, the shape of the spectrum is adjusted to obtain the frequency domain signal; Perform an inverse Fourier transform on the frequency domain signal to obtain the time domain signal; Based on the sampled phase, the time-domain signal is phase-adjusted to generate a noise segment for this operating condition; Noise segments from all operating conditions are spliced ​​together to obtain a continuous noise signal; The noise signal is subjected to a short-time Fourier transform to obtain the noise spectrum; The acoustic waveform of the traction machine is subjected to a short-time Fourier transform to obtain the acoustic waveform spectrum. The noise spectrum is subtracted from the speaker spectrum using spectral subtraction to obtain the noise-reduced speaker spectrum; The denoised acoustic signature spectrum is subjected to inverse short-time Fourier transform to obtain the denoised traction machine operating acoustic signature.

[0026] In one embodiment of the present invention, after obtaining the traction machine operating sound pattern of the elevator under different elevator loads throughout its entire operating cycle, the method further includes noise reduction processing on the inherent noise contained in the traction machine operating sound pattern. Specifically: During actual operation, elevator traction machines inevitably contain various inherent noises, such as airflow noise within the elevator shaft and electromagnetic interference noise from surrounding equipment. These inherent noises mix with the actual operating sound of the traction machine, interfering with subsequent accurate analysis of the traction machine's operating status and fault characteristics.

[0027] To effectively eliminate these inherent noises, it is first necessary to retrieve the probability distribution of the corresponding noise parameters from a pre-set noise parameter probability distribution library based on the elevator's load and operating conditions. This is because the characteristics of inherent noise will differ under different loads and operating conditions. For example, when the elevator is running under high load, the increased output power of the traction machine may cause stronger electromagnetic interference noise, and the probability distribution of its noise parameters will change accordingly.

[0028] The pre-defined noise parameter probability distribution library was established through extensive preliminary experiments and actual data collection. Long-term acoustic signature data was collected from elevators under various loads and operating conditions in diverse elevator operating environments. Simultaneously, specialized noise analysis equipment was used to separate and extract features from the inherent noise in these collected acoustic signature data. For example, a spectrum analyzer can decompose the acoustic signature signal into different frequency components, presenting the frequency distribution of noise; an acoustic vibration analyzer can analyze the relationship between noise and mechanical vibration, obtaining more comprehensive noise characteristic information. For each data collection, the elevator load, operating conditions, and corresponding noise characteristic parameters, including amplitude, frequency, phase, and bandwidth, were recorded in detail. After accumulating a large amount of data, statistical methods were used to analyze and model this data, thereby obtaining the probability distribution of noise parameters under different loads and operating conditions, and storing it to form the pre-defined noise parameter probability distribution library.

[0029] It should be noted that professional noise analysis equipment is typically expensive, bulky, and complex to operate. Equipping and continuously using such equipment for every elevator in actual elevator operation monitoring would significantly increase monitoring costs. Furthermore, in real-world elevator operating environments, space constraints and equipment compatibility issues may exist, making it difficult to directly use professional equipment for real-time, long-term noise monitoring. This invention, by establishing a pre-defined noise parameter probability distribution library and performing noise simulation and reduction processing based on this library, can efficiently remove inherent noise from the acoustic signature of elevator traction machines without relying on professional equipment. This allows for more convenient and economical accurate monitoring and analysis of elevator operating status.

[0030] For each specific operating condition, based on the probability distribution of the noise parameters obtained from the call, a Monte Carlo random sampling method is used to generate a combination of noise parameters that conforms to these probability distributions. Noise parameters include amplitude, frequency, phase, and bandwidth parameters. Taking the frequency parameter as an example, if its probability distribution shows that the frequency is mainly concentrated in a certain range under a certain operating condition, random sampling can obtain the specific frequency values ​​within that range, and simultaneously determine the values ​​of amplitude, phase, and bandwidth, forming a complete set of noise parameter combinations.

[0031] Based on the frequency and bandwidth parameters obtained from sampling, the spectral shape of the noise signal is constructed. A suitable window function is typically used to simulate the spectral characteristics, with the frequency as the center frequency and the bandwidth used to define the width of the spectrum, thus constructing a preliminary spectral model. Then, the amplitude of the spectrum is adjusted according to the amplitude parameters obtained from sampling, so that the overall amplitude of the spectrum matches the sampled values, thereby obtaining the frequency domain signal.

[0032] The adjusted frequency domain signal is subjected to an inverse Fourier transform to convert it to the time domain, resulting in a time domain signal. Then, the time domain signal is phase-adjusted based on the sampled phase parameters. For complex signals, this can be achieved by multiplying by the corresponding phase factor; for real signals, Euler's formula is used for conversion. Finally, a noise segment under this operating condition is generated.

[0033] Noise segments generated under all operating conditions are spliced ​​together according to the actual time sequence of elevator operation to form a continuous noise signal. Then, short-time Fourier transforms are performed on the spliced ​​noise signal and the collected traction machine operation acoustic waveforms to obtain the noise spectrum and acoustic waveform spectrum, respectively.

[0034] The noise spectrum is subtracted from the acoustic signature spectrum using spectral subtraction. It should be noted that during the spectral subtraction process, the estimated value of the noise spectrum amplitude is subtracted from the amplitude of the noisy acoustic signature spectrum while keeping the phase of the acoustic signature spectrum unchanged.

[0035] The noise-reduced ripple spectrum after spectral subtraction is subjected to inverse short-time Fourier transform to convert the frequency domain signal back to the time domain signal, ultimately obtaining the noise-reduced traction machine operating sound pattern. This series of processes removes the interference of inherent noise, allowing the traction machine operating sound pattern to more accurately reflect its true operating status.

[0036] Step S2: Perform wavelet transform on the traction machine's operating acoustic fingerprint to extract acoustic fingerprint features; In a preferred embodiment, wavelet transform is performed on the traction machine's operating acoustic signature to extract acoustic signature features, including: The traction machine's operating acoustic signature is divided according to the operating conditions to obtain corresponding acoustic signature segments; For each voiceprint segment, the corresponding wavelet basis function is determined according to the operating condition of the voiceprint segment; Calculate the load factor based on the elevator load and rated load; Based on the modified wavelet basis function using the loading coefficient, the modified wavelet basis function is obtained; Wavelet transform is performed on the voiceprint segments based on the modified wavelet basis function to obtain the corresponding voiceprint features.

[0037] Regarding step S2, it should be noted that the essence of elevator operation soundprints is a time-series signal, the length of which is directly determined by the operation cycle. For example, the operation time from the 1st floor to the 3rd floor is short, and the soundprint signal duration may be only 5 seconds; the operation time from the 1st floor to the 10th floor is long, and the soundprint signal duration may reach 15 seconds. Before performing wavelet transform on the traction machine operation soundprints to extract soundprint features, it is necessary to align the time scales of all traction machine operation soundprints to ensure that the soundprint features extracted by wavelet transform have consistency and reliability.

[0038] Taking an office building elevator as an example, with a rated load of 1250kg, the traction machine's operating sound patterns under different loads throughout the entire operating cycle have been obtained through step S1. Now, these sound patterns will be divided according to the operating conditions. For example, the sound pattern data of the starting phase is extracted as one sound pattern segment, and the corresponding sound pattern data of the acceleration phase, constant speed phase, deceleration phase, and braking phase are also extracted to form their respective sound pattern segments. The originally continuous sound pattern signal is now divided into multiple segments corresponding to different operating phases.

[0039] For each segmented acoustic signature, the corresponding wavelet basis function is determined based on the operating condition of the segment. For example, during the startup phase, the traction machine accelerates from a standstill, and its acoustic signature signal exhibits sudden changes and rapid increases. In this case, a wavelet basis function with good temporal localization and abrupt change detection capabilities is selected, such as the db4 wavelet from the Daubechies wavelet (dbN wavelet family). This is because the db4 wavelet has a tight support characteristic in the time domain, which can effectively capture abrupt changes in the signal and is suitable for analyzing acoustic signature signals with large dynamic changes during the startup phase. During the acceleration phase, the traction machine's rotational speed continuously increases, and its acoustic signature signal exhibits a gradual increase and a constantly changing frequency. At this point, the coif3 wavelet from the Coiflets wavelet family (coifN wavelet family) can be selected. Coiflets wavelets have a high vanishing moment, meaning they have good localization capabilities in the frequency domain while maintaining certain characteristics in the time domain. During the constant-speed phase, the traction machine runs relatively smoothly, and the acoustic signature signal is relatively stable. Wavelet basis functions with good frequency domain localization characteristics can be selected, such as the sym8 wavelet from the Symlets wavelet family (symN wavelet family). It can provide more accurate analysis in the frequency domain, helping to extract the frequency characteristics of the acoustic signature signal during the constant-speed phase. During the deceleration phase, the traction machine speed gradually decreases, and the trend of the acoustic signature signal is opposite to that of the acceleration phase; the energy gradually weakens, and the frequency also gradually decreases. At this time, the bi... The Bior3.7 wavelet, with its linear phase characteristics, is suitable for the traction machine during deceleration. As the interaction between components changes, the phase relationship of the acoustic signal becomes complex. The Bior3.7 wavelet effectively preserves the signal's phase information, and its biorthogonal properties give it an advantage in signal reconstruction. During braking, the brake contacts the traction sheave, generating momentary friction that causes brief impacts and noise in the acoustic signal. In this case, the Meyer wavelet is chosen. Defined in the frequency domain, the Meyer wavelet possesses excellent regularity and symmetry. During braking, the impact component in the acoustic signal contains rich fault information. The symmetry of the Meyer wavelet ensures that phase distortion is not introduced during signal analysis, and its good regularity helps accurately capture abrupt changes and impact characteristics in the signal.

[0040] The load factor is calculated based on the elevator's actual load and rated load. Assuming the elevator load corresponding to the currently collected voiceprint segment is 800 kg and the rated load is 1250 kg, then the load factor... The load factor reflects the ratio of the elevator's current load to its rated load. The operating state and acoustic characteristics of the traction machine will differ under different loads. Therefore, the wavelet basis function for each operating stage is corrected using the load factor to better suit the acoustic signature segment analysis under the current load. The specific correction process is as follows: According to the elevator's load factor The load is divided into different levels. Taking the rated load of the office building elevator as 1250kg as an example, the rated load elevator load level classification table is set as shown in Table 1: Table 1 Rated Load Classification of Elevator Load Ratings

[0041] When the elevator load factor This corresponds to the medium load level. To ensure that subsequent wavelet transform analysis can more accurately adapt to the voiceprint segments under the current medium load level, the wavelet basis functions are corrected using preset correction strategies for each load level. The following explanation uses the startup and acceleration phases as examples: When an elevator traction machine starts under medium load, the amplitude of abrupt changes in the acoustic signature signal is larger than under low load, but not as drastic as under high load. According to the preset correction strategy, the db4 wavelet, with its tight support in the time domain, is originally suitable for capturing signal abrupt changes of moderate magnitude. However, to better adapt to acoustic signature signals under medium load, the parameters of the db4 wavelet need to be adjusted. Specifically, its scaling parameter is multiplied by an adjustment factor of approximately 0.9. This is done to slightly narrow the support range of the db4 wavelet in the time domain, enhancing its sensitivity to medium-amplitude abrupt changes. Because the abrupt changes in the acoustic signature signal under medium load have a certain intensity, narrowing the support range allows the wavelet to focus more precisely on the abrupt change region, more effectively capturing the abrupt change information of the acoustic signature signal.

[0042] During the acceleration process of a medium-load elevator, the traction machine speed continuously increases, and the acoustic signature signal exhibits a gradual increase in intensity and a constantly changing frequency, with the amplitude and complexity of the frequency changes being moderate. The coif3 wavelet has a high vanishing moment and performs well in both the frequency and time domains. Following a preset correction strategy, the scale parameter of the coif3 wavelet is appropriately reduced, by approximately 0.85 of the original scale parameter. Reducing the scale parameter improves the resolution of the coif3 wavelet in the frequency domain, enabling it to more sensitively capture subtle changes in the acoustic signature signal frequency during medium-load acceleration. Because frequency changes at medium loads are not as drastic and complex as at high loads, adjusting the scale parameter allows the wavelet to be analyzed within a suitable frequency range.

[0043] It should be noted that the acoustic characteristics of the traction machine of different brands and models of elevators may vary under different loads. In addition, the elevator's operating environment (such as temperature, humidity, noise level, etc.) will also affect the acoustic signal. Therefore, the preset correction strategy can be set and adjusted according to the actual situation.

[0044] Finally, wavelet transforms are performed on the corresponding stage voiceprint segments using these modified wavelet basis functions. After the wavelet transform is completed, representative voiceprint features are extracted from the transform results, mainly including wavelet energy entropy and wavelet correlation coefficient.

[0045] This invention fully considers the differences in elevator operating conditions and tailors wavelet basis functions for each stage, making them more closely aligned with signal characteristics and accurately capturing key features. This avoids feature omissions or misjudgments caused by using a uniform wavelet basis function to process acoustic fingerprint signals with significant differences under different operating conditions. Simultaneously, a load coefficient is introduced to classify load levels, and the wavelet basis function is modified accordingly. Since the actual load on the elevator is constantly changing, and the acoustic characteristics of the traction machine differ under different load levels, the modified wavelet basis function can better adapt to the acoustic fingerprint signal under the current load, enabling the wavelet transform to more accurately decompose the signal. The extracted wavelet energy entropy and wavelet correlation coefficient, among other features, more realistically reflect the operating status.

[0046] Step S3: Based on the acoustic characteristics of the traction machine's operating acoustics under different elevator loads throughout the entire operating cycle, construct the first point cloud space with the operating conditions as the X-axis, the elevator load as the Y-axis, and the acoustic characteristics as the Z-axis. For step S3, the operating conditions are used as the X-axis to locate and distinguish the different operating stages of the elevator, such as starting, accelerating, constant speed, deceleration, and braking. The elevator load is used as the Y-axis to represent the actual weight carried by the elevator on the vertical axis. The extracted voiceprint features are used as the Z-axis. Each operating condition, elevator load, and corresponding voiceprint feature is mapped to a three-dimensional coordinate system to form data points. All data points are aggregated to form the first point cloud space.

[0047] This point cloud space provides a clear visual representation of the correlation between different operating conditions, elevator loads, and acoustic signature characteristics. For example, the constructed first point cloud space clearly shows the distribution of features such as wavelet energy entropy and wavelet correlation coefficient of the acoustic signature under high-load acceleration conditions. This provides spatial data support for subsequent analysis of the traction machine's operating status under different conditions and loads, as well as for fault diagnosis.

[0048] Step S4: Input the first point cloud space into the trained elevator fault risk assessment model, so that the elevator fault risk assessment model can extract lateral temporal features along the XZ plane of the first point cloud space through the built-in temporal convolutional network; extract vertical spatial features along the YZ plane of the first point cloud space through the built-in perceptual convolutional network; extract joint distribution features along the XYZ space of the first point cloud space through the built-in first 3D convolutional network; perform broadcast multiplication on the lateral temporal features and vertical spatial features to generate spatiotemporal interactive features; after concatenating the spatiotemporal interactive features and joint distribution features along the channel dimension, perform local feature aggregation through the built-in second 3D convolutional network to generate the first fusion feature; determine the fault risk value based on the first fusion feature. For step S4, after inputting the first point cloud space into the trained elevator fault risk assessment model, within the model, in order to capture the dynamic patterns of voiceprint features (Z-axis) in the time dimension as the operating conditions (X-axis) change during elevator operation, a built-in temporal convolutional network is used to extract lateral temporal features along the XZ plane of the first point cloud space. Specifically: In a preferred embodiment, a built-in temporal convolutional network is used to extract lateral temporal features along the XZ plane of the first point cloud space, including: Multi-scale data slicing was performed on the Y-axis direction of the first point cloud space to obtain several first slice data that characterize the temporal variation law during the switching of different operating conditions of the same elevator load. Perform temporal convolution processing on each first slice of data to obtain the first trend feature; By concatenating all primary trend features, we obtain the lateral time series features.

[0049] In one embodiment of the present invention, multi-scale data slicing is performed along the Y-axis of the first point cloud space. Slicing along the Y-axis essentially involves extracting the acoustic signature features (Z-axis) corresponding to all operating conditions (X-axis) under a fixed load value. Multi-scale slicing here means segmenting the time-series curve under the same load according to different numbers of operating conditions, thereby obtaining subsequences of different lengths. This allows for capturing both the subtle changes in operating condition switching within short spans, such as the minute changes in acoustic signature features during the elevator's start-up and acceleration processes, and the overall trend over long spans, such as the general direction of the elevator's acoustic signature features throughout its entire operating cycle.

[0050] For example, in small-scale slicing, data from two consecutive operating conditions are extracted each time, such as the elevator transitioning from a starting state to an acceleration state, or from an acceleration state to a constant speed state. In this case, the focus is on the detailed characteristics during the transition between adjacent operating conditions. By analyzing the abrupt change pattern of the voiceprint during the transition from acceleration to constant speed, we can gain a deeper understanding of the dynamic characteristics of the elevator during the local operating state transition. In medium-scale slicing, data from three to four consecutive operating conditions are extracted each time, such as the elevator transitioning from a starting state, through an acceleration state, and then to a constant speed state. During this process, we focus on the coordinated change trend of multiple consecutive operating conditions. In large-scale slicing, data from the entire cycle of operating conditions is extracted to capture the overall temporal pattern of the complete operating process.

[0051] These slices, spanning different operating conditions, constitute a multi-scale slice. Smaller scale slices cover fewer operating conditions, allowing for a focus on localized, detailed changes, such as the precise capture of transitions between adjacent operating conditions. Larger scale slices cover a wider range of operating conditions, reflecting overall trends, such as the grasp of the entire operational cycle's patterns. This multi-scale slicing process enables the comprehensive extraction of acoustic signature information during elevator operation from multiple levels.

[0052] Temporal convolution is performed on each slice of data obtained after slicing. Temporal convolution can extract the first trend feature from these subsequence data. This feature can reflect the changing trend of voiceprint features within the range of specific load and local working conditions.

[0053] The first trend features obtained after temporal convolution are concatenated. Through this concatenation operation, the features extracted from slices at different scales are integrated into a comprehensive lateral temporal feature. This lateral temporal feature incorporates the changes in voiceprint features during various operating condition switching processes under different loads of the elevator.

[0054] To capture the dynamic patterns of voiceprint features (Z-axis) spatial distribution as the elevator load (Y-axis) changes during elevator operation, a built-in perceptual convolutional network extracts vertical spatial features along the YZ plane of the first point cloud space. Specifically: In a preferred embodiment, vertical spatial features are extracted along the YZ plane of the first point cloud space using a built-in perceptual convolutional network, including: Multi-scale data slicing was performed on the X-axis direction of the first point cloud space to obtain several second slice data for characterizing the variation law of voiceprint features under different elevator loads under the same operating conditions. Dilated convolution is performed on each second slice of data to obtain the second trend feature; By concatenating all the second-trend features, the vertical spatial features are obtained.

[0055] In one embodiment of the present invention, multi-scale data slicing processing is performed along the X-axis direction of the first point cloud space. Slicing along the X-axis essentially involves extracting the voiceprint features (Z-axis) corresponding to all elevator loads (Y-axis) under a fixed operating condition. Here, multi-scale slicing means cutting relevant data under the same operating condition according to different load variation ranges or intervals, thereby obtaining subsets of data with different ranges, i.e., several second slices of data used to characterize the variation patterns of voiceprint features under different elevator loads under the same operating condition.

[0056] For example, in small-scale slicing, data is extracted from a relatively small range of load variation each time. For instance, when the elevator is running at a constant speed, the focus is on the acoustic signature characteristics corresponding to load variations within a small interval. In this case, the focus is on the changes in acoustic signature characteristics caused by subtle load changes. By analyzing these subtle changes, we can gain a deeper understanding of the impact of local load fluctuations on acoustic signature characteristics under specific operating conditions. In medium-scale slicing, data from a medium range of load variation is extracted each time. For example, when the elevator is accelerating, data is extracted from load variations within a certain interval, focusing on the co-change relationship between load variations within this range and acoustic signature characteristics. In large-scale slicing, data from the entire load range under this operating condition is extracted to grasp the overall change pattern of acoustic signature characteristics across the entire load variation range.

[0057] These slices, representing different load variation ranges, constitute a multi-scale slice. Smaller scale slices cover a narrower range of load variations, focusing more intently on subtle local load changes; larger scale slices cover a wider load range, reflecting the overall load variation trend. This multi-scale slicing process allows for the comprehensive acquisition of acoustic signature characteristics corresponding to different loads under the same operating condition from multiple perspectives.

[0058] Dilated convolution is performed on each second slice of data obtained after slicing. Dilated convolution can expand the receptive field without increasing the number of parameters, thus better capturing long-term dependencies and trends in the data. Through dilated convolution, a second trend feature can be extracted from the second slice data, which can reflect the changing trend of acoustic signature features under specific operating conditions and within the range of local load variations.

[0059] All the secondary trend features obtained after dilated convolution are concatenated. Through this concatenation operation, the features extracted from slices at different scales are integrated into a comprehensive vertical spatial feature. This vertical spatial feature incorporates the changes in voiceprint features during different load variations under the same operating conditions of the elevator.

[0060] To capture the complex and dynamic relationship between elevator operating conditions (X-axis), elevator load (Y-axis), and voiceprint features (Z-axis) during elevator operation, a built-in first 3D convolutional network extracts joint distribution features along the XYZ space of the first point cloud space. Specifically: In a preferred embodiment, joint distribution features are extracted along the XYZ space of the first point cloud space using a built-in first 3D convolutional network, including: Multi-scale data space cutting processing is performed on the Z-axis direction of the first point cloud space to obtain several associated spatial data that characterize the operating conditions and elevator load distribution within the same voiceprint feature range. Perform 3D convolution on each associated spatial data to obtain associated features; By concatenating all associated features, a joint distribution feature is obtained.

[0061] In one embodiment of the present invention, multi-scale data spatial segmentation processing is performed along the Z-axis direction of the first point cloud space. The segmentation operation along the Z-axis essentially involves analyzing the distribution of operating conditions (X-axis) and elevator load (Y-axis) within a fixed range of acoustic signature features. Here, multi-scale data spatial segmentation means segmenting according to different acoustic signature feature intervals or intervals to obtain subspace data of different ranges, i.e., several associated spatial data used to characterize the distribution of operating conditions and elevator load within the same acoustic signature feature range.

[0062] For example, in small-scale segmentation, data is extracted from a relatively narrow range of voiceprint features each time. For instance, when the voiceprint features are within a small numerical range, the focus is on the specific distribution of different elevator operating conditions and loads within that range. The focus is on the combination of operating conditions and loads corresponding to subtle changes in the voiceprint features. By analyzing these local distributions, the correlation between elevator operating conditions and loads within a specific voiceprint feature range can be understood. In medium-scale segmentation, data from a medium range of voiceprint features is extracted each time. For example, when the voiceprint features change within a certain range, the distribution patterns of operating conditions and loads within that range are analyzed, focusing on the coordinated changes between the two. In large-scale segmentation, data from the entire voiceprint feature range is extracted to grasp the overall distribution patterns of operating conditions and loads across the entire range of voiceprint feature variations.

[0063] These segmentations of different acoustic signature ranges constitute multi-scale segmentation. Smaller scales cover a narrower range of acoustic signature features, allowing for a more focused analysis of subtle local changes in these features and their corresponding operating conditions and load distributions. Larger scales cover a wider range of acoustic signature features, better reflecting the overall distribution trends of operating conditions and loads under global changes in acoustic signature features. This multi-scale segmentation process enables the comprehensive acquisition of operating condition and elevator load distribution information within the same acoustic signature range from multiple perspectives.

[0064] Each segmented, associated spatial data point is processed using 3D convolution. 3D convolution considers information from three dimensions of space simultaneously. By performing convolution on the associated spatial data, the complex relationships between operating conditions, elevator load, and acoustic signature features can be fully explored, thus yielding associated features. These features can reflect the inherent connections and distribution characteristics of operating conditions and loads within a specific acoustic signature feature range.

[0065] All associated features obtained after 3D convolution are concatenated. Through this concatenation operation, features extracted at different scales are integrated into a comprehensive joint distribution feature. This joint distribution feature incorporates the operating conditions and load distribution information corresponding to different acoustic signature ranges throughout the elevator's operation.

[0066] After extracting horizontal temporal features, vertical spatial features, and joint distribution features, in order to more comprehensively and deeply explore the information during elevator operation and further grasp the complex relationship between elevator operating status and voiceprint features, these features are fused. Specifically: In a preferred embodiment, broadcast multiplication is performed on the horizontal temporal features and the vertical spatial features to generate spatiotemporal interactive features, including: Align the horizontal temporal features and vertical spatial features according to the feature dimensions to obtain the adapted horizontal temporal features and adapted vertical spatial features; Tensor outer product operation is performed on the adapted horizontal temporal features and the adapted vertical spatial features to obtain spatiotemporal interaction features.

[0067] In one embodiment of the present invention, firstly, the horizontal temporal features reflect the temporal evolution of the acoustic signature features as the operating conditions continuously change under a fixed load; the vertical spatial features reflect the correlation between load changes and acoustic signature features under specific operating conditions. In other words, the information such as the range of operating condition changes and time span covered by the horizontal temporal features differs in dimension from the load change information covered by the vertical spatial features. Therefore, it is necessary to perform dimensional analysis and mapping on the horizontal temporal features and vertical spatial features according to their feature dimensions to achieve alignment and ensure that the horizontal temporal features and vertical spatial features can be subsequently calculated and analyzed within the same dimensional framework. Specifically, by constructing a shared dimensional mapping matrix, the horizontal temporal features and vertical spatial features are projected onto the same high-dimensional latent space. During the mapping process, the matrix parameters are not fixed but dynamically adjusted through extensive data training and optimization algorithms. During training, the goal is to minimize the information loss of the two features in the new dimensional space and maximize their matching degree in the new space, continuously optimizing the matrix parameters. After such optimization, the two transformed features can fully retain their core information in the new dimensional space and achieve complete dimensional matching. After alignment, the adapted horizontal temporal features and adapted vertical spatial features were obtained.

[0068] Tensor outer product operations are performed on the adapted lateral temporal features and the adapted vertical spatial features. Tensor outer product operations enable comprehensive combination and interaction of elements from both features. Through this operation, the potential connections between the lateral temporal features regarding the audioprint temporal information under elevator operating condition switching and load changes, and the vertical spatial features regarding the spatial distribution of elevator load and audioprint features, and the correlation distribution between operating conditions and audioprint features, are fully explored. The resulting spatiotemporal interactive features integrate key information from both time and space dimensions, providing a more comprehensive and detailed reflection of the complex characteristics of elevator operation.

[0069] The spatiotemporal interaction features contain the evolution law of elevator voiceprint features under dynamic combinations of load and operating conditions. It includes the temporal changes of voiceprint when different operating conditions are continuously switched under the same load, as well as the voiceprint differences under different loads for the same operating condition. It fully presents the temporal changes of operating conditions in the time dimension, and the voiceprint characteristics under the cross-effect of load differences in the spatial dimension. The joint distribution features focus on the global correlation between load, operating condition and voiceprint. The spatiotemporal interaction features and joint distribution features are spliced ​​along the channel dimension. This can not only retain the dynamic details of voiceprint under specific load and operating condition combinations, but also integrate the global distribution information of the three correlations, providing a richer data foundation for subsequent feature processing.

[0070] After the splicing is completed, the built-in second 3D convolutional network performs local feature aggregation. The 3D convolutional network has powerful feature extraction and integration capabilities, which can perform in-depth analysis and aggregation of local information in the spliced ​​features, extract more representative and key features, and generate the first fused feature. This feature further integrates the effective information in the spatiotemporal interaction features and joint distribution features, and expresses the relevant features of the elevator's operating status more concisely.

[0071] Finally, through the decoding layer built into the model, based on the knowledge and patterns learned in the previous training, the first fusion feature is analyzed to determine the fault risk value, providing an intuitive quantitative indicator for assessing the operational safety of the elevator.

[0072] The training process of the elevator failure risk assessment model is explained in detail below: First, acquire elevator operation data under normal operation and different fault scenarios. This data covers the acoustic characteristics of the elevator under different elevator loads throughout the entire cycle of operation. Professional elevator maintenance personnel and experts annotate the collected operating data, and assign a corresponding fault risk value label to each data sample based on the actual operating status and fault conditions of the elevator. Based on the acoustic characteristics of the elevator under different elevator loads throughout the entire cycle of operation, a second point cloud space is constructed with the operation condition as the X-axis, the elevator load as the Y-axis, and the acoustic characteristics as the Z-axis. Initialize the model parameters of the elevator failure risk assessment model to be trained; The second point cloud space is input into the elevator fault risk assessment model to be trained for iterative training. The elevator fault risk assessment model extracts horizontal temporal sample features along the XZ plane of the second point cloud space through the built-in temporal convolutional network; extracts vertical spatial sample features along the YZ plane of the second point cloud space through the built-in perceptual convolutional network; extracts joint distributed sample features along the XYZ space of the second point cloud space through the built-in first 3D convolutional network; broadcast multiplication is performed on the horizontal temporal sample features and the vertical spatial sample features to generate spatiotemporal interactive sample features; the spatiotemporal interactive sample features and the joint distributed sample features are concatenated along the channel dimension, and then local feature aggregation is performed through the built-in second 3D convolutional network to generate a second fusion feature; the fault prediction risk value is determined based on the second fusion feature. During each training iteration, a loss function is calculated based on the predicted fault risk value and its label to measure the difference between the predicted and labeled true fault risk values. A smaller loss value indicates that the model's prediction is closer to reality. Based on the calculated loss value, the error is propagated back from the output layer to the input layer using a backpropagation algorithm, calculating the gradient of each parameter. Then, an optimization algorithm (such as the Adam optimizer) is used to update the model's parameters based on the gradient information to reduce the loss value.

[0073] The process of forward propagation, loss calculation, backpropagation, and parameter update is repeated, continuously adjusting the model parameters until the loss function converges, resulting in a well-trained elevator failure risk assessment model. At this point, the elevator failure risk assessment model has learned the inherent patterns and correlations between elevator operating characteristics and failure risks, enabling it to predict elevator failure risks relatively accurately.

[0074] Step S5: If the fault risk value is greater than the preset fault threshold, issue a fault warning signal.

[0075] For step S5, after determining the fault risk value, it is compared with the preset fault threshold. The preset fault threshold is set based on a large amount of historical data, professional knowledge of elevator operation, and actual operation and maintenance experience.

[0076] When the calculated fault risk value exceeds the preset fault threshold, it indicates that the elevator's current operating status is abnormal. At this time, the system will immediately issue a fault warning signal to promptly notify relevant operation and maintenance personnel and managers to conduct further inspections and diagnoses of the elevator, so as to take corresponding maintenance and repair measures before the fault actually occurs, thereby avoiding the occurrence of the fault or mitigating its potential impact.

[0077] In a preferred embodiment, the preset fault threshold is determined in the following manner: Obtain the design parameters and current service life of the elevator to be tested; Determine the initial threshold based on the design parameters; Calculate the degradation coefficient under the current service life based on the preset life distribution of the elevator to be tested; Determine the preset fault threshold based on the degradation coefficient and the initial threshold.

[0078] In one embodiment of the present invention, the design parameters and current service life of the elevator to be tested are first obtained. The design parameters include key parameters such as the elevator's rated load, operating speed, motor power, and control system configuration. These parameters reflect the performance and capability range of the elevator at the time of its initial design. The current service life clarifies the length of time the elevator has been in use since it was put into service.

[0079] Based on the obtained elevator design parameters and combined with the technical standards of the elevator industry, an initial fault threshold is determined. This initial threshold is a reference value based on the ideal design state of the elevator and represents the critical point of fault risk for the elevator under new and normal operating conditions.

[0080] Considering that elevator performance degrades over time during use, the degradation coefficient for the current service life is calculated based on the elevator's preset lifespan distribution. This preset lifespan distribution is established based on the elevator's design lifespan, statistical data on the actual service life of similar elevators, and theoretical frameworks, describing the probability distribution of elevator malfunctions at different stages of use. By analyzing the preset lifespan distribution and combining it with the elevator's current service life, the degree of performance degradation relative to a brand-new state can be quantified, and the degradation coefficient can be calculated. For example, if the elevator's preset lifespan is 20 years and it has been in use for 10 years, according to the preset lifespan distribution model, the degradation coefficient might be 0.6, meaning the elevator's performance has degraded to 60% of its brand-new level.

[0081] Finally, the preset fault threshold is determined based on the calculated degradation coefficient and the initial threshold. Since elevator performance gradually degrades with age, its operating pressure tolerance and fault risk threshold also decrease accordingly. Therefore, the initial threshold is multiplied by the degradation coefficient to obtain a preset fault threshold that adapts to the elevator's current actual condition. For example, if the initial threshold is set to 80 and the degradation coefficient is 0.6, then the preset fault threshold is 48.

[0082] This invention calculates a degradation coefficient based on a preset lifespan distribution and the current service life, and uses the degradation coefficient to adjust the initial threshold, thereby scientifically and rationally determining the preset fault threshold. It fully considers the performance degradation of the elevator during use, making the preset fault threshold more closely match the current actual state of the elevator. This helps to detect potential elevator fault risks more promptly and accurately, and ensures the safe and stable operation of the elevator.

[0083] like Figure 2 As shown, based on the above method embodiments, corresponding system embodiments are provided; An embodiment of the present invention provides an elevator fault early warning system based on voiceprint recognition, including: a voiceprint acquisition module, a voiceprint feature extraction module, a point cloud spatial construction module, a risk assessment module, and a fault early warning module; The acoustic signature acquisition module is used to acquire the traction machine operating acoustic signature of the elevator under different elevator loads throughout the entire operating cycle. The entire operating cycle includes: starting, acceleration, constant speed, deceleration and braking. The voiceprint feature extraction module is used to perform wavelet transform on the voiceprint of the traction machine to extract voiceprint features; The point cloud space construction module is used to construct the first point cloud space based on the acoustic features of the traction machine's operating acoustic features under different elevator loads and the full-cycle operating conditions, with the operating conditions as the X-axis, the elevator load as the Y-axis, and the acoustic features as the Z-axis. The risk assessment module is used to input the first point cloud space into the trained elevator fault risk assessment model. This allows the elevator fault risk assessment model to extract lateral temporal features along the XZ plane of the first point cloud space using a built-in temporal convolutional network; extract vertical spatial features along the YZ plane of the first point cloud space using a built-in perceptual convolutional network; extract joint distribution features along the XYZ space of the first point cloud space using a built-in first 3D convolutional network; perform broadcast multiplication on the lateral temporal features and vertical spatial features to generate spatiotemporal interactive features; concatenate the spatiotemporal interactive features and joint distribution features along the channel dimension; and then perform local feature aggregation using a built-in second 3D convolutional network to generate a first fusion feature; finally, determine the fault risk value based on the first fusion feature. The fault warning module is used to issue a fault warning signal when the fault risk value exceeds the preset fault threshold.

[0084] In a preferred embodiment, the elevator fault early warning system based on voiceprint recognition further includes: a voiceprint noise reduction module; The voiceprint noise reduction module includes: a noise signal generation unit, a noise frequency domain transformation unit, a voiceprint frequency domain transformation unit, a spectral subtraction noise reduction unit, and a voiceprint time domain reconstruction unit; The noise signal generation unit is used to call the probability distribution of the corresponding noise parameter from the preset noise parameter probability distribution library according to the elevator load and operating conditions, and to generate a noise signal by random sampling. The noise frequency domain transformation unit is used to perform a short-time Fourier transform on the noise signal to obtain the noise spectrum; The acoustic signature frequency domain transformation unit is used to perform short-time Fourier transform on the acoustic signature of the traction machine to obtain the acoustic signature spectrum; The spectral subtraction noise reduction unit is used to subtract the noise spectrum from the acoustic spectrum through spectral subtraction processing to obtain the noise-reduced acoustic spectrum. The acoustic signature time-domain reconstruction unit is used to perform inverse short-time Fourier transform on the denoised acoustic signature spectrum to obtain the denoised traction machine operation acoustic signature.

[0085] It is understood that the above system embodiments correspond to the method embodiments of the present invention, and can implement the elevator fault early warning method based on voiceprint recognition provided by any of the above method embodiments of the present invention.

[0086] It should be noted that the system embodiments described above are merely illustrative, and some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Furthermore, in the accompanying drawings of the system embodiments provided by this invention, the connection relationships between modules indicate that they have communication connections, which can be specifically implemented as one or more communication buses or signal lines. Those skilled in the art can understand and implement this without any creative effort.

[0087] The above description represents the preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications are also considered to be within the scope of protection of the present invention.

Claims

1. A voiceprint recognition-based elevator failure early warning method, characterized in that, The method comprises the following steps: obtaining hoist operation sound prints of a full cycle operation condition of an elevator to be detected under different elevator loads; the full cycle operation condition comprises starting, accelerating, uniform speed, decelerating and braking; wavelet transforming the hoist operation sound prints to extract sound print features; constructing a first point cloud space with the sound print features corresponding to the hoist operation sound prints of the full cycle operation condition under different elevator loads as the X-axis, the elevator load as the Y-axis and the sound print feature as the Z-axis; inputting the first point cloud space into a trained elevator fault risk assessment model to enable the elevator fault risk assessment model to extract horizontal time sequence features along the X-Z plane of the first point cloud space through an internally set time sequence convolution network, extract vertical space features along the Y-Z plane of the first point cloud space through an internally set perception convolution network, and extract joint distribution features along the X-Y-Z space of the first point cloud space through an internally set first 3D convolution network; performing broadcast multiplication on the horizontal time sequence features and the vertical space features to generate space-time interaction features; after the space-time interaction features and the joint distribution features are spliced along the channel dimension, performing local feature aggregation through an internally set second 3D convolution network to generate first fusion features; and determining a fault risk value according to the first fusion features; if the fault risk value is greater than a preset fault threshold, issuing a fault warning signal.

2. The voiceprint recognition based elevator failure early warning method according to claim 1, characterized in that, After obtaining the hoist operation sound prints of the full cycle operation condition of the elevator to be detected under different elevator loads, the method further comprises the following steps: calling a probability distribution of corresponding noise parameters from a preset noise parameter probability distribution library according to the elevator load and the operation condition; for each operation condition, generating a noise parameter combination conforming to the probability distribution through random sampling based on the probability distribution of the noise parameters; the noise parameter combination comprises amplitude, frequency, phase and bandwidth; determining the spectral shape of the noise signal according to the sampled frequency and bandwidth; adjusting the spectral shape according to the sampled amplitude to obtain a frequency domain signal; performing inverse Fourier transform on the frequency domain signal to obtain a time domain signal; adjusting the phase of the time domain signal according to the sampled phase to generate a noise segment of the operation condition; splicing the noise segments of all operation conditions to obtain a continuous noise signal; performing short-time Fourier transform on the noise signal to obtain a noise spectrum; performing short-time Fourier transform on the hoist operation sound prints to obtain a sound print spectrum; subtracting the noise spectrum from the sound print spectrum by using spectral subtraction to obtain a noise-reduced sound print spectrum; performing inverse short-time Fourier transform on the noise-reduced sound print spectrum to obtain a noise-reduced hoist operation sound print.

3. The voiceprint recognition based elevator failure pre-warning method according to claim 1, characterized in that, The wavelet transforming the hoist operation sound prints to extract sound print features comprises the following steps: dividing the hoist operation sound prints according to the operation condition to obtain corresponding sound print segments; for each sound print segment, determining a corresponding wavelet basis function according to the operation condition in which the sound print segment is located; calculating a load coefficient according to the elevator load and the rated load; correcting the wavelet basis function based on the load coefficient to obtain a corrected wavelet basis function; The voiceprint feature is obtained by wavelet transform on the voiceprint segment based on the corrected wavelet basis function.

4. The voiceprint recognition based elevator failure early warning method according to claim 1, characterized in that, Through the built-in time sequence convolution network, the lateral time sequence feature is extracted along the X-Z plane of the first point cloud space, including: The Y-axis direction of the first point cloud space is subjected to multi-scale data slicing processing to obtain a plurality of first slice data for representing the time sequence change rule in the switching process of different operating conditions of the same elevator load; Each first slice data is subjected to time sequence convolution processing to obtain a first trend feature; The lateral time sequence feature is obtained by feature splicing of all the first trend features.

5. The voiceprint recognition based elevator failure early warning method according to claim 4, characterized in that, Through the built-in perception convolution network, the vertical spatial feature is extracted along the Y-Z plane of the first point cloud space, including: The X-axis direction of the first point cloud space is subjected to multi-scale data slicing processing to obtain a plurality of second slice data for representing the voiceprint feature change rule under different elevator loads in the same operating condition; Each second slice data is subjected to dilated convolution processing to obtain a second trend feature; The vertical spatial feature is obtained by feature splicing of all the second trend features.

6. The voiceprint recognition based elevator failure early warning method according to claim 5, characterized in that, Through the built-in first 3D convolution network, the joint distribution feature is extracted along the X-Y-Z space of the first point cloud space, including: The Z-axis direction of the first point cloud space is subjected to multi-scale data space cutting processing to obtain a plurality of associated spatial data for representing the distribution of operating conditions and elevator loads within the same voiceprint feature range; Each associated spatial data is subjected to 3D convolution processing to obtain an associated feature; The joint distribution feature is obtained by feature splicing of all the associated features.

7. The voiceprint recognition based elevator failure early warning method according to claim 6, characterized in that, The space-time interaction feature is generated by broadcast multiplication of the lateral time sequence feature and the vertical spatial feature, including: The lateral time sequence feature and the vertical spatial feature are aligned according to the feature dimension to obtain an adapted lateral time sequence feature and an adapted vertical spatial feature; The space-time interaction feature is obtained by tensor outer product operation on the adapted lateral time sequence feature and the adapted vertical spatial feature.

8. The voiceprint recognition based elevator failure early warning method according to claim 1, characterized in that, The preset fault threshold is determined by: Obtaining the design parameters and the current service life of the elevator to be detected; According to the design parameters, an initial threshold is determined; According to the preset life distribution of the elevator to be detected, a degradation coefficient under the current service life is calculated; According to the degradation coefficient and the initial threshold, the preset fault threshold is determined.

9. A voiceprint recognition based elevator failure warning system characterized in that, It includes: The voiceprint acquisition module, the voiceprint feature extraction module, the point cloud space construction module, the risk assessment module and the fault warning module; The voiceprint acquisition module is used to acquire the traction machine running voiceprint of the elevator to be detected under different elevator loads in the full-cycle operating condition; The full-cycle operating condition includes: starting, accelerating, uniform speed, decelerating and braking; The voiceprint feature extraction module is used to perform wavelet transform on the traction machine running voiceprint to extract the voiceprint feature; The point cloud space construction module is used to construct a first point cloud space with the operating condition as the X-axis, the elevator load as the Y-axis and the voiceprint feature as the Z-axis according to the voiceprint feature corresponding to the traction machine running voiceprint of the full-cycle operating condition under different elevator loads. The risk assessment module is configured to input the first point cloud space into a trained elevator fault risk assessment model, so that the elevator fault risk assessment model extracts lateral time sequence features along an X-Z plane of the first point cloud space through an internally set time sequence convolution network, extracts vertical space features along a Y-Z plane of the first point cloud space through an internally set perception convolution network, and extracts joint distribution features along an X-Y-Z space of the first point cloud space through an internally set first 3D convolution network; the lateral time sequence features and the vertical space features are subjected to broadcast multiplication to generate space-time interaction features; after the space-time interaction features and the joint distribution features are spliced along a channel dimension, local feature aggregation is performed through an internally set second 3D convolution network to generate first fusion features; and a fault risk value is determined according to the first fusion features. The fault warning module is configured to issue a fault warning signal when the fault risk value is greater than a preset fault threshold.

10. The voiceprint recognition based elevator failure warning system of claim 9, wherein, Further comprising: a voiceprint noise reduction module; The voiceprint noise reduction module comprises a noise signal generation unit, a noise frequency domain conversion unit, a voiceprint frequency domain conversion unit, a spectral subtraction noise reduction unit, and a voiceprint time domain reconstruction unit. The noise signal generation unit is configured to call a probability distribution of corresponding noise parameters from a preset noise parameter probability distribution library according to elevator load and operating conditions, and generate a noise signal through random sampling; The noise frequency domain conversion unit is configured to perform short-time Fourier transform on the noise signal to obtain a noise spectrum; The voiceprint frequency domain conversion unit is configured to perform short-time Fourier transform on the traction machine operation voiceprint to obtain a voiceprint spectrum; The spectral subtraction noise reduction unit is configured to subtract the noise spectrum from the voiceprint spectrum through spectral subtraction processing to obtain a noise-reduced voiceprint spectrum; The voiceprint time domain reconstruction unit is configured to perform inverse short-time Fourier transform on the noise-reduced voiceprint spectrum to obtain a noise-reduced traction machine operation voiceprint.

Images