Waterfall plot processing method and device and storage medium

Abstract

The embodiment of the invention provides a waterfall plot processing method and device and a storage medium. The method comprises the steps of collecting optical fiber signal data; generating an initial waterfall plot according to the optical fiber signal data; enhancing event signals in the initial waterfall plot to obtain an enhanced waterfall plot; oblique line slopes of various vibration characteristics in the enhanced waterfall plot are determined; when the slope of the oblique line is in a speed slope range corresponding to the specific type of engineering machinery in operation, determining that the vibration type of the vibration characteristic corresponding to the slope of the oblique line is low threat; when the slope of the oblique line is not in the speed slope range, determining the vibration type of the vibration characteristic corresponding to the slope of the oblique line according to the slope of the oblique line and a preset threshold value; according to the method, the vibration features of which the vibration categories are low threats in the enhanced waterfall plot are filtered out to obtain a new waterfall plot, the waterfall plot is refined and recognized, the capacity of capturing the vibration features of the engineering machinery of a specific type is enhanced, the vibration categories of the vibration features of other vibration sources are accurately distinguished, and the recognition efficiency and accuracy of the waterfall plot are improved.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a waterfall graph processing method, device and storage medium. Background Art

[0002] The fiber optic sensing system uses optical fiber as a sensing medium to detect external vibrations and disturbances by monitoring changes in optical signals. The environment in which optical fiber is laid is complex and changeable, especially in areas such as accompanying highways, railways, etc. There are not only obvious accompanying signals generated by cars and trains, but also some specific types of vibration sources and vibration characteristics generated by other vibration sources. For example, for some specific types of vibration sources such as agricultural machinery, they usually operate while moving and have a relatively slow running speed, but their impact range is often wider. However, the existing ability to identify and classify external vibrations is limited, making it difficult to accurately capture the vibration characteristics of specific types of vibration sources, and it is impossible to effectively distinguish the categories of vibrations caused by specific types of vibration sources and other vibration sources, resulting in low efficiency and accuracy of waterfall chart recognition. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a waterfall chart processing method, device and storage medium to solve the problem of low accuracy of waterfall chart recognition in the prior art.

[0004] In order to achieve the above-mentioned object, the first aspect of the present application provides a waterfall chart processing method, comprising:

[0005] Collect optical fiber signal data;

[0006] generating an initial waterfall diagram based on the optical fiber signal data;

[0007] enhancing an event signal in an initial waterfall diagram to obtain an enhanced waterfall diagram, wherein the event signal includes at least one vibration feature;

[0008] Determine the slope of the lines for various vibration features in the enhanced waterfall plot;

[0009] When the slope of the oblique line is within a speed slope range corresponding to the operation of a specific type of engineering machinery, determining that the vibration category of the vibration feature corresponding to the slope of the oblique line is low threat;

[0010] When the slope of the oblique line is not within the speed slope range, determining the vibration category of the vibration feature corresponding to the slope of the oblique line according to the slope of the oblique line and a preset threshold;

[0011] The vibration features with low-threat vibration categories in the enhanced waterfall chart are filtered out to obtain a new waterfall chart.

[0012] In an embodiment of the present application, when the slope of the oblique line is not within the speed slope range, determining the vibration category of the vibration feature corresponding to the slope of the oblique line based on the slope of the oblique line and a preset threshold includes: when the slope of the oblique line is not within the speed slope range, judging whether the slope of the oblique line is greater than a preset threshold, wherein the preset threshold is determined based on vibration characteristics of other targets that pose a potential threat to the optical fiber other than a specific type of engineering machinery; when the slope of the oblique line is greater than the preset threshold, determining that the vibration category of the vibration feature corresponding to the slope of the oblique line is a high threat; when the slope of the oblique line is less than or equal to the preset threshold, determining that the vibration category of the vibration feature corresponding to the slope of the oblique line is a low threat.

[0013] In an embodiment of the present application, the method also includes: obtaining the historical operating speed of a specific type of engineering machinery under different operating conditions; determining the historical vibration range of the specific type of engineering machinery during operation based on all historical operating speeds; and determining the speed slope range of the specific type of engineering machinery during operation based on the historical vibration range.

[0014] In an embodiment of the present application, the initial waterfall plot also includes an accompanying signal, which refers to a signal generated by the vibration of a moving target outside the optical fiber laying area. The method also includes: filtering out the accompanying signal in the initial waterfall plot before enhancing the event signal in the initial waterfall plot.

[0015] In an embodiment of the present application, determining the oblique slopes of various vibration features in the enhanced waterfall plot includes: smoothing the enhanced waterfall plot to obtain a smoothed waterfall plot; determining the pixel gradient, gradient strength, and gradient direction of each pixel point in the smoothed waterfall plot; determining edge information of various vibration features in the smoothed waterfall plot based on the pixel gradient, gradient strength, and gradient direction; and determining the oblique slopes of various vibration features based on their edge information.

[0016] In an embodiment of the present application, determining edge information of various vibration features in a smooth waterfall diagram based on pixel gradient, gradient strength, and gradient direction includes: filtering out pixels in the smooth waterfall diagram whose gradient strength is less than a preset value; for each remaining pixel in the smooth waterfall diagram, when the gradient strength of the pixel is greater than a first threshold, determining the pixel as a strong edge pixel; filtering out the pixel when the gradient strength of the pixel is less than a second threshold; determining the pixel as a weak edge pixel when the gradient strength of the pixel is greater than or equal to the second threshold and less than or equal to the first threshold; and determining edge information of various vibration features in the smooth waterfall diagram based on the strong edge pixels and the weak edge pixels.

[0017] In an embodiment of the present application, the method further includes: inputting the new waterfall chart into a preset neural network to obtain an event type result; and sending an alarm prompt when the event type result is an alarm event.

[0018] In the embodiment of the present application, the specific type of engineering machinery is agricultural machinery.

[0019] A second aspect of the present application provides a waterfall chart processing device, comprising:

[0020] a memory configured to store instructions;

[0021] The processor is configured to call instructions from the memory and implement the above-mentioned waterfall chart processing method when executing the instructions.

[0022] A third aspect of the present application provides a machine-readable storage medium having instructions stored thereon, which, when executed by a processor, configure the processor to execute the above-mentioned waterfall chart processing method.

[0023] Through the above technical scheme, it is determined whether the slope of the oblique line is within the speed slope range corresponding to the operation of a specific type of engineering machinery. When the slope of the oblique line is not within the speed slope range, the vibration category of the vibration feature corresponding to the slope of the oblique line is determined according to the slope of the oblique line and a preset threshold, and the waterfall chart is refined and identified to enhance the ability to capture the vibration features of a specific type of engineering machinery, accurately distinguish the vibration categories of the vibration features of other vibration sources, and improve the recognition efficiency and accuracy of the waterfall chart.

[0024] Other features and advantages of the embodiments of the present application will be described in detail in the subsequent specific implementation section. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the following specific implementations, they are used to explain the embodiments of the present application, but do not constitute a limitation on the embodiments of the present application. In the accompanying drawings:

[0026] Figure 1 The flowchart of the waterfall chart processing method according to the embodiment of the present application is schematically shown;

[0027] Figure 2 The internal structure of a computer device according to an embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the specific implementation methods described herein are only used to illustrate and explain the embodiments of the present application, and are not used to limit the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0029] It should be noted that if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0030] Figure 1 The flowchart of the waterfall chart processing method according to the embodiment of the present application is schematically shown. Figure 1 As shown, in one embodiment of the present application, a waterfall chart processing method is provided, comprising the following steps:

[0031] Step 101: Collect optical fiber signal data.

[0032] Optical fibers may be deployed near the pipeline, which may be damaged by other objects moving near the pipeline. The processor may collect optical fiber signal data, specifically, the optical fiber signal data may be collected through an optical fiber sensor.

[0033] Step 102: Generate an initial waterfall diagram according to the optical fiber signal data.

[0034] The processor may generate an initial waterfall diagram based on the optical fiber signal data. The initial waterfall diagram may include an event signal. The event signal refers to a signal generated by target vibration that is potentially dangerous to the optical fiber laid in the pipeline, for example, it may include a signal generated by the vibration of construction machinery under construction around the pipeline.

[0035] In an embodiment of the present application, the initial waterfall diagram also includes an accompanying signal, which refers to a signal generated by the vibration of a moving target outside the optical fiber laying area. The method also includes: filtering out the accompanying signal in the initial waterfall diagram before enhancing the event signal in the initial waterfall diagram.

[0036] The initial waterfall diagram may also include accompanying signals, which are signals generated by background vibrations caused by moving targets outside the fiber optic laying area. For example, the fiber optic laying environment is complex and changeable, and it may also be accompanied in areas such as highways and railways, where accompanying signals of high-speed moving targets such as cars and trains will appear. Among them, the accompanying signal is shown as a diagonal line in the waterfall diagram. A high-speed moving target refers to a target whose moving speed is greater than a certain threshold. Before enhancing the event signal in the initial waterfall diagram, the processor may filter out the accompanying signal in the initial waterfall diagram.

[0037] Specifically, when filtering out the accompanying signal in the initial waterfall diagram, a bandpass filter can be used to filter the accompanying signal by setting a specific frequency range. For example, according to the specific vibration frequency of the accompanying signal, the signal frequency band is adjusted to only retain the vibration signal within a specific frequency range through a bandpass filter. After that, adaptive adjustments are made to the filter parameter settings so that the frequency range of various accompanying signals can be adapted. In this way, the vibration impact of high-speed accompanying vehicles can be effectively weakened, while low-speed operating signals such as agricultural machinery can be made more significant.

[0038] Step 103: enhancing the event signal in the initial waterfall diagram to obtain an enhanced waterfall diagram, wherein the event signal includes at least one vibration feature.

[0039] The processor may enhance the event signal in the initial waterfall diagram to obtain an enhanced waterfall diagram, wherein the event signal includes at least one vibration feature. The event signal refers to a signal generated by a target vibration that is potentially dangerous to the optical fiber laid in the pipeline, and if there are multiple target vibrations that are potentially dangerous to the optical fiber laid in the pipeline, the event signal includes multiple vibration features.

[0040] The above scheme filters out the accompanying signal in the initial waterfall diagram, enhances the time signal in the initial waterfall diagram, and improves the signal strength of the event signal, thereby reducing the correlation between the event signal and the accompanying signal, which helps to accurately identify the waterfall diagram in the subsequent process and improve the recognition effect.

[0041] Step 104: Determine the slopes of the various vibration features in the enhanced waterfall diagram.

[0042] The processor may determine the slopes of the oblique lines of various vibration features in the enhanced waterfall graph. Specifically, the processor may use the Canny edge recognition algorithm to determine the edge information of various vibration features, and may determine the slopes of the oblique lines of various vibration features according to the edge information of various vibration features.

[0043] In an embodiment of the present application, determining the oblique slopes of various vibration features in an enhanced waterfall plot includes: smoothing the enhanced waterfall plot to obtain a smoothed waterfall plot; determining the pixel gradient, gradient strength, and gradient direction of each pixel point in the smoothed waterfall plot; determining edge information of various vibration features in the smoothed waterfall plot based on the pixel gradient, gradient strength, and gradient direction; and determining the oblique slopes of various vibration features based on their edge information.

[0044] The processor may smooth the enhanced waterfall graph to obtain a smoothed waterfall graph. A Gaussian filter may be used for the smoothing process. The processor may then determine the pixel gradient, gradient strength, and gradient direction of each pixel in the smoothed waterfall graph. The pixel gradient may be determined based on the following formula:

[0045]

[0046] Among them, G x and G y Refers to the pixel gradient in the x and y directions calculated by the Sobel operator.

[0047] The gradient strength can be determined based on the following formula:

[0048]

[0049] Here, M refers to the gradient strength.

[0050] The gradient direction can be determined based on the following formula:

[0051] θ=arctan2(G y ,G x )

[0052] Here, θ refers to the gradient direction.

[0053] The processor can determine the edge information of various vibration features in the smooth waterfall graph according to the pixel gradient, gradient strength and gradient direction. Specifically, the processor can process each pixel point by applying non-maximum suppression, and then process each pixel point by applying double thresholds, so as to obtain the edge information of various vibration features.

[0054] In an embodiment of the present application, determining edge information of various vibration features in a smooth waterfall diagram based on pixel gradient, gradient strength, and gradient direction includes: filtering out pixels in the smooth waterfall diagram whose gradient strength is less than a preset value; for each remaining pixel in the smooth waterfall diagram, determining the pixel as a strong edge pixel when the gradient strength of the pixel is greater than a first threshold; filtering out the pixel when the gradient strength of the pixel is less than a second threshold; determining the pixel as a weak edge pixel when the gradient strength of the pixel is greater than or equal to the second threshold and less than or equal to the first threshold; and determining edge information of various vibration features in the smooth waterfall diagram based on the strong edge pixels and the weak edge pixels.

[0055] If the gradient strength of a pixel point is less than the preset value, it means that its gradient strength is not the local maximum. In this case, the pixel point may not be retained, that is, the processor may filter out the pixel point whose gradient strength is less than the preset value in the smooth waterfall graph. If the gradient strength of a pixel point is greater than or equal to the preset value, it means that its gradient strength is the local maximum. In this case, the pixel point may be retained. The preset value may be set according to actual needs.

[0056] For each pixel remaining in the smoothed waterfall graph, the processor may determine the pixel as a strong edge pixel when the gradient strength of the pixel is greater than the first threshold, and may filter out the pixel when the gradient strength of the pixel is less than the second threshold.

[0057] When the gradient strength of the pixel is greater than or equal to the second threshold and less than or equal to the first threshold, the processor may determine the pixel as a weak edge pixel point. The first threshold is greater than the second threshold, and both the first threshold and the second threshold can be customized according to actual conditions.

[0058] The processor can determine the edge information of various vibration features in the smooth waterfall diagram according to the strong edge pixels and the weak edge pixels. Specifically, if a weak edge pixel is connected to a strong edge pixel, it can be marked as an edge, otherwise it will be ignored.

[0059] After determining the edge information of various vibration features in the smooth waterfall graph, the processor may determine the oblique line slopes of the various vibration features according to the edge information of the various vibration features. For example, for each vibration feature, a polygon may be constructed according to the edge information of the vibration feature, and the vertex coordinates of the polygon may be determined as the oblique line slope of the vibration feature.

[0060] For example, for the vibration signal of agricultural machinery operation, its slope is usually small and stable, showing slow changes. The vibration signal of accompanying signals (such as vehicles, etc.) has a steeper slope, usually representing faster movement. The slope of the low-speed signal will be defined within a specific range, which can effectively identify the operation process of agricultural machinery and avoid misjudging it as a threat.

[0061] Step 105: When the slope of the oblique line is within the speed slope range corresponding to the operation of a specific type of engineering machinery, determine that the vibration category of the vibration feature corresponding to the slope of the oblique line is low threat.

[0062] When the slope of the oblique line is within the speed slope range corresponding to the operation of a specific type of engineering machinery, the processor may determine that the vibration category of the vibration feature corresponding to the slope of the oblique line is low threat. The specific type of engineering machinery refers to engineering machinery with low speed characteristics. In the embodiment of the present application, the specific type of engineering machinery includes but is not limited to agricultural machinery.

[0063] The above solution helps to quickly filter low-threat signals from agricultural machinery, etc., reduce subsequent false alarms, and improve the accuracy of subsequent alarms.

[0064] In an embodiment of the present application, the method also includes: obtaining the historical operating speed of a specific type of engineering machinery under different operating conditions; determining the historical vibration range of the specific type of engineering machinery during operation based on all historical operating speeds; and determining the speed slope range of the specific type of engineering machinery during operation based on the historical vibration range.

[0065] The processor may obtain the historical operating speed of a specific type of construction machinery under different working conditions. For example, if the specific type of construction machinery is agricultural machinery, the average speed of the agricultural machinery under working conditions such as ploughing, sowing, and fertilizing may be obtained. The processor may determine the historical vibration range of the specific type of construction machinery when it is operating based on all historical operating speeds. The processor may determine the speed slope range of the specific type of construction machinery when it is operating based on the historical vibration range.

[0066] For example, taking a specific type of construction machinery as an example of agricultural machinery, first, obtain the actual speed data of agricultural machinery under different working conditions, such as the average speed in operations such as plowing, sowing, and fertilizing. The speed of general agricultural machinery is lower than that of ordinary vehicles, so it has specific low-speed vibration range data. Then, according to the obtained low-speed vibration range, the corresponding algorithm is input to generate a set of slope values. For example, ordinary vehicles generate a slope of 1-1.5 according to the algorithm, then agricultural machinery may be 0.5-0.8. The slope is matched with the vibration of the corresponding rate. In this way, by setting a lower slope value, low-speed vibration can be detected more sensitively. Finally, the optical fiber sensing system can be used to judge the surrounding vibration amplitude to determine whether there is agricultural machinery around. If there is agricultural machinery around, the normal slope can be switched to a low-speed slope.

[0067] Step 106: When the slope of the oblique line is not within the speed slope range, determine the vibration category of the vibration feature corresponding to the slope of the oblique line according to the slope of the oblique line and a preset threshold.

[0068] When the slope of the oblique line is not within the speed slope range, the processor may determine the vibration category of the vibration feature corresponding to the slope of the oblique line based on the slope of the oblique line and a preset threshold. The preset threshold is determined based on the vibration features of other targets that pose a potential threat to the optical fiber in addition to a specific type of engineering machinery. The vibration categories of the vibration features may include low threat and high threat. If the vibration category of the vibration feature is low threat, it can be said that the degree of vibration is low and the threat to the optical fiber laid in the pipeline is low. If the vibration category of the vibration feature is high threat, it can be said that the degree of vibration is high and the threat to the optical fiber laid in the pipeline is high.

[0069] In an embodiment of the present application, when the slope of the oblique line is not within the speed slope range, determining the vibration category of the vibration feature corresponding to the slope of the oblique line based on the slope of the oblique line and a preset threshold includes: when the slope of the oblique line is not within the speed slope range, judging whether the slope of the oblique line is greater than a preset threshold, wherein the preset threshold is determined based on the vibration characteristics of other targets that pose a potential threat to the optical fiber other than a specific type of engineering machinery; when the slope of the oblique line is greater than the preset threshold, determining that the vibration category of the vibration feature corresponding to the slope of the oblique line is a high threat; when the slope of the oblique line is less than or equal to the preset threshold, determining that the vibration category of the vibration feature corresponding to the slope of the oblique line is a low threat.

[0070] When the slope of the oblique line is not within the speed slope range, the processor may determine whether the slope of the oblique line is greater than a preset threshold. The preset threshold is determined based on the vibration characteristics of other targets that pose a potential threat to the optical fiber in addition to a specific type of engineering machinery. When the slope of the oblique line is greater than the preset threshold, the processor may determine that the vibration category of the vibration characteristic corresponding to the slope of the oblique line is a high threat. When the slope of the oblique line is less than or equal to the preset threshold, the processor may determine that the vibration category of the vibration characteristic corresponding to the slope of the oblique line is a low threat.

[0071] The above scheme can flexibly set preset thresholds of different speeds so as to accurately filter different types of moving targets.

[0072] Step 107: Filter out vibration features with low-threat vibration categories in the enhanced waterfall chart to obtain a new waterfall chart.

[0073] The processor can filter out vibration features with low-threat vibration categories in the enhanced waterfall chart to obtain a new waterfall chart.

[0074] In an embodiment of the present application, the method further includes: inputting the new waterfall chart into a preset neural network to obtain an event type result; and sending an alarm prompt when the event type result is an alarm event.

[0075] The processor may input the new waterfall chart into the preset neural network to obtain an event type result. The event type result includes an alarm event and a non-alarm event. The preset neural network may be a Transformer model, which is fitted with an alarm module. When the event type result is an alarm event, the processor may send an alarm prompt.

[0076] In one embodiment, when the event type result is a non-alarm event, the processor may not send an alarm prompt.

[0077] Through the above technical scheme, it is determined whether the slope of the oblique line is within the speed slope range corresponding to the operation of a specific type of engineering machinery. When the slope of the oblique line is not within the speed slope range, the vibration category of the vibration feature corresponding to the slope of the oblique line is determined according to the slope of the oblique line and a preset threshold, and the waterfall chart is refined and identified to enhance the ability to capture the vibration features of a specific type of engineering machinery, accurately distinguish the vibration categories of the vibration features of other vibration sources, and improve the recognition efficiency and accuracy of the waterfall chart.

[0078] Figure 1 FIG. 1 is a flowchart of a waterfall chart processing method in one embodiment. It should be understood that although Figure 1The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0079] In one embodiment, a waterfall chart processing device is provided, comprising:

[0080] a memory configured to store instructions;

[0081] The processor is configured to call instructions from the memory and implement the above-mentioned waterfall chart processing method when executing the instructions.

[0082] In one embodiment, a storage medium is provided, on which a program is stored, and when the program is executed by a processor, the above-mentioned waterfall chart processing method is implemented.

[0083] In one embodiment, a processor is provided, and the processor is used to run a program, wherein the above-mentioned waterfall chart processing method is executed when the program is run.

[0084] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 2 As shown. The computer device includes a processor A01, a network interface A02, a memory (not shown in the figure) and a database (not shown in the figure) connected via a system bus. Among them, the processor A01 of the computer device is used to provide computing and control capabilities. The memory of the computer device includes an internal memory A03 and a non-volatile storage medium A04. The non-volatile storage medium A04 stores an operating system B01, a computer program B02 and a database (not shown in the figure). The internal memory A03 provides an environment for the operation of the operating system B01 and the computer program B02 in the non-volatile storage medium A04. The database of the computer device is used to store data such as waterfall charts. The network interface A02 of the computer device is used to communicate with an external terminal through a network connection. When the computer program B02 is executed by the processor A01, a waterfall chart processing method is implemented.

[0085] Those skilled in the art will understand that Figure 2The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0086] The embodiment of the present application provides a device, which includes a processor, a memory, and a program stored in the memory and executable on the processor. When the processor executes the program, the following steps are implemented:

[0087] Collect optical fiber signal data;

[0088] generating an initial waterfall diagram based on the optical fiber signal data;

[0089] enhancing an event signal in an initial waterfall diagram to obtain an enhanced waterfall diagram, wherein the event signal includes at least one vibration feature;

[0090] Determine the slope of the lines for various vibration features in the enhanced waterfall plot;

[0091] When the slope of the oblique line is within a speed slope range corresponding to the operation of a specific type of engineering machinery, determining that the vibration category of the vibration feature corresponding to the slope of the oblique line is low threat;

[0092] When the slope of the oblique line is not within the speed slope range, determining the vibration category of the vibration feature corresponding to the slope of the oblique line according to the slope of the oblique line and a preset threshold;

[0093] The vibration features with low-threat vibration categories in the enhanced waterfall chart are filtered out to obtain a new waterfall chart.

[0094] In one embodiment, when the slope of the oblique line is not within the speed slope range, determining the vibration category of the vibration feature corresponding to the slope of the oblique line based on the slope of the oblique line and a preset threshold includes: when the slope of the oblique line is not within the speed slope range, judging whether the slope of the oblique line is greater than a preset threshold, wherein the preset threshold is determined based on vibration characteristics of other targets that pose a potential threat to the optical fiber other than a specific type of engineering machinery; when the slope of the oblique line is greater than the preset threshold, determining that the vibration category of the vibration feature corresponding to the slope of the oblique line is a high threat; when the slope of the oblique line is less than or equal to the preset threshold, determining that the vibration category of the vibration feature corresponding to the slope of the oblique line is a low threat.

[0095] In one embodiment, the method also includes: obtaining the historical operating speed of a specific type of engineering machinery under different operating conditions; determining the historical vibration range of the specific type of engineering machinery when operating based on all historical operating speeds; and determining the speed slope range of the specific type of engineering machinery when operating based on the historical vibration range.

[0096] In one embodiment, the initial waterfall diagram also includes a companion signal, which refers to a signal generated by vibration of a moving target outside the optical fiber laying area. The method also includes: before enhancing the event signal in the initial waterfall diagram, filtering out the companion signal in the initial waterfall diagram.

[0097] In one embodiment, determining the oblique slopes of various vibration features in an enhanced waterfall graph includes: smoothing the enhanced waterfall graph to obtain a smoothed waterfall graph; determining the pixel gradient, gradient strength, and gradient direction of each pixel point in the smoothed waterfall graph; determining edge information of various vibration features in the smoothed waterfall graph based on the pixel gradient, gradient strength, and gradient direction; and determining the oblique slopes of various vibration features based on the edge information of the various vibration features.

[0098] In one embodiment, determining edge information of various vibration features in a smooth waterfall graph based on pixel gradient, gradient strength, and gradient direction includes: filtering out pixels in the smooth waterfall graph whose gradient strength is less than a preset value; for each remaining pixel in the smooth waterfall graph, determining the pixel as a strong edge pixel when the gradient strength of the pixel is greater than a first threshold; filtering out the pixel when the gradient strength of the pixel is less than a second threshold; determining the pixel as a weak edge pixel when the gradient strength of the pixel is greater than or equal to the second threshold and less than or equal to the first threshold; and determining edge information of various vibration features in the smooth waterfall graph based on the strong edge pixels and the weak edge pixels.

[0099] In one embodiment, the method further includes: inputting the new waterfall chart into a preset neural network to obtain an event type result; and sending an alarm prompt when the event type result is an alarm event.

[0100] In one embodiment, the particular type of work machine is an agricultural machine.

[0101] The present application also provides a computer program product, which, when executed on a data processing device, is suitable for executing a program for initializing the steps of the waterfall chart processing method.

[0102] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0103] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0104] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0105] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0106] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0107] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0108] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0109] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0110] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A waterfall chart processing method, characterized in that: The method comprises: Collect optical fiber signal data; generating an initial waterfall diagram according to the optical fiber signal data; enhancing the event signal in the initial waterfall diagram to obtain an enhanced waterfall diagram, wherein the event signal includes at least one vibration feature; Determining the slope of the various vibration characteristics in the enhanced waterfall diagram; When the slope of the oblique line is within a speed slope range corresponding to a specific type of engineering machinery operation, determining that the vibration category of the vibration feature corresponding to the slope of the oblique line is low threat; When the slope of the oblique line is not within the speed slope range, determining the vibration category of the vibration feature corresponding to the slope of the oblique line according to the slope of the oblique line and a preset threshold; The vibration features with low-threat vibration categories in the enhanced waterfall chart are filtered out to obtain a new waterfall chart.

2. The waterfall chart processing method according to claim 1, characterized in that: In the case where the slope of the oblique line is not within the speed slope range, determining the vibration category of the vibration feature corresponding to the slope of the oblique line according to the slope of the oblique line and a preset threshold comprises: In the case where the slope of the oblique line is not within the speed slope range, determining whether the slope of the oblique line is greater than a preset threshold, wherein the preset threshold is determined based on vibration characteristics of other targets that pose a potential threat to the optical fiber in addition to the specific type of engineering machinery; When the slope of the oblique line is greater than a preset threshold, determining that the vibration category of the vibration feature corresponding to the slope of the oblique line is high threat; When the slope of the oblique line is less than or equal to the preset threshold, it is determined that the vibration category of the vibration feature corresponding to the slope of the oblique line is low threat.

3. The waterfall chart processing method according to claim 1, characterized in that: The method further comprises: Obtaining historical operating speeds of the specific type of engineering machinery under different working conditions; Determining the historical vibration range of the specific type of construction machinery when operating based on all historical operating speeds; The speed slope range of the specific type of engineering machinery during operation is determined according to the historical vibration range.

4. The waterfall chart processing method according to claim 1, characterized in that: The initial waterfall diagram also includes a companion signal, which is a signal generated by the vibration of a moving target outside the optical fiber laying area. The method also includes: Before enhancing the event signal in the initial waterfall diagram, the accompanying signal in the initial waterfall diagram is filtered out.

5. The waterfall chart processing method according to claim 1, characterized in that: Determining the slopes of the various vibration features in the enhanced waterfall diagram includes: Smoothing the enhanced waterfall graph to obtain a smoothed waterfall graph; Determine the pixel gradient, gradient strength and gradient direction of each pixel point in the smooth waterfall graph; Determine edge information of various vibration features in the smooth waterfall graph according to the pixel gradient, the gradient strength, and the gradient direction; The slopes of the oblique lines of the various vibration features are determined according to the edge information of the various vibration features.

6. The waterfall chart processing method according to claim 5, characterized in that: The determining of edge information of various vibration features in the smooth waterfall graph according to the pixel gradient, the gradient strength and the gradient direction comprises: Filter out pixel points in the smooth waterfall graph whose gradient intensity is less than a preset value; For each remaining pixel point in the smoothed waterfall graph, if the gradient intensity of the pixel point is greater than a first threshold, determining the pixel point as a strong edge pixel point; When the gradient intensity of the pixel point is less than a second threshold, filtering out the pixel point; When the gradient intensity of the pixel is greater than or equal to the second threshold and less than or equal to the first threshold, determining the pixel as a weak edge pixel point; The edge information of various vibration features in the smooth waterfall graph is determined according to the strong edge pixel points and the weak edge pixel points.

7. The waterfall chart processing method according to claim 1, characterized in that: The method further comprises: Inputting the new waterfall chart into a preset neural network to obtain an event type result; When the event type result is an alarm event, an alarm prompt is sent.

8. The waterfall chart processing method according to any one of claims 1 to 7, characterized in that: The specific type of construction machinery is agricultural machinery.

9. A waterfall chart processing device, characterized in that: The device comprises: a memory configured to store instructions; A processor is configured to call the instructions from the memory and implement the waterfall chart processing method according to any one of claims 1 to 8 when executing the instructions.

10. A machine-readable storage medium, characterized in that: The machine-readable storage medium stores instructions, which are used to enable a machine to execute the waterfall chart processing method according to any one of claims 1 to 8.

Images