Monitoring video processing method, apparatus and system

Abstract

The application provides a kind of monitoring video processing method, device and system, the method comprises: obtaining the monitoring video sent by multiple monitoring devices, obtain multiple monitoring videos to be processed, the video to be processed is the video recorded by monitoring device;Each monitoring video to be processed is carried out micro-vibration imaging processing, and micro-vibration data is obtained;Each micro-vibration data is processed, comparison result is obtained, and comparison result is displayed on display page, and comparison result is used to represent the relationship between time and amplitude of each monitoring device or the relationship with vibration frequency.Avoid a large amount of manpower consumption, and improve work efficiency, so as to solve the problem of how to avoid a large amount of manpower to go to equipment operation site to measure again by manual analysis and discussion detection result.

Description

Technical Field

[0001] This application relates to the field of video processing technology, and more specifically, to a monitoring video processing method, apparatus, computer-readable storage medium, and system. Background Technology

[0002] Currently, in the industrial sector, effective equipment condition monitoring and fault diagnosis using vibration analysis still rely on contact-type monitoring equipment. The location and stability requirements for contact-type monitoring equipment are quite stringent; otherwise, effective monitoring data cannot be obtained. Furthermore, interpreting and analyzing the monitoring results requires specialized technical personnel to perform statistical analysis to arrive at the final test results. Additionally, vibration measurement technology for large-scale machinery and building structures suffers from low measurement efficiency and complex sensor placement. Some industrial production processes operate in harsh environments, requiring personnel to conduct inspections at heights, in the presence of toxic or hazardous substances, or in flammable and explosive environments. Current fault detection operations are primarily manual, resulting in low detection efficiency, poor repeatability, compromised personnel safety, and high labor intensity.

[0003] Offline monitoring is a diagnostic tool used to eliminate vibration faults. This diagnostic process requires equipment maintenance personnel and on-site production operators to regularly measure, record, and track the equipment status, or to take temporary measurements when equipment malfunctions. Finally, the equipment faults are carefully analyzed and discussed. All monitoring work is still mainly done manually. Summary of the Invention

[0004] The main objective of this application is to provide a monitoring video processing method, apparatus, computer-readable storage medium, and system to solve the problem of how to avoid a large number of people going to the equipment operation site to perform measurements and then manually analyzing and discussing the test results.

[0005] According to one aspect of the present invention, a monitoring video processing method is provided. The method includes: acquiring monitoring videos sent by multiple monitoring devices to obtain multiple monitoring videos to be processed, wherein the monitoring videos to be processed are videos recorded by the monitoring devices; performing micro-vibration imaging processing on each of the monitoring videos to be processed to obtain micro-vibration data; processing each of the micro-vibration data to obtain comparison results, and displaying the comparison results on a display page, wherein the comparison results are used to characterize the relationship between time and amplitude, or the relationship with vibration frequency of each of the monitoring devices.

[0006] Optionally, the micro-vibration data are processed to obtain comparison results, including: processing the micro-vibration data to obtain a frame frequency analysis map and an object vibration data map, wherein the frame frequency analysis map is used to characterize the relationship between the number of frames and the amplitude, or the relationship with the vibration frequency, and the object vibration data map is used to characterize the relationship between the time and the amplitude, or the relationship with the vibration frequency; performing Fast Fourier Transform processing on the frame frequency analysis map and the object vibration data map to obtain analysis results, which are used to characterize; and using the frame frequency analysis map, the object vibration data map, and the analysis results as the comparison results.

[0007] Optionally, the method further includes: highlighting the frame number using a first color when the frame number is greater than or equal to 0 and the frame number is less than a first preset frame number; highlighting the frame number using a second color when the frame number is greater than or equal to the first preset frame number and the frame number is less than a second preset frame number; highlighting the frame number using a third color when the frame number is greater than or equal to the second preset frame number and the frame number is less than a third preset frame number; and highlighting the frame number using a fourth color when the frame number is greater than or equal to the third preset frame number and the frame number is less than a fourth preset frame number, wherein the first preset frame number is less than the second preset frame number, the second preset frame number is less than the third preset frame number, and the third preset frame number is less than the fourth preset frame number.

[0008] Optionally, after processing the micro-vibration data to obtain a frame frequency analysis diagram and an object vibration data diagram, the method further includes: creating a first display area and a second display area on the display page; displaying the frame frequency analysis diagram on the first display area; and displaying the object vibration data diagram on the second display area.

[0009] Optionally, after displaying the object vibration data graph on the second display area, the method further includes: receiving and responding to a predetermined selection operation acting on the first display area, determining to highlight the frame frequency analysis graph, wherein the predetermined selection operation is used to highlight the frame frequency analysis graph; and enlarging the frame frequency analysis graph to be displayed in the first display area.

[0010] Optionally, after performing micro-vibration imaging processing on each of the monitoring videos to be processed to obtain micro-vibration data, the method further includes: obtaining an amplitude-frequency halo based on the micro-vibration data, the amplitude-frequency halo being used to characterize the amplitude and frequency of each of the monitoring devices; and displaying the amplitude-frequency halo on the display page.

[0011] Optionally, after the amplitude-frequency halo is displayed on the display page, the method further includes: displaying the amplitude-frequency halo of the current monitoring device on the display page when a leftward swipe operation is detected; and displaying the amplitude-frequency halo of the next monitoring device on the display page when a rightward swipe operation is detected.

[0012] According to another aspect of the present invention, a monitoring video processing apparatus is also provided. The apparatus includes an acquisition unit, a first processing unit, and a second processing unit. The acquisition unit is used to acquire monitoring videos sent by multiple monitoring devices to obtain multiple monitoring videos to be processed, wherein the monitoring videos to be processed are videos recorded by the monitoring devices. The first processing unit is used to perform micro-vibration imaging processing on each of the monitoring videos to be processed to obtain micro-vibration data. The second processing unit is used to process each of the micro-vibration data to obtain comparison results and display the comparison results on a display page. The comparison results are used to characterize the relationship between time and amplitude or the relationship with vibration frequency of each of the monitoring devices.

[0013] According to another aspect of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored program, wherein the program executes any of the described monitoring video processing methods.

[0014] According to another aspect of the present invention, a monitoring video processing system is also provided, the system including one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including methods for performing any of the monitoring video processing methods described above.

[0015] In this embodiment of the invention, by processing the micro-vibration data, comparison results are obtained and displayed on the display page, which avoids a large amount of manpower consumption and improves work efficiency. This solves the problem of how to avoid a large number of people going to the equipment operation site to measure and then manually analyzing and discussing the test results. Attached Figure Description

[0016] The accompanying drawings, which form part of this application, are used to provide a further understanding of this application. The illustrative embodiments and descriptions of this application are used to explain this application and do not constitute an undue limitation of this application. In the drawings:

[0017] Figure 1 A flowchart of a monitoring video processing method according to an embodiment of this application is shown;

[0018] Figure 2 A flowchart of a monitoring video processing method according to an embodiment of this application is shown. Detailed Implementation

[0019] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. This application will now be described in detail with reference to the accompanying drawings and embodiments.

[0020] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0021] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of this application described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0022] It should be understood that when an element (such as a layer, film, region, or substrate) is described as being "on" another element, the element may be directly on the other element, or there may be an intermediate element present. Furthermore, in the specification and claims, when an element is described as being "connected" to another element, the element may be "directly connected" to the other element, or "connected" to the other element via a third element.

[0023] As mentioned in the background section, existing offline monitoring is a diagnostic tool used to eliminate vibration faults. This diagnostic process requires equipment maintenance personnel and on-site production operators to regularly measure, record, and track equipment status, or to take temporary measurements when equipment malfunctions. Finally, the equipment faults are carefully analyzed and discussed. All monitoring work is still mainly done manually. In order to solve the problem of how to avoid a large number of people going to the equipment operation site to take measurements and then manually analyzing and discussing the test results, a typical embodiment of this application provides a monitoring video processing method, apparatus, computer-readable storage medium, and system.

[0024] According to an embodiment of this application, a monitoring video processing method is provided.

[0025] Figure 1 This is a flowchart of a monitoring video processing method according to an embodiment of this application. Figure 1 As shown, the method includes the following steps:

[0026] Step S101: Obtain monitoring videos sent by multiple monitoring devices to obtain multiple monitoring videos to be processed. The monitoring videos to be processed are the videos recorded by the monitoring devices.

[0027] Step S102: Perform micro-vibration imaging processing on each of the above-mentioned monitoring videos to be processed to obtain micro-vibration data;

[0028] Step S103: Process the micro-vibration data to obtain comparison results, and display the comparison results on the display page. The comparison results are used to characterize the relationship between time and amplitude or the relationship with vibration frequency of each of the above-mentioned monitoring devices.

[0029] In the above steps, by processing the micro-vibration data, comparison results are obtained and displayed on the display page. This avoids a large amount of manpower consumption and improves work efficiency, thereby solving the problem of how to avoid a large number of people going to the equipment operation site to measure and then manually analyzing and discussing the test results.

[0030] In one embodiment of this application, the micro-vibration data are processed to obtain comparison results, including: processing the micro-vibration data to obtain a frame frequency analysis graph and an object vibration data graph, wherein the frame frequency analysis graph is used to characterize the relationship between the number of frames and the amplitude, or the relationship with the vibration frequency, and the object vibration data graph is used to characterize the relationship between the time and the amplitude, or the relationship with the vibration frequency; performing Fast Fourier Transform (FFT) processing on the frame frequency analysis graph and the object vibration data graph to obtain analysis results, which are used to characterize the object vibration data graph and the frame frequency analysis graph after FFT processing; and using the frame frequency analysis graph, the object vibration data graph, and the analysis results as the comparison results.

[0031] Specifically, AI-based contactless monitoring avoids the limitations of traditional contact sensors due to wiring constraints. It can rapidly deploy monitoring equipment while ensuring the inspected equipment is undamaged and highly adaptable to various environments. It is convenient to use anywhere, allowing us to more easily and intuitively analyze the real-time operating status of a device. Three types of charts provide a more comprehensive view of the device's operating status throughout its entire lifecycle, which can be used not only for later historical data analysis but also for predicting and providing early warnings about the future usage of the same model of equipment.

[0032] By employing a high frame rate camera, images of the micro-motions of the device under test are quickly captured during operation. Combined with computer analysis techniques, these micro-motions are converted into the motion of individual pixels within the images, capturing their three-dimensional trajectories and calculating the amplitude and frequency of vibration for each pixel. By combining data acquired per unit time and per frame, the system can analyze whether any anomalies exist in the target device.

[0033] In one embodiment of this application, the method further includes: highlighting the frame number using a first color when the frame number is greater than or equal to 0 and less than a first preset frame number; highlighting the frame number using a second color when the frame number is greater than or equal to the first preset frame number and less than a second preset frame number; highlighting the frame number using a third color when the frame number is greater than or equal to the second preset frame number and less than a third preset frame number; and highlighting the frame number using a fourth color when the frame number is greater than or equal to the third preset frame number and less than a fourth preset frame number, wherein the first preset frame number is less than the second preset frame number, the second preset frame number is less than the third preset frame number, and the third preset frame number is less than the fourth preset frame number.

[0034] The parameters (frequency and amplitude) of an object's vibration can be represented by several points in space, with different colors indicating the different parameter values ​​they represent. By comprehensively analyzing the colors of these points, we can obtain a general understanding of the object's motion state. Image micro-vibration can display the amplitude and frequency of an object's motion separately.

[0035] The amplitude of each point (pixel) reflects the relative motion state of the element stored within a fixed time period, while it is known that the motion of unrelated pixels between frames is proportional to the overall motion of the target. Relative motion inevitably involves information conversion, which requires precise target distance and operation in a stable environment. Therefore, the color frequency distribution scale can be scaled up or down proportionally in millimeters or micrometers. Thus, although different objects appear to be roughly the same size on the screen, the color frequency distribution scale automatically performs relative scaling, allowing for calculations on different objects.

[0036] Different colors represent different frequency ranges: 0-1Hz is purple, 1-4Hz is dark blue, 4-8Hz is green, and 8-10Hz is red.

[0037] Micro-vibration halo: Colored lines formed by the maximum frequency and average amplitude create a halo around the object, making it easier to visually analyze the object's state. The color of the halo represents the frequency magnitude, and the halo is composed of several lines, the length of each line representing the maximum vibration frequency of the pixel at that location. The unevenness of the halo's color and its size both indicate the object's motion state in the image. For normal objects, the halo's color and outer shape are relatively uniform, and the halo is almost flush with the object's image. For abnormal objects, such as equipment in an abnormal state, the halo occupies a larger space and its color is uneven.

[0038] In one embodiment of this application, after performing micro-vibration imaging processing on each of the above-mentioned monitoring videos to be processed to obtain micro-vibration data, the method further includes: obtaining an amplitude-frequency halo based on the micro-vibration data, wherein the amplitude-frequency halo is used to characterize the amplitude and frequency of each of the above-mentioned monitoring devices; and displaying the amplitude-frequency halo on the above-mentioned display page.

[0039] Amplitude-frequency halo, also known as "image micro-vibration halo," reflects the vibration frequency and amplitude of pixels. When the vibration frequency and amplitude of each pixel in each frame are depicted around the device, a halo is formed. The color of the halo is related to the vibration frequency, and the size of the halo is related to the vibration amplitude.

[0040] Non-contact monitoring devices, namely cameras, acquire video data and perform real-time micro-vibration imaging analysis to analyze the vibration amplitude and frequency of the equipment, forming an amplitude-frequency halo. The amplitude is determined by the length of each line on the halo, and the frequency is determined by the color of the lines, allowing for direct observation of abnormal equipment fault locations. Furthermore, for vibration measurement of large-scale mechanical equipment and building structures, high-definition cameras can be deployed at multiple points to achieve full-area image coverage of the production environment. In harsh industrial production processes, AI-based non-contact monitoring avoids the limitations of traditional contact sensors due to wiring constraints, enabling rapid deployment of monitoring equipment while ensuring no damage to the inspected equipment and demonstrating strong environmental adaptability.

[0041] It supports testing offline video recordings. First, monitoring video files of the equipment in operation need to be obtained. These files must be manually uploaded to the system. The system then performs micro-vibration imaging analysis on the uploaded video images, analyzing the micro-vibration data presented in the footage. It then returns a report of the micro-vibration data detection results for each device in the video file, providing statistical analysis of the operating status of each device based on time and spectral trends. Simultaneously, during playback, it supports real-time display of the amplitude-frequency halo of each device, providing a more intuitive observation result. This avoids the need for a large amount of manpower to go to the equipment operation site for measurement and then manually analyze and discuss the test results.

[0042] In one embodiment of this application, after processing the aforementioned micro-vibration data to obtain a frame frequency analysis diagram and an object vibration data diagram, the method further includes: creating a first display area and a second display area on the aforementioned display page; displaying the frame frequency analysis diagram on the first display area; and displaying the object vibration data diagram on the second display area.

[0043] It facilitates the simultaneous display of frame rate analysis graphs and object vibration data graphs.

[0044] In one embodiment of this application, after displaying the object vibration data graph on the second display area, the method further includes: receiving and responding to a predetermined selection operation acting on the first display area, determining to highlight the frame frequency analysis graph, wherein the predetermined selection operation is used to highlight the frame frequency analysis graph; and enlarging the frame frequency analysis graph to be displayed in the first display area before displaying it.

[0045] Specifically, when an operator performs a two-finger operation (two-finger operation: an operation of sliding two fingers from close together to separate the two fingers) on the first display area of ​​the touch screen, the frame frequency analysis diagram to be displayed in the first display area is enlarged and displayed.

[0046] In one embodiment of this application, after the amplitude-frequency halo is displayed on the display page, the method further includes: displaying the amplitude-frequency halo of the current monitoring device on the display page when a leftward swipe operation is detected; and displaying the amplitude-frequency halo of the next monitoring device on the display page when a rightward swipe operation is detected.

[0047] Specifically, when the staff swipes left on the touch screen, the amplitude-frequency halo of the current monitoring device is displayed on the aforementioned display page. When the staff swipes right on the touch screen, the amplitude-frequency halo of the next monitoring device is displayed on the aforementioned display page, so that the staff can quickly view multiple amplitude-frequency haloes.

[0048] It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0049] This application also provides a monitoring video processing apparatus. It should be noted that the monitoring video processing apparatus of this application can be used to execute the monitoring video processing method provided in this application. The monitoring video processing apparatus provided in this application will be described below.

[0050] Figure 2This is a schematic diagram of a monitoring video processing apparatus according to an embodiment of this application. Figure 2 As shown, the device includes an acquisition unit 21, a first processing unit 22, and a second processing unit 23. The acquisition unit 21 is used to acquire monitoring videos sent by multiple monitoring devices to obtain multiple monitoring videos to be processed, wherein the monitoring videos to be processed are videos recorded by the monitoring devices. The first processing unit 22 is used to perform micro-vibration imaging processing on each of the monitoring videos to be processed to obtain micro-vibration data. The second processing unit 23 is used to process each of the micro-vibration data to obtain comparison results and display the comparison results on the display page. The comparison results are used to characterize the relationship between time and amplitude or the relationship with vibration frequency of each of the monitoring devices.

[0051] In the aforementioned device, by processing the aforementioned micro-vibration data, comparison results are obtained and displayed on the display page. This avoids a large amount of manpower consumption and improves work efficiency, thereby solving the problem of how to avoid a large number of people going to the equipment operation site to conduct measurements and then manually analyzing and discussing the test results.

[0052] In one embodiment of this application, the second processing unit includes a first processing module, a second processing module, and a third processing module. The first processing module processes the aforementioned micro-vibration data to obtain a frame frequency analysis diagram and an object vibration data diagram. The frame frequency analysis diagram is used to characterize the relationship between the number of frames and the amplitude, or the relationship with the vibration frequency. The object vibration data diagram is used to characterize the relationship between the time and the amplitude, or the relationship with the vibration frequency. The second processing module performs Fast Fourier Transform (FFT) processing on the frame frequency analysis diagram and the object vibration data diagram to obtain an analysis result. The analysis result is used to characterize the object vibration data diagram and the frame frequency analysis diagram after FFT processing. The third processing module uses the frame frequency analysis diagram, the object vibration data diagram, and the analysis result as the comparison result.

[0053] In one embodiment of this application, the device further includes a third processing unit, a fourth processing unit, a fifth processing unit, and a sixth processing unit. The third processing unit is configured to highlight the frame number using a first color when the frame number is greater than or equal to 0 and the frame number is less than a first preset frame number. The fourth processing unit is configured to highlight the frame number using a second color when the frame number is greater than or equal to the first preset frame number and the frame number is less than a second preset frame number. The fifth processing unit is configured to highlight the frame number using a third color when the frame number is greater than or equal to the second preset frame number and the frame number is less than a third preset frame number. The sixth processing unit is configured to highlight the frame number using a fourth color when the frame number is greater than or equal to the third preset frame number and the frame number is less than a fourth preset frame number. The first preset frame number is less than the second preset frame number, the second preset frame number is less than the third preset frame number, and the third preset frame number is less than the fourth preset frame number.

[0054] In one embodiment of this application, the second processing unit includes a creation module, a first display module, and a second display module. After processing the micro-vibration data to obtain a frame frequency analysis diagram and an object vibration data diagram, the creation module is used to create a first display area and a second display area on the display page; the first display module is used to display the frame frequency analysis diagram on the first display area; and the second display module is used to display the object vibration data diagram on the second display area.

[0055] In one embodiment of this application, the second processing unit includes a determining module and a fourth processing module. After displaying the object vibration data graph on the second display area, the determining module is used to receive and respond to a predetermined selection operation acting on the first display area to determine to highlight the frame frequency analysis graph, wherein the predetermined selection operation is used to highlight the frame frequency analysis graph; the fourth processing module is used to enlarge and display the frame frequency analysis graph to be displayed in the first display area.

[0056] In one embodiment of this application, the device further includes a seventh processing unit and a first display unit. After performing micro-vibration imaging processing on each of the above-mentioned monitoring videos to be processed to obtain micro-vibration data, the seventh processing unit is used to obtain an amplitude-frequency light ring based on the micro-vibration data. The amplitude-frequency light ring is used to characterize the amplitude and frequency of each of the above-mentioned monitoring devices. The first display unit is used to display the amplitude-frequency light ring on the display page.

[0057] In one embodiment of this application, the device further includes a second display unit and a third display unit. After the amplitude-frequency halo is displayed on the display page, the second display unit is used to display the amplitude-frequency halo of the current monitoring device on the display page when a leftward sliding operation is detected; the third display unit is used to display the amplitude-frequency halo of the next monitoring device on the display page when a rightward sliding operation is detected.

[0058] The aforementioned video monitoring processing device includes a processor and a memory. The aforementioned acquisition unit, first processing unit, and second processing unit are all stored in the memory as program units, and the processor executes the aforementioned program units stored in the memory to realize the corresponding functions.

[0059] The processor contains a kernel, which retrieves the corresponding program units from memory. One or more kernels can be configured. By adjusting kernel parameters, the problem of avoiding the need for extensive on-site measurements and subsequent manual analysis and discussion of test results can be addressed.

[0060] The memory may include non-permanent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0061] This invention provides a computer-readable storage medium having a program stored thereon, which, when executed by a processor, implements the above-described monitoring video processing method.

[0062] This invention provides a processor for running a program, wherein the program executes the aforementioned monitoring video processing method.

[0063] This invention provides a device including a processor, a memory, and a program stored in the memory and executable on the processor. When the processor executes the program, it performs at least the following steps: acquiring monitoring videos sent by multiple monitoring devices to obtain multiple monitoring videos to be processed, wherein the monitoring videos to be processed are videos recorded by the monitoring devices; performing micro-vibration imaging processing on each of the monitoring videos to be processed to obtain micro-vibration data; processing each of the micro-vibration data to obtain comparison results, and displaying the comparison results on a display page. The comparison results are used to characterize the relationship between time and amplitude, or the relationship with vibration frequency, of each of the monitoring devices. The device described herein may be a server, PC, PAD, mobile phone, etc.

[0064] This application also provides a computer program product, which, when executed on a data processing device, is suitable for executing an initialization program having at least the following method steps: acquiring monitoring videos sent by multiple monitoring devices to obtain multiple monitoring videos to be processed, wherein the monitoring videos to be processed are videos recorded by the monitoring devices; performing micro-vibration imaging processing on each of the monitoring videos to be processed to obtain micro-vibration data; processing each of the micro-vibration data to obtain comparison results, and displaying the comparison results on a display page, wherein the comparison results are used to characterize the relationship between time and amplitude, or the relationship with vibration frequency, of each of the monitoring devices.

[0065] This application also provides a monitoring video processing system, which includes one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include methods for performing any of the aforementioned monitoring video processing methods. By processing the aforementioned micro-vibration data, comparison results are obtained and displayed on a display page, avoiding a large amount of manpower consumption and improving work efficiency. This solves the problem of how to avoid a large number of people going to the equipment operation site to perform measurements and then manually analyzing and discussing the test results.

[0066] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0067] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0068] If the aforementioned integrated units are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0069] As can be seen from the above description, the embodiments of this application achieve the following technical effects:

[0070] 1) The monitoring video processing method of this application processes the above-mentioned micro-vibration data to obtain comparison results and displays the comparison results on the display page, which avoids a lot of manpower consumption and improves work efficiency. This solves the problem of how to avoid a large number of people going to the equipment operation site to measure and then manually analyzing and discussing the test results.

[0071] 2) The monitoring video processing device of this application processes the above-mentioned micro-vibration data to obtain comparison results and displays the comparison results on the display page, which avoids a lot of manpower consumption and improves work efficiency. This solves the problem of how to avoid a large number of people going to the equipment operation site to measure and then manually analyzing and discussing the test results.

[0072] 3) The monitoring video processing system of this application processes the above-mentioned micro-vibration data to obtain comparison results and displays the comparison results on the display page, which avoids a lot of manpower consumption and improves work efficiency. This solves the problem of how to avoid a large number of people going to the equipment operation site to measure and then manually analyzing and discussing the test results.

[0073] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method for processing monitoring video, characterized in that, include: Multiple monitoring videos sent by multiple monitoring devices are acquired to obtain multiple monitoring videos to be processed, wherein the monitoring videos to be processed are videos recorded by the monitoring devices; Micro-vibration imaging processing is performed on each of the monitoring videos to be processed to obtain micro-vibration data; The micro-vibration data are processed to obtain comparison results, which are then displayed on a display page. The comparison results are used to characterize the relationship between time and amplitude, or the relationship between time and vibration frequency, of each monitoring device. The process of processing each of the micro-vibration data to obtain the comparison results includes: The micro-vibration data are processed to obtain a frame frequency analysis diagram and an object vibration data diagram. The frame frequency analysis diagram is used to characterize the relationship between the number of frames and the amplitude, or the relationship with the vibration frequency. The object vibration data diagram is used to characterize the relationship between the time and the amplitude, or the relationship with the vibration frequency. The frame frequency analysis map and the object vibration data map are processed by Fast Fourier Transform to obtain the analysis results. The analysis results are used to characterize the object vibration data map and the frame frequency analysis map after Fast Fourier Transform processing. The frame frequency analysis graph, the object vibration data graph, and the analysis results are used as the comparison results.

2. The method according to claim 1, characterized in that, The method further includes: When the number of frames is greater than or equal to 0 and the number of frames is less than a first preset number of frames, the number of frames is highlighted using a first color. When the number of frames is greater than or equal to the first preset number of frames and the number of frames is less than the second preset number of frames, the number of frames is highlighted using a second color. If the number of frames is greater than or equal to the second preset number of frames and less than the third preset number of frames, the number of frames is highlighted using a third color. When the number of frames is greater than or equal to the third preset number of frames and the number of frames is less than the fourth preset number of frames, the number of frames is highlighted using a fourth color, wherein the first preset number of frames is less than the second preset number of frames, the second preset number of frames is less than the third preset number of frames, and the third preset number of frames is less than the fourth preset number of frames.

3. The method according to claim 1, characterized in that, After processing the micro-vibration data to obtain the frame frequency analysis diagram and the object vibration data diagram, the method further includes: Create a first display area and a second display area on the display page; The frame frequency analysis graph is displayed on the first display area; The vibration data graph of the object is displayed on the second display area.

4. The method according to claim 3, characterized in that, After displaying the object vibration data graph on the second display area, the method further includes: Receive and respond to a predetermined selection operation performed on the first display area, determine to highlight the frame frequency analysis graph, wherein the predetermined selection operation is used to highlight the frame frequency analysis graph; The frame rate analysis graph to be displayed in the first display area is enlarged and then displayed.

5. The method according to claim 1, characterized in that, After performing micro-vibration imaging processing on each of the monitoring videos to be processed to obtain micro-vibration data, the method further includes: Based on the micro-vibration data, an amplitude-frequency optical loop is obtained, which is used to characterize the amplitude and frequency of each monitoring device; The amplitude-frequency halo is displayed on the display page.

6. The method according to claim 5, characterized in that, After the amplitude-frequency halo is displayed on the display page, the method further includes: Upon detecting a leftward swipe operation, the amplitude-frequency halo of the current monitoring device is displayed on the display page; Upon detecting a rightward swipe operation, the amplitude-frequency halo of the next monitoring device is displayed on the display page.

7. A video monitoring processing device, characterized in that, include: The acquisition unit is used to acquire monitoring videos sent by multiple monitoring devices to obtain multiple monitoring videos to be processed, wherein the monitoring videos to be processed are videos recorded by the monitoring devices; The first processing unit is used to perform micro-vibration imaging processing on each of the monitoring videos to be processed to obtain micro-vibration data; The second processing unit is used to process each of the micro-vibration data, obtain comparison results, and display the comparison results on the display page. The comparison results are used to characterize the relationship between time and amplitude, or the relationship with vibration frequency of each of the monitoring devices. The second processing unit includes: The first processing module is used to process each of the micro-vibration data to obtain a frame frequency analysis diagram and an object vibration data diagram. The frame frequency analysis diagram is used to characterize the relationship between the number of frames and the amplitude, or the relationship with the vibration frequency. The object vibration data diagram is used to characterize the relationship between the time and the amplitude, or the relationship with the vibration frequency. The second processing module is used to perform fast Fourier transform processing on the frame frequency analysis map and the object vibration data map to obtain analysis results. The analysis results are used to characterize the object vibration data map and the frame frequency analysis map after fast Fourier transform processing. The third processing module is used to use the frame frequency analysis diagram, the object vibration data diagram, and the analysis result as the comparison result.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program performs the monitoring video processing method according to any one of claims 1 to 6.

9. A video monitoring processing system, characterized in that, include: One or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including methods for performing the monitoring video processing method according to any one of claims 1 to 6.

Images