A visual vibration measurement method and system for improving vibration measurement frequency range

Abstract

This invention discloses a visual vibration measurement method and system to improve the frequency range of vibration measurement. The method includes: dividing an image sensor into multiple regions according to a preset division method; configuring the working timing parameters of the image sensor, wherein the working timing parameters include the working time period of each region, and the working time periods of each region do not overlap; controlling each region of the image sensor to sequentially start and stop its working state based on the working timing parameters, so as to realize that different regions of the sensor can acquire images of different local positions of the tested object at multiple different times; obtaining the vibration parameters of the local position based on the images of the same local position of the tested object at multiple different times and the temporal correlation of vibration information; and analyzing the global vibration parameters of the tested object based on the spatial correlation of vibration information of different local positions. This invention effectively improves the frequency range of visual vibration measurement.

Description

Technical Field

[0001] This invention relates to the field of visual vibration measurement technology, and specifically to a visual vibration measurement method and system for improving the vibration measurement frequency range. Background Technology

[0002] Vibration testing is an important means of diagnosing equipment status and faults. Conventional vibration measurement methods generally use contact sensors such as accelerometers, velocity sensors, and displacement sensors. In recent years, image-based methods have also been used to measure vibration. However, the measured vibration frequency is limited by the frame rate of high-speed cameras (<10kHz), making it impossible to measure vibrations at higher frequencies. Summary of the Invention

[0003] To address the problems existing in the prior art, this invention provides a visual vibration measurement method and system that significantly improves the frequency range of visual vibration measurement. The technical solution is as follows:

[0004] Firstly, a visual vibration measurement method for improving the vibration measurement frequency range is provided, the method comprising the following steps:

[0005] S1: Divide the image sensor into multiple regions according to a preset division method;

[0006] S2: Configure the working timing parameters of the image sensor, the working timing parameters including the working time period of each region, wherein the working time periods of each region do not overlap;

[0007] S3: Based on the working timing parameters, control each region of the image sensor to start and stop working in sequence, so as to realize that different regions of the sensor can acquire images of different local positions of the object under test at multiple different times;

[0008] S4: Based on images of the same local location of the test object at multiple different times, and combined with the temporal correlation of vibration information, obtain the vibration parameters of the local location. Based on the spatial correlation of vibration information from different local locations, analyze the global vibration parameters of the test object.

[0009] As a further optimization of the above scheme, the image sensor is divided using pixel units in the image sensor as the basic unit.

[0010] As a further optimization of the above scheme, the method for dividing each region of the image sensor includes:

[0011] Regions are divided based on at least one row of pixel units, at least one column of pixel units, or at least one row and at least one column of pixel units in an image sensor.

[0012] As a further optimization of the above scheme, the method for dividing each region of the image sensor includes:

[0013] Based on the total number of rows and columns of pixel units in the image sensor, the image sensor is divided into multiple regions with the same number of rows and columns.

[0014] As a further optimization of the above scheme, the method for dividing each region of the image sensor includes:

[0015] Based on the total number of rows 'a' of pixel units in the image sensor, the 'a' rows of pixel units are divided into 'b' regions, and the number of pixel unit rows in each region is 'm' = 'a' / 'b', where 'a', 'b', and 'm' are all integers.

[0016] As a further optimization of the above scheme, the working time period of each region in the working sequence of the configured image sensor is configured as follows:

[0017] For two regions with the same working duration and adjacent working order, the time interval between the shutdown time of the previous region and the startup time of the next region is the same.

[0018] As a further optimization of the above solution, step S4 includes:

[0019] Vibration signals at different times at the same local location are obtained from images at different times at the same local location;

[0020] Based on the vibration signals at different times at the local location, the complete vibration signal of the local location during the acquisition of the local location image is obtained;

[0021] The global vibration parameters of the object under test are obtained based on the complete vibration signal of each local location during the acquisition of the local location image.

[0022] Secondly, a visual vibration measurement system with an improved vibration measurement frequency range is provided, the system comprising:

[0023] The partitioning module is used to divide the image sensor into multiple regions according to a preset partitioning method.

[0024] The working timing configuration module is used to configure the working timing parameters of the image sensor. The working timing parameters include the working time period of each region, wherein the working time periods of each region do not overlap.

[0025] The working timing control module is used to control the sequential start and stop of the working state of each area of ​​the image sensor based on the working timing parameters, so as to realize the acquisition of images of different local positions of the object under test at different times by different areas of the sensor;

[0026] The vibration information analysis module is used to obtain the vibration parameters of the local location based on the images of the same local location of the test object at different times and the temporal correlation of vibration information, and to analyze the global vibration parameters of the test object based on the spatial correlation of vibration information from different local locations.

[0027] Thirdly, an intraoperative ultrasound detection method is provided, which is based on the visual vibration measurement method described in the first aspect above.

[0028] Fourthly, a visual vibration measurement device for improving the vibration measurement frequency range is provided, the device comprising:

[0029] processor;

[0030] Memory used to store processor-executable instructions;

[0031] The processor implements the visual vibration measurement method for improving the vibration measurement frequency range described in the first aspect by running the executable instructions.

[0032] The present invention provides a visual vibration measurement method and system for improving the vibration measurement frequency range, which has the following beneficial effects: Based on the partitioning of an image sensor and the control of the partitioning working time, the present invention significantly reduces the data acquisition cycle of each frame of image data during the working period of each region, thereby increasing the image acquisition frame rate. Based on the high-frequency sampling achieved during the working period of each region of the sensor, the frequency range of visual vibration measurement is effectively improved. In this application, by dividing the image sensor into multiple regions and controlling them separately, a high operating frequency is achieved within the same image sensor without changing the original circuit structure and electronic components of the image sensor. Furthermore, compared to methods that increase the image acquisition frequency based on the complete image sensor image acquisition process control, the present invention achieves a greater increase in image acquisition frequency within a single image sensor, and the timing control of the image acquisition process for different image sensor regions is more precise and efficient. Attached Figure Description

[0033] Figure 1 This is a schematic diagram of the image sensor partitioning method in the visual vibration measurement method of this application embodiment;

[0034] Figure 2 This is a flowchart of a visual vibration measurement method for improving the vibration measurement frequency range according to an embodiment of this application;

[0035] Figure 3 This is a structural diagram of a visual vibration measurement system for improving the vibration measurement frequency range according to an embodiment of this application. Detailed Implementation

[0036] To make the objectives, technical solutions, and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on the present invention. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0037] See Figure 2 This application provides a visual vibration measurement method to improve the vibration measurement frequency range. The method includes the following steps:

[0038] S1: Divide the image sensor into multiple regions according to a preset division method;

[0039] S2: Configure the working timing parameters of the image sensor, the working timing parameters including the working time period of each region, wherein the working time periods of each region do not overlap;

[0040] S3: Based on the working timing parameters, control each region of the image sensor to start and stop working in sequence, so as to realize that different regions of the sensor can acquire images of different local positions of the object under test at multiple different times;

[0041] S4: Based on the temporal correlation of vibration information from multiple images of the same local location of the test object at different times, the vibration parameters of the local location are obtained. Based on the spatial correlation of vibration information from different local locations, the global vibration parameters of the test object are analyzed. These vibration parameters include, but are not limited to, mode shape, vibration frequency, resonance frequency, and vibration amplitude.

[0042] In this embodiment of the application, the image acquisition of the vibrating object adopts a method of dividing the global image of the object into several local images and acquiring them separately. Based on the images acquired at different acquisition times at different local locations of the same object, the vibration parameters on the object are analyzed from the two aspects of the temporal and spatial correlation of the vibration information propagation on the object.

[0043] This application, based on the partitioning of the image sensor and the control of the partitioning working time, achieves a significant reduction in the data acquisition cycle of each frame of image data during the working period of each region, thereby increasing the image acquisition frame rate. The high-frequency sampling achieved during the working period of each region of the sensor effectively improves the frequency range of visual vibration measurement. This application, by dividing the image sensor into multiple regions and controlling them separately, achieves a high operating frequency within the same image sensor without changing the original circuit structure and electronic components. Furthermore, compared to methods that increase the image acquisition frequency based on controlling the entire image sensor's image acquisition process, this application achieves a greater increase in image acquisition frequency within a single image sensor and provides more precise and efficient timing control for the image acquisition process in different image sensor regions. Generally, the acquisition frame rate of a high-speed camera image sensor is less than 10kHz; based on the partitioning of the image sensor and the control of the partitioning working time in this application, an image acquisition frame rate reaching the MHz level, at least 8MHz or higher, can be achieved.

[0044] In this application, the working time sequence of each region of the image sensor is configured. The working time period parameter of each region can determine the working duration T1, working sequence, and working start and end time of each region. In the embodiment of this application, the working duration T1 is such that multiple image frames of the local position of the object under test can be acquired within the working time period T1 of each region. Based on the local images of the same local position acquired within the time period T1, and based on the vibration information represented by each local image and the temporal relationship of multiple local images, the complete vibration information of the local position of the object under test within the time period T1 can be analyzed and obtained. Furthermore, based on the complete vibration information of different local positions of the object under test within different time periods T1, the complete vibration information of the global position of the object under test can be analyzed and obtained.

[0045] In one embodiment, in step S1 above, the image sensor is divided using pixel units in the image sensor as the basic unit.

[0046] In this embodiment, based on the prior art, each pixel unit in the image sensor is operated and controlled by row selection logic unit and column selection logic unit. In order to facilitate control, the original circuit structure of the image sensor is not changed. The region is also divided with pixel unit as the basic unit to realize individual control of the working state of a single region.

[0047] In one embodiment, the method for dividing each region of the image sensor in step S1 above includes: dividing the region based on at least one row of pixel units, at least one column of pixel units, or at least one row and at least one column of pixel units in the image sensor.

[0048] In this embodiment, region division can be achieved by selecting several rows of pixel units from all pixel rows of the image sensor to form a region, or by selecting several columns of pixel units from all pixel columns of the image sensor to form a region, or by dividing the image sensor into several rows and several columns of pixel units. Of course, the number of pixel rows and / or pixel columns in each region can be the same or different. Preferably, in this embodiment, consecutive pixel rows and / or consecutive pixel columns are selected for region division, which facilitates efficient control and orderly management of each region.

[0049] In one embodiment, the method for dividing each region of the image sensor in step S1 above includes: dividing the image sensor into multiple regions with the same number of rows and columns based on the total number of rows and columns of pixel units in the image sensor.

[0050] In this embodiment, each region is set to have the same area size, meaning the number of pixel unit rows in each region is the same as the number of pixel unit rows in other regions, and the number of pixel unit columns in each region is the same as the number of pixel unit columns in other regions. The division method is simple, the number of regions is easy to obtain, and it facilitates the unified adjustment and management of time periods (working duration, working sequence, working start and end times, etc.) for each region.

[0051] In one embodiment, the method for dividing each region of the image sensor in step S1 above includes: dividing the a rows of pixel units into b regions based on the total number of rows a of pixel units in the image sensor, wherein the number of rows of pixel units in each region is m = a / b, and a, b, and m are all integers.

[0052] In this embodiment, the region is divided only by row pixel units. When actually controlling each region, it is not necessary to control it separately in the column pixel direction. It is only necessary to control it separately in the row pixel unit direction, which reduces the number of control switches or control signals.

[0053] For example, such as Figure 1As shown, assuming the image sensor has N rows, it is divided into M groups of n rows each. Each group acquires images at a frequency of f1 within a working time T1, where f1 is greater than the original operating frequency range of the image sensor. The interval between each pair of groups is fixed and strictly synchronized. The total sampling time for the M groups is T2 seconds. The acquired image data can be transmitted to the host computer in real time via USB 3.0 or Gigabit Ethernet, or it can be stored in the DDR memory in the hardware and transmitted after the measurement stops. By acquiring the image sequence at frequency f1 in each working time T1, high-frequency vibration information of the local position of the measured object can be obtained. Furthermore, based on the information acquired within the entire sampling time T2, the vibration information and mode shapes of all positions of the measured object can be obtained.

[0054] In one implementation, in step S2 above, the working time period for each region of the image sensor is configured as follows:

[0055] For two regions with the same working duration and adjacent working order, the time interval between the shutdown time of the previous region and the startup time of the next region is the same.

[0056] In this embodiment, the working sequence of each region of the image sensor is configured. Based on the working duration, working order, and working start and end time of each region, the start and stop times of the working state of each region are determined. After all regions have completed one start and stop, the time period T2 of the work start and stop of all regions is determined. The working duration T1 of each region can be set differently or the same. The time interval between the working state stop time of the previous region and the working state start time of the next region in the working sequence can be set differently or the same. Preferably, in this embodiment, the time interval between the working state stop time of the previous region and the working state start time of the next region in the working sequence is set to 0, and the working duration T1 of each region is set to the same. In this case, the working frequency of each region is f1, the working duration is T1, and the total time for the image sensor to acquire the image of the object under test is T2, where T2 = b * T1, and b is the number of regions divided by the image sensor. Specifically, when the first region of the image sensor starts working, it acquires an image of the first local position of the object under test. During the first T1 time period, it acquires multiple image frames at a frequency f1. Then, it controls the first region of the image sensor to stop working while controlling the second region to start working, acquires an image of the second local position of the object under test, and acquires multiple image frames at a frequency f1 during the second T1 time period. This process continues until each region of the image sensor completes one T1 time period image acquisition process.

[0057] In one embodiment, step S4 above, which involves obtaining vibration parameters at a local location based on images of the same local location at multiple different times and the temporal correlation of vibration information, and analyzing the global vibration parameters of the object based on the spatial correlation of vibration information from different local locations, includes the following steps:

[0058] Vibration signals at different times at the same local location are obtained from images at different times at the same local location;

[0059] Based on the vibration signals at different times at the local location, the complete vibration signal of the local location during the acquisition of the local location image is obtained;

[0060] The global vibration parameters of the object under test are obtained based on the complete vibration signal of each local location during the acquisition of the local location image.

[0061] Specifically, based on the image acquisition method described above, by analyzing the vibration information represented by multiple local images at each location of the object under test, the vibration signal at the local location can be recovered, and thus the global vibration signal of the object under test can be recovered. The acquired vibration signals are then used to further analyze vibration parameters. Specifically, by acquiring multiple image frames at a local location of the object under test within a time period T1, the vibration signal at that local location at multiple moments within that time period T1 can be obtained. Based on the temporal correlation and temporal variation relationship of the vibration signals, the complete vibration signal of that local location of the object under test within the time period T1 can be obtained. Furthermore, based on the vibration signals at different local locations of the object under test within a time period T1, and utilizing the spatial correlation of vibration signals on the object under test, the complete global vibration signal of the object under test within the time period T2 can be obtained, and thus the global vibration parameters of the object under test within the time period T2 can be obtained.

[0062] Furthermore, based on the aforementioned visual vibration measurement method that improves the vibration measurement frequency range, a digital laser projector (DLP) is added. The projected laser pattern is acquired simultaneously with the image signal acquisition. Based on the image acquired by the image sensor and the laser pattern, three-dimensional vibration information can be recovered. Of course, the scanning frequency of the DLP is matched with the image acquisition frequency.

[0063] See Figure 3 This application also provides a visual vibration measurement system to improve the vibration measurement frequency range. The system includes:

[0064] The partitioning module is used to divide the image sensor into multiple regions according to a preset partitioning method.

[0065] The working timing configuration module is used to configure the working timing parameters of the image sensor. The working timing parameters include the working time period of each region, wherein the working time periods of each region do not overlap.

[0066] The working timing control module is used to control the sequential start and stop of the working state of each area of ​​the image sensor based on the working timing parameters, so as to realize the acquisition of images of different local positions of the object under test at different times by different areas of the sensor;

[0067] The vibration information analysis module is used to obtain the vibration parameters of the local location based on the images of the same local location of the test object at different times and the temporal correlation of vibration information, and to analyze the global vibration parameters of the test object based on the spatial correlation of vibration information from different local locations.

[0068] Specific limitations regarding visual vibration measurement systems that improve the vibration measurement frequency range can be found in the limitations of visual vibration measurement methods for improving the vibration measurement frequency range described above, and will not be repeated here. Each module in the aforementioned visual vibration measurement system for improving the vibration measurement frequency range can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each unit.

[0069] This application also provides an intraoperative ultrasound detection method, which is based on the above-mentioned visual vibration measurement method that improves the vibration measurement frequency range.

[0070] Conventional ultrasonic detection methods utilize ultrasonic probes to perform both transmission and reception functions. In this embodiment, the transmitter is identical to a traditional ultrasonic probe, while the receiver uses a high-speed camera to capture images of human tissue. The control method for image acquisition of human tissue by the high-speed camera is based on the steps in the aforementioned visual vibration measurement method, thereby enabling the acquisition of high-frequency vibration information on human tissue.

[0071] Specifically, the ultrasound probe emits ultrasound waves, causing vibrations in different parts of the tissue. The high-speed camera uses the aforementioned visual vibration measurement method to acquire images of the vibrating human tissue, enabling high-precision capture of this high-frequency vibration information. Furthermore, due to the high frame rate of the high-speed camera, an auxiliary lighting device is placed on the high-speed camera module in this embodiment to improve image acquisition quality.

[0072] This application embodiment also provides a visual vibration measurement device for improving the vibration measurement frequency range. The device includes: a processor; a memory for storing processor-executable instructions; wherein the processor implements the above-mentioned visual vibration measurement method for improving the vibration measurement frequency range by running the executable instructions.

[0073] Specifically, the visual vibration measurement device according to embodiments of this application includes: at least one processor, a memory, a user interface, and at least one network interface. The various components in the visual vibration measurement device are coupled together via a bus system. It is understood that the bus system is used to realize communication between these components. In addition to a data bus, the bus system also includes a power bus, a control bus, and a status signal bus. It is understood that the memory can be volatile memory or non-volatile memory, or both. The vibration testing device may also include other components for realizing the device's functions, which will not be elaborated here.

[0074] This invention is not limited to the specific embodiments described above. Any modifications made by those skilled in the art based on the above concept without creative effort are within the scope of protection of this invention.

Claims

1. A visual vibration measurement method for improving the vibration measurement frequency range, characterized in that, include: S1: Divide the image sensor into multiple regions according to a preset division method; S2: Configure the working timing parameters of the image sensor, the working timing parameters including the working time period of each region, wherein the working time periods of each region do not overlap; In the working time sequence of each region of the configured image sensor, the working time period of each region is configured as follows: For each region with the same working duration and adjacent working order, the time interval between the working state shutdown time of the previous region and the working state startup time of the next region is the same. S3: Based on the working timing parameters, control each region of the image sensor to start and stop working in sequence, so as to realize that different regions of the sensor can acquire images of different local positions of the object under test at multiple different times; S4: Based on the images of the same local location of the test object at multiple different times and the temporal correlation of vibration information, obtain the vibration parameters of the local location, and analyze the global vibration parameters of the test object based on the spatial correlation of vibration information from different local locations. Step S4 includes: Vibration signals at different times at the same local location are obtained from images at different times at the same local location; Based on the vibration signals at different times at the local location, the complete vibration signal of the local location during the acquisition of the local location image is obtained; The global vibration parameters of the object under test are obtained based on the complete vibration signal of each local location during the acquisition of the local location image.

2. The visual vibration measurement method for improving the vibration measurement frequency range according to claim 1, characterized in that, The image sensor is divided using the pixel unit within the image sensor as the basic unit.

3. The visual vibration measurement method for improving the vibration measurement frequency range according to claim 2, characterized in that, The method for dividing each region of the image sensor includes: Regions are divided based on at least one row of pixel units, at least one column of pixel units, or at least one row and at least one column of pixel units in an image sensor.

4. The visual vibration measurement method for improving the vibration measurement frequency range according to claim 3, characterized in that, The method for dividing each region of the image sensor includes: Based on the total number of rows and columns of pixel units in the image sensor, the image sensor is divided into multiple regions with the same number of rows and columns.

5. The visual vibration measurement method for improving the vibration measurement frequency range according to claim 4, characterized in that, The method for dividing each region of the image sensor includes: Based on the total number of rows 'a' of pixel units in the image sensor, the 'a' rows of pixel units are divided into 'b' regions, and the number of pixel unit rows in each region is 'm' = 'a' / 'b', where 'a', 'b', and 'm' are all integers.

6. A visual vibration measurement system for improving the vibration measurement frequency range, characterized in that, include: The partitioning module is used to divide the image sensor into multiple regions according to a preset partitioning method. The working timing configuration module is used to configure the working timing parameters of the image sensor. The working timing parameters include the working time period of each region, wherein the working time periods of each region do not overlap. In the working time sequence of each region of the configured image sensor, the working time period of each region is configured as follows: For each region with the same working duration and adjacent working order, the time interval between the working state shutdown time of the previous region and the working state startup time of the next region is the same. The working timing control module is used to control the sequential start and stop of the working state of each area of ​​the image sensor based on the working timing parameters, so as to realize the acquisition of images of different local positions of the object under test at different times by different areas of the sensor; The vibration information analysis module is used to obtain the vibration parameters of the local location based on the images of the same local location of the test object at different times and the temporal correlation of vibration information, and to analyze the global vibration parameters of the test object based on the spatial correlation of vibration information of different local locations. The vibration information analysis module is specifically used for: Vibration signals at different times at the same local location are obtained from images at different times at the same local location; Based on the vibration signals at different times at the local location, the complete vibration signal of the local location during the acquisition of the local location image is obtained; The global vibration parameters of the object under test are obtained based on the complete vibration signal of each local location during the acquisition of the local location image.

7. A method for intraoperative ultrasound detection, characterized in that, It is implemented based on the visual vibration measurement method as described in any one of claims 1-5.

8. A visual vibration measurement device for improving the vibration measurement frequency range, characterized in that, The device includes: processor; Memory used to store processor-executable instructions; The processor executes the executable instructions to implement the visual vibration measurement method for improving the vibration measurement frequency range as described in any one of claims 1-5.

Images