Processing device and processing method

Abstract

To provide a processing device and a processing method by which measurement can be easily performed.SOLUTION: A processing device includes an acquisition part for acquiring information indicating a first movie in which a measurement object is imaged at a first imaging position and information indicating a second movie in which the measurement object is imaged at a second imaging position different from the first imaging position, a displacement calculation part for calculating a first displacement which is a displacement of a first analyzing point which is an analyzing point on the measurement object in the first movie based on the first movie and calculating a second displacement which is a displacement of a second analyzing point which is an analyzing point on the measurement object corresponding to the first analyzing point in the second movie based on the second movie, and a correction part for correcting at least one of the first displacement or the second displacement based on the ratio of the component of the first displacement to the component of the second displacement with respect to the component which is in the same direction in the first movie and the second movie.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a processing device and a processing method.

Background Art

[0002] Patent Document 1 discloses a configuration example of a vibration measurement system that measures vibration based on the imaging results of a target by at least two cameras. In the vibration measurement system described in Patent Document 1, calibration is performed so that the positional relationship between the two cameras and the target is known in advance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the vibration measurement system described in Patent Document 1, since a plurality of cameras are used, there is a problem that it may take time to install and adjust the plurality of cameras.

[0005] The present disclosure has been made to solve the above problems, and an object thereof is to provide a processing device and a processing method that can easily perform measurement.

Means for Solving the Problems

[0006] To solve the above problems, a processing apparatus according to the present disclosure includes an acquisition unit that acquires information indicating a first moving image obtained by photographing a measurement target at a first photographing position and information indicating a second moving image obtained by photographing the measurement target at a second photographing position different from the first photographing position; a displacement calculation unit that calculates a first displacement, which is a displacement of a first analysis point that is an analysis point on the measurement target in the first moving image, based on the first moving image, and calculates a second displacement, which is a displacement of a second analysis point that is an analysis point on the measurement target corresponding to the first analysis point in the second moving image, based on the second moving image; and a correction unit that corrects at least one of the first displacement and the second displacement based on a ratio between the component of the first displacement and the component of the second displacement for components in the same direction in the first moving image and the second moving image.

[0007] A processing method according to the present disclosure includes a step of acquiring information indicating a first moving image obtained by photographing a measurement target at a first photographing position and information indicating a second moving image obtained by photographing the measurement target at a second photographing position different from the first photographing position; a step of calculating a first displacement, which is a displacement of a first analysis point that is an analysis point on the measurement target in the first moving image, based on the first moving image, and calculating a second displacement, which is a displacement of a second analysis point that is an analysis point on the measurement target corresponding to the first analysis point in the second moving image, based on the second moving image; and a step of correcting at least one of the first displacement and the second displacement based on a ratio between the component of the first displacement and the component of the second displacement for components in the same direction in the first moving image and the second moving image.

Advantages of the Invention

[0008] According to the processing apparatus and the processing method of the present disclosure, measurement can be easily performed.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Embodiments for Carrying Out the Invention

[0010] Hereinafter, a processing apparatus and a processing method according to embodiments of the present disclosure will be described with reference to each figure. In each figure, the same or corresponding configurations will be described with the same reference numerals or reference numerals with an alphabet added to the end of the same reference numeral, and the description will be omitted as appropriate.

[0011] <First Embodiment> FIG. 1 is a block diagram showing a configuration example of a vibration measurement system according to the first embodiment of the present disclosure. FIG. 2 is a flowchart showing an operation example of the vibration measurement system according to the first embodiment of the present disclosure. FIG. 3 is a perspective view showing an example of a measurement object according to the first embodiment of the present disclosure. FIG. 4 is a plan view showing an example of the arrangement relationship between the measurement object and the imaging device according to the first embodiment of the present disclosure. FIG. 5 is a front view showing an example of the arrangement relationship between the measurement object and the imaging device according to the first embodiment of the present disclosure. FIG. 6 is a schematic diagram showing an example of a first moving image according to the first embodiment of the present disclosure. FIG. 7 is a schematic diagram showing an example of a vibration model M1 corresponding to the first moving image according to the first embodiment of the present disclosure. FIG. 8 is a schematic diagram showing an example of a second moving image according to the first embodiment of the present disclosure. FIG. 9 is a schematic diagram showing an example of a vibration model M2 corresponding to the second moving image according to the first embodiment of the present disclosure. FIG. 10 is a schematic diagram for explaining an operation example of the vibration measurement system according to the first embodiment of the present disclosure.

[0012] (Configuration of Vibration Measurement System) As shown in FIG. 1, a vibration measurement system 10 according to a first embodiment of the present disclosure includes a photographing device 2 that photographs a measurement target 3, and a processing device 1 that analyzes vibrations generated in the measurement target 3 based on a moving image photographed by the photographing device 2. The measurement target 3 is a structure such as a dynamic device, for example, a motor, a pump, an engine, a pipe, or the like. The photographing device 2 is a camera that photographs a moving image. The processing device 1 can be configured using a computer such as a server, a personal computer, or a tablet terminal. The processing device 1 includes each part shown in FIG. 1 as a functional configuration composed of a combination of hardware such as a computer and its peripheral devices, and software such as a program executed by the computer. That is, the processing device 1 includes, as a functional configuration, an input unit 11, an acquisition unit 12, a displacement calculation unit 13, a frequency analysis unit 14, a ratio calculation unit 15, a correction unit 16, a vibration analysis unit 17, an output unit 18, and a storage unit 19. The storage unit 19 stores a first moving image 191 and a second moving image 192.

[0013] The input unit 11 inputs instructions and data according to a user's operation using, for example, a keyboard, a mouse, a touch panel, or the like. The output unit 18 is, for example, a display panel that displays characters and images.

[0014] The acquisition unit 12 acquires, by wire or wirelessly, moving images of the measurement target 3 photographed from two different positions by the photographing device 2, and stores them in the storage unit 19 as the first moving image 191 or the second moving image 192. Here, the position where the first moving image 191 is photographed is referred to as the first photographing position. The position where the second moving image 192 is photographed is referred to as the second photographing position. In this case, the acquisition unit 12 acquires information indicating the first moving image of the measurement target 3 photographed at the first photographing position and information indicating the second moving image of the measurement target 3 photographed at the second photographing position different from the first photographing position.

[0015] The displacement calculation unit 13 calculates a first displacement, which is the displacement of a first analysis point that is an analysis point on the measurement target 3 within the first moving image 191 based on the first moving image 191, and calculates a second displacement, which is the displacement of a second analysis point that is an analysis point on the measurement target 3 corresponding to the first analysis point within the second moving image 192 based on the second moving image 192. Note that there is no limitation on the method for calculating the displacement based on the moving image. Further, the displacement calculation unit 13 has a function of, for example, causing the output unit 18 to display the first moving image 191 and the second moving image 192, and setting the first analysis point and the second analysis point according to an input operation on the input unit 11.

[0016] Here, with reference to FIGS. 3 to 6 and FIG. 8, the analysis points in the present embodiment will be described. FIG. 3 shows an example of the measurement target 3 and an example of measurement points 101 to 116 on the measurement target 3 that are the objects of vibration analysis. FIG. 6 schematically shows a display example of an image 501 of one frame in the first moving image 191 on the output unit 18. FIG. 8 schematically shows a display example of an image 502 of one frame in the second moving image 192 on the output unit 18. In the image 501, the analysis points 201 to 216 are points corresponding to the measurement points 101 to 116 on the measurement target 3, and are set on the image 501, for example, according to the operation of the input unit 11 by the user. In the image 502, the analysis points 301 to 316 are points corresponding to the analysis points 201 to 216 in the image 501, and are set on the image 502, for example, according to the operation of the input unit 11 by the user. Note that the analysis points in the first moving image 191 are referred to as first analysis points. Also, the analysis points in the second moving image 192 are referred to as second analysis points.

[0017] In FIGS. 3 to 6 and FIG. 8, the XYZ axes represent three-dimensional coordinate axes in the real space. Also, in FIG. 6, the XI1ZI1 axes represent two-dimensional pixel coordinate axes in the image 501. Also, in FIG. 8, the XI2ZI2 axes represent two-dimensional pixel coordinate axes in the image 502.

[0018] In the present embodiment, as shown in FIGS. 4 and 5, the first moving image 191 is a moving image obtained by installing the imaging device 2 at the first imaging position P1 and imaging the measurement target 3 in the imaging direction D1 from the front of the measurement target 3. The second moving image 192 is obtained by moving the imaging device 2 from the first position P1 to the second imaging position P2 that is horizontally moved at the same height in the vertical direction (Z direction), and imaging the measurement target 3 in the imaging direction D2 from an oblique direction of the measurement target 3. In this case, the deviation of each distance from the first imaging position P1 to a plurality of analysis points is within a predetermined range. That is, the variation is small. The angle difference between the imaging direction D1 from the first imaging position P1 to each analysis point (for example, analysis point 208) and the imaging direction D2 from the second imaging position P2 to each analysis point (for example, analysis point 308) is approximately a right angle. Also, each analysis point 304 to 316 can be recognized in the second moving image 192. In this case, the displacement in the XI2-axis direction in the second moving image 192 can be regarded as being approximately in the Y direction.

[0019] As shown in FIGS. 7 and 9, for each of the first analysis points 201 to 216 and each of the second analysis points 301 to 316 photographed from two different directions, in the vertical direction (Z direction), the pixel coordinate axes ZI1 and ZI2 on the image are in the same direction. FIG. 7 schematically shows the correspondence between the first analysis points 201 to 216, the XYZ axes, and the XI1ZI1 axes. FIG. 8 schematically shows the correspondence between the second analysis points 301 to 316, the XYZ axes, and the XI2ZI2 axes. As shown in FIG. 7, in the first moving image 191 (image 501), the vibration mode in the XZ direction can be grasped. Also, as shown in FIG. 9, in the second moving image 192 (image 502), the vibration mode in the ZY direction can be grasped. However, for the second moving image 192 (image 502), as shown in FIG. 4, it is photographed not from the X direction but from a direction slightly oblique to the X direction. Therefore, the vibration mode in the Y direction is grasped in a state including the influence of the vibration mode in the X direction. The oblique angle should be such that each of the analysis points 301 to 316 can be individually recognized (not overlapping on the image), the oblique angle should be as shallow as possible (to the extent that the Y-direction displacement can be treated as being approximately the same when geometrically orthogonal to the front), and within a sufficient displacement resolution range (where displacement analysis by the image is sufficiently possible). In this case, the displacement in the XI2 direction on the second moving image 192 (image 502) can be regarded as the displacement in the Y direction.

[0020] Therefore, based on the first moving image 191, the displacement calculation unit 13 calculates, as the first displacement, the displacement component in the X direction based on the displacement component in the XI1 direction of the first analysis points 201 to 216, which are the analysis points on the measurement target 3 in the first moving image 191, and calculates the displacement component in the Z direction based on the displacement component in the ZI1 direction. Also, based on the second moving image 192, the displacement calculation unit 13 calculates, as the second displacement, the displacement component in the Y direction based on the displacement component in the XI2 direction of the second analysis points 301 to 316, which are the analysis points on the measurement target 3 in the second moving image 192, and calculates the displacement component in the Z direction based on the displacement component in the ZI2 direction.

[0021] In addition, the frequency analysis unit 14 performs frequency analysis on the first displacement of the components (components in the Z direction) that are in the same direction in the first moving image and the second moving image to calculate the vibration mode. Further, the frequency analysis unit 14 performs frequency analysis on the second displacement of the components (components in the Z direction) that are in the same direction in the first moving image and the second moving image to calculate the vibration mode.

[0022] In addition, the ratio calculation unit 15 calculates the ratio between the component of the first displacement (displacement component in the ZI1 direction) and the component of the second displacement (displacement component in the ZI2 direction) for the same vibration mode of the components in the same direction (in this case, the components in the Z direction) in the first moving image 191 and the second moving image 192. When the measurement object 3 is photographed obliquely from the second photographing position P2, the distances from the photographing device 2 to each of the measurement points 101 to 116 are different for each measurement point. In this case, for example, the closest measurement point 112 is photographed larger than the farthest measurement point 104. Therefore, in the present embodiment, the ratio calculation unit 15 calculates the ratio of each displacement of the Z component in the same direction in the first moving image 191 and the second moving image 192 for each analysis point, and the correction unit 16 corrects the difference in the size (displacement sensitivity) in the depth direction based on this ratio.

[0023] The ratio calculation unit 15 calculates, for example, the ratio of the displacement in the ZI1 direction of the analysis point 201 and the displacement in the ZI2 direction of the analysis point 301 corresponding to the analysis point 201 as the ratio at the analysis point 201 and the analysis point 301. For example, if the displacement in the ZI1 direction of the analysis point 201 is Z1 and the displacement in the ZI2 direction of the analysis point 301 corresponding to the analysis point 201 is Z2, the ratio is obtained as Z1 / Z2 or Z2 / Z1. The value of the displacement can be, for example, the amplitude value, the peak value, the effective value, etc.

[0024] The correction unit 16 corrects at least one of the first displacement and the second displacement based on the ratio between the component of the first displacement and the component of the second displacement for the components in the same direction in the first moving image 191 and the second moving image 192. For example, the correction unit 16 calculates the displacement components X1, Y1, and Z1 in each direction of the analysis point 201 as follows. That is, the displacement component X1 in the X direction of the analysis point 201 is the displacement component X1 in the XI1 direction of the analysis point 201 calculated from the first moving image 191. Also, the displacement component Z1 in the Z direction of the analysis point 201 is the displacement component Z1 in the ZI1 direction of the analysis point 201 calculated from the first moving image 191. Further, the displacement component Y1 in the Y direction of the analysis point 201 is a value obtained by correcting the displacement component X2 in the XI2 direction of the analysis point 301 calculated from the second moving image 192 by the ratio calculated by the ratio calculation unit 15. The correction unit 16 sets the value obtained by multiplying the displacement component X2 in the XI2 direction of the analysis point 301 calculated from the second moving image 192 by the ratio Z1 / Z2 as the displacement component Y1 in the Y direction of the analysis point 201 (Y1 = X2·Z1 / Z2).

[0025] Alternatively, for example, the correction unit 16 calculates the displacement components (X2, Y2, Z2) in each direction of the analysis point 301 as follows. That is, the displacement component X2 in the X direction of the analysis point 301 is a value obtained by correcting the displacement component X1 in the XI1 direction of the analysis point 201 calculated from the first moving image 191 by a ratio. The correction unit 16 sets the value obtained by multiplying the displacement component X1 in the XI1 direction of the analysis point 201 calculated from the first moving image 191 by the ratio Z2 / Z1 as the displacement component X2 in the X direction of the analysis point 301 (X2 = X1·Z2 / Z1). Also, the displacement component Y2 in the Y direction of the analysis point 301 is the displacement component X2 in the XI2 direction of the analysis point 301 calculated from the second moving image 192. Further, the displacement component Z2 in the Z direction of the analysis point 301 is the displacement component Z2 in the ZI2 direction of the analysis point 301 calculated from the second moving image 192.

[0026] Based on the three-dimensional displacement components calculated by the correction unit 16, the vibration analysis unit 17 performs vibration analysis such as eigenvalue analysis for each analysis point and outputs the analysis results from, for example, the output unit 18.

[0027] (Operation example of the vibration measurement system) Next, with reference to FIGS. 2 and 10, an operation example of the vibration measurement system 10 in the present embodiment will be described. In the vibration measurement system 10, first, for example, a user installs the imaging device 2 at the first imaging position P1 and captures a first moving image for a predetermined time (step S101). Next, the user installs the imaging device 2 at the second imaging position P2 and captures a second moving image for a predetermined time (step S102). Next, the acquisition unit 12 acquires the first moving image and the second moving image of the measurement target 3 from the imaging device 2 (step S103). Next, the displacement calculation unit 13 outputs, for example, the image 501 from the output unit 18 and sets a first analysis point in the first moving image 191 (image 501) according to an operation on the input unit 11 (step S104). Next, the displacement calculation unit 13 outputs, for example, the second moving image 192 (image 502) from the output unit 18 and sets a second analysis point in the second moving image 192 (image 502) according to an operation on the input unit 11 (step S105).

[0028] Next, the displacement calculation unit 13 calculates the displacement of the first analysis point based on the first moving image 191 (step S106). Next, the displacement calculation unit 13 calculates the displacement of the second analysis point based on the second moving image 192 (step S107). In step S106, as shown in FIG. 10, for example, the displacement components in the XI1 direction and the ZI1 direction with the horizontal axis as the time axis are calculated based on the first moving image 191. Also, in step S107, as shown in FIG. 10, for example, the displacement components in the XI2 direction and the ZI2 direction with the horizontal axis as the time axis are calculated based on the second moving image 192.

[0029] Next, the frequency analysis unit 14 performs frequency analysis on the first displacement of the components (components in the Z direction) that are in the same direction in the first moving image and the second moving image to calculate the vibration mode (step S108). Further, the frequency analysis unit 14 performs frequency analysis on the second displacement of the components (components in the Z direction) that are in the same direction in the first moving image and the second moving image to calculate the vibration mode (step S109). In step S108, as shown in FIG. 10, for example, a frequency spectrum of the displacement component in the ZI1 direction with the horizontal axis being the frequency is calculated based on the displacement component in the ZI1 direction. In the example shown in FIG. 10, the frequency spectrum of the displacement component in the ZI1 direction includes the i-th vibration mode and the j-th vibration mode (i and j are natural numbers). Also, in step S109, as shown in FIG. 10, for example, a frequency spectrum of the displacement component in the ZI2 direction with the horizontal axis being the frequency is calculated based on the displacement component in the ZI2 direction. In the example shown in FIG. 10, the frequency spectrum of the displacement component in the ZI2 direction includes the i-th vibration mode and the j-th vibration mode.

[0030] Next, the ratio calculation unit 15 calculates the ratio of the component of the first displacement to the component of the second displacement for the same vibration mode of the components (components in the Z direction) that are in the same direction in the first moving image 191 and the second moving image 192 (step S110). In the example shown in FIG. 10, for example, the ratio of the value of the spectrum of the i-th vibration mode of the displacement component in the ZI1 direction to the value of the spectrum of the i-th vibration mode of the displacement component in the ZI2 direction is calculated.

[0031] Next, the correction unit 16 corrects the first displacement or the second displacement based on the ratio to calculate the displacement of each component (step S111). Next, the vibration analysis unit 17 performs vibration analysis based on the displacement of each component (step S112), and the output unit 18 outputs the analysis result (step S113).

[0032] (Function and Effect) According to the present embodiment, a three-dimensional vibration mode can be analyzed and output using a plurality (two or more) of two-dimensional image measurement results. At that time, the shooting positions and shooting directions of the plurality of image measurements can be set relatively easily. Therefore, according to the present embodiment, measurement can be easily performed.

[0033] As described above, in this embodiment, image measurement is performed by a single camera from a plurality of angles. The angles for multiple shootings may be angles where one of the vertical and horizontal directions of the image is regarded as common. The ratio of displacements in two directions within the image plane is calculated from one image. The ratio of similar displacements at the same point can be calculated from a plurality of image data, and a displacement vector can be derived using the displacements in the common direction. By performing the above correction, a three-dimensional vibration mode can be created. In the reference image, it is necessary to face the measurement object directly so that the magnitude of displacement in the image does not differ, or to perform correction considering the distance between the camera and the measurement object. As described above, according to this embodiment, a three-dimensional vibration mode can be analyzed and output using a plurality (two or more) of two-dimensional image measurement results.

[0034] In addition, based on moving images from three or more different shooting directions, for example, not only the front surface but also the back surface and the upper surface may be set with analysis points to perform vibration measurement. In that case, a moving image of the vibration state is taken so that the same analysis point is reflected from each two directions. For example, one is from the front and one is from an oblique direction. The imaging device 2 is installed at a position horizontally moved at the same height. When using image data in two or more directions, the same analysis is possible if there is a combination of an image from the front and an image from an oblique direction. Although multiple results can be obtained at the same analysis point, the error due to measurement and analysis can be minimized by taking the average.

[0035] In addition, as described above, the oblique angle should be such that the analysis points can be individually recognized (not overlapping on the image), the oblique angle should be as shallow as possible (to the extent that the Y-direction displacement can be treated as approximately the same when geometrically orthogonal to the front), and within the range of sufficient displacement resolution (where displacement analysis by the image is sufficiently possible). By the above calculation, the magnitude and phase of the displacement at each analysis point are all considered in the XYZ directions.

[0036] In addition, in the above description, shooting of moving images in two different directions is performed by moving the same imaging device 2, but shooting may also be performed using a plurality of imaging devices.

[0037] Also, when there are a plurality of analysis points and the distance between the first imaging position P1 or the second imaging position P2 and the measurement target 3 is equal to or greater than a certain value, the correction unit 16 can perform correction for the remaining analysis points based on the ratio calculated for some of the analysis points. For example, when the first imaging position P1 is the front with respect to the measurement target 3 and the second imaging position P2 is located on the side with respect to the measurement target 3, when the distance between the second imaging position P2 and the measurement target 3 is equal to or greater than a certain value, there may be a case where the difference in distance to each analysis point can be ignored. In such a case, the correction unit 16 can perform correction for the remaining analysis points based on the ratio calculated for some of the analysis points.

[0038] <Second Embodiment> Next, with reference to FIGS. 11 and 12, a vibration measurement system according to a second embodiment of the present disclosure will be described. FIG. 11 is a schematic diagram showing an example of the arrangement relationship between a measurement target and an imaging device according to the second embodiment of the present disclosure. FIG. 12 is a schematic diagram for explaining an operation example of the vibration measurement system according to the second embodiment of the present disclosure.

[0039] The basic configuration of the vibration measurement system described with reference to FIG. 1 in the first embodiment and the second embodiment is the same. In the first embodiment, the first imaging position P1 is set to a position facing the front of the measurement target 3, for example, and the second imaging position P2 is set to a position with a shallow angle from the direction orthogonal to the front of the measurement target 3. On the other hand, in the second embodiment, the condition of a shallow angle is not required. Also, the processing content of the correction unit 16 shown in FIG. 1 in the second embodiment is partially different from the processing content of the correction unit 16 shown in FIG. 1 in the first embodiment.

[0040] As shown in FIG. 11, in the second embodiment, the difference from the first embodiment is that the displacement measured from the moving image is corrected using the angular difference θ between the shooting direction D1 from the first shooting position P1 to the measurement target 3 (for example, measurement point 117) and the shooting direction D2 from the second shooting position P2 to the measurement target 3 (measurement point 117). That is, in the second embodiment, the first displacement or the second displacement is corrected based on the angular difference θ and the ratio of the displacement in the Z direction for each analysis point calculated in the same manner as in the first embodiment.

[0041] As shown in FIG. 12, the displacement component in the pixel coordinate axis XI1 direction based on the first moving image 191 taken from the first shooting position P1 includes only the displacement component in the X direction. In contrast, the displacement component in the pixel coordinate axis XI2 direction based on the second moving image 192 taken from the second shooting position P2 includes the displacement component in the X direction and the displacement component in the Y direction. Therefore, the correction unit 16 of the second embodiment calculates the displacements of each of the XYZ components based on the ratio calculated by the ratio calculation unit 15 and the angular difference θ.

[0042] The correction unit 16 of the second embodiment calculates the displacement components X1, Y1, and Z1 in each direction of the first analysis point (referred to as analysis point 217) corresponding to the measurement point 117, for example, as follows. It is assumed that the displacement component in the XI1 direction of the analysis point 217 calculated by the displacement calculation unit 13 is X1, and the displacement component in the ZI1 direction is Z1. Also, it is assumed that the displacement component in the XI2 direction of the second analysis point (referred to as analysis point 317) corresponding to the analysis point 217 is X2, and the displacement component in the ZI2 direction is Z2. In this case, the ratio calculation unit 15 calculates Z2 / Z1 as the ratio for the analysis point 217.

[0043] The correction unit 16 of the second embodiment first calculates the influence of the displacement X1 in the XI1 direction on the displacement X2 in the XI2 direction. At this time, the correction unit 16 grasps the influence including the displacement and phase in the ZI1 direction and the displacement and phase in the ZI2 direction.

[0044] Next, the correction unit 16 subtracts the influence of the displacement X1 in the XI1 direction from the displacement X2 in the XI2 direction, taking into account the displacement and phase in the ZI1 direction and the displacement and phase in the ZI2 direction. Here, the value obtained by subtracting the influence of the displacement X1 in the XI1 direction from the displacement X2 in the XI2 direction is defined as X2c.

[0045] Next, the correction unit 16 calculates the displacement component Y1 of the first analysis point 217 in the Y direction from the value X2c using the equation Y1=X2c / sin θ.

[0046] The angular difference θ is input to the processing device 1 by operating the input unit 11, for example, as a measured value by the user. When the angular difference θ is close to 90 degrees, this corresponds to the arrangement of the image capturing device 2 in the first embodiment.

[0047] In the second embodiment, in addition to the effects achieved by the first embodiment, the angle of the oblique image measurement position is clarified, thereby improving the analysis accuracy. Compared to the first embodiment, the second embodiment provides a greater degree of freedom in the imaging position, thereby improving the analysis accuracy and shortening the analysis time.

[0048] <Third embodiment> Next, a vibration measuring system according to a third embodiment of the present disclosure will be described with reference to Fig. 13. Fig. 13 is a block diagram showing an example of the configuration of the vibration measuring system according to the third embodiment of the present disclosure.

[0049] 13, a processing device 1a included in a vibration measuring system 10a according to the third embodiment differs from those of the first and second embodiments in that a storage unit 19 stores a three-dimensional model (three-dimensional design model) 193 of the measurement target 3, and a ratio calculation unit 15a calculates the ratio using the three-dimensional model 193. The other configurations are the same as those of the first or second embodiment.

[0050] In the third embodiment, by grasping the positional relationship of the measurement points and the camera shooting position (angle), the analysis of each of the above embodiments becomes easier. It is possible to obtain information (coordinate information) on the measurement point positions by utilizing advance planning, a three-dimensional measurement device for distances and directions such as LIDAR (Laser Imaging Detection And Ranging), or 3DCAD (3D Computer Aided Design). Furthermore, by reflecting the installation position (coordinate information) and shooting angle of the camera in 3DCAD or the like, the angle difference θ and the ratio at the time of correction can be calculated. By using a program that automatically corrects by inputting them, image data can be instantaneously analyzed and a three-dimensional vibration mode can be derived.

[0051] In the third embodiment, for example, based on an image measurement plan, 3DCAD or the like is utilized to obtain coordinate information on the analysis point, the camera position, the shooting angle of the camera, the distance between the camera and the measurement point, and the like. Then, using these, a three-dimensional displacement at the analysis point is derived by a program that calculates and analyzes correction rates and the like in each image data. By executing a vibration analysis program using the measurement images, a vibration mode can be obtained. Note that there may be a plurality of combinations of the images of the first moving image 191 and the second moving image 192, and by implementing on the back side or side surface of the measurement object, etc., it can be applied even to a structure with a complex shape. At that time, a node shared between each combination data is necessary (not necessary if the distance from the reference point to the camera is the same).

[0052] In the third embodiment, the input unit 11 inputs at least one of the coordinate information of the first shooting position P1, information indicating the shooting angle at the first shooting position P1, information indicating the distance from the first shooting position P1 to the measurement object 3, and information specifying the analysis point on the measurement object 3, and at least one of the coordinate information of the second shooting position P2, information indicating the shooting angle at the second shooting position P2, and information indicating the distance from the second shooting position P2 to the measurement object 3. Further, the ratio calculation unit 15a calculates the above-described ratio based on the information acquired by the acquisition unit 12 and the information input by the input unit 11 using the three-dimensional space including the three-dimensional model 193 of the measurement object 3.

[0053] According to the third embodiment, labor saving can be achieved more than in the first and second embodiments.

[0054] <Fourth Embodiment> Next, with reference to FIG. 14, a vibration measurement system according to a fourth embodiment of the present disclosure will be described. FIG. 14 is a block diagram showing a configuration example of the vibration measurement system according to the fourth embodiment of the present disclosure.

[0055] The processing device 1b included in the vibration measurement system 10b according to the fourth embodiment shown in FIG. 14 is different from the first and second embodiments in that the storage unit 19 stores the three-dimensional model 193 and the finite element method analysis model 194 of the measurement target 3, and the ratio calculation unit 15a calculates the ratio using the three-dimensional model 193 in the same manner as in the third embodiment, and further includes an optimization unit 20. Other configurations are the same as those in the first or second embodiment. The finite element method analysis model 194 is a vibration analysis model generated based on the three-dimensional model 193. The optimization unit 20 changes, for example, the boundary conditions of the finite element method analysis model 194 so as to match the vibration analysis result of the measurement target 3 by the vibration analysis unit 17.

[0056] The vibration measurement system 10b according to the fourth embodiment reflects the data obtained in the first to third embodiments in the analysis data (eigenvalue analysis result) of FEM (finite element method). For example, the optimization unit 20 performs optimization of the analysis model (optimization of boundary conditions, etc.) using the three-dimensional displacement at multiple points.

[0057] According to the fourth embodiment, labor saving can be achieved more than in the first to third embodiments. In addition, the analysis model can be optimized using the image measurement data.

[0058] <Fifth Embodiment> Next, with reference to FIGS. 15 to 17, a vibration measurement system according to the fifth embodiment of the present disclosure will be described. FIG. 15 is a block diagram showing a configuration example of the vibration measurement system according to the fifth embodiment of the present disclosure. FIG. 16 is a schematic diagram showing an example of a first moving image according to the fifth embodiment of the present disclosure. FIG. 17 is a schematic diagram showing an example of a vibration model M3 corresponding to a second moving image according to the fifth embodiment of the present disclosure.

[0059] As shown in FIG. 14, in the vibration measurement system 10c according to the fifth embodiment, a plurality of three-dimensional accelerometers 41 and 42 are installed on the measurement object 3. As shown in FIGS. 16 and 17, for example, the accelerometer 41 is installed at the measurement point 401 corresponding to the analysis point 204. Further, the accelerometer 42 is installed at the measurement point 402 corresponding to the analysis point 212. Note that FIG. 16 schematically shows a display example at the output unit 18 of the image 503 of one frame in the first moving image 191.

[0060] In the processing device 1c in the fifth embodiment, the acquisition unit 12c further acquires information indicating the accelerometer measurement results, which are the results of measuring the acceleration at a plurality of measurement points 401 and 402 on the measurement object 3. The acquisition unit 12c stores the information indicating the acquired accelerometer measurement results in the storage unit 19 as the accelerometer measurement results 195. Further, the displacement calculation unit 13 calculates each displacement for a plurality of analysis points 201 to 216 and 301 to 316 in the first moving image 191 and the second moving image 192, which are more than the number of measurement points 401 and 402 at which the acceleration is measured. Further, the correction unit 16c corrects each displacement based on the accelerometer measurement results 195 and the respective accelerations corresponding to the analysis points 201 to 216 and 301 to 316 obtained by interpolating the accelerometer measurement results.

[0061] In the first to fourth embodiments, the depth correction was performed from the image measurement results. In the fifth embodiment, instead, three-dimensional vibration mode analysis is enabled by analyzing the image measurement data using a small number of accelerometer measurement results. In the fifth embodiment, correction using acceleration data is performed, and a three-dimensional vibration mode can be constructed.

[0062] Each of the accelerometers 41 and 42 acquires the acceleration in the three directions XYZ. At this time, for example, let the acceleration of the front accelerometer 42 at the peak frequency be (AX1, AY1, AZ1). Note that the acceleration at the peak frequency is targeted because when the acceleration is large, the influence of noise is small and the error is small. Also, let the acceleration of the rear accelerometer 41 be (AX2, AY2, AZ2). These are measured by actual measurement and are correct numerical values.

[0063] Next, in image measurement, the displacements of the analysis points 204, 212, 304, and 305 at the same accelerometer positions in image measurement are measured. Let the displacement of the rear be (DX1, DY1, DZ1) and the displacement of the front be (DX2, DY2, DZ2). In 2D image measurement, the displacement is calculated considering the sensitivity of the displacement amount with respect to the screen based on the distance from the camera to the reference point. Since the displacement of the front closer to the reference point is closer to the camera, the displacement appears larger than the actual value, and since the displacement of the rear farther from the reference point is farther from the camera, the displacement appears smaller than the actual value.

[0064] Also, the relationship between acceleration and displacement is acceleration = (2πf) 2 × displacement (f: frequency). The coefficient for correctly correcting the displacement of the front is A1 / ((2πf) 2 × D1). The coefficient for correctly correcting the displacement of the rear is A2 / ((2πf) 2 × D2). Here, A1 is (AX1, AY1, AZ1). A2 is (AX2, AY2, AZ2). D1 is (DX1, DY1, DZ1). D2 is (DX2, DY2, DZ2). The correction coefficient between these is linearly interpolated according to the depth distance. Also, by multiplying the displacement obtained by image measurement by the above correction coefficient, the influence of the displacement due to depth is corrected.

[0065] As shown in FIG. 17, in the fifth embodiment, correct displacements considering the depth in the YZ direction are calculated. Also, as shown in FIG. 7, the displacements of XZ measured from the front are output. Therefore, by outputting all the displacements of XYZ, a three-dimensional vibration mode can be output. Note that in the example shown in FIG. 7, even if images are measured not only from the front but also from diagonals at different angles as in FIG. 17 and corrected with acceleration data, the same analysis is possible.

[0066] According to the fifth embodiment, the accuracy is further improved, and a three-dimensional vibration mode can be obtained from the two-dimensional image measurement results.

[0067] (Other embodiments) As described above, the embodiments of the present disclosure have been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and design changes and the like within the scope not departing from the gist of the present disclosure are also included. For example, in the above embodiment, the ratio calculation unit 15 calculates the ratio of the component of the first displacement and the component of the second displacement for the components of the same vibration mode in the same direction in the first moving image 191 and the second moving image 192. However, for example, when the same vibration periodically occurs in the measurement target 3 in the first moving image 191 and the second moving image 192 (for example, when the vibration frequency is the same and the vibration level during measurement is constant), the ratio may be calculated from the first displacement and the second displacement in the same direction in the first moving image 191 and the second moving image 192.

[0068] 〈Computer configuration〉 FIG. 18 is a schematic block diagram showing the configuration of a computer according to at least one embodiment. The computer 90 includes a processor 91, a main memory 92, a storage 93, and an interface 94. The above-described processing devices 1, 1a, 1b, and 1c are implemented in a computer 90. The operations of the respective processing units described above are stored in a storage 93 in the form of a program. The processor 91 reads the program from the storage 93, expands it in the main memory 92, and executes the above processing according to the program. Further, the processor 91 secures a storage area corresponding to each of the above-described storage units in the main memory 92 according to the program.

[0069] The program may be for realizing a part of the functions to be exhibited by the computer 90. For example, the program may exhibit functions in combination with other programs already stored in the storage, or in combination with other programs implemented in other devices. In other embodiments, the computer may include a custom LSI (Large Scale Integrated Circuit) such as a PLD (Programmable Logic Device) in addition to or instead of the above configuration. Examples of PLDs include PAL (Programmable Array Logic), GAL (Generic Array Logic), CPLD (Complex Programmable Logic Device), FPGA (Field Programmable Gate Array), and the like. In this case, some or all of the functions realized by the processor may be realized by the integrated circuit.

[0070] Examples of the storage 93 include an HDD (Hard Disk Drive), an SSD (Solid State Drive), a magnetic disk, a magneto-optical disk, a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), a semiconductor memory, and the like. The storage 93 may be an internal medium directly connected to the bus of the computer 90, or may be an external medium connected to the computer 90 via the interface 94 or a communication line. Further, when this program is distributed to the computer 90 via a communication line, the computer 90 that has received the distribution may expand the program in the main memory 92 and execute the above processing. In at least one embodiment, the storage 93 is a non-transitory tangible storage medium.

[0071] <Appendix> The processing apparatuses 1, 1a, 1b, and 1c described in each embodiment are understood as follows, for example.

[0072] (1) The processing apparatuses 1, 1a, and 1b according to the first aspect include an acquisition unit 12 that acquires information indicating a first moving image 191 obtained by photographing the measurement target 3 at a first photographing position P1 and information indicating a second moving image 192 obtained by photographing the measurement target 3 at a second photographing position P2 different from the first photographing position P1, a displacement calculation unit 13 that calculates a first displacement, which is a displacement of first analysis points 201 to 216, which are analysis points on the measurement target 3 in the first moving image, based on the first moving image 191, and calculates a second displacement, which is a displacement of second analysis points 301 to 316, which are analysis points on the measurement target 3 corresponding to the first analysis points in the second moving image, based on the second moving image 192, and a correction unit 16 that corrects at least one of the first displacement or the second displacement based on a ratio between the component of the first displacement and the component of the second displacement for components in the same direction in the first moving image and the second moving image. According to this aspect and the following aspects, measurement can be easily performed.

[0073] (2) The processing devices 1, 1a, and 1b according to the second aspect are the processing devices of (1), and the correction unit 16 corrects at least one of the first displacement or the second displacement based on the ratio between the component of the first displacement and the component of the second displacement for the components of the same vibration mode that are in the same direction in the first moving image and the second moving image. According to this aspect, each component can be accurately corrected without being affected by the vibration state.

[0074] (3) The processing devices 1, 1a, and 1b according to the third aspect are the processing devices of (1) or (2), and the deviation of each distance from the first imaging position P1 to the plurality of analysis points is within a predetermined range, the angle difference between the imaging direction from the first imaging position P1 to each analysis point and the imaging direction from the second imaging position P2 to each analysis point is substantially a right angle, and each of the analysis points 304 to 316 can be recognized in the second moving image 192. According to this aspect, the displacement in the horizontal direction for the image calculated based on the second moving image 192 can be regarded as the displacement in the depth direction in the first moving image 191.

[0075] (4) The processing devices 1, 1a, and 1b according to the fourth aspect are the processing devices of (1) to (3), and when there are a plurality of the analysis points and the distance between the first imaging position or the second imaging position and the measurement object is a certain value or more, the correction unit 16 performs correction for the remaining analysis points based on the ratio calculated for some of the analysis points.

[0076] (5) The processing devices 1, 1a, and 1b according to the fifth aspect are the processing devices of (1) to (4), and the correction unit 16 corrects at least one of the first displacement or the second displacement based on the angle difference between the imaging direction from the first imaging position to the first analysis point and the imaging direction from the second imaging position to the second analysis point, and the ratio. According to this aspect, the first imaging position P1 and the second imaging position P2 can be easily set.

[0077] (6) The processing device 1c according to the sixth aspect is the processing device of (1) to (5), wherein the acquisition unit 12c further acquires information indicating an acceleration measurement result which is a result of measuring acceleration at a plurality of measurement points on the measurement target 3, the displacement calculation unit 13 calculates each displacement for a plurality of the analysis points in the first moving image and the second moving image that is more than the number of measurement points at which the acceleration is measured, and the correction unit 16c corrects each displacement based on the acceleration measurement result and each acceleration corresponding to each analysis point obtained by interpolating the acceleration measurement result. According to this aspect, the accuracy can be further improved.

[0078] (7) The processing devices 1a and 1b according to the seventh aspect are the processing devices of (1) to (6), and further include an input unit 11 that inputs at least one of the coordinate information of the first shooting position, the information indicating the shooting angle at the first shooting position, the information indicating the distance to the measurement target at the first shooting position, and the information specifying the analysis point on the measurement target, and at least one of the coordinate information of the second shooting position, the information indicating the shooting angle at the second shooting position, and the information indicating the distance to the measurement target at the second shooting position, and a ratio calculation unit 15a that calculates the ratio based on the information acquired by the acquisition unit 12 and the information input by the input unit 11 using a three-dimensional space including the three-dimensional model 193 of the measurement target.

[0079] (8) The processing device 1b according to the eighth aspect is the processing device of (7), and further includes an optimization unit 20 that optimizes the boundary conditions of the finite element method analysis model 194 corresponding to the three-dimensional model based on the corrected displacement.

[0080] (9) The processing devices 1, 1a, 1b, and 1c according to the ninth aspect are the processing devices of (1) to (8), and the first moving image and the second moving image are taken by moving the same imaging device 2.

Explanation of Reference Numerals

[0081] 10, 10a, 10b, 10c Vibration measurement system 1, 1a, 1b, 1c Processing device 2 Imaging device 3 Measurement target 11 Input unit 12, 12c Acquisition unit 13 Displacement calculation unit 15, 15a Ratio calculation unit 16, 16c Correction unit 17 Vibration analysis unit 18 Output unit 19 Memory unit 20 Optimization unit

Claims

1. An acquisition unit that acquires information indicating a first moving image obtained by photographing a measurement target at a first photographing position and information indicating a second moving image obtained by photographing the measurement target at a second photographing position different from the first photographing position; A displacement calculation unit that calculates a first displacement, which is a displacement of a first analysis point that is an analysis point on the measurement target in the first moving image, based on the first moving image, and calculates a second displacement, which is a displacement of a second analysis point that is an analysis point on the measurement target corresponding to the first analysis point in the second moving image, based on the second moving image; A correction unit that corrects at least one of the first displacement and the second displacement based on a ratio between the component of the first displacement and the component of the second displacement for components in the same direction in the first moving image and the second moving image A processing device comprising the above.

2. The correction unit corrects at least one of the first displacement and the second displacement based on a ratio between the component of the first displacement and the component of the second displacement for components of the same vibration mode that are in the same direction in the first moving image and the second moving image The processing device according to Claim 1.

3. The deviation of each distance from the first photographing position to the plurality of analysis points is within a predetermined range, the angular difference between the photographing angle from the first photographing position to each analysis point and the photographing angle from the second photographing position to each analysis point is substantially a right angle, and each analysis point can be recognized in the second moving image The processing device according to Claim 1 or 2.

4. When there are a plurality of the analysis points and the distance between the first photographing position or the second photographing position and the measurement target is equal to or greater than a certain value, The correction unit performs correction for the remaining analysis points based on the ratio calculated for some of the analysis points The processing device according to any one of Claims 1 to 3.

5. The correction unit corrects at least one of the first displacement and the second displacement based on the angular difference between the photographing direction from the first photographing position to the first analysis point and the photographing direction from the second photographing position to the second analysis point and the ratio The processing device according to any one of Claims 1 to 4.

6. The acquisition unit further acquires information indicating an acceleration measurement result, which is a result of measuring acceleration at a plurality of measurement points on the measurement target, The displacement calculation unit calculates each displacement for a plurality of the analysis points in the first moving image and the second moving image, which are more than the number of measurement points at which the acceleration was measured, The correction unit corrects each of the displacements based on the acceleration measurement result and each acceleration corresponding to each analysis point obtained by interpolating the acceleration measurement result. The processing device according to any one of claims 1 to 5.

7. An input unit that inputs at least one of the coordinate information of the first shooting position, information indicating the shooting angle at the first shooting position, information indicating the distance to the measurement target at the first shooting position, and information specifying an analysis point on the measurement target, and at least one of the coordinate information of the second shooting position, information indicating the shooting angle at the second shooting position, and information indicating the distance to the measurement target at the second shooting position; A ratio calculation unit that calculates the ratio based on the information acquired by the acquisition unit and the information input by the input unit using a three-dimensional space including a three-dimensional model of the measurement target. The processing device according to any one of claims 1 to 6, further comprising.

8. An optimization unit that optimizes the boundary conditions of the finite element method analysis model corresponding to the three-dimensional model based on the corrected displacement. The processing device according to claim 7, further comprising.

9. The first moving image and the second moving image are taken by moving the same imaging device. The processing device according to any one of claims 1 to 8.

10. A step of acquiring information indicating a first moving image obtained by shooting a measurement target at a first shooting position and information indicating a second moving image obtained by shooting the measurement target at a second shooting position different from the first shooting position; A step of calculating a first displacement that is the displacement of a first analysis point that is an analysis point on the measurement target in the first moving image based on the first moving image, and calculating a second displacement that is the displacement of a second analysis point that is an analysis point on the measurement target corresponding to the first analysis point in the second moving image based on the second moving image; A step of correcting at least one of the first displacement or the second displacement based on a ratio between the component of the first displacement and the component of the second displacement for components that are in the same direction in the first moving image and the second moving image. A processing method including.

Images