Method and system for generating augmented reality representation of vibratory deformation of structure

Abstract

The invention relates to a method for generating an augmented reality representation of a vibrational deformation of a structure, using positions of at least two vibrating sensor elements in the structure to generate a reference graphical virtual representation, and using vibration data of the sensor elements to animation the reference graphical virtual representation. The generated animated graphic virtual representation is superimposed on the captured image of the structure, generating a combined image that allows perceiving vibrational deformations experienced by the structure.

Description

Technical Field

[0001] The present invention relates to a method for generating an augmented reality representation of a vibration deformation of a structure, such as a piece of equipment or a group of equipment, which vibrates during its operation. Background Art

[0002] Augmented reality (AR) is a technology that can represent images or virtual graphic objects on images captured in a real environment. This technology has applications in various technological fields.

[0003] In medicine, for example, this technology is used to train doctors who can analyze and interact with virtual objects in real environments. In marketing, augmented reality allows consumers to experience product activities in three dimensions. In retail, AR allows consumers to visualize virtual representations of consumer products in the place where they will be used, whether in their home or in the environment of a part of their own body.

[0004] Document US7,787,992 shows an example of using augmented reality in industrial processes. In the solution described in this document, a specific virtual graphic associated with a piece of equipment or device and stored in the system is combined with the associated equipment or device after being identified by the recognition system, so that the real image of the object and the stored virtual image associated with the object can be combined and displayed later. The proposed system is used to generate a human-machine interface for monitoring or controlling devices and equipment.

[0005] Another example of an augmented reality solution applied to the industrial sector is described in document DE10120574. This document shows a system and method for information representation, wherein the system includes a context browser allowing access to an extensive database. Thus, depending on the spatial context and using the AR system, the system provides a user interface with context-relevant information and functions.

[0006] Well-known solutions for applying AR in industrial fields often have great complexity, require high computational costs and / or use large databases. Summary of the invention

[0007] Purpose of the invention

[0008] The invention proposes a method for generating an augmented reality representation of a vibrating deformation of a structure, which involves a technical solution of lower complexity and cost compared to the known solutions of the prior art.

[0009] Another object of the present invention is to provide a method for generating an augmented reality representation of a vibration deformation of a structure, which method allows a user to intuitively perceive the characteristics of the vibration deformation experienced by the structure.

[0010] Yet another object of the present invention is to provide a method for generating an augmented reality representation of a vibration deformation of a structure which does not require the creation of a three-dimensional representation of the structure to be analyzed.

[0011] Yet another object of the present invention is to provide a method for generating an augmented reality representation of a vibrating deformation of a structure which does not require altering the pixels of a captured image of the structure.

[0012] It is a further object of the present invention to provide a method for generating an augmented reality representation of a vibrating deformation of a structure which does not require the user to have prior knowledge of programming and / or the physics of vibration.

[0013] Another object of the invention is to provide a method for generating an augmented reality representation of the vibration deformations of a structure, which method allows the analysis to be performed during normal operation of the equipment of the structure, without the need to generate forced impacts on the structure.

[0014] Brief description of the invention

[0015] The present invention achieves these and other objects by a method for generating an augmented reality representation of a vibratory deformation of a structure, the method comprising:

[0016] Arranging at least two vibration sensor elements at different locations of the structure;

[0017] capturing an image of the structure before or after the step of arranging the at least two vibration sensor elements;

[0018] indicating said positions of said at least two vibration sensor elements in said captured image;

[0019] generating a reference graphical virtual representation based on the positions indicated for the at least two vibration sensor elements;

[0020] performing at least two vibration measurements by the vibration sensor;

[0021] animating the reference graphical virtual representation to reflect the vibration measurements performed, generating an animated graphical virtual representation;

[0022] superimposing said animated graphical virtual representation on said captured image of said structure to generate a combined image; and

[0023] The combined image is displayed.

[0024] In an embodiment of the invention, the captured image is a static image (such as a photograph) of the structure or a single frame of a video image. In an alternative embodiment of the invention, the captured image is a video image of the structure.

[0025] The reference graphical representation is preferably a 2D representation, the generation of which requires low computational processing power.

[0026] In an embodiment of the invention, the step of indicating the positions of at least two vibration sensor elements in a captured image is performed in an interface device having a screen.

[0027] The vibration sensor element used by the invention preferably comprises vibration sensors that perform measurement by means of voltage variations proportional to the vibrations, and the step of animating the graphical virtual representation is performed based on the voltage variations measured by at least two vibration sensors.

[0028] The present invention also contemplates an augmented reality representation of a vibration deformation of a structure, comprising:

[0029] at least two vibration sensor elements disposed at different locations of the structure;

[0030] an image capture device for capturing an image of the structure;

[0031] a user interface that receives an indication of a position of the at least two vibration sensor elements;

[0032] processing means for receiving data measured by the vibration sensor element as an indication of its position in the image and for creating a reference graphical virtual representation based on these received data;

[0033] wherein the processing means generates an animated graphical virtual representation reflecting vibration measurements performed by the vibration sensor element and superimposes the animated graphical virtual representation on the captured image of the structure to create a combined image; and

[0034] The display device is used to display the combined image.

[0035] The processing device is preferably (but not limited to) a remote processing device, whereby the vibration information generated by the at least two vibration sensor elements reaches the remote processing device via a measurement acquisition device that communicates with the sensor and can access the Internet. The capture device and the display device and the user interface can also be connected to the processing device by accessing the Internet.

[0036] In a preferred embodiment of the present invention, at least two vibration sensors preferably communicate by means of a wireless network communication having the capability of exchanging information in real time.

[0037] Knowing that the amplitude of the signals captured by the at least two sensors may not be sufficient to create a user-visible virtual representation of the animation graphic, the present invention may use amplification of each measurement point to better visualize the animation.

[0038] In an embodiment of the present invention, means for image capture, collection and display of vibration data measurements and a user interface are integrated into a single piece of equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The present invention will be described in more detail below with reference to the accompanying drawings, in which:

[0040] Figure 1 - shows an example structure in which the method according to the invention for generating a vibro-deformed augmented reality representation is applied;

[0041] Figure 2 - schematically shows an augmented reality representation of a vibration deformation obtained according to the method of the invention;

[0042] Figure 3 - schematically shows another augmented reality representation of a vibration deformation obtained according to the method of the invention. DETAILED DESCRIPTION

[0043] The following will be based on Figures 1 to 3 The embodiment schematically shown in Figure 4 describes a method according to the invention for generating an augmented reality representation of a vibration deformation of a structure.

[0044] Figure 1 An example of a structure 1 to which the method according to the invention can be applied is shown. In the example shown, the structure 1 comprises two motors 2, 3 mechanically connected to each other, between which a structural element 4 is arranged. The sensor 6 is a device responsible for measuring vibrations. Of course, a person skilled in the art will understand that the structure 1 can be any structure that vibrates during its operation, such as, for example, a piece of equipment or a group of equipment. Furthermore, the location of the sensor does not interfere with the final result of the invention.

[0045] Excessive vibration of a structure can lead to several inconveniences ranging from excessive noise to operational failures. The present invention proposes a method to make vibration patterns and motions more easily visualized, allowing for visual perception of characteristics of the vibration deformations such as intensity and direction.

[0046] The visualization in augmented reality provided by the method of the invention allows even non-expert users to have a correct perception of vibration deformations, enabling the user to identify adjustment or maintenance needs of the analyzed equipment.

[0047] The method according to the invention is based on superimposing a virtually created image onto a real image of the structure to be analyzed, captured by an image capturing device. The image capturing device may be any known type of device, such as a camera, a camcorder, a security camera, a smartphone or tablet with a camera, or any other type of image capturing device, whether dedicated or not.

[0048] The method according to the invention uses at least two vibration sensor elements to be arranged in the structure. The vibration sensor elements may be of any suitable type. In an embodiment of the invention, the vibration sensor is a WEG Motor sold by WEG Equipamentos Elétricos SA. Monitor the portion of the device.

[0049] At least two vibration sensor elements are arranged in the structure to be analyzed. Figures 1 to 3 In the exemplary embodiment of , four vibration sensors 6 are arranged at points P0 , P1 , P2 and P3 .

[0050] Thus, in an embodiment of the method of the present invention, the image capturing is performed after the sensor is arranged. However, it will be appreciated that in alternative embodiments the sensor element may be arranged after the actual image of the structure is captured.

[0051] After capturing the image, the user must indicate the position of the vibration sensor element in the captured image. This can be achieved through any suitable interface, such as a touch screen of the image capture device itself, a separate interface of the image capture device, a computer, a smartphone or a tablet.

[0052] User-specified locations mark reference points for vibration deformations and allow creation of reference graphical virtual representations.

[0053] It should be emphasized that the reference graphical representation is not necessarily a graphical representation of the structure to be analyzed, but an image allowing a characteristic visualization of the vibration deformations to which the structure is subjected.

[0054] exist Figure 2 and Figure 3 In the image shown, the reference graphic virtual representation is formed by a straight line 5 connecting the points P0, P1, P2 and P3. Thus, in the embodiment shown in the figures, the graphic representation is a 2D image, the generation of which requires less computational effort. However, in alternative embodiments of the invention, the graphic representation may be, for example, a three-dimensional image.

[0055] The vibration sensor element is preferably (but not limited to) a vibration measurement sensor operating by a voltage variation proportional to the vibration. The measurements performed are used to animate the reference graphical virtual representation, generating an animated graphical virtual representation to be superimposed on the captured image.

[0056] In an embodiment of the method of the invention, the animation of the animated graphical virtual representation is generated by displacement of an indication point of the position of the vibration sensor relative to a reference graphical virtual representation.

[0057] Therefore, in Figure 2 and Figure 3In an exemplary embodiment of the invention, the animation virtually represented by the animated graphic is one in which points P1 and P2 have a larger displacement, while points P0 and P3 do not actually move, because the vibration displacement of points P0 and P3 is proportionally much smaller than that of points P1 and P2, and therefore, the lines connecting points P0 and P1, P1 and P2, and P2 and P3 are "driven" to move by the displacement of points P1 and P2.

[0058] In a preferred embodiment of the invention, the displacements of points P1, P2, P3 and P4 are proportional to the voltage changes measured by the vibration sensor at these points. These displacements are identified by the frequency of the vibrating motion. Once the frequency of the vibration is defined, it is sufficient to identify the peak or amplitude of the change and use it to animate the points. The frequency of the vibration is also a feature extracted from the voltage data measured by the vibration sensor by processing the voltage data measured from the vibration sensor in a data processing device. The relative direction (or phase) between the deformations measured at points P0, P1, P2 and P3 is also extracted from the measured data by processing in the data processing device. The extraction of the relative direction is possible because the measurements are made at the same time and are therefore synchronized. In this way, it is known that point P1 moves in the same direction as point P2 and vice versa.

[0059] Therefore, in one embodiment of the invention, the method comprises the step of synchronizing the sensors before the measurement starts. The synchronization may be achieved by connecting the sensors to each other so that the measurement starts substantially at the same time.

[0060] However, it should be emphasized that the measuring sensor element does not measure the displacement of the structure itself during vibration. The displacement of the previously mentioned points is a characteristic of the animation generated by the voltage changes measured in the sensor, not of the displacement of the structure itself.

[0061] In the context of the present invention, the term "proportional" may indicate an amplified ratio, where the displacement of a point relative to the measured value of the voltage change is exaggerated so that it can be used to better visualize and perceive the vibration deformation in the animation.

[0062] In an embodiment of the invention, data from vibration measurements is sent to the cloud, and the processing and handling of the data for generating the reference graphical virtual representation and the animated graphical virtual representation is performed remotely. However, other data processing means may be used, such as processing means embedded in the device itself.

[0063] The forwarding of the data from the vibration measurement can take place via the measurement acquisition device.

[0064] The animated graphical virtual representation is superimposed on the captured image of the structure and the resulting combined image is displayed in a display device.

[0065] The display device can be a dedicated device, such as a monitor set up in a workshop, or a multi-function device such as a smartphone, tablet, laptop or computer.

[0066] The capture, indication and display devices may be combined into a single device or separate devices. Such a device may communicate with the data processing means for generating the virtual image and may also communicate with the vibration sensor element, preferably in a wireless manner.

[0067] In a preferred embodiment of the method of the invention, the image of the structure to be analyzed is a static image of the structure, for example a single frame such as a photograph or a video image.

[0068] This is possible because the method according to the invention does not require the capture of further images, since the animated graphic virtual image is not dependent on the captured image. In other words, in the method of the invention, the pixels of the captured image do not need to be altered, but on the contrary: the animated graphic virtual representation is superimposed on the captured image. This feature of the invention reduces the computational processing power required to apply the method, thus saving resources and costs.

[0069] Another advantage achieved by the method of the invention is that real-time vibration deformation data can be used. In fact, since the method of the invention uses a monitoring device (sensor element) capable of monitoring the condition of the equipment during normal operation of the equipment, it is not necessary to generate a forced impact on the structure to measure the vibration. In addition, the sensor element used by the invention generates a discrete signal proportional to the vibration over time, allowing this signal to be captured on a (e.g. remote) device and used to generate an animated graphical virtual image when such a signal is needed.

[0070] Another extremely advantageous point of the method proposed by the invention is that it eliminates the need for the user to program or configure specific devices for analyzing specialized deformations. This is mainly due to two characteristics of the invention: the preference for remote processing to generate the animated representation, and the fact that the animated representation does not depend on the pixels of the captured image, i.e., it does not require a graphical reproduction of the structure to be analyzed, and therefore it is not necessary to create a specific three-dimensional model of the structure.

[0071] The present invention also contemplates a system for generating an augmented reality representation of a vibratory deformation of a structure. The operation of the system is based on the described method, using image capture, data capture, image display and user interface devices - which may be in the form of devices integrated into a single piece of equipment or may be separate devices - a vibration sensor element, and a processing medium that can be connected to the device.

[0072] Having described an example of an embodiment of the present invention, it should be understood that the scope of the present invention encompasses other possible variations of the described inventive concept, being limited only by the content of the appended claims, including possible equivalents.

Claims

1. A method for generating an augmented reality representation of a vibration deformation of a structure, characterized in that The method comprises: Arranging at least two vibration sensor elements at different locations of the structure; capturing an image of the structure before or after the step of arranging the at least two vibration sensor elements; indicating said positions of said at least two vibration sensor elements in said captured image; generating a reference graphical virtual representation based on the positions indicated for the at least two vibration sensor elements; performing at least two vibration measurements by the vibration sensor; animating the reference graphical virtual representation to reflect the vibration measurements taken, generating an animated graphical virtual representation; superimposing said animated graphical virtual representation on said captured image of said structure to generate a combined image; The combined image is displayed.

2. The method according to claim 1, characterized in that The method comprises, prior to the step of performing at least two vibration measurements by the vibration sensor, synchronizing at least two vibration sensor elements.

3. The method according to claim 1 or 2, characterized in that: The captured image is one of a static image of the structure and a video image of the structure.

4. The method according to any one of claims 1 to 3, characterized in that The reference graphical representation is a 2D representation.

5. The method according to any one of claims 1 to 4, characterized in that The step of indicating said positions of said at least two vibration sensor elements in said captured image is performed in an interface device.

6. The method according to any one of claims 1 to 5, characterized in that The at least two vibration sensor elements comprise a vibration sensor which performs the measurement by means of voltage changes.

7. A system for generating an augmented reality representation of a vibration deformation of a structure, characterized in that The system comprises: at least two vibration sensor elements arranged at different locations of the structure; an image capture device for capturing an image of the structure; a user interface to receive an indication of said position of said at least two vibration sensor elements; processing means for receiving data measured by said vibration sensor elements and data from said indications of said positions of said at least two vibration sensor elements, and for creating a reference graphical virtual representation based on said received data; wherein the processing means generates an animated graphical virtual representation reflecting vibration measurements performed by the vibration sensor element and superimposes the animated graphical virtual representation on the captured image of the structure to create a combined image; and A display device is used to display the combined image.

8. The system according to claim 7, characterized in that The measurements performed by the at least two vibration sensor elements are extracted by a measurement acquisition device connected to the processing medium via the Internet.

9. The system according to claim 8, characterized in that The capture device and the display device as well as the user interface are connected to the processing apparatus via a wireless network.

10. The system according to any one of claims 8 or 9, characterized in that The image capture device, the measurement acquisition device and the display device as well as the user interface are integrated into a single piece of equipment.

Images