Hydrostatic leveling instrument liquid level visualization method based on augmented reality (AR) technology

Abstract

The invention relates to a hydrostatic leveling instrument liquid level visualization method based on an augmented reality (AR) technology. The pain point that time and labor are consumed in the installation, debugging, operation and maintenance process of a hydrostatic leveling instrument is solved. After the AR terminal (including but not limited to a mobile phone, a tablet computer, AR glasses, an intelligent helmet and the like) is connected with the acquisition instrument, a camera of the terminal is used for irradiating a subject matter of the static force level gauge, an engineering model and a real image of the static force level gauge are fused and matched, and image information and liquid level conditions are visually displayed. And when the liquid level does not meet the standard, colors are used for distinguishing. According to the liquid level data returned in real time, the liquid level fluctuation state of the static force level gauge is presented. And marking key information and warning information beside the static leveling instrument image. And displaying the change curve and stability evaluation of the liquid level in the latest period of time. And the inclination angles of x, y and z axes are calculated in real time, and a coordinate system is displayed on an image of the static leveling instrument and used for observing whether the leveling requirement is met or not.

Description

Technical Field

[0001] The invention belongs to the field of information technology, and in particular relates to a static level visualization method based on augmented reality (AR) technology. Background Art

[0002] The automated static leveling system, which has been developed since the 1990s, is a high-precision measurement system used to measure relative elevation changes. The static level uses the principle of connecting liquid. The liquid levels of the liquid storage tanks connected by multiple universal connecting pipes are always at the same level. By measuring the liquid level heights of the unconnected liquid storage tanks, the relative differential settlement of each static level can be calculated. The entire system consists of multiple static levels and mounting brackets, liquid pipes, gas pipes, and collectors. It is mainly suitable for vertical displacement monitoring between multiple points for long-term and high-frequency monitoring of geotechnical and structural safety engineering. Compared with the traditional level or total station, which relies on manual data acquisition, the automated static leveling system has faster response, higher efficiency, and better accuracy. It can closely observe and measure the settlement of buildings or ground under load, which plays a vital role in public safety and resident safety.

[0003] So far, the working conditions in most monitoring scenarios are relatively complex, so for the automatic static level, it should be guaranteed to be anti-crack, anti-explosion, anti-foreign matter, and anti-corrosion, while also ensuring certain moisture resistance and waterproof sealing requirements. In this case, most manufacturers' automatic static levels are generally made of closed opaque metal materials to meet the needs of most scenarios. During the installation and adjustment of the water level, on-site construction personnel cannot directly observe the key information of the static level: including the liquid level value, the dynamic change curve of the liquid level and the stable state of the liquid level, and the liquid level state of the entire waterway. And related alarm information: such as uneven liquid level in the waterway, liquid level exceeding the range, the inclination angle of the installation axis of the static level, used to observe whether the leveling requirements are met, etc. The existing solution can only be viewed by relying on relevant mobile phone applications, and the liquid level data collected periodically by the collector is displayed in a list. This display method has many problems such as lack of intuitiveness, unnatural interaction, and information density that is inconvenient to view. Summary of the invention

[0004] In order to solve the shortcomings of the above method, the purpose of the present invention is to provide a static level instrument liquid level visualization method based on augmented reality (AR) technology. During the installation, debugging and operation and maintenance of the static level instrument, the changes in the static level instrument liquid level can be intuitively observed, and key business information can be displayed at the same time. More natural human-computer interaction can greatly enhance the user experience and solve the time-consuming and labor-intensive pain points during the installation, debugging and operation and maintenance of the static level instrument.

[0005] In order to achieve the above object, the present invention provides a method for visualizing the liquid level of a static level based on augmented reality (AR) technology. The method comprises: Create a 3D engineering model of the static level. The 3D engineering model is used to match and fuse with the real image of the static level, so that the measurement data and key information can be presented intuitively in the form of augmented reality images.

[0006] Use an AR terminal (including but not limited to mobile phones, tablets, AR glasses, smart helmets, etc.) to connect to the collector device through a wireless network. The quality level of the aforementioned wireless network is displayed in real time on the display screen of the AR terminal.

[0007] The AR terminal communicates with the collector to obtain the measurement data of the static level collected by the collector in real time.

[0008] The camera of the AR terminal is used to illuminate the static level target, match and fuse the 3D engineering model with the real image of the static level, and display the image of the static level and the liquid level fusion. When the liquid level does not meet the standard, it will be distinguished by color.

[0009] Based on the real-time returned liquid level data, the liquid level fluctuation state of the static level gauge is presented in real time on the smart terminal in the form of augmented reality images to observe whether the liquid level has entered a steady state.

[0010] The coordinate system is displayed on the augmented reality image of the static level to observe the inclination angles of the x, y, and z axes of the static level installation and determine whether the leveling requirements are met.

[0011] Other key information is displayed next to the augmented reality image of the static level, including the equipment factory serial number, equipment name, liquid level value, average liquid level of the entire waterway, etc.

[0012] The liquid level change curve and stability evaluation over the recent period are displayed next to the augmented reality image of the static level, providing an intuitive understanding of the current waterway conditions.

[0013] Display key warning messages next to the augmented reality image of the static level, such as: "Liquid level exceeds the range", "Current waterway liquid level is uneven", etc. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 This is a schematic diagram of the common static leveling system topology.

[0015] Figure 2 It is a flow chart of the operation method of the present invention. DETAILED DESCRIPTION

[0016] In order to achieve the above object, the present invention provides a static level instrument liquid level visualization method based on augmented reality (AR) technology.

[0017] In order to make the technical solution of the present invention more clear, the following Figure 1 and 2 , embodiments of the present invention are given to further illustrate the present invention.

[0018] The detailed implementation steps are as follows: S1: Create and import the 3D engineering model of the static level; S2: Use an AR terminal (including but not limited to mobile phones, tablets, AR glasses, smart helmets, etc.) to connect to the data collector through a wireless network. The quality level of the aforementioned wireless network is displayed in real time on the display screen of the AR terminal; S3: The AR terminal communicates with the collector to obtain the measurement data of the static level collected by the collector through the field communication bus in real time; S4: Use the camera of the AR terminal to illuminate the static level target, match and fuse the three-dimensional engineering model created in step S1 with the real image of the static level, and intuitively display the image information of the static level and the liquid level image information. When the liquid level does not meet the standard, it will be distinguished by color; S5-1: Based on the liquid level measurement data returned in real time in step S3, the liquid level fluctuation state of the static level gauge is presented in real time on the smart terminal in the form of augmented reality images through standard deviation calculation and two-dimensional wave equation solution to observe whether the liquid level has entered a steady state; S5-2: according to the liquid level measurement data returned in real time in step S3, the discrete measurement data is fitted into a curve graph, and the change curve and stability evaluation of the liquid level in the recent period are displayed next to the augmented reality image of the static level instrument, so as to intuitively understand the current waterway conditions; S5-3: Based on the measurement data returned in real time in step S3, other key information is displayed next to the aforementioned augmented reality image of the static level, including the equipment factory serial number, equipment name, liquid level value, average liquid level of the entire waterway, stability of the entire waterway, etc.; S5-4: Calculate the inclination angles of the x, y, and z axes in real time according to the attitude measurement data returned in real time in step S3, and display the coordinate system on the aforementioned static level augmented reality image to observe whether the leveling requirements are met; S5-5: Calculate and judge based on the measurement data returned in real time in step S3, and display key warning information next to the augmented reality image of the static level, such as: "Liquid level exceeds the range", "Current waterway liquid level is uneven", etc.

[0019] In step S2, the wireless connection between the AR terminal and the data collector can be a variety of network connection methods. Here, taking the Bluetooth signal as an example, the following evaluation levels can be given: divided into four levels, RSSI above -50dBm is considered a very good signal, -50dBm to -70dBm is a good signal, -70dBm to -85dBm is a medium signal, and below -85dBm is a weak signal. The evaluation formula is: Where x is the RSSI value, S is the evaluation value, and the higher S is, the better the evaluation is.

[0020] In step S4, the engineering model needs to be fused and matched with the real image of the static level. The method is as follows: First, the target detection algorithm is used to train all the static levels selected for the project as samples to accurately identify the static levels in the video frames. Next, the video frames of the static level are reconstructed in three dimensions to obtain the three-dimensional vertex coordinates corresponding to the static level from the input image. After that, the AR layer algorithm is used to obtain the transformation matrix of the imported three-dimensional model based on the reconstructed three-dimensional vertex coordinates, and the three-dimensional model is adjusted to the correct position to achieve the effect of integrating the three-dimensional model with the static level in the real image. Finally, the combined image is converted into a video frame output, and the augmented reality static level liquid level image effect can be seen.

[0021] In step S4, a liquid column model of corresponding height is generated according to the liquid level measurement data returned in real time in step S3, and different colors are used to indicate whether the current liquid level is within the expected range.

[0022] Step S5-1 is used to analyze and calculate the fluctuation state of the liquid level in real time, and display the fluctuation state of the liquid level of the static level in real time in the AR image of the smart terminal. The detailed method is as follows: First, the standard deviation method is used to calculate the liquid level stability of the static level. The formula is as follows: , where represents the standard deviation of the ith instrument in the waterway; represents the jth data of the ith waterway; m represents the number of samples; represents the average value of the i-th instrument; then the two-dimensional wave equation is used to present the fluctuation state of the static level liquid surface, using the above formula Substitute the parameters into the equation. In order to realize the liquid surface fluctuation effect, it is necessary to numerically solve the two-dimensional wave equation. First, discretize it, use the finite difference method in the discretization process, then sort out the explicit update formula, and finally write it into a program to realize the liquid surface fluctuation. The explicit update formula is as follows: In the formula In the Cartesian coordinate system, the base is the xy axis, the x-axis value is k, the y-axis value is j, and the z-axis value of the n+1th point is u; is the unit time; and is the unit step length; Represents the standard deviation of the ith instrument in this waterway.

[0023] Finally, the liquid level fluctuation state of the static level is presented in real time on the AR terminal in the form of augmented reality images.

[0024] In engineering, multiple static levels are usually connected in series in a waterway. In step S5-3, the method of observing the stability of the entire waterway requires statistical evaluation of the overall stability of multiple static levels in the waterway. Here, the standard deviation of the liquid level data of each static level in the waterway in a fixed time period is used, and then the average is calculated to evaluate the stability of the entire waterway. The formula is as follows: In the formula, S represents the stability of the waterway. The smaller the value, the higher the stability. It represents the standard deviation of the ith instrument in the waterway; n represents the total number of instruments in the waterway.

[0025] In step S5-4, the coordinate system is used to assist the leveling of the static level, and the method is as follows: The static level has a built-in inertial navigation chip that calculates the attitude information of the static level in real time, including the x, y, and z inclination data. After the data collector collects this data, it transmits it to the AR terminal via a wireless connection. The AR terminal draws a coordinate system to indicate the current attitude and draws a positive direction coordinate system to assist the user in leveling the instrument.

[0026] In step S5-5, the evaluation formula for the average value of the liquid level of all static levels in the waterway exceeding the threshold warning is as follows: In the formula, h refers to the current water level of the device, i represents the number of devices, represents the average value of the water level of the current waterway, and m represents the threshold value of uneven water level. Represents the evaluation of whether the current average liquid level of the equipment exceeds the threshold. 1 represents the average water level of the current device. A value of 0 indicates that the current device water level is uneven.

[0027] The above embodiments do not limit the present invention, and the present invention is not limited to the above examples. Any changes, modifications, additions or substitutions made by those skilled in the art within the scope of the technical solution of the present invention also fall within the protection scope of the present invention.

Claims

1. A static level gauge liquid level visualization method based on augmented reality (AR) technology, the method comprising the following steps: S1: Create and import the 3D engineering model of the static level; S2: Use an AR terminal (including but not limited to mobile phones, tablets, AR glasses, smart helmets, etc.) to connect to the data collector through a wireless network. The quality level of the aforementioned wireless network is displayed in real time on the display screen of the AR terminal; S3: The AR terminal communicates with the collector to obtain the measurement data of the static level collected by the collector through the field communication bus in real time; S4: Use the camera of the AR terminal to illuminate the static level target, match and fuse the 3D engineering model created in S1 with the real image of the static level, and intuitively display the image information of the static level and the liquid level image. When the liquid level does not meet the standard, it will be distinguished by color; S5-1: Based on the liquid level measurement data returned in real time by S3, the standard deviation is calculated and the two-dimensional wave equation is solved. The liquid level fluctuation state of the static level is presented in real time on the smart terminal in the form of augmented reality images to observe whether the liquid level has entered a steady state. S5-2: Based on the liquid level measurement data returned in real time by S3, the discrete measurement data is fitted into a curve graph, and the change curve and stability evaluation of the liquid level in the recent period are displayed next to the aforementioned augmented reality image of the static level, so as to intuitively understand the current waterway conditions; S5-3: Based on the measurement data returned by S3 in real time, other key information is displayed next to the aforementioned augmented reality image of the static level, including the equipment factory serial number, equipment name, liquid level value, average liquid level of the entire waterway, stability of the entire waterway, etc.; S5-4: Calculate the inclination angles of the x, y, and z axes in real time based on the attitude measurement data returned in real time by S3, and display the coordinate system on the aforementioned static level augmented reality image to observe whether the leveling requirements are met; S5-5: Calculate and judge based on the measurement data returned by S3 in real time, and display key warning information next to the augmented reality image of the static level, such as: "Liquid level exceeds the range", "Current water channel liquid level is uneven", etc.

2. The method for visualizing the liquid level of a static level based on augmented reality (AR) technology according to claim 1, characterized in that: In the step S1, a three-dimensional engineering model file capable of expressing the physical dimension information of the static level is created and imported into the system.

3. The method for visualizing the liquid level of a static level based on augmented reality (AR) technology according to claim 1, characterized in that: In step S2, an AR terminal is used to connect to the collector through a wireless network to obtain key information. The wireless network connection method includes but is not limited to wireless communication technologies such as Bluetooth and Wi-Fi. The quality level of the wireless network is displayed in real time in the augmented reality image. Taking the Bluetooth signal as an example, the following evaluation level can be given: it is divided into four grades, and RSSI above -50dBm is considered a very good signal, -50dBm to -70dBm is a good signal, -70dBm to -85dBm is a medium signal, and the signal below -85dBm is a weak signal. Formula 1 is as follows: , where x is the RSSI value, S is the evaluation value, and the higher S is, the better the evaluation is.

4. The method for visualizing the liquid level of a static level based on augmented reality (AR) technology according to claim 1, characterized in that: In the step S4, a target detection algorithm is first used to train all the static levels selected for the project as samples to accurately identify the static levels in the video frames. Next, the video frames of the static levels are three-dimensionally reconstructed to obtain the three-dimensional vertex coordinates corresponding to the static levels from the input images. After that, the AR layer algorithm is used to obtain the transformation matrix of the imported three-dimensional model based on the three-dimensional vertex coordinates after reconstruction, and the three-dimensional model is adjusted to the correct position to achieve the effect of integrating the three-dimensional model with the static level in the real image. Finally, the combined image is converted into a video frame output, and the augmented reality static level liquid level image effect can be seen.

5. The method for visualizing the liquid level of a static level based on augmented reality (AR) technology according to claim 1, characterized in that: In step S5-1, the liquid level stability of the static level is first calculated using the standard deviation method, and formula 2 is as follows: , where represents the standard deviation of the ith instrument in the waterway; represents the jth data of the ith waterway; m represents the number of samples; represents the average value of the ith instrument; Then, a two-dimensional wave equation is used to present the fluctuation state of the liquid surface of the static level. The calculated standard deviation is substituted into the equation, and finally the display update formula is obtained. Formula 3 is as follows: , where In the Cartesian coordinate system, the base is the xy axis, the x-axis value is k, the y-axis value is j, and the z-axis value of the n+1th point is u; is the unit time; and is the unit step length; Represents the standard deviation of the ith instrument in the waterway. The above formula is used to present the liquid level fluctuation state of the static level in real time in the form of augmented reality images on the AR terminal.

6. The method for visualizing the liquid level of a static level based on augmented reality (AR) technology according to claim 1, characterized in that: In step S5-3, the standard deviation of the liquid level data of each static level on the waterway in a fixed time period is calculated (see formula 2), and then the average is calculated to evaluate the stability of the entire waterway. Formula 4 is as follows: , where S represents the stability of the waterway, and the smaller the value, the higher the stability; It represents the standard deviation of the ith instrument in the waterway; n represents the total number of instruments in the waterway.

7. The method for visualizing the liquid level of a static level based on augmented reality (AR) technology according to claim 1, characterized in that: In step S5-4, the static level has a built-in inertial navigation chip, which calculates the attitude information of the static level in real time, including the inclination data of x, y, and z. After the data is collected by the collector, it is transmitted to the AR terminal via a wireless connection. The AR terminal draws a coordinate system to indicate the current attitude, and at the same time draws a positive direction coordinate system to assist the user in leveling the instrument.

8. The method for visualizing the liquid level of a static level based on augmented reality (AR) technology according to claim 1, characterized in that: In step S5-5, an evaluation formula is proposed for warning that the average value of the liquid level of all static levels in the waterway exceeds the threshold, and formula 5 is as follows: , where h refers to the current water level of the device, i represents the number of devices, represents the average value of the water level of the current waterway, and m represents the threshold value of uneven water level. Represents the evaluation of whether the current average liquid level of the equipment exceeds the threshold. 1 represents the average water level of the current device. A value of 0 indicates that the current device water level is uneven.

Images