Augmented reality-based power pipeline data visualization system and method

Abstract

The invention relates to a power pipeline data visualization system and method based on augmented reality, and the system comprises a preprocessing unit which is used for obtaining the GIS data of a power pipeline in real time, and carrying out the preprocessing of the GIS data; the 3D modeling module is used for constructing a 3D model of the power pipeline; the mobile equipment data acquisition module is used for acquiring related positioning data and sight angle of mobile equipment in real time; the mobile equipment runtime library is used for calculating an augmented reality virtual space according to the related positioning data and the preprocessed GIS data, then loading a 3D model to a corresponding position in the virtual space, and carrying out angle adjustment on the virtual space loaded with the 3D model according to the sight line angle so as to enable the virtual space to be matched with the real world; and the user interaction interface is used for displaying the virtual space loaded with the 3D model after angle adjustment so as to realize visualization of the power pipeline. Compared with the prior art, the method has the advantages of improving the inspection efficiency and the like.

Description

Technical Field

[0001] The present invention relates to the field of information technology, and in particular to an augmented reality-based power pipeline data visualization system and method. Background Art

[0002] In the daily inspection process of urban cable pipelines, due to the strong concealment of urban underground cable pipelines, the use of traditional underground cable pipeline GIS (geographic information system) information faces many challenges. At present, various operations such as management, inspection, and maintenance of various types of power cables, including high-voltage and low-voltage ones, especially underground cable pipelines, basically rely on the experience of practitioners and their familiarity with the layout and filling of cable networks in the responsible area. Therefore, the professional quality of practitioners and personnel changes will directly affect the efficiency, safety and timeliness of the operation, maintenance, repair, and rescue of power cable pipelines, and the resulting situation will even affect the safe operation of the entire power grid. Specifically, these problems include but are not limited to the following:

[0003] High threshold for image recognition:

[0004] Traditional GIS information is usually presented in the form of two-dimensional drawings, which requires line inspectors to have high professional skills and experience to accurately interpret them.

[0005] For new or inexperienced line inspectors, this high threshold may lead to misreading or misunderstanding of GIS data, thus affecting the quality of inspections.

[0006] Changes in environmental references:

[0007] Geological changes, vegetation changes, and building changes in urban environments may lead to inconsistencies between real scenes and the markers in GIS information.

[0008] For example, the buildings that were originally used as reference points may have been demolished or rebuilt, making it difficult for line inspectors to determine the specific location of the underground cable network based on GIS information.

[0009] Lack of sense of space:

[0010] Two-dimensional GIS information cannot provide sufficient spatial sense, and it is difficult for line inspectors to intuitively understand the spatial layout of underground cable networks.

[0011] This lack of spatial information makes it difficult for line inspectors to fully grasp the actual direction and depth of the pipeline during inspections, increasing the difficulty of inspections.

[0012] Line inspection quality is difficult to guarantee:

[0013] Due to the existence of the above problems, line inspectors may miss some important information or make inaccurate judgments on the location of pipelines during the inspection process.

[0014] This not only reduces inspection efficiency, but can also lead to safety hazards, such as failure to detect potential problem areas in a timely manner.

[0015] Low accuracy of pipeline excavation:

[0016] When conducting pipeline excavation operations, if construction workers only rely on traditional GIS information, they may not be able to accurately determine the location and depth of the pipeline.

[0017] This uncertainty may lead to unnecessary excavation work, increase construction costs, and potentially damage existing pipeline facilities, causing greater losses.

[0018] In summary, traditional underground cable network GIS information has many limitations in practical applications, and a new technology and method is urgently needed to improve the inspection quality and the accuracy of pipeline management. Summary of the invention

[0019] The purpose of the present invention is to provide a power pipeline data visualization system and method based on augmented reality to improve the inspection quality.

[0020] The purpose of the present invention can be achieved by the following technical solutions:

[0021] A power pipeline data visualization system based on augmented reality, comprising:

[0022] Preprocessing unit: used to obtain GIS data of power pipelines in real time and perform preprocessing, wherein the GIS data includes power pipeline entities and their attribute data;

[0023] 3D modeling module: used to build 3D models of power pipelines based on preprocessed GIS data;

[0024] Mobile device data collection module: used to collect relevant positioning data and sight angle of mobile devices in real time;

[0025] Mobile device runtime library: used to obtain the relevant positioning data, sight angle and pre-processed GIS data, calculate the virtual space of augmented reality according to the relevant positioning data and the pre-processed GIS data, then load the 3D model to the corresponding position in the virtual space, and adjust the angle of the virtual space loaded with the 3D model according to the sight angle to make it consistent with the real world;

[0026] User interaction interface: used to display the virtual space loaded with 3D models after adjusting the angle to achieve visualization of power pipelines.

[0027] Furthermore, the preprocessing unit includes a converter and a coordinate conversion module,

[0028] Converter: used to standardize the GIS data into WGS84 coordinate system data;

[0029] Coordinate conversion module: used to convert the WGS84 coordinate system data into north-south coordinate data according to the scale of GIS data.

[0030] Furthermore, the power pipeline entity includes cables, drainage pipes, work wells, cable trenches, cable tunnels, and cable racks, and the attribute data of the power pipeline entity includes the material, specification, and installation date of the power pipeline entity.

[0031] Furthermore, the 3D modeling module collects computer graphics technology to construct a 3D model of the power pipeline, and the execution steps of the 3D modeling module include:

[0032] According to the scale of the GIS data, the preprocessed GIS data is converted according to centimeter-level accuracy and data type to obtain an initial 3D model of the power pipeline entity, and the attribute data is bound to the corresponding initial 3D model to obtain the final 3D model of the power pipeline.

[0033] Furthermore, the relevant positioning data of the mobile device includes the mobile device's own positioning, CORS base station positioning and RTK positioning.

[0034] Furthermore, the mobile device runtime library includes a positioning data module, a sight angle module, and an augmented reality visualization module.

[0035] Positioning data module: used to obtain relevant positioning data of mobile devices through the positioning service interface and input it into the augmented reality visualization module;

[0036] Sight angle module: used to obtain the sight angle of the mobile device and input it into the augmented reality visualization module;

[0037] Augmented reality visualization module: used to receive relevant positioning data, line of sight angle, pre-processed GIS data and 3D model, first calculate the augmented reality virtual space according to the relevant positioning data and pre-processed GIS data, then load the 3D model to the corresponding position in the virtual space, and adjust the angle of the virtual space loaded with the 3D model according to the line of sight angle to make it consistent with the real world, so as to realize the visualization of power pipelines.

[0038] Furthermore, when calculating the virtual space of the augmented reality, the calculation is performed with the mobile device as the center point.

[0039] Furthermore, the mobile device runtime library also includes a data communication protocol module, and the data communication protocol module is used to provide communication services for data transmission in the mobile device runtime library.

[0040] Furthermore, the mobile device runtime is integrated with an AR rendering engine for providing image rendering for the virtual space and 3D model.

[0041] The present invention also provides a method for visualizing power pipeline data based on augmented reality, comprising the following steps:

[0042] Acquire GIS data of power pipelines in real time and perform preprocessing, wherein the GIS data includes power pipeline entities and their attribute data;

[0043] Construct a 3D model of the power pipeline based on the preprocessed GIS data;

[0044] Collect relevant positioning data and sight angles of mobile devices in real time;

[0045] The relevant positioning data, sight line angle and pre-processed GIS data are obtained, and the virtual space of augmented reality is calculated according to the relevant positioning data and the pre-processed GIS data. The 3D model is then loaded into the corresponding position in the virtual space, and the angle of the virtual space loaded with the 3D model is adjusted according to the sight line angle so that it matches and displays the real world, thereby realizing the visualization of the power pipeline.

[0046] Compared with the prior art, the present invention has the following beneficial effects:

[0047] (1) The present invention models GIS data into a 3D model through a 3D modeling module. The mobile device data acquisition module collects the relevant positioning data and line of sight angle of the mobile device in real time, and processes them in the mobile device runtime library to obtain an augmented reality virtual space, and loads the 3D model into it to adjust the angle, thereby ensuring the real-time update and visualization of the underground power pipelines, thereby improving the inspection quality.

[0048] (2) The present invention displays power pipelines through 3D models, which solves the problem of misreading or misunderstanding caused by the use of two-dimensional drawings in the prior art, and reduces the threshold for image recognition. At the same time, when calculating the virtual space of augmented reality, the mobile device runtime library of the present invention uses the mobile device as the center point for calculation, that is, the mobile device is used as the only reference object, which solves the problem in the prior art that it is difficult to determine the specific location of underground power pipelines due to changes in environmental reference objects, and further improves the inspection quality and speed.

[0049] (3) The present invention uses high-precision positioning technology and augmented reality technology to display a virtual space that matches the real world, allowing patrol personnel and construction personnel to more intuitively understand the spatial layout of underground power pipelines, allowing patrol personnel and construction personnel to accurately determine the specific location of the pipelines, improve the accuracy of pipeline excavation, reduce construction costs, and achieve intuitive and efficient power pipeline management. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 It is a schematic diagram of the system structure of the present invention. DETAILED DESCRIPTION

[0051] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. This embodiment is implemented based on the technical solution of the present invention, and provides a detailed implementation method and specific operation process, but the protection scope of the present invention is not limited to the following embodiments.

[0052] This embodiment provides a power pipeline data visualization system based on augmented reality. The system mainly realizes GIS underground power pipeline data visualization through augmented reality technology. It mainly includes converting GIS data into 3D models, and converting GIS longitude and latitude information into 3D virtual space information for visualization, and obtaining device positioning data through a runtime library included in the method running in a mobile device, loading surrounding pipeline models and GIS data in segments with itself as the center point, and converting and displaying the GIS coordinate system and the augmented reality coordinate system based on the angle and direction of the mobile device, so as to realize the direct visualization of the underground power pipeline network with a "perspective" effect through the camera of the mobile device. Specifically, Figure 1 As shown, the system includes a preprocessing unit 1, a 3D modeling module 2, a mobile device data acquisition module 3, a mobile device runtime library 4 and a user interaction interface 5.

[0053] The preprocessing unit 1 includes a converter 11 and a coordinate conversion module 12. The execution steps of the preprocessing unit 1 are:

[0054] Data standardization: All incoming GIS data are converted into standard World Geodetic System 1984 (WGS84) coordinate system data through a converter 11. The GIS data includes power pipeline entities and their attribute data, and the power pipeline entity data includes the geographic location information of the pipeline.

[0055] Coordinate conversion: According to the scale of GIS data, convert the longitude and latitude in WGS84 coordinate system data into north-south coordinate data.

[0056] The 3D modeling module 2 is used to model the intercom power pipeline as a 3D model. The execution steps of the 3D modeling module 2 include:

[0057] According to the scale, the points between GIS data are converted into 3D models of underground power pipelines such as cables, pipes, work wells, cable trenches, cable tunnels, cable supports, etc. according to the data type with centimeter-level accuracy, and other power pipeline attribute data contained in the GIS data are bound to the 3D model. In this step, computer graphics technology is used to generate a detailed 3D model based on GIS data. The 3D model includes not only entities such as cables, pipes, work wells, cable trenches, cable tunnels, cable supports, etc., but also attribute data related to them, such as materials, specifications, installation dates, etc.

[0058] The mobile device data acquisition module 3 is used to collect the relevant positioning data and line of sight angle of the mobile device. The relevant positioning data includes the positioning data of the mobile device itself, the continuously operating reference station (CORS) base station positioning, the real-time dynamic carrier phase differential positioning (RTK) high-precision positioning, etc. The line of sight angle is obtained based on the gyroscope calculation component in the mobile device.

[0059] The mobile device runtime library 4 integrates a positioning service interface, a data communication protocol and an AR rendering engine, and is mainly used for positioning integration, real-time data exchange, virtual space calculation and perspective matching, etc. Therefore, the mobile device runtime library 4 includes a positioning data module 41, a line of sight angle module 42, an augmented reality visualization module 43 and a data communication protocol module 44. The positioning data module 41 is used for positioning integration, so that the mobile device runtime library 4 can obtain positioning data such as the mobile device's own positioning, the continuous operation reference station (CORS) base station positioning, and the real-time dynamic carrier phase differential positioning (RTK) high-precision positioning. The line of sight angle module 42 is used to obtain the line of sight angle of the mobile device. The augmented reality visualization module 43 is used for real-time data exchange, and the positioning data is exchanged with the system body in real time to obtain the nearby GIS data and its bound 3D data, and the augmented reality virtual space is calculated with the mobile device as the center point, and the 3D model is loaded to the corresponding position, and then the line of sight angle of the device is calculated by the gyroscope, and finally the "lens" angle of the virtual space is determined to match the angle of the real world, thereby realizing the visualization of the augmented reality underground cable pipeline. The data communication protocol module 44 is used to provide communication services for data transmission in the mobile device runtime 4 so as to transmit data in real time.

[0060] The process of calculating the virtual space of augmented reality is as follows:

[0061] Through the ROS principle, by obtaining the focal length parameters of the device lens, calculating the sum of the square of the focal length and the inverse of the aperture diameter, and combining the lens focal length to deduce and calculate the depth of field of the augmented reality space, the horizontal and depth of field spaces are bound as the basic xy axes, and the positioning point is used as the elevation base, and the elevation data in the GIS data is bound to the elevation base as the z-axis, thereby realizing the conversion calculation of GIS two-dimensional data to the three-dimensional coordinate system space of the augmented reality space.

[0062] The above process of determining the "lens" angle of the virtual space to match the angle of the real world includes:

[0063] It mainly obtains the 6-8 axis IMU inertial measurement data of the equipment (i.e. the 6-axis data of front, back, left, right, up and down combined with the skew angle data) as the main angle reference, and combines the SLAM of the augmented reality space as a supplement to calculate the fact that the equipment status and 3D model should be adjusted in real time according to the angle and distance displayed by the equipment status to make it consistent with the real world, so as to realize the visualization of the power pipeline.

[0064] The user interaction interface 5 is used for visual display. By designing a friendly and easy-to-use operation interface, it is convenient for technicians to view and operate. The interface should support multi-touch, gesture control and other interactive methods to improve user experience.

[0065] In summary, the visualization system performs the following steps to visualize the power pipeline:

[0066] Acquire GIS data of the power pipeline in real time, standardize the GIS data into WGS84 coordinate system data by using the preprocessing unit 1, and convert the WGS84 coordinate system data into north-south coordinate data according to the scale;

[0067] Use 3D modeling module to build 3D model of power pipeline;

[0068] The mobile device data collection module 3 is used to collect the relevant positioning data and sight angle of the mobile device in real time;

[0069] The mobile device runtime library 4 obtains the relevant positioning data, line of sight angle and pre-processed GIS data, calculates the virtual space of augmented reality according to the relevant positioning data and the pre-processed GIS data, and then loads the 3D model to the corresponding position in the virtual space, and adjusts the angle of the virtual space loaded with the 3D model according to the line of sight angle so that it matches and displays the real world, thereby realizing the visualization of the power pipeline.

[0070] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0071] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A power pipeline data visualization system based on augmented reality, characterized in that: include: Preprocessing unit (1): used for acquiring GIS data of power pipelines in real time and performing preprocessing, wherein the GIS data includes power pipeline entities and their attribute data; 3D modeling module (2): used to construct a 3D model of the power pipeline based on the preprocessed GIS data; Mobile device data collection module (3): used for collecting relevant positioning data and sight angle of the mobile device in real time; Mobile device runtime library (4): used to obtain the relevant positioning data, sight angle and pre-processed GIS data, calculate the virtual space of augmented reality according to the relevant positioning data and the pre-processed GIS data, then load the 3D model to the corresponding position in the virtual space, and adjust the angle of the virtual space loaded with the 3D model according to the sight angle so that it is consistent with the real world; User interaction interface (5): used to display the virtual space loaded with the 3D model after adjusting the angle, so as to realize the visualization of the power pipeline.

2. The power pipeline data visualization system based on augmented reality according to claim 1, characterized in that: The preprocessing unit (1) comprises a converter (11) and a coordinate conversion module (12). Converter (11): used for standardizing the GIS data into WGS84 coordinate system data; Coordinate conversion module (12): used for converting the WGS84 coordinate system data into north-south coordinate data according to the scale of the GIS data.

3. The power pipeline data visualization system based on augmented reality according to claim 1, characterized in that: The power pipeline entity includes cables, drainage pipes, work wells, cable trenches, cable tunnels, and cable racks. The attribute data of the power pipeline entity includes the material, specification, and installation date of the power pipeline entity.

4. The power pipeline data visualization system based on augmented reality according to claim 1, characterized in that: The 3D modeling module (2) collects computer graphics technology to construct a 3D model of the power pipeline. The execution steps of the 3D modeling module include: According to the scale of the GIS data, the preprocessed GIS data is converted according to centimeter-level accuracy and data type to obtain an initial 3D model of the power pipeline entity, and the attribute data is bound to the corresponding initial 3D model to obtain the final 3D model of the power pipeline.

5. The power pipeline data visualization system based on augmented reality according to claim 1, characterized in that: The relevant positioning data of the mobile device includes the mobile device's own positioning, CORS base station positioning and RTK positioning.

6. The power pipeline data visualization system based on augmented reality according to claim 1, characterized in that: The mobile device runtime library (4) comprises a positioning data module (41), a sight angle module (42), and an augmented reality visualization module (43). Positioning data module (41): used to obtain relevant positioning data of the mobile device through a positioning service interface and input the data into the augmented reality visualization module (43); A sight angle module (42): used to obtain the sight angle of the mobile device and input it into the augmented reality visualization module (43); The augmented reality visualization module (43) is used to receive relevant positioning data, sight angle, pre-processed GIS data and 3D model, first calculate the augmented reality virtual space according to the relevant positioning data and pre-processed GIS data, then load the 3D model to the corresponding position in the virtual space, and adjust the angle of the virtual space loaded with the 3D model according to the sight angle so that it matches the real world, thereby realizing the visualization of the power pipeline.

7. The power pipeline data visualization system based on augmented reality according to claim 6, characterized in that: When calculating the virtual space of the augmented reality, the calculation is performed with the mobile device as the center point.

8. The power pipeline data visualization system based on augmented reality according to claim 6, characterized in that: The mobile device runtime library (4) also includes a data communication protocol module (44), and the data communication protocol module (44) is used to provide communication services for data transmission in the mobile device runtime library (4).

9. The power pipeline data visualization system based on augmented reality according to claim 1, characterized in that: The mobile device runtime library (4) is integrated with an AR rendering engine, which is used to provide image rendering for virtual space and 3D models.

10. A method for visualizing power pipeline data based on augmented reality, characterized in that: include: Acquire GIS data of power pipelines in real time and perform preprocessing, wherein the GIS data includes power pipeline entities and their attribute data; Construct a 3D model of the power pipeline based on the preprocessed GIS data; Collect relevant positioning data and sight angles of mobile devices in real time; The relevant positioning data, sight line angle and pre-processed GIS data are obtained, and the virtual space of augmented reality is calculated according to the relevant positioning data and the pre-processed GIS data. The 3D model is then loaded into the corresponding position in the virtual space, and the angle of the virtual space loaded with the 3D model is adjusted according to the sight line angle so that it matches and displays the real world, thereby realizing the visualization of the power pipeline.

Images