Equipment state monitoring method based on simulation data and three-dimensional model fusion rendering

Abstract

The invention discloses an equipment state monitoring method based on simulation data and three-dimensional model fusion rendering, and relates to the technical field of power system monitoring, and the method comprises the steps: obtaining the standard simulation data of equipment; performing data analysis based on the standard simulation data to obtain rendering engine readable data; performing large-scale tetrahedron three-dimensional splicing rendering according to the rendering engine readable data to obtain a simulation rendering result; performing three-dimensional registration fusion rendering on the simulation rendering result and the three-dimensional model to obtain a fusion model; based on the fusion model, performing three-dimensional scene real-time cloud rendering service by adopting a real-time pixel push flow technology to obtain a visual rendering result; and monitoring the equipment state according to the visual rendering result. According to the equipment state monitoring method based on simulation data and three-dimensional model fusion rendering, the accuracy and real-time performance of equipment state monitoring can be effectively improved, and the monitoring cost is reduced.

Description

Technical Field

[0001] The present application relates to the technical field of power system monitoring, and in particular to a method for monitoring equipment status based on fusion rendering of simulation data and three-dimensional models. Background Art

[0002] The converter station is the central link of energy conversion in the AC / DC transmission system and a key node of the power grid backbone. The internal structure of the converter station equipment is complex, and during operation, due to the long-term combined effects of complex electrical, thermal, and force fields, its internal state is complex and changeable, and the risk of failure is high. Therefore, it is necessary to monitor the status of the converter station electrical equipment in real time. Multi-physics field simulation analysis is an important basis for accurate prediction and comprehensive diagnosis of converter station electrical equipment. Through multi-physics field simulation, the simulation data of the converter station electrical equipment is obtained and displayed to assist operation and maintenance personnel in monitoring the status of the converter station electrical equipment. Existing business applications are mainly based on three-dimensional model display and local status data display, and only the perception fusion of conventional physical parameters such as voltage and current and the three-dimensional visualization of the geometric structure of electrical equipment have been preliminarily realized. In addition, the existing simulation result visualization technology has the following difficulties: first, different types of professional simulation software and diverse data formats make it difficult to parse and uniformly process simulation data, which increases the cost of inverter equipment status monitoring; second, the simulation results fluctuate strongly, the simulation data volume is large, and the parsing is slow, making it difficult to achieve real-time rendering, reducing the real-time performance of inverter equipment status monitoring; third, business applications often require high-fidelity structural models to be combined with simulation results, and the fusion rendering and spatial registration technology of these two types of data are complex. Summary of the invention

[0003] The purpose of this application is to provide a device status monitoring method based on the fusion rendering of simulation data and three-dimensional model, which can effectively improve the accuracy and real-time performance of device status monitoring and reduce monitoring costs.

[0004] To achieve the above objectives, this application provides the following solutions:

[0005] In a first aspect, the present application provides a device status monitoring method based on fusion rendering of simulation data and three-dimensional model, comprising:

[0006] Acquire standard simulation data of a device; the device is an electrical device of a converter station;

[0007] Perform data analysis based on standard simulation data to obtain data readable by the rendering engine;

[0008] Perform large-scale tetrahedral stereo stitching rendering based on the data readable by the rendering engine to obtain simulation rendering results;

[0009] Perform stereo registration and fusion rendering on the simulation rendering result and the three-dimensional model to obtain a fusion model;

[0010] Based on the fusion model, real-time pixel push streaming technology is used to provide real-time cloud rendering services for 3D scenes to obtain visual rendering results;

[0011] Monitor device status based on visual rendering results.

[0012] Optionally, the acquiring of standard simulation data of the device specifically includes:

[0013] Perform multi-physics field simulation analysis on the electrical equipment of the converter station to obtain simulation data of the electrical equipment of the converter station; the simulation data includes vertex coordinates, vertex connection order and simulation results at the vertices; the simulation results at the vertices include simulation value size, simulation value direction and color coding at the vertices;

[0014] The simulation data is stored in two tables, one table stores the vertex coordinates and vertex connection order in the simulation data, and the other table stores the vertex coordinates and simulation results at the vertices in the simulation data, thereby obtaining standard simulation data stored in a standard simulation data format.

[0015] Optionally, performing data parsing based on standard simulation data to obtain rendering engine readable data specifically includes:

[0016] Data analysis is performed based on the simulation results at the vertices in the standard simulation data to obtain rendering engine readable data and store them in a high-speed cache real-time library and a database; the rendering engine readable data includes vertex coordinates, vertex connection order, color level values, and the highest and lowest intervals of the simulation results at the vertices.

[0017] Optionally, a uniform color scale is used to perform conversion according to the simulation result at the vertex to obtain the color scale value.

[0018] Optionally, performing large-scale tetrahedral stereo stitching rendering according to the rendering engine readable data to obtain a simulation rendering result specifically includes:

[0019] Construct multiple regular tetrahedrons according to the vertex coordinates and vertex connection order in the rendering engine readable data; if the rendering engine readable data is two-dimensional simulation data, the obtained vertex connection order is the connection order of the triangle facets in the simulation result; if the rendering engine readable data is three-dimensional simulation data, the obtained vertex connection order is the vertex drawing order;

[0020] Based on the color level values ​​in the data readable by the rendering engine, multiple regular tetrahedrons are subjected to large-scale tetrahedron stereo stitching rendering to obtain a simulation rendering result.

[0021] Optionally, performing stereo registration and fusion rendering on the simulation rendering result and the three-dimensional model to obtain the fusion model specifically includes:

[0022] The same spatial coordinates are used to transform and align the coordinates of the simulation rendering results and the three-dimensional model, so as to achieve stereo registration fusion rendering of the simulation rendering results and the three-dimensional model and obtain a fusion model.

[0023] Optionally, the step of performing stereo registration and fusion rendering on the simulation rendering result and the three-dimensional model to obtain a fusion model further includes:

[0024] Before performing coordinate transformation and alignment, the center point of the global coordinate system is used as the alignment reference and the alignment references in the three-dimensional model and the simulation rendering result are compared to calculate the transformation matrix between the three-dimensional model and the simulation rendering result; the transformation matrix is ​​used to transform and align the coordinates of the simulation rendering result and the three-dimensional model.

[0025] According to the specific embodiments provided in this application, this application discloses the following technical effects:

[0026] The present application provides a device status monitoring method based on the fusion rendering of simulation data and three-dimensional model, which mainly relates to a stereo registration technology for fusion rendering of simulation data and three-dimensional model. The present application first obtains the standard simulation data of the equipment, and performs data analysis based on the standard simulation data, so as to realize efficient asynchronous simulation cloud map analysis and efficient storage. Subsequently, the simulation rendering result is subjected to stereo registration fusion rendering and large-scale tetrahedron stereo splicing rendering with the three-dimensional model to realize the registration of the simulation rendering result and the three-dimensional model. Finally, the real-time pixel push streaming technology is used to realize the real-time cloud rendering service of the three-dimensional scene for the fusion registration of simulation data and three-dimensional model, and the visual rendering result is obtained and the device status is monitored accordingly, which can effectively improve the accuracy and real-time performance of the device status monitoring and reduce the monitoring cost. Therefore, the device status monitoring method based on the fusion rendering of simulation data and three-dimensional model in the present application realizes the visualization of the full-dimensional status information of the equipment through the stereo registration technology of the fusion rendering of simulation data and three-dimensional model of high-fidelity structure, which can intuitively and real-timely display the simulation data of the operating power equipment, and enhance the precise control of the equipment status by the operation and maintenance personnel. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0028] Figure 1 A flow chart of the equipment status monitoring method based on the fusion rendering of simulation data and three-dimensional model provided in this application. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0030] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0031] like Figure 1 As shown, the present application discloses a device status monitoring method based on fusion rendering of simulation data and three-dimensional model, comprising:

[0032] Step 1: Get the standard simulation data of the device.

[0033] First, as a specific embodiment, the device described in the present application is a converter station electrical equipment, and multi-physics field simulation analysis is performed on the converter station electrical equipment to obtain simulation data of the converter station electrical equipment, and then a standard format for simulation data transmission and analysis is defined, that is, a standard simulation data format that meets lightweight transmission and accurate data semantics is proposed, and the simulation data is converted and stored in a standard simulation data format to obtain standard simulation data. Among them, the obtained simulation data includes vertex coordinates, vertex connection order, and simulation results at vertices. In addition, as a specific embodiment, the standard simulation data format of the present application is to store the simulation data in two tables, one table stores the vertex coordinates and vertex connection order in the simulation data, and the other table stores the information of each vertex, including the vertex coordinates in the simulation data and the simulation results at the vertex, thereby obtaining standard simulation data. The simulation results at the vertices include the size of the simulation values, the direction of the simulation values, and the color coding at the vertices.

[0034] Step 2: Perform data analysis based on standard simulation data to obtain data readable by the rendering engine.

[0035] Since in the prior art, data analysis services often need to adapt to simulation data in multiple formats, increasing the workload of the analysis service, the present application analyzes the output results of different simulation software and simulation models, that is, simulation data, in step 1, and converts the simulation data into a customized standard simulation data format to obtain standard simulation data. Subsequent three-dimensional visualization based on standard simulation data can effectively reduce the workload of the analysis service, improve the overall analysis speed, and reduce time costs. After obtaining the standard simulation data of the converter station electrical equipment through step 1, the simulation results at the vertices of the standard simulation data are processed, that is, a data analysis service is developed to analyze and process the simulation results at the vertices in the standard simulation data in a unified format stored in two tables, and obtain data readable by the rendering engine, including vertex coordinates, vertex connection order, color scale values, and the highest and lowest intervals of the simulation results at the vertices, and store them in the cache real-time library and database. Among them, the color scale values ​​are obtained by converting the simulation results at the vertices using a unified color scale.

[0036] Combining steps 1 and 2, it can be seen that the present application reads the simulation data of the converter station electrical equipment obtained in real time through the simulation structure model and converts it into the standard simulation data format to obtain the standard simulation data. Then, the data parsing service is used to obtain the standard simulation data and parse it into program-readable and available vertex coordinates, vertex connection order, color level values, and structured data such as simulation results at the vertex, which are stored in the high-speed cache real-time library and database to form data readable by the rendering engine.

[0037] Step 3: Perform large-scale tetrahedral stereo stitching rendering based on the data readable by the rendering engine to obtain a simulation rendering result.

[0038] According to the rendering engine readable data obtained in step 2, simulation rendering processing is performed. Specifically, at the time of initialization, the vertex coordinates and vertex connection order in the rendering engine readable data are obtained. If the rendering engine readable data obtained at this time is two-dimensional data, the vertex connection order obtained is the connection order of the triangular face in the simulation result; if the rendering engine readable data obtained at this time is three-dimensional data, the vertex connection order obtained is the vertex drawing order of the four vertices of the tetrahedron, and the vertex connection order is converted to the connection order of the counterclockwise triangular face, that is, the vertex connection order is expanded from 1234 to 132, 143, 124 and 234. The vertex coordinates and vertex connection order are converted into a tetrahedral solid mesh in the program, thereby constructing multiple regular tetrahedrons. The simulation model is assembled by tens of thousands of regular tetrahedrons. Subsequently, the vertex shader is drawn through the vertex color data (the color level value in the rendering engine readable data) and smoothly transitioned to each fragment shader to generate the color simulation result of the temperature field simulation of the simulation model. For different rendering effects, data interpolation or smoothing is performed according to the characteristics of the data. Whenever the physical field data is updated, the corresponding vertex is searched to modify the shader data and submitted to the graphics processing unit (GPU). The GPU draws the updated temperature field color data when drawing the next frame, completes the real-time update of the physical simulation, and obtains the simulation rendering result.

[0039] Step 4: Perform stereo registration and fusion rendering on the simulation rendering result and the 3D model to obtain a fusion model.

[0040] In the 3D rendering engine, the same spatial coordinates are used to transform and align the coordinates of the 3D model and the simulation rendering result, so as to achieve stereo registration fusion rendering of the simulation rendering result and the 3D model and obtain a fusion model. The 3D model is a 3D model with a high-fidelity structure.

[0041] Before coordinate transformation and alignment, the center point of the global coordinate system is used as the alignment reference and the transformation matrix between the three-dimensional model and the simulation rendering result is calculated by comparing the alignment reference in the three-dimensional model and the simulation rendering result. This transformation matrix contains parameters such as rotation, translation and scaling, which are used to transform the coordinates in the simulation rendering result to a spatial position consistent with the three-dimensional model. The rendering of the three-dimensional model uses the same three-dimensional rendering engine as the standard simulation data. By reading the three-dimensional model component file, focusing on material texture, transparency and lighting processing, three high-fidelity rendering methods are proposed: appearance model, perspective model and disassembled model.

[0042] The 3D model supports the import of GIM, 3dsMax, FBX and other format files, can accurately read the model hierarchy, data-driven logic and other attribute parameters, supports the import of device models and component models, and stores them in the component model library and device model library respectively, which can be called immediately. The 3D model needs to add materials and textures to further enhance its realism. This includes selecting the appropriate material type (such as metal, glass, wood, etc.) and adding corresponding textures and textures to it. Lighting and camera settings: During the rendering process, different types of light sources (such as point light sources, spotlights, ambient light, etc.) need to be set, and their positions, intensities and colors need to be adjusted to simulate the lighting effects in the real world. Adjust the camera's position, focal length, field of view and other parameters to adjust the perspective and composition of the final rendered image. Before rendering, you need to set the rendering engine parameters to adjust the quality and rendering speed of the rendered image, including resolution, anti-aliasing level, ray tracing depth, etc. Aligned rendering can be performed by adjusting transparency, display and hiding, etc. High-fidelity models support access to device data information, which can display data in real time and highlight device components synchronously.

[0043] Step 5: Based on the fusion model, use real-time pixel streaming technology to perform real-time cloud rendering services for 3D scenes to obtain visual rendering results.

[0044] Based on real-time pixel push streaming technology, a real-time cloud rendering service for three-dimensional scenes is implemented. The high-load graphics engine program is placed on the server backend, and then the real-time video stream is pushed to the web page (frontend) using WebRTC technology. Visual rendering results are generated on the frontend, and interactive synchronization from the frontend to the backend can be achieved, thereby improving the model loading speed and achieving high-quality rendering effects. The server is used to implement the contents of steps 1 to 4.

[0045] Here's how it works: When you start the Pixel Streaming component, the Pixel Streaming component running in the rendering engine will first establish a link to the signaling and web servers. The client will connect to the signaling server, which will serve an HTML page to the client that contains the player controls and control code written in JavaScript. When the user starts streaming, the signaling server will negotiate to establish a direct connection between the client browser and the rendering engine. Once the connection between the client and the rendering engine is established, the Pixel Streaming plugin will start streaming the media directly to the browser. Input from the client is sent directly back to the rendering engine by the JavaScript environment of the player page.

[0046] Step 6: Monitor the device status based on the visual rendering results.

[0047] The visualization rendering results obtained through the above steps 1 to 5, including the rendering results of the simulation results, the rendering results of the three-dimensional model and the fusion visualization rendering results of the two, realize full-dimensional information visualization, and can intuitively and in real time display the key operating indicators such as the internal temperature distribution and magnetic field distribution of the operating power equipment, realize accurate positioning of the equipment and real-time data viewing, enhance the operation and maintenance personnel's accurate control of the equipment status, effectively improve the accuracy of daily equipment inspections and emergency rescue and power supply of converter station electrical equipment, and help the new power system to operate safely and stably.

[0048] In summary, traditional simulation data is directly visualized in professional simulation software, and this application proposes a stereo registration technology for fusion rendering of simulation data based on standard simulation data format and three-dimensional model with high-fidelity structure. First, a standard simulation data format that meets lightweight transmission and accurate data semantics is defined, including vertex coordinates, vertex connection relationship and simulation results at vertices of simulation data. Then, data parsing and transmission services are performed based on the defined standard simulation data format, realizing efficient asynchronous simulation cloud graph parsing and efficient storage. According to the unified spatial coordinates, the three-dimensional model and the simulation rendering results are transformed and aligned with the coordinates, and large-scale tetrahedron stereo splicing rendering is performed to realize the registration of the simulation results and the three-dimensional model. Finally, the real-time pixel push streaming technology is used to realize the real-time cloud rendering service of the three-dimensional scene that fusion registers the simulation data with the three-dimensional model with high-fidelity structure, and the high-load graphics engine program is placed on the server backend. This technology realizes the loose coupling of simulation data visualization and simulation software, as well as the registration fusion visualization of simulation data and three-dimensional models with high-fidelity structures, reducing the dependence on specific simulation software, and also reducing the complexity and cost of replacing or upgrading simulation software. At the same time, data parsing and transmission services are developed based on the defined standard simulation data format, and real-time cloud rendering services for three-dimensional scenes that integrate simulation data with three-dimensional models with high-fidelity structures are realized through real-time pixel streaming technology. This overcomes problems such as strong fluctuations in simulation results, large volumes of simulation data, slow parsing, and difficult rendering, and successfully shortens the rendering time from tens of minutes to seconds, reducing time costs.

[0049] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0050] This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and core ideas of this application. At the same time, for those skilled in the art, according to the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. A device status monitoring method based on fusion rendering of simulation data and three-dimensional model, characterized in that: include: Get standard simulation data of the equipment; The equipment is electrical equipment of a converter station; Perform data analysis based on standard simulation data to obtain data readable by the rendering engine; Perform large-scale tetrahedral stereo stitching rendering based on the data readable by the rendering engine to obtain simulation rendering results; Perform stereo registration and fusion rendering on the simulation rendering result and the three-dimensional model to obtain a fusion model; Based on the fusion model, real-time pixel push streaming technology is used to provide real-time cloud rendering services for 3D scenes to obtain visual rendering results; Monitor device status based on visual rendering results.

2. The device status monitoring method based on fusion rendering of simulation data and three-dimensional model according to claim 1 is characterized in that: The obtaining of standard simulation data of the device specifically includes: Perform multi-physics field simulation analysis on the electrical equipment of the converter station to obtain simulation data of the electrical equipment of the converter station; the simulation data includes vertex coordinates, vertex connection order and simulation results at the vertices; the simulation results at the vertices include simulation value size, simulation value direction and color coding at the vertices; The simulation data is stored in two tables, one table stores the vertex coordinates and vertex connection order in the simulation data, and the other table stores the vertex coordinates and simulation results at the vertices in the simulation data, thereby obtaining standard simulation data stored in a standard simulation data format.

3. The device status monitoring method based on fusion rendering of simulation data and three-dimensional model according to claim 2 is characterized in that: The data is parsed based on the standard simulation data to obtain the rendering engine readable data, specifically including: Data analysis is performed based on the simulation results at the vertices in the standard simulation data to obtain rendering engine readable data and store them in a high-speed cache real-time library and a database; the rendering engine readable data includes vertex coordinates, vertex connection order, color level values, and the highest and lowest intervals of the simulation results at the vertices.

4. The device status monitoring method based on fusion rendering of simulation data and three-dimensional model according to claim 3 is characterized in that: The color scale value is obtained by converting the simulation result at the vertex using a unified color scale.

5. The device status monitoring method based on fusion rendering of simulation data and three-dimensional model according to claim 4 is characterized in that: The large-scale tetrahedron stereo stitching rendering is performed according to the readable data of the rendering engine to obtain the simulation rendering result, specifically including: Construct multiple regular tetrahedrons according to the vertex coordinates and vertex connection order in the rendering engine readable data; if the rendering engine readable data is two-dimensional simulation data, the obtained vertex connection order is the connection order of the triangle facets in the simulation result; if the rendering engine readable data is three-dimensional simulation data, the obtained vertex connection order is the vertex drawing order; Based on the color level values ​​in the data readable by the rendering engine, multiple regular tetrahedrons are subjected to large-scale tetrahedron stereo stitching rendering to obtain a simulation rendering result.

6. The device status monitoring method based on fusion rendering of simulation data and three-dimensional model according to claim 1 is characterized in that: The simulation rendering result is subjected to stereo registration and fusion rendering with the three-dimensional model to obtain a fusion model, specifically comprising: The same spatial coordinates are used to transform and align the coordinates of the simulation rendering results and the three-dimensional model, so as to achieve stereo registration fusion rendering of the simulation rendering results and the three-dimensional model and obtain a fusion model.

7. The device status monitoring method based on fusion rendering of simulation data and three-dimensional model according to claim 6 is characterized in that: The step of performing stereo registration fusion rendering on the simulation rendering result and the three-dimensional model to obtain a fusion model further includes: Before performing coordinate transformation and alignment, the center point of the global coordinate system is used as the alignment reference and the alignment references in the three-dimensional model and the simulation rendering result are compared to calculate the transformation matrix between the three-dimensional model and the simulation rendering result; the transformation matrix is ​​used to transform and align the coordinates of the simulation rendering result and the three-dimensional model.

Images