Electric power digital twin system 3D data display optimization method and system

Abstract

The invention provides an electric power digital twin system 3D data display optimization method and system, and relates to digital twin model optimization display. Comprising the following steps: mapping each information display panel to a screen 2D domain; judging whether the information display panels on the 2D domain of the screen are overlapped or not; if overlapping exists, supposing that repulsive force exists between the overlapped information display panels by adopting a stress simulation method, determining resultant force borne by each information display panel, and evacuating and separating each overlapped information display panel once according to the direction of the resultant force and a set speed; re-judging whether the evacuated and separated information display panels are still overlapped or not until the information display panels have no overlapped areas; and obtaining the current position of each information display panel, and mapping each information display panel back to the 3D domain according to the current position. According to the invention, misjudgment caused by missing important data by an operator is avoided, and the intelligent level of safe operation of a power system is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of digital twin model optimization and display, and in particular to a 3D data display optimization method and system for an electric power digital twin system. Background Art

[0002] Digital twins make full use of data such as physical models, sensor updates, and operation history, integrate multi-disciplinary, multi-physical quantity, multi-scale, and multi-probability simulation processes, and complete mapping in virtual space, thereby reflecting the entire life cycle of the corresponding physical equipment. It is currently widely used in product design, product manufacturing, medical analysis, engineering construction, and other fields. Digital twin technology has been widely used in power systems. In general, it is to digitally model the power equipment and environment in the real power system, use 3D visualization technology to display and update the data of these equipment and environments in real time, and enable the model to present reasonable changes according to human-machine operations.

[0003] Among them, the common 3D visualization data display is to display a panel with data on top of the model. When there are multiple panels, they often cover each other. The traditional way is to manually configure the position of the panel, which is complicated, time-consuming and labor-intensive, and it is inevitable that the problem of covering will still occur after the human-machine operation reaches a certain angle. If some important data is covered, it is easy for the operator to miss and misjudge, which has certain hidden dangers and hazards to the safe and stable operation of the power system. Summary of the invention

[0004] In order to overcome the shortcomings of the above-mentioned prior art, the present invention provides a 3D data display optimization method and system for an electric power digital twin system, which adopts a strategy of mapping the information display panel from the 3D domain to the 2D domain of the screen. When overlap is detected between panels, the overlapped ones are evacuated to a new position and then the new position is remapped back to the 3D domain. This avoids misjudgment caused by the operator missing important data and improves the intelligent level of safe operation of the power system.

[0005] To achieve the above objectives, one or more embodiments of the present invention provide the following technical solutions:

[0006] A first aspect of the present invention provides a method for optimizing 3D data display of an electric power digital twin system.

[0007] The 3D data display optimization method of the power digital twin system includes:

[0008] Step 1: Obtain the size and position of each information display panel in the 3D domain in the power digital twin system, and map each information display panel to the 2D domain of the screen;

[0009] Step 2: Determine whether the information display panels on the 2D domain of the screen overlap;

[0010] Step 3: If there is overlap, a force simulation method is used to assume that there is a repulsive force between the overlapping information display panels, and the resultant force on each overlapping information display panel is determined, and each overlapping information display panel is evacuated and separated once at a set speed according to the direction of the resultant force;

[0011] Step 4: re-determine whether the information display panels after evacuation and separation still overlap. If so, continue to iterate step 3 until there is no overlapping area between the information display panels; if not, directly execute step 5;

[0012] Step 5: Obtain the current position of each information display panel, and map each information display panel back to the 3D domain according to the current position, so as to prevent each display panel from being covered.

[0013] A second aspect of the present invention provides a 3D data display optimization system for a power digital twin system.

[0014] The 3D data display optimization system of the power digital twin system includes:

[0015] The mapping module is configured to: obtain the size and position of each information display panel in the 3D domain in the power digital twin system, and map each information display panel to the 2D domain of the screen;

[0016] The initial determination module is configured to: determine whether the information display panels on the 2D domain of the screen overlap;

[0017] The evacuation and separation module is configured to: if there is overlap, use a force simulation method to assume that there is a repulsive force between the overlapping information display panels, and determine the resultant force on each overlapping information display panel, and evacuate and separate each overlapping information display panel once at a set speed according to the direction of the resultant force;

[0018] The re-judgment module is configured to: re-judgment whether the information display panels after evacuation and separation still overlap; if so, continue to iterate the evacuation and separation module until there is no overlapping area between the information display panels; if not, directly execute the inverse mapping module:

[0019] The inverse mapping module is configured to: obtain the current position of each information display panel, and map each information display panel back to the 3D domain according to the current position, so as to prevent each display panel from being covered.

[0020] One or more of the above technical solutions have the following beneficial effects:

[0021] The present invention provides a method and system for optimizing 3D data display of an electric power digital twin system. The method tracks the size and position of each information display panel in the electric power digital twin system in the 3D domain, maps it from the 3D domain to the 2D domain of the screen, and detects whether there is overlap between the panels in the 2D domain. When there is overlap between the panels, the overlapped ones are evacuated to a new position, and iterates until all panels have no overlap, and then remaps the new position back to the 3D domain. This method can automatically prevent the displayed information from being covered, avoids the operator's misjudgment due to missing some important data, and improves the intelligent level of safe operation of the power system.

[0022] The present invention adopts a method of simulating force when evacuating and separating overlapping panels in the 2D domain of the screen. It assumes that there is a repulsive force between the overlapping information display panels, and determines the resultant force received by each overlapping information display panel. Each overlapping information display panel is evacuated and separated once at a set speed according to the direction of the resultant force, and then it is re-judged whether the panels moved to the new position are still overlapping. The overall judgment logic is simple and easy to operate.

[0023] The present invention regards each panel as a rectangle, and converts the judgment of whether there is overlap between any two information display panels into the judgment of whether there is overlap between rectangle A and rectangle B. The reverse thinking is adopted to judge the "non-overlap" situation, and the judgment criteria are designed. When none of the judgment criteria are met, it is judged that the two rectangles overlap, and then it is judged that the two panels overlap.

[0024] Advantages of additional aspects of the present invention will be given in part in the following description, and in part will become obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The accompanying drawings in the specification, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0026] Figure 1 This is a flow chart of the method of the first embodiment.

[0027] Figure 2 This is a schematic diagram showing the stress states of various rectangles of the panel on the 2D domain of the screen in the first embodiment.

[0028] Figure 3 It is a system structure diagram of the second embodiment. DETAILED DESCRIPTION

[0029] It should be noted that the following detailed descriptions are exemplary and are intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those commonly understood by those skilled in the art to which the present invention belongs.

[0030] It should be noted that the terms used herein are for describing specific embodiments only and are not intended to be limiting of exemplary embodiments according to the present invention.

[0031] In the absence of conflict, the embodiments of the present invention and the features of the embodiments may be combined with each other.

[0032] The overall idea proposed by the present invention is:

[0033] The method for automatically avoiding display information from being covered in a digital twin 3D proposed by the present invention comprises the following steps:

[0034] (1) Track the size and position of each information display panel in the 3D domain and map them to the screen 2D domain;

[0035] (2) Check the size and position of these 2D screens to determine whether there is overlap between panels. If so, move the overlapping panels away from each other, that is, evacuate the overlapping panels to new positions, and check whether the panels in the new positions and other panels that did not overlap before have new overlaps due to the evacuation. If so, translate them synchronously until they do not overlap;

[0036] (3) Re-map these evacuated new positions back into the 3D domain for other operations, such as drawing indicator lines from the panel to the corresponding model.

[0037] The present invention actually provides a design method for automatically avoiding display information from being covered. The method tracks the size and position of each information display panel in the 3D domain, maps each information display panel to the 2D domain of the screen, and when overlap between panels is detected, evacuates the overlapped ones to a new position, and then remaps the new position back to the 3D domain, thereby avoiding misjudgment caused by the operator missing some important data and improving the intelligent level of safe operation of the power system.

[0038] Embodiment 1

[0039] This embodiment discloses a 3D data display optimization method for an electric power digital twin system.

[0040] like Figure 1 As shown, the 3D data display optimization method of the power digital twin system includes:

[0041] Step 1: Obtain the size and position of each information display panel in the 3D domain in the power digital twin system, and map each information display panel to the 2D domain of the screen;

[0042] Step 2: Determine whether the information display panels on the 2D domain of the screen overlap;

[0043] Step 3: If there is overlap, a force simulation method is used to assume that there is a repulsive force between the overlapping information display panels, and the resultant force on each overlapping information display panel is determined, and each overlapping information display panel is evacuated and separated once at a set speed according to the direction of the resultant force;

[0044] Step 4: re-determine whether the information display panels after evacuation and separation still overlap. If so, continue to iterate step 3 until there is no overlapping area between the information display panels; if not, directly execute step 5;

[0045] Step 5: Obtain the current position of each information display panel, and map each information display panel back to the 3D domain according to the current position, so as to prevent each display panel from being covered.

[0046] In order to automatically avoid the display information in the power system twin system from being covered, this embodiment first tracks the size and position of each panel in the 3D domain, maps the panels in the 3D domain to the 2D domain of the screen, and when it is detected that there is overlap between panels in the 2D domain of the screen, evacuates the overlapped panels to a new position. Re-map this new position back to the 3D domain, and then draw an indicator line from the panel to the corresponding model according to the 3D coordinates, or perform other operations.

[0047] After the human-machine operation, the system recalculates and updates according to the new position. The panel is always parallel to the screen, and the information can be fully displayed without covering. When the corresponding model moves in space, the position between the panel and the corresponding model can also be automatically adjusted. Through experimental data testing, the effect of the automatic avoidance of covering method of this embodiment in digital twin 3D is verified, which can display the operating status of the power system more friendly and reliable than the traditional display method.

[0048] Before step 1, it is understandable that the real power equipment in the power system needs to be mapped to the digital twin system, the real power equipment and environment need to be digitally modeled, and the data of these equipment and environment need to be displayed and updated in real time using 3D visualization technology to form a power digital twin system. This is the existing technology and will not be described in detail.

[0049] Further:

[0050] The specific method of step one is:

[0051] The business program that drives the 3D engine to draw the information panel to the corresponding position must hold the initial coordinates and size information of each panel in the 3D domain. The initial position of these panels is generally around the corresponding 3D model, and it moves with the corresponding model. What we see on the display screen is actually what the "camera" in the 3D world sees, that is, the projection of the 3D model on the camera imaging plane. The direction of the camera is the normal of this projection plane.

[0052] Mapping the initial coordinates and size of the business program in the 3D domain to the 2D domain of the screen is to convert according to the normal and the distance from the mapped object to the projection plane. Specifically, the 3D coordinates (x, y, z) are converted into 2D coordinates (u, v) through the general perspective projection algorithm - perspective transformation, as shown below:

[0053]

[0054] in, It is the projection matrix, and its specific parameters are determined according to the distance from the near clipping plane to the camera, the distance from the far clipping plane to the camera, the width of the projection plane, the height of the projection plane and other parameters.

[0055] The stereo image in the 3D domain is mapped to a plane image on the 2D domain of the screen, which can then be further rendered for display on the screen and provide user interaction functions such as scaling, rotating and moving the image to change its display on the screen.

[0056] The specific method of step 2 is:

[0057] Through step 1, the size and position of each panel after perspective transformation into a plane can be obtained. Each panel is a horizontal and vertical plane rectangle, and these 2D coordinates are traversed to determine whether there is overlap.

[0058] Here we use reverse thinking to determine the "non-overlapping" situation: the coordinates of the upper left corner and lower right corner of rectangle A are expressed as (aStartX, aStartY) and (aEndX, aEndY) respectively; the coordinates of the upper left corner and lower right corner of rectangle B are expressed as (bStartX, bStartY) and (bEndX, bEndY) respectively.

[0059] The above-mentioned rectangular coordinates of this embodiment are related to the present technical solution in that after each panel is transformed into a plane, the obtained plane is regarded as a plane rectangle, and the coordinates of the plane rectangle are represented by the above-mentioned coordinate representation method.

[0060] Since in a rectangle, the coordinates of the entire rectangle can be located by only locating the coordinates of the upper left corner and the lower right corner, the above coordinate representation only shows the coordinate representation of the upper left corner and the lower right corner.

[0061] If rectangle A does not overlap rectangle B, then rectangle A must be on the left, right, top, or bottom of rectangle B. That is:

[0062] aEndX<bStartX∪aStartX> bEndX∪aEndY>bStartY∪

[0063] aStartY <bEndY

[0064] The above conditions are related to the present technical solution in that after each panel is transformed into a plane and the obtained plane is regarded as a flat rectangle, if it is to be determined whether two rectangles overlap, this embodiment provides the above example. That is, when rectangle A does not overlap rectangle B, rectangle A must be on the left side, right side, top side, or bottom side of rectangle B.

[0065] When rectangle A is on the left side of rectangle B: aEndX <bStartX;

[0066] When rectangle A is on the right side of rectangle B: aStartX>bEndX;

[0067] When rectangle A is on the upper side of rectangle B: aEndY>bStartY;

[0068] When rectangle A is below rectangle B: aStartY <bEndY。

[0069] When one of the above conditions is met, rectangle A and rectangle B do not overlap; when none of the above conditions is met, rectangle A and rectangle B overlap.

[0070] When the above conditions are not met, rectangle A and rectangle B need to be evacuated from each other. The evacuation strategy is achieved by simulating force:

[0071] Assume that when any rectangle A overlaps with any rectangle B, there is a repulsive force between the centers of rectangle A and rectangle B. When there is no overlap, the repulsive force is 0. It is agreed that the speed at which the rectangles separate from each other due to the repulsive force is consistent with the direction of the repulsive force. For simplicity, the speed of separation is defined as a constant value v (v>0), and when the repulsive force becomes 0, v=0.

[0072] like Figure 2 As shown, the direction of the repulsive force Fb on rectangle A is from the center of rectangle B to the center of rectangle A; if rectangle A overlaps with any rectangle C at the same time, rectangle A is also subject to a repulsive force Fc, the direction of which is from the center of rectangle C to the center of rectangle A; the final resultant force on rectangle A is the vector sum of Fb and Fc. If there are more overlapping rectangles, the same applies.

[0073] Assuming the coordinates of the upper left corner (aStartX, aStartY) and the lower right corner (aEndX, aEndY) of rectangle A, the center coordinates of rectangle A are:

[0074] (aCenterX, aCenterY) = ((aStartX+aEndX) / 2, (aStartY+aEndY) / 2).

[0075] Similarly, the coordinates of the upper left corner (bStartX, bStartY) and lower right corner (bEndX, bEndY) of rectangle B, then the center coordinates of rectangle B are:

[0076] (bCenterX, bCenterY) = ((bStartX+bEndX) / 2, (bStartY+bEndY) / 2).

[0077] The connection between the above formula and the technical solution of this embodiment is that after each panel is transformed into a plane and the obtained plane is regarded as a plane rectangle, the center coordinates of the rectangle are half of the sum of the X-axis coordinates corresponding to the upper left corner coordinate and the lower right corner coordinate, and half of the sum of the corresponding Y-axis coordinates.

[0078] When any rectangle A overlaps with rectangle B at one point, the repulsive force from rectangle B at the center coordinates (aCenterX, aCenterY) of rectangle A is expressed as:

[0079]

[0080] Each time the rectangles are calculated, the translation direction is the direction of their current resultant force, and the displacement changes by v. If an overlapping area is reduced to 0, the repulsive force component will become 0, and the speed will lose its influence in direction. When all overlapping areas of a rectangle are 0, v becomes 0, and the rectangle stops moving.

[0081] The specific method of step 4 is:

[0082] At the end of each calculation, check whether all rectangles have no overlapping areas. If not, continue to iterate, otherwise the evacuation is completed and the calculation ends.

[0083] When the value of v is larger, the evacuation speed is faster, and the maximum gap between rectangles after the evacuation is completed is also larger. When the value of v is smaller, the evacuation speed is slower, but the maximum gap between rectangles after the evacuation is completed is smaller. The size of the gap has little effect on the expected effect.

[0084] The specific method of step five is:

[0085] Using the new coordinate values ​​obtained in step 4, reapply the inverse operation of the perspective transformation in step 1 to convert the 2D coordinates into 3D coordinates:

[0086]

[0087] in, It is the inverse projection matrix, and its specific parameters are determined according to parameters such as the distance from the near clipping plane to the camera, the distance from the far clipping plane to the camera, the width of the projection plane, and the height of the projection plane.

[0088] At this point, the effect of automatically avoiding the display information from being covered in the power digital twin 3D has been achieved. Subsequent rendering can be used to perform other operations, such as drawing indicator lines from the panel to the corresponding model.

[0089] This embodiment overcomes the shortcomings of the prior art and provides a design method for automatically avoiding the covering of displayed information for the application of 3D visualization data display technology based on digital twins in power systems. It can display the operating status of the power system in a more friendly and reliable manner, thereby avoiding the risk of missed judgment or misjudgment caused by the operator omitting certain important data, and improving the stability and intelligence level of safe operation of the power system.

[0090] Embodiment 2

[0091] This embodiment discloses a 3D data display optimization system for a power digital twin system.

[0092] like Figure 3 As shown in the figure, the 3D data display optimization system of the power digital twin system includes:

[0093] The mapping module is configured to: obtain the size and position of each information display panel in the 3D domain in the power digital twin system, and map each information display panel to the 2D domain of the screen;

[0094] The initial determination module is configured to: determine whether the information display panels on the 2D domain of the screen overlap;

[0095] The evacuation and separation module is configured to: if there is overlap, use a force simulation method to assume that there is a repulsive force between the overlapping information display panels, and determine the resultant force on each overlapping information display panel, and evacuate and separate each overlapping information display panel once at a set speed according to the direction of the resultant force;

[0096] The re-judgment module is configured to: re-judgment whether the information display panels after evacuation and separation still overlap, if so, continue to iterate the evacuation and separation module until there is no overlapping area between the information display panels; if not, directly execute the inverse mapping module;

[0097] The inverse mapping module is configured to: obtain the current position of each information display panel, and map each information display panel back to the 3D domain according to the current position, so as to prevent each display panel from being covered.

[0098] Those skilled in the art should understand that the modules or steps of the present invention described above can be implemented by a general-purpose computer device, or alternatively, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. The present invention is not limited to any specific combination of hardware and software.

[0099] Although the above describes the specific implementation mode of the present invention in conjunction with the accompanying drawings, it is not intended to limit the scope of protection of the present invention. Those skilled in the art should understand that various modifications or variations that can be made by those skilled in the art on the basis of the technical solution of the present invention without creative work are still within the scope of protection of the present invention.

Claims

1. A 3D data display optimization method for a power digital twin system, characterized in that: include: Step 1: Obtain the size and position of each information display panel in the 3D domain in the power digital twin system, and map each information display panel to the 2D domain of the screen; Step 2: Determine whether the information display panels on the 2D domain of the screen overlap; Step 3: If there is overlap, a force simulation method is used to assume that there is a repulsive force between the overlapping information display panels, and the resultant force on each overlapping information display panel is determined, and each overlapping information display panel is evacuated and separated once at a set speed according to the direction of the resultant force; Step 4: re-determine whether the information display panels after evacuation and separation still overlap. If so, continue to iterate step 3 until there is no overlapping area between the information display panels; if not, directly execute step 5; Step 5: Obtain the current position of each information display panel, and map each information display panel back to the 3D domain according to the current position, so as to prevent each display panel from being covered.

2. The 3D data display optimization method of the power digital twin system according to claim 1, characterized in that: In step 2, it is determined whether the information display panels on the 2D domain of the screen overlap, specifically including: Each panel is regarded as a rectangle, and the determination of whether any two information display panels overlap is converted into the determination of whether rectangle A and rectangle B overlap; The coordinates of the upper left corner and lower right corner of rectangle A are expressed as (aStartX, aStartY) and (aEndX, aEndY) respectively; the coordinates of the upper left corner and lower right corner of rectangle B are expressed as (bStartX, bStartY) and (bEndX, bEndY) respectively; Determine whether the following conditions are met: aEndX<bStartX∪aStartX> bEndX∪aEndY>bStartY∪ aStartY <bEndY; When one of the above conditions is met, rectangle A and rectangle B do not overlap; when none of the above conditions is met, rectangle A and rectangle B overlap.

3. The 3D data display optimization method of the power digital twin system according to claim 2, characterized in that: In step 3, it is assumed that when rectangle A and rectangle B representing the information display panel overlap, there is a repulsive force between rectangle A and rectangle B. When there is no overlap, the repulsive force is 0: It is agreed that the direction of the repulsive force Fb on rectangle A from rectangle B is from the center of rectangle B to the center of rectangle A; If rectangle A overlaps with any rectangle C at the same time, rectangle A will also be subject to a repulsive force Fc from rectangle C, and the direction of the repulsive force Fc is from the center of rectangle C to the center of rectangle A; The final resultant force on rectangle A is the vector sum of Fb and Fc.

4. The 3D data display optimization method of the power digital twin system according to claim 3, characterized in that: In the step three, at each movement, the speed at which the two rectangles are evacuated and separated from each other is defined as a constant value v, where v>0.

5. The 3D data display optimization method of the power digital twin system according to claim 1, characterized in that: When the repulsive force between the rectangles becomes 0, the repulsive force loses its directional influence on the velocity, and v=0.

6. The 3D data display optimization method of the power digital twin system according to claim 4, characterized in that: When the evacuation separation speed value is larger, the evacuation separation speed between rectangles is faster, and the gap between rectangles will be larger after the evacuation is completed.

7. The method for optimizing 3D data display of a power digital twin system according to claim 1, characterized in that: In the step 1, each information display panel in the 3D domain is mapped to the 2D domain of the screen through perspective transformation, and the 3D coordinates are converted into 2D coordinates.

8. The method for optimizing 3D data display of a power digital twin system according to claim 1, characterized in that: In the step five, each information display panel is mapped back into the 3D domain through the inverse operation of the perspective transformation, and the 2D coordinates are converted into 3D coordinates.

9. The method for optimizing 3D data display of a power digital twin system according to claim 1, characterized in that: Before step one, it is also necessary to map the real power equipment in the power system to the digital twin system, digitally model the real power equipment and environment, and use 3D visualization technology to display and update the data of the real power equipment and environment in real time to form a power digital twin system.

10. The 3D data display optimization system of the power digital twin system is characterized by: include: The mapping module is configured to: obtain the size and position of each information display panel in the 3D domain in the power digital twin system, and map each information display panel to the 2D domain of the screen; The initial determination module is configured to: determine whether the information display panels on the 2D domain of the screen overlap; The evacuation and separation module is configured to: if there is overlap, use a force simulation method to assume that there is a repulsive force between the overlapping information display panels, and determine the resultant force on each overlapping information display panel, and evacuate and separate each overlapping information display panel once at a set speed according to the direction of the resultant force; The re-judgment module is configured to: re-judgment whether the information display panels after evacuation and separation still overlap, if so, continue to iterate the evacuation and separation module until there is no overlapping area between the information display panels; if not, directly execute the inverse mapping module; The inverse mapping module is configured to: obtain the current position of each information display panel, and map each information display panel back to the 3D domain according to the current position, so as to prevent each display panel from being covered.

Images