3D Modeling Method of Smart Substation

CN114741768BActive Publication Date: 2024-11-26四川赛康智能科技股份有限公司
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202210451319.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-27
Publication Date
2024-11-26
Estimated Expiration
2042-04-27

Smart Images

  • Figure CN114741768B_ABST
    Figure CN114741768B_ABST
Patent Text Reader

Abstract

The present application discloses a three-dimensional modeling method for a smart substation, comprising the following steps: substation mapping, formulating a modeling sampling route and setting a plurality of sampling points K r ; Using CCD camera at sampling point K r The nearest primary equipment and auxiliary equipment are photographed to obtain the corresponding image P rt And record the image P rt The direction of shooting and the modeling sampling route at sampling point K r The angle α rt ; Obtain 3D point cloud data through non-contact active scanning of laser point cloud; Image P rt The color point cloud data is obtained by fusing with the three-dimensional point cloud data through the F‑PoirtRet algorithm, and the color point cloud data is used through the OpenGL graphics algorithm to construct a three-dimensional space geometry and render it through a shader, and then the WebGL graphics acceleration renderer is used to generate a WebGL-based digital twin graphics library to obtain a three-dimensional model of the substation. The present invention adopts preset modeling sampling routes, sampling points and single-point multi-angle shooting and non-contact laser scanning point clouds through the F‑PoirtRet algorithm to obtain a high-precision substation digital twin model.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of image processing and modeling technology, in particular to the field of modeling technology based on image and laser point cloud fusion, and specifically to a three-dimensional modeling method for a smart substation. Background Art

[0002] The power system consists of various links such as generation, transmission, transformation and distribution, and substation is an important part of it. Under the strategic requirements of the country to promote the construction of a new power system, substations are the hub of the power grid operation, and their operating status is related to the safety and stability of the entire power system. With the rapid growth of equipment scale and the rapid development of new digital technologies, the requirements for the digitization of the entire station information are getting higher and higher. Building an intelligent substation platform based on the Internet of Things technology has become the focus of industry research. Three-dimensional visual modeling is the basic technology for building an intelligent substation platform, and the quality of modeling will be directly related to the quality of the intelligent substation platform.

[0003] The current mainstream 3D modeling technology refers to the use of 3D design software based on the ACIS kernel to construct various wireframes, surfaces, and solid shapes through geometric transformation to form models with 3D display features. This model provides 3D visualization effects such as coloring and hiding. Directly loading the model generated by 3D modeling technology into a 3D environment cannot fully reflect the 3D characteristics of power equipment. In order to enhance the realism of the substation 3D model and lay the foundation for the system construction of smart substations, a substation model that is closer to the real one is needed. Summary of the invention

[0004] In order to solve the problem that the three-dimensional model of the substation built by the existing three-dimensional modeling software cannot fully reflect the three-dimensional characteristics of the power equipment, the present application provides a three-dimensional modeling method for an intelligent substation, which can convert the physical structure into a digital model to achieve the effect of a digital twin by accurately fusing images and point clouds according to the points and orientations of the image shooting.

[0005] In the prior art, for the digital model obtained by three-dimensional modeling, although the software has given the functions of coloring, lighting, and rendering to make the obtained three-dimensional model data as realistic as possible, the three-dimensional features of the power equipment in the prior art cannot be fully reflected after modeling, and the coloring reality after rendering is low, and there is a problem of partial distortion of the position ratio between the equipment. The main reason for this problem is that due to the angle limitation of a single scan, the software has calculation errors that lead to proportion distortion; there is no objective material color correspondence, resulting in coloring distortion.

[0006] In order to solve this problem, the present invention specifically adopts secondary imaging and image precision fusion methods to respectively solve the problems of size ratio distortion and color rendering distortion caused by single-angle scanning.

[0007] In order to achieve the above purpose, the technical solution adopted in this application is:

[0008] The three-dimensional modeling method of the smart substation includes the following steps:

[0009] Step STP100, substation mapping, obtain the overall outer dimensions of the substation and formulate a modeling sampling route, the modeling sampling route is formed by connecting multiple line segments, and multiple sampling points K are set on the modeling sampling route r ;

[0010] Step STP200, using a CCD camera to sequentially scan sampling points K along the modeled sampling route r The nearest device and auxiliary device are photographed to obtain the corresponding image P rt And record the image P rt The direction of shooting and the modeling sampling route are along the forward direction at the sampling point K r The angle α rt ;

[0011] Step STP300, using a FARO Focus s 150 / 70 laser scanner to acquire three-dimensional point cloud data along the modeling sampling route through laser point cloud non-contact active scanning;

[0012] Step STP400, the image P obtained in step STP200 is rt The three-dimensional point cloud data obtained in step STP300 is fused with the F-PoirtRet algorithm to obtain color point cloud data, where the fusion reference point is the sampling point K r , the matching angle is angle α rt ;

[0013] Step STP500, the color point cloud data is used through the OpenGL graphics algorithm to construct a three-dimensional space geometry and render it through a shader, and then the WebGL graphics acceleration renderer is used to generate a WebGL-based digital twin graphics library to obtain a three-dimensional model of the substation.

[0014] Brief description of model establishment principle:

[0015] Since each substation has a different layout, size, and installed power equipment, in order to objectively reflect the equipment layout of the substation from an overall global perspective, so as to facilitate the later digitalization, intelligence, and visualization of the substation, it is necessary to fully reflect the main primary equipment and secondary auxiliary equipment in the substation. Therefore, when sampling the substation, multi-angle sampling is required for the main equipment of the substation to achieve accurate matching and the technical effect of twin modeling. Step STP100 The purpose of mapping the substation and formulating the modeling sampling route is to ensure that all major power equipment, including primary equipment and secondary auxiliary equipment, are reasonably included in the sampling range, and sampling point K r The number and location of the sampling points are not subject to specific restrictions and can be determined according to the actual substation layout. r It can be set on the line segment or at the end point of the line segment, where r=1, 2, 3, 4...r; sampling work is carried out after the modeling sampling route and sampling point are determined.

[0016] A CCD camera is used to capture images at each sampling point K1-K along the set modeling sampling line. r Photograph the power equipment on both sides of the modeling sampling line, and take pictures at the corresponding sampling point K. r As the base point, with sampling point K r The line segment along which the line segment moves toward the next endpoint or sampling point K r+1 The direction is used as the reference line and deflected clockwise to the direction of the actual shooting alignment. The actual deflection angle α rt Denote as at sampling point K r The first photo of P rt , where t=1, 2, 3, 4...t; if at sampling point K r If you need to take a second photo, the second photo will be recorded as P rt+1 The above method is followed until all sampling points are executed, at which point the actual framing photo collection work is completed.

[0017] A FARO Focus s 150 / 70 laser scanner is used to obtain three-dimensional point cloud data through non-contact active scanning of laser point clouds along the modeling sampling route; of course, there are many types of non-contact laser point cloud scanning equipment. According to the actual scene application needs, technicians in this field can flexibly and independently choose laser scanners on the premise of achieving or exceeding the expected effect. After the scanning is completed, the point cloud of the entire substation will be obtained.

[0018] The 3D point cloud data and the photos P rt The collection is divided into two groups according to the corresponding sampling point K. r and matching angle α rtThe F-PoirtRet algorithm is used for fusion. It is worth noting that the fusion calculation here is one of the important technical inventions of the present invention, and is described in detail as follows:

[0019] The existing F-PoirtRet algorithm is usually calculated based on pure 3D point cloud data. Although the final calculation accuracy will meet expectations, its disadvantage is that it requires high computing power and a huge amount of calculation, which leads to a large time consumption and low computing efficiency. Of course, based on the improved method of F-PoirtRet, it is also possible to first perform 2D target detection, such as target detection using photos taken by a CCD camera, and then perform 3D target detection and matching on the point cloud data. This method is more efficient than calculating pure 3D point data, but there are still areas for improvement, specifically:

[0020] First, when performing the fusion algorithm, it takes time and effort to detect two-dimensional targets, and positioning cannot be achieved quickly;

[0021] Second, after the two-dimensional target is detected, there is a matching error in the point cloud matching process. The fundamental reason lies in the discreteness of the point cloud data and the recognition error of the two-dimensional target.

[0022] In this application, any picture taken by a CCD camera can be obtained by sampling the corresponding point K r and the matching angle α rt To perform precise positioning, the advantage is that fast positioning fusion can be achieved without changing the underlying algorithm. Compared with autonomous identification of two-dimensional targets, it has higher efficiency and precise matching, and the distortion of the fused model is lower.

[0023] After matching and fusion, the color point cloud data is passed through the OpenGL graphics algorithm to construct a three-dimensional spatial geometry and rendered through a shader, and then the WebGL graphics acceleration renderer is used to generate a WebGL-based digital twin graphics library to obtain a three-dimensional model of the substation. The above-mentioned subsequent processing algorithm is an existing technology, and its rendering process is not described in detail here.

[0024] In order to achieve accurate matching, preferably, the height from the ground when shooting with a CCD camera in step STP200 and the height of the laser point cloud scanning in step STP300 are both H.

[0025] Further preferably, step STP300 also includes a second laser point cloud scanning step, where the scanning height is greater than the highest height of the substation equipment. In this step, an existing photography drone can be used to fly and sample along the modeling sampling route at a preset height, thereby achieving multi-angle point cloud set calibration, filling in the scanning blind area, and overcoming the problem of substation scale distortion and equipment missing.

[0026] Further preferably, the step STP400 further includes the step of simulating and identifying the color point cloud data, specifically including:

[0027] Octree encoding is used to simplify the denoising of the color point cloud data, the processed color point cloud data is calibrated and the size is standardized, the subspace feature vector is classified using the KNN algorithm, and the classification accuracy is improved using the particle cluster optimization algorithm. The simplified denoising process specifically includes the following steps:

[0028] Step STP410, according to the specified point distance d 0 Determine the number of layers n of the octree division;

[0029] Step STP420, encoding each point p (x, y, z) in the color point cloud data;

[0030] Convert x, y, z to index values ​​i, j, k using the following formula:

[0031] ,

[0032] Among them, x min ,y min 、z min They are the minimum values ​​of the x, y, and z axis coordinates respectively. The index values ​​can be expressed in binary as follows:

[0033] ;

[0034] where i m 、j m , k m ∈{0, 1} and m∈{0, 1, ..., n-1}. P(x, y, z) is encoded as Q=q n-1 ˄q m ˄q1q0, where q m =i m +j m 2 1 +k m 2 2 ;

[0035] Step STP430, the same code value is stored in the same minimum cube sorted by code value;

[0036] In step STP440, the point closest to the center point is retained, and other points in each minimum cube are deleted to achieve the purpose of denoising.

[0037] Beneficial effects:

[0038] The present invention adopts preset modeling sampling routes, sampling points and single-point multi-angle shooting and non-contact laser scanning point cloud to fuse through the F-PoirtRet algorithm to obtain a high-precision digital twin model of the substation; at the same time, through the calibration of sampling points and angles, rapid positioning fusion can be achieved without changing the underlying algorithm for photo recognition, which has higher efficiency and precise matching compared to autonomous identification of two-dimensional targets, and reduces the distortion of the fused model. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative labor.

[0040] Figure 1 It is a schematic diagram of the present invention using a CCD camera to shoot.

[0041] Figure 2 It is a picture collected by a CCD camera.

[0042] Figure 3 It is a 3D model of the substation.

[0043] Figure 4 It is a model of electric power equipment after fusion and grayscale processing. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.

[0045] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0046] Preferred embodiment:

[0047] This embodiment provides a three-dimensional modeling method for a smart substation, comprising the following steps:

[0048] Step STP100, substation mapping, obtain the overall outer dimensions of the substation and formulate a modeling sampling route, the modeling sampling route is formed by connecting multiple line segments, and multiple sampling points K are set on the modeling sampling route r ;

[0049] Step STP200, using a CCD camera to sequentially scan sampling points K along the modeled sampling route r The nearest device and auxiliary device are photographed to obtain the corresponding image P rt And record the image P rt The direction of shooting and the modeling sampling route are along the forward direction at the sampling point K r The angle α rt ;

[0050] In step STP300, a FARO Focus s 150 / 70 laser scanner is used to obtain three-dimensional point cloud data by non-contact active scanning of laser point cloud along the modeling sampling route; in order to achieve accurate matching, in this embodiment, the height from the ground when shooting with a CCD camera in step STP200 and the height of the laser point cloud scanning in step STP300 are both H.

[0051] Step STP300 also includes a second laser point cloud scanning step, where the scanning height is greater than the highest height of the substation equipment. In this step, an existing photography drone can be used to fly and sample along the modeled sampling route at a preset height, thereby achieving multi-angle point cloud set calibration, filling in the scanning blind area, and overcoming the problem of substation scale distortion and equipment missing.

[0052] Step STP400, the image P obtained in step STP200 is rt The three-dimensional point cloud data obtained in step STP300 is fused with the F-PoirtRet algorithm to obtain color point cloud data, where the fusion reference point is the sampling point K r , the matching angle is angle α rt ;

[0053] In this embodiment, step STP400 also includes the step of simulating and identifying the color point cloud data, specifically including:

[0054] Octree encoding is used to simplify the denoising of the color point cloud data, the processed color point cloud data is calibrated and the size is standardized, the subspace feature vector is classified using the KNN algorithm, and the classification accuracy is improved using the particle cluster optimization algorithm. The simplified denoising process specifically includes the following steps:

[0055] Step STP410, according to the specified point distance d 0 Determine the number of layers n of the octree division;

[0056] Step STP420, encoding each point p (x, y, z) in the color point cloud data;

[0057] Convert x, y, z to index values ​​i, j, k using the following formula:

[0058] ,

[0059] Among them, x min ,y min 、z min They are the minimum values ​​of the x, y, and z axis coordinates respectively. The index values ​​can be expressed in binary as follows:

[0060] ;

[0061] where i m 、j m , k m ∈{0, 1} and m∈{0, 1, ..., n-1}. P(x, y, z) is encoded as Q=q n-1 ˄q m ˄q1q0, where q m =i m +j m 2 1 +k m 2 2 ;

[0062] Step STP430, the same code value is stored in the same minimum cube sorted by code value;

[0063] In step STP440, the point closest to the center point is retained, and other points in each minimum cube are deleted to achieve the purpose of denoising.

[0064] Step STP500, the color point cloud data is used through the OpenGL graphics algorithm to construct a three-dimensional space geometry and render it through a shader, and then the WebGL graphics acceleration renderer is used to generate a WebGL-based digital twin graphics library to obtain a three-dimensional model of the substation.

[0065] Brief description of model establishment principle:

[0066] Since each substation has a different layout, size, and installed power equipment, in order to objectively reflect the equipment layout of the substation from an overall global perspective, so as to facilitate the later digitalization, intelligence, and visualization of the substation, it is necessary to fully reflect the main primary equipment and secondary auxiliary equipment in the substation. Therefore, when sampling the substation, multi-angle sampling is required for the main equipment of the substation to achieve accurate matching and the technical effect of twin modeling. Step STP100 The purpose of mapping the substation and formulating the modeling sampling route is to ensure that all major power equipment, including primary equipment and secondary auxiliary equipment, are reasonably included in the sampling range, and sampling point K r The number and location of the sampling points are not subject to specific restrictions and can be determined according to the actual substation layout. r It can be set on the line segment or at the end point of the line segment, where r=1, 2, 3, 4...r; sampling work is carried out after the modeling sampling route and sampling point are determined.

[0067] A CCD camera is used to capture images at each sampling point K1-K along the set modeling sampling line. r Photograph the power equipment on both sides of the modeling sampling line, and take pictures at the corresponding sampling point K. r As the base point, with sampling point K r The line segment along which the line segment moves toward the next endpoint or sampling point K r+1 The direction is used as the reference line and deflected clockwise to the direction of the actual shooting alignment. The actual deflection angle α rt Denote as at sampling point K r The first photo of P rt , where t=1, 2, 3, 4...t; if at sampling point K r If you need to take a second photo, the second photo will be recorded as P rt+1 The above method is followed until all sampling points are executed. At this point, the actual framing photo collection work is completed. Specifically, at the first sampling point K1, take a photo at angles α11=-45°, α12=-30°, α13=-15°, α14=0°, α15=15°, α16=30°, and α17=45°, and the corresponding photo is P 11 , P 12 , P 13 , P 14 , P 15 , P 16 , P 17 Similarly, at sampling point K2, photos are collected as needed in the same way until sampling point K r Until the collection is completed.

[0068] A FARO Focus s 150 / 70 laser scanner is used to obtain three-dimensional point cloud data through non-contact active scanning of laser point clouds along the modeling sampling route; of course, there are many types of non-contact laser point cloud scanning equipment. According to the actual scene application needs, technicians in this field can flexibly and independently choose laser scanners on the premise of achieving or exceeding the expected effect. After the scanning is completed, the point cloud of the entire substation will be obtained.

[0069] The 3D point cloud data and the photos P rt The collection is divided into two groups according to the corresponding sampling point K. r and matching angle α rt The F-PoirtRet algorithm is used for fusion. It is worth noting that the fusion calculation here is one of the important technical inventions of the present invention, and is described in detail as follows:

[0070] The existing F-PoirtRet algorithm is usually calculated based on pure 3D point cloud data. Although the final calculation accuracy will meet expectations, its disadvantage is that it requires high computing power and a huge amount of calculation, which leads to a large time consumption and low computing efficiency. Of course, based on the improved method of F-PoirtRet, it is also possible to first perform 2D target detection, such as target detection using photos taken by a CCD camera, and then perform 3D target detection and matching on the point cloud data. This method is more efficient than calculating pure 3D point data, but there are still areas for improvement, specifically:

[0071] First, when performing the fusion algorithm, it takes time and effort to detect two-dimensional targets, and positioning cannot be achieved quickly;

[0072] Second, after the two-dimensional target is detected, there is a matching error in the point cloud matching process. The fundamental reason lies in the discreteness of the point cloud data and the recognition error of the two-dimensional target.

[0073] In this application, any picture taken by a CCD camera can be obtained by sampling the corresponding point K r and the matching angle α rt To perform precise positioning, the advantage is that fast positioning fusion can be achieved without changing the underlying algorithm. Compared with autonomous identification of two-dimensional targets, it has higher efficiency and precise matching, and the distortion of the fused model is lower.

[0074] After matching and fusion, the color point cloud data is passed through the OpenGL graphics algorithm to construct a three-dimensional spatial geometry and rendered through a shader, and then the WebGL graphics acceleration renderer is used to generate a WebGL-based digital twin graphics library to obtain a three-dimensional model of the substation. The above-mentioned subsequent processing algorithm is an existing technology, and its rendering process is not described in detail here.

[0075] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A three-dimensional modeling method for a smart substation, characterized in that: The following steps are involved: Step STP100, substation mapping, obtain the overall outer dimensions of the substation and formulate a modeling sampling route, the modeling sampling route is formed by connecting multiple line segments, and multiple sampling points K are set on the modeling sampling route r ; Step STP200, using a CCD camera to sequentially scan sampling points K along the modeled sampling route r The nearest device and auxiliary device are photographed to obtain the corresponding image P rt And record the image P rt The direction of shooting and the modeling sampling route are along the forward direction at the sampling point K r The angle α rt ; Step STP300, using a FARO Focus s 150 / 70 laser scanner to acquire three-dimensional point cloud data along the modeling sampling route through laser point cloud non-contact active scanning; Step STP400, the image P obtained in step STP200 is rt The three-dimensional point cloud data obtained in step STP300 is fused with the F-PoirtRet algorithm to obtain color point cloud data, where the fusion reference point is the sampling point K r , the matching angle is angle α rt ; Step STP500, the color point cloud data is used through the OpenGL graphics algorithm to construct a three-dimensional space geometry and render it through a shader, and then the WebGL graphics acceleration renderer is used to generate a WebGL-based digital twin graphics library to obtain a three-dimensional model of the substation.

2. The three-dimensional modeling method of smart substation according to claim 1 is characterized in that: The height from the ground when the CCD camera is used to take pictures in step STP200 and the height of the laser point cloud scanning in step STP300 are both H.

3. The three-dimensional modeling method of smart substation according to claim 2 is characterized in that: Step STP300 also includes a step of secondary laser point cloud scanning, and the scanning height is greater than the highest height of the substation equipment.

4. The three-dimensional modeling method of smart substation according to claim 2 or 3, characterized in that: Step STP400 also includes the step of simulating and identifying the color point cloud data, specifically including: Octree encoding is used to simplify the denoising of the color point cloud data, the processed color point cloud data is calibrated and the size is standardized, the subspace feature vector is classified using the KNN algorithm, and the classification accuracy is improved using the particle cluster optimization algorithm. The simplified denoising process specifically includes the following steps: Step STP410, according to the specified point distance d 0 Determine the number of layers n of the octree division; Step STP420, encoding each point p (x, y, z) in the color point cloud data; Convert x, y, z to index values ​​i, j, k using the following formula: , Among them, x min ,y min 、z min They are the minimum values ​​of the x, y, and z axis coordinates respectively. The index values ​​can be expressed in binary as follows: ; where i m 、j m , k m ∈{0, 1} and m∈{0, 1, ..., n-1}; P(x, y, z) is encoded as Q = q n-1 ˄q m ˄q1q0, where q m =i m +j m 2 1 +k m 2 2 ; Step STP430, the same code value is stored in the same minimum cube sorted by code value; In step STP440, the point closest to the center point is retained, and other points in each minimum cube are deleted to achieve the purpose of denoising.

Citation Information

Cited By

  • Virtual substation modeling system and method based on three-dimensional model

    CN120219657A

  • Three-dimensional model-based virtual substation modeling system and method

    CN120219657B