A three-dimensional model-based substation safety early warning system and method

By acquiring and processing high-precision three-dimensional data of the substation, generating high-precision three-dimensional models, and conducting safety assessments, the problems of error accumulation and lack of automated early warning in the existing technology are solved, and more efficient and accurate substation safety assessment and early warning are achieved.

CN118736140BActive Publication Date: 2024-11-29SUPER HIGH VOLTAGE BRANCH OF STATE GRID JIANGXI ELECTRIC POWER CO LTD +2
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202411224945.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-09-03
Publication Date
2024-11-29
Estimated Expiration
2044-09-03

AI Technical Summary

Technical Problem

The prior art has accumulated errors in the generation and safety assessment of three-dimensional model of substation equipment and lacks an automated early warning mechanism, resulting in insufficient accuracy and real-timeness of safety assessment.

Method used

By obtaining the high-precision point cloud data and image data of the substation, preprocessing and splicing, a high-precision three-dimensional model is generated, and a preset fusion algorithm and security assessment algorithm are used for security evaluation and early warning.

Benefits of technology

It improves data acquisition efficiency and model accuracy, realizes comprehensive three-dimensional monitoring and safety evaluation of substation equipment, and improves the overall safety and operational reliability of substations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118736140B_ABST
    Figure CN118736140B_ABST
Patent Text Reader

Abstract

The present invention discloses a substation safety early warning system and method based on a three-dimensional model, which relates to the technical field of substation safety early warning, including obtaining high-precision point cloud and image data of the substation; preprocessing the high-precision point cloud data, splicing the preprocessed high-precision point cloud data, and generating a three-dimensional point cloud model; extracting the three-dimensional information of the image data, generating a dense point cloud, and fusing the dense point cloud to the three-dimensional point cloud model according to a preset fusion algorithm to generate a high-precision three-dimensional model; performing a safety assessment on the substation through a preset safety assessment algorithm, generating an assessment result, and performing a safety early warning. By processing the high-precision point cloud data and combining it with the three-dimensional information of the image data, a high-precision three-dimensional point cloud model can be generated, the accuracy of the model can be improved, and comprehensive three-dimensional monitoring and safety assessment of the substation equipment can be performed, potential safety hazards can be discovered in a timely manner, accidents can be prevented, and the overall safety and operational reliability of the substation can be significantly improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of substation safety early warning, and in particular to a substation safety early warning system and method based on a three-dimensional model. Background Art

[0002] In the power system, substations are important nodes for power transmission and conversion, and their safety and stability are crucial to the operation of the entire power system. Traditional substation monitoring and early warning methods mainly rely on manual inspections and fixed monitoring equipment. These methods are not only inefficient and costly, but also slow to respond to emergencies, making it difficult to meet the needs of modern power systems for real-time monitoring and safety early warning of substations.

[0003] At present, with the development of 3D laser scanning technology and computer vision technology, the application of 3D point cloud data in power systems has gradually received attention. Using 3D point cloud data for monitoring and early warning of substation equipment can obtain the 3D spatial information of the equipment more comprehensively and accurately. However, due to the error accumulation in the point cloud data processing and model generation process of the existing technology, the generated 3D model is not accurate, which affects the accuracy of safety assessment. At the same time, most of the existing substation monitoring methods rely on manual analysis, lack of automated safety assessment and early warning mechanisms, and it is difficult to achieve real-time early warning. Summary of the invention

[0004] Based on the above-mentioned shortcomings of the prior art, the purpose of the present invention is to provide a three-dimensional model-based substation safety early warning system and method to solve the above-mentioned technical problems.

[0005] To achieve the above object, the present invention provides the following technical solution: a three-dimensional model-based substation safety early warning method, comprising:

[0006] Obtain high-precision point cloud data and image data of substations;

[0007] Preprocessing the high-precision point cloud data, and splicing the preprocessed high-precision point cloud data to generate a three-dimensional point cloud model;

[0008] Extracting three-dimensional information of the image data to generate a dense point cloud, and fusing the dense point cloud into the three-dimensional point cloud model according to a preset fusion algorithm to generate a high-precision three-dimensional model;

[0009] A safety assessment of the substation is performed according to the high-precision three-dimensional model using a preset safety assessment algorithm to generate an assessment result, and a safety warning is issued according to the assessment result.

[0010] The present invention is further configured such that the high-precision point cloud data is obtained by scanning the substation through a laser radar, and the image data is obtained by photographing the substation through a high-definition camera.

[0011] The present invention is further configured to pre-process the high-precision point cloud data, and splice the pre-processed high-precision point cloud data to generate a three-dimensional point cloud model, including:

[0012] De-noising and filtering the high-precision point cloud data;

[0013] Obtain any two sets of high-precision point clouds from the high-precision point cloud data and ;

[0014] Obtain high-precision point cloud based on the nearest neighbor search algorithm based on the KD tree Each point in In high-precision point cloud The closest point , recorded as matching point pair ;

[0015] Based on matching point pairs , calculate the rotation matrix and translation vectors , according to the rotation matrix and the translation vector Update high-precision point cloud Location ;

[0016] Repeat until the matching error converges to a preset matching error threshold or reaches a maximum number of iterations;

[0017] Transform all high-precision point cloud data into the same global coordinate system and merge them to generate a three-dimensional point cloud model;

[0018] The construction error of the three-dimensional point cloud model is detected according to the preset error detection algorithm. When there is an area where the construction error is greater than the construction error threshold, local optimization reconstruction of the area is performed.

[0019] The present invention is further configured to: based on the matching point pair , calculate the rotation matrix and translation vectors , according to the rotation matrix and the translation vector Update high-precision point cloud Location ,include:

[0020] Calculate high-precision point cloud and The centroid of is calculated as follows: ,in, For high-precision point cloud The center of mass, for or , is the number of matching point pairs, For high-precision point cloud No. The coordinate vector of the point;

[0021] High-precision point cloud and Translate to the centroid position to obtain a de-centroided high-precision point cloud. The calculation logic is: ,in, This is a high-precision point cloud after de-centroiding. The The coordinate vector of the point;

[0022] Calculate the covariance matrix of the high-precision point cloud after de-centroiding , the calculation logic is: ,in, This is a high-precision point cloud after de-centroiding. The The coordinate vector of the point, This is a high-precision point cloud after de-centroiding. The The transposed coordinate vector of the points;

[0023] Covariance matrix Perform singular value decomposition, the calculation logic is: ,in, is the left singular matrix obtained by matrix decomposition, is the diagonal matrix obtained by matrix decomposition, is the transpose of the right singular matrix obtained by matrix decomposition;

[0024] According to the left singular matrix and the right singular matrix Calculate the rotation matrix , the calculation logic is: ,in, is the transpose of the left singular matrix;

[0025] According to the rotation matrix Calculate the translation vector , the calculation logic is: ,in, For high-precision point cloud The center of mass, For high-precision point cloud The centroid of

[0026] According to the rotation matrix and the translation vector Update high-precision point cloud Middle The location of the points , the calculation logic is: .

[0027] The present invention is further configured such that the calculation logic of the matching error is: ,in, is the matching error, For high-precision point cloud No. The coordinate vector of the point, Computes the sign for the Euclidean distance.

[0028] The present invention is further configured such that the calculation logic of the error detection algorithm is: , is the construction error, is the Euclidean distance between matching point pairs, is the geometric feature difference between the matching point pairs, is the color feature difference between the matching point pairs, , and is the weight coefficient.

[0029] The present invention is further configured to extract the three-dimensional information of the image data, generate a dense point cloud, fuse the dense point cloud to the three-dimensional point cloud model according to a preset fusion algorithm, and generate a high-precision three-dimensional model, including:

[0030] Calculating coordinate transformation matrices of the dense point cloud and the three-dimensional point cloud model;

[0031] Converting the dense point cloud to the coordinate system of the three-dimensional point cloud model according to the coordinate transformation matrix, and aligning with the three-dimensional point cloud model;

[0032] The dense point cloud is fused with the three-dimensional point cloud model using a weighted average algorithm to generate a high-precision three-dimensional model.

[0033] The present invention is further configured to perform a safety assessment on the substation according to the high-precision three-dimensional model using a preset safety assessment algorithm, generate an assessment result, and issue a safety warning according to the assessment result, including:

[0034] Calculating a structural integrity index and a structural deformation index according to the high-precision three-dimensional model;

[0035] Calculating a safety assessment index according to the structural integrity index and the structural deformation index;

[0036] When the safety assessment index is greater than a first threshold and less than or equal to a second threshold, a first warning message is generated to perform non-stop inspection and maintenance;

[0037] When the safety assessment index is greater than a second threshold, a second warning message is generated, and shutdown inspection and comprehensive maintenance are performed.

[0038] The present invention is further configured such that the calculation logic of the structural integrity index is: ,in, is the structural integrity index, , and For high-precision three-dimensional models The coordinates of the points, , and is the average coordinate of all points in the high-precision 3D model, is the number of points in the high-precision three-dimensional model;

[0039] The calculation logic of the structural deformation index is: ,in, is the structural deformation index, , and For high-precision three-dimensional models The initial coordinates of the points;

[0040] The calculation logic of the safety assessment index is: ,in, is the safety assessment index, and is the weight coefficient of the structural integrity index and the structural deformation index.

[0041] The present invention also provides a three-dimensional model-based substation safety early warning system, the system comprising:

[0042] Data acquisition module: obtain high-precision point cloud data and image data of the substation;

[0043] The first generation module is used to pre-process the high-precision point cloud data, and to splice the pre-processed high-precision point cloud data to generate a three-dimensional point cloud model;

[0044] The second generation module extracts the three-dimensional information of the image data to generate a dense point cloud, and fuses the dense point cloud into the three-dimensional point cloud model according to a preset fusion algorithm to generate a high-precision three-dimensional model;

[0045] Safety warning module: performs safety assessment on the substation according to the high-precision three-dimensional model through a preset safety assessment algorithm, generates an assessment result, and issues a safety warning according to the assessment result.

[0046] The present invention provides a three-dimensional model-based substation safety early warning system and method. The method obtains high-precision point cloud data and image data of the substation; pre-processes the high-precision point cloud data, splices the pre-processed high-precision point cloud data, and generates a three-dimensional point cloud model; extracts three-dimensional information of the image data to generate a dense point cloud, and fuses the dense point cloud to the three-dimensional point cloud model according to a preset fusion algorithm to generate a high-precision three-dimensional model; performs a safety assessment on the substation according to the high-precision three-dimensional model through a preset safety assessment algorithm to generate an assessment result, and performs a safety early warning according to the assessment result. The beneficial effects produced include:

[0047] 1. Improve data acquisition efficiency: By combining laser scanning and image shooting, high-precision point cloud data and image data of the substation can be obtained quickly and efficiently, significantly improving the efficiency of data acquisition;

[0048] 2. Enhanced model accuracy: By preprocessing and multiple splicing of high-precision point cloud data and combining it with the three-dimensional information of image data, the present invention can generate a high-precision three-dimensional point cloud model, effectively reducing error accumulation and improving the accuracy of the model. Multi-source data fusion technology makes the generated three-dimensional model more accurate and comprehensive, greatly improving the accuracy and reliability of the model;

[0049] 3. Improve safety: The present invention can conduct comprehensive three-dimensional monitoring and safety assessment of substation equipment, timely discover potential safety hazards, prevent accidents, and significantly improve the overall safety and operational reliability of the substation. Through accurate three-dimensional models and real-time safety assessments, substation operation and maintenance personnel can more accurately grasp the equipment status, take targeted maintenance measures, and prevent accidents.

[0050] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0052] Figure 1A flowchart of a three-dimensional model-based substation safety early warning method is shown as an exemplary embodiment of the present invention;

[0053] Figure 2 The present invention is a schematic structural diagram of a three-dimensional model-based substation safety early warning system according to an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0054] The following will describe the embodiments of the present invention with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are only for illustrating the present invention, not for limiting the scope of protection of the present invention.

[0055] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0056] In the following description, numerous details are discussed to provide a more thorough explanation of the embodiments of the present invention. However, it is obvious to those skilled in the art that the embodiments of the present invention can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present invention difficult to understand.

[0057] Embodiment 1

[0058] A safety early warning method for substation based on three-dimensional model, such as Figure 1 As shown, including:

[0059] Obtain high-precision point cloud data and image data of substations;

[0060] Preprocessing the high-precision point cloud data, and splicing the preprocessed high-precision point cloud data to generate a three-dimensional point cloud model;

[0061] Extracting three-dimensional information of the image data to generate a dense point cloud, and fusing the dense point cloud into the three-dimensional point cloud model according to a preset fusion algorithm to generate a high-precision three-dimensional model;

[0062] A safety assessment of the substation is performed according to the high-precision three-dimensional model using a preset safety assessment algorithm to generate an assessment result, and a safety warning is issued according to the assessment result.

[0063] Specifically, the high-precision point cloud data is obtained by scanning the substation through a laser radar, and the image data is obtained by photographing the substation with a high-definition camera; high-precision point cloud data is obtained by scanning the substation through a laser radar (LiDAR), including detailed three-dimensional spatial information inside and outside the substation; image data is obtained through high-resolution photos taken by drones or ground cameras, and the image data provides appearance and texture information of the substation.

[0064] The present invention is further configured to pre-process the high-precision point cloud data, and splice the pre-processed high-precision point cloud data to generate a three-dimensional point cloud model, including:

[0065] Denoising and filtering the high-precision point cloud data; specifically, removing noise points and outliers in the point cloud data by using a denoising and filtering algorithm to maintain the authenticity and accuracy of the data;

[0066] Obtain any two sets of high-precision point clouds from the high-precision point cloud data and ; Select any two sets of point cloud data from the high-precision point cloud data set and record them as high-precision point cloud and , ready for registration and stitching;

[0067] Obtain high-precision point cloud based on the nearest neighbor search algorithm based on the KD tree Each point in In high-precision point cloud The closest point , recorded as matching point pair ; Specifically, using high-precision point cloud The KD tree is constructed based on the data. The KD tree is a data structure for spatial partitioning. When constructing the KD tree, a dimension is selected for partitioning. In a feasible embodiment of the present invention, the dimension with the largest data variance is selected for partitioning to ensure uniform distribution of the data. The point cloud data is sorted according to the selected dimension, the median point is found, and it is used as the current node. The data is divided into left and right parts, and the left and right subtrees are constructed respectively. The above steps are repeated recursively until all data points are processed to form a complete KD tree. For high-precision point clouds, Each point in , use the constructed KD tree to perform nearest neighbor search and find high-precision point cloud Middle distance The nearest point , wherein the nearest neighbor search is a prior art and will not be described in detail here.

[0068] Based on matching point pairs , calculate the rotation matrix and translation vector , according to the rotation matrix and the translation vector Update high-precision point cloud Location The present invention is further configured to: based on the matching point pair , calculate the rotation matrix and translation vector , according to the rotation matrix and the translation vector Update high-precision point cloud Location , including: Calculate high-precision point cloud and The centroid of is calculated as follows: ,in, For high-precision point cloud The center of mass, for or , is the number of matching point pairs, For high-precision point cloud No. Coordinate vectors of points; calculate high-precision point cloud and The centroid of represents the geometric center position of the high-precision point cloud;

[0069] High-precision point cloud and Translate to the centroid position to obtain a de-centroided high-precision point cloud. The calculation logic is: ,in, This is a high-precision point cloud after de-centroiding. The The coordinate vector of each point; translate the high-precision point cloud to its respective centroid position to facilitate subsequent rotation and translation transformation calculations;

[0070] Calculate the covariance matrix of the high-precision point cloud after de-centroiding , the calculation logic is: ,in, This is a high-precision point cloud after de-centroiding. The The coordinate vector of the point, This is a high-precision point cloud after de-centroiding. The The transposed coordinate vector of points; the covariance matrix Representing high-precision point clouds and The geometric relationship of is used to calculate the rotation matrix;

[0071] Covariance matrix Perform singular value decomposition, the calculation logic is: ,in, is the left singular matrix obtained by matrix decomposition, is the diagonal matrix obtained by matrix decomposition, is the transpose of the right singular matrix obtained by matrix decomposition; singular value decomposition is a method for calculating the rotation matrix, and the rotation matrix is ​​obtained by decomposing the covariance matrix. It is a prior art and will not be described in detail here;

[0072] According to the left singular matrix and the right singular matrix Calculate the rotation matrix , the calculation logic is: ,in, is the transpose of the left singular matrix; according to the rotation matrix Calculate the translation vector , the calculation logic is: ,in, For high-precision point cloud The center of mass, For high-precision point cloud The center of mass of the point cloud; the rotation matrix and translation vector are used to transform the high-precision point cloud Transform to high-precision point cloud In the coordinate system of , the two sets of point clouds are aligned;

[0073] According to the rotation matrix and the translation vector Update high-precision point cloud Middle The location of the points , the calculation logic is: ; Through rotation and translation transformation, high-precision point cloud The position is updated to the high-precision point cloud Aligned position.

[0074] Repeat until the matching error converges to a preset matching error threshold or reaches a maximum number of iterations; the present invention is further configured such that the calculation logic of the matching error is: ,in, is the matching error, For high-precision point cloud No. The coordinate vector of the point, Calculate the sign for the Euclidean distance; reduce the high-precision point cloud through iterative optimization and high-precision point cloud The matching error between them is reduced to ensure the accurate alignment of the two sets of point clouds. A reasonable error threshold and maximum number of iterations are set to ensure that the algorithm converges within an acceptable time and achieve the goal of accurate registration.

[0075] All high-precision point cloud data are transformed into the same global coordinate system for merging to generate a 3D point cloud model; the updated high-precision point cloud With high-precision point cloud Merge to generate a 3D point cloud model.

[0076] The construction error of the three-dimensional point cloud model is detected according to a preset error detection algorithm. When there is a region where the construction error is greater than the construction error threshold, local optimization reconstruction of the region is performed. The present invention is further configured such that the calculation logic of the error detection algorithm is: , is the construction error, is the Euclidean distance between matching point pairs, is the geometric feature difference between the matching point pairs, is the color feature difference between the matching point pairs, , and is the weight coefficient, specifically, the geometric feature difference ,in, Updated high-precision point cloud Previous Points exist The normal vector component on the axis, For high-precision point cloud Previous Points exist The normal vector component on the axis, Updated high-precision point cloud Previous Points exist The normal vector component on the axis, the meaning of other parameters in the formula can be obtained in the same way, which will not be elaborated here. , Updated high-precision point cloud Previous Points The red component, Updated high-precision point cloud Previous Points The green component, Updated high-precision point cloud Previous Points The blue component of For high-precision point cloud Previous Points The red component of , and the meanings of other parameters in the formula can be obtained similarly, which will not be elaborated here.

[0077] The present invention is further configured to extract the three-dimensional information of the image data, generate a dense point cloud, fuse the dense point cloud to the three-dimensional point cloud model according to a preset fusion algorithm, and generate a high-precision three-dimensional model, including:

[0078] Calculate the coordinate transformation matrix of the dense point cloud and the three-dimensional point cloud model; transform the dense point cloud to the coordinate system of the three-dimensional point cloud model according to the coordinate transformation matrix, and align it with the three-dimensional point cloud model; transform the dense point cloud to the coordinate system of the three-dimensional point cloud model by splicing the pre-processed high-precision point cloud data and generating the logic of the three-dimensional point cloud model, which will not be described in detail here;

[0079] Use a weighted average algorithm to fuse the dense point cloud with the three-dimensional point cloud model to generate a high-precision three-dimensional model. For the same point in the dense point cloud and the three-dimensional point cloud model, weighted average fusion is performed based on the data weights of the dense point cloud and the three-dimensional point cloud model. The weight is set according to specific needs and is not restricted here.

[0080] The present invention is further configured to perform a safety assessment on the substation according to the high-precision three-dimensional model using a preset safety assessment algorithm, generate an assessment result, and issue a safety warning according to the assessment result, including:

[0081] The structural integrity index and the structural deformation index are calculated according to the high-precision three-dimensional model; the present invention is further configured that the calculation logic of the structural integrity index is: ,in, is the structural integrity index, , and For high-precision three-dimensional models The coordinates of the points, , and is the average coordinate of all points in the high-precision 3D model, is the number of points in the high-precision three-dimensional model; the calculation logic of the structural deformation index is: ,in, is the structural deformation index, , and For high-precision three-dimensional models The initial coordinates of the points;

[0082] The safety assessment index is calculated according to the structural integrity index and the structural deformation index; the calculation logic of the safety assessment index is: ,in, is the safety assessment index, and is the weight coefficient of the structural integrity index and the structural deformation index; through the above steps, the safety assessment index can be calculated and a safety warning can be issued according to the structural integrity and deformation degree of the high-precision three-dimensional model.

[0083] When the safety assessment index is greater than the first threshold and less than or equal to the second threshold, a first warning message is generated, and inspection and maintenance are performed without stopping the machine. Inspections are performed without stopping the machine, the operating status of the substation is monitored, and necessary maintenance operations are performed to prevent potential safety hazards from further deteriorating.

[0084] When the safety assessment index is greater than a second threshold, a second warning message is generated, and the substation is shut down for inspection and comprehensive maintenance. Under the premise of ensuring safety, the substation is shut down for comprehensive inspection and maintenance to repair or replace problematic equipment and structures to ensure safe operation of the substation.

[0085] Embodiment 2

[0086] See also Figure 2 , the exemplary three-dimensional model-based substation safety early warning system includes:

[0087] Data acquisition module: obtain high-precision point cloud data and image data of the substation;

[0088] The first generation module is used to pre-process the high-precision point cloud data, and to splice the pre-processed high-precision point cloud data to generate a three-dimensional point cloud model;

[0089] The second generation module extracts the three-dimensional information of the image data to generate a dense point cloud, and fuses the dense point cloud into the three-dimensional point cloud model according to a preset fusion algorithm to generate a high-precision three-dimensional model;

[0090] Safety warning module: performs safety assessment on the substation according to the high-precision three-dimensional model through a preset safety assessment algorithm, generates an assessment result, and issues a safety warning according to the assessment result.

[0091] It should be noted that the three-dimensional model-based substation safety warning system provided in the above embodiment and the three-dimensional model-based substation safety warning method provided in the above embodiment belong to the same concept, wherein the specific manner in which each module and unit performs operations has been described in detail in the method embodiment and will not be repeated here. In actual application, the three-dimensional model-based substation safety warning system provided in the above embodiment can distribute the above functions to different functional modules as needed, that is, divide the internal structure of the system into different functional modules to complete all or part of the functions described above, and this is not limited here.

[0092] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented by software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.

[0093] It should be understood that the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. A and B can be singular or plural. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship, but it may also indicate an "and / or" relationship. Please refer to the context for specific understanding.

[0094] In this application, "at least one" means one or more, and "more than one" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0095] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0096] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0097] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0098] In the several embodiments provided in the present application, it should be understood that the disclosed system can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0099] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0100] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0101] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

[0102] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A three-dimensional model-based substation safety early warning method, characterized in that: include: Obtain high-precision point cloud data and image data of substations; Preprocessing the high-precision point cloud data, splicing the preprocessed high-precision point cloud data, and generating a three-dimensional point cloud model, including: denoising and filtering the high-precision point cloud data; obtaining any two groups of high-precision point cloud data from the high-precision point cloud data and ; Obtain high-precision point cloud based on the nearest neighbor search algorithm based on the KD tree Each point in In high-precision point cloud The closest point , recorded as matching point pair ; Based on matching point pairs , calculate the rotation matrix and translation vectors , according to the rotation matrix and the translation vector Update high-precision point cloud Location ; Repeat until the matching error converges to the preset matching error threshold or reaches the maximum number of iterations; transform all high-precision point cloud data into the same global coordinate system for merging to generate a three-dimensional point cloud model; detect the construction error of the three-dimensional point cloud model according to the preset error detection algorithm, and perform local optimization reconstruction of the region when there is an area with a construction error greater than the construction error threshold; the calculation logic of the error detection algorithm is: , is the construction error, is the Euclidean distance between matching point pairs, is the geometric feature difference between the matching point pairs, is the color feature difference between the matching point pairs, , and is the weight coefficient, the geometric feature difference ,in, Updated high-precision point cloud Previous Points exist The normal vector component on the axis, For high-precision point cloud Previous Points exist The normal vector component on the axis, Updated high-precision point cloud Previous Points exist The normal vector component on the axis, the meaning of other parameters in the formula can be obtained in the same way; Extracting three-dimensional information of the image data to generate a dense point cloud, and fusing the dense point cloud into the three-dimensional point cloud model according to a preset fusion algorithm to generate a high-precision three-dimensional model; The substation is subjected to a safety assessment according to the high-precision three-dimensional model through a preset safety assessment algorithm, an assessment result is generated, and a safety warning is issued according to the assessment result, including: calculating a structural integrity index and a structural deformation index according to the high-precision three-dimensional model; calculating a safety assessment index according to the structural integrity index and the structural deformation index; when the safety assessment index is greater than a first threshold value and less than or equal to a second threshold value, generating a first warning message, and performing non-stop inspection and maintenance; when the safety assessment index is greater than the second threshold value, generating a second warning message, and performing shutdown inspection and comprehensive maintenance. The calculation logic of the structural integrity index is: ,in, is the structural integrity index, , and For high-precision three-dimensional models The coordinates of the points, , and is the average coordinate of all points in the high-precision 3D model, is the number of points in the high-precision three-dimensional model; the calculation logic of the structural deformation index is: ,in, is the structural deformation index, , and For high-precision three-dimensional models The initial coordinates of the points; the calculation logic of the safety assessment index is: ,in, is the safety assessment index, and is the weight coefficient of the structural integrity index and the structural deformation index.

2. A three-dimensional model-based substation safety early warning method according to claim 1, characterized in that: The high-precision point cloud data is obtained by scanning the substation through a laser radar, and the image data is obtained by photographing the substation with a high-definition camera.

3. A three-dimensional model-based substation safety early warning method according to claim 1, characterized in that: Based on matching point pairs , calculate the rotation matrix and translation vectors , according to the rotation matrix and the translation vector Update high-precision point cloud Location ,include: Calculate high-precision point cloud and The centroid of is calculated as follows: ,in, For high-precision point cloud The center of mass, for or , is the number of matching point pairs, For high-precision point cloud No. The coordinate vector of the point; High-precision point cloud and Translate to the centroid position to obtain a de-centroided high-precision point cloud. The calculation logic is: ,in, This is a high-precision point cloud after de-centroiding. The The coordinate vector of the point; Calculate the covariance matrix of the high-precision point cloud after de-centroiding , the calculation logic is: ,in, This is a high-precision point cloud after de-centroiding. The The coordinate vector of the point, This is a high-precision point cloud after de-centroiding. The The transposed coordinate vector of the points; Covariance matrix Perform singular value decomposition, the calculation logic is: ,in, is the left singular matrix obtained by matrix decomposition, is the diagonal matrix obtained by matrix decomposition, is the transpose of the right singular matrix obtained by matrix decomposition; According to the left singular matrix and the right singular matrix Calculate the rotation matrix , the calculation logic is: ,in, is the transpose of the left singular matrix; According to the rotation matrix Calculate the translation vector , the calculation logic is: ,in, For high-precision point cloud The center of mass, For high-precision point cloud The centroid of According to the rotation matrix and the translation vector Update high-precision point cloud Middle The location of the points , the calculation logic is: .

4. A three-dimensional model-based substation safety early warning method according to claim 3, characterized in that: The calculation logic of the matching error is: ,in, is the matching error, For high-precision point cloud No. The coordinate vector of the point, Computes the sign for the Euclidean distance.

5. The three-dimensional model-based substation safety early warning method according to claim 1 is characterized in that: Extracting three-dimensional information of the image data to generate a dense point cloud, fusing the dense point cloud into the three-dimensional point cloud model according to a preset fusion algorithm to generate a high-precision three-dimensional model, including: Calculating coordinate transformation matrices of the dense point cloud and the three-dimensional point cloud model; Converting the dense point cloud to the coordinate system of the three-dimensional point cloud model according to the coordinate transformation matrix, and aligning with the three-dimensional point cloud model; The dense point cloud is fused with the three-dimensional point cloud model using a weighted average algorithm to generate a high-precision three-dimensional model.

6. A three-dimensional model-based substation safety early warning system, characterized in that: include: Data acquisition module: obtain high-precision point cloud data and image data of the substation; The first generation module: pre-processes the high-precision point cloud data, splices the pre-processed high-precision point cloud data, and generates a three-dimensional point cloud model, including: denoising and filtering the high-precision point cloud data; obtaining any two groups of high-precision point clouds in the high-precision point cloud data and ; Obtain high-precision point cloud based on the nearest neighbor search algorithm based on the KD tree Each point in In high-precision point cloud The closest point , recorded as matching point pair ; Based on matching point pairs , calculate the rotation matrix and translation vectors , according to the rotation matrix and the translation vector Update high-precision point cloud Location ; Repeat until the matching error converges to the preset matching error threshold or reaches the maximum number of iterations; transform all high-precision point cloud data into the same global coordinate system for merging to generate a three-dimensional point cloud model; detect the construction error of the three-dimensional point cloud model according to the preset error detection algorithm, and perform local optimization reconstruction of the region when there is an area with a construction error greater than the construction error threshold; the calculation logic of the error detection algorithm is: , is the construction error, is the Euclidean distance between matching point pairs, is the geometric feature difference between the matching point pairs, is the color feature difference between the matching point pairs, , and is the weight coefficient, the geometric feature difference ,in, Updated high-precision point cloud Previous Points exist The normal vector component on the axis, For high-precision point cloud Previous Points exist The normal vector component on the axis, Updated high-precision point cloud Previous Points exist The normal vector component on the axis, the meaning of other parameters in the formula can be obtained in the same way; The second generation module extracts the three-dimensional information of the image data to generate a dense point cloud, and fuses the dense point cloud into the three-dimensional point cloud model according to a preset fusion algorithm to generate a high-precision three-dimensional model; Safety warning module: perform safety assessment on the substation according to the high-precision three-dimensional model through a preset safety assessment algorithm, generate an assessment result, and issue a safety warning according to the assessment result, including: calculating the structural integrity index and the structural deformation index according to the high-precision three-dimensional model; calculating the safety assessment index according to the structural integrity index and the structural deformation index; when the safety assessment index is greater than a first threshold and less than or equal to a second threshold, generate a first warning message, and perform non-stop inspection and maintenance; when the safety assessment index is greater than the second threshold, generate a second warning message, and perform shutdown inspection and comprehensive maintenance. The calculation logic of the structural integrity index is: ,in, is the structural integrity index, , and For high-precision three-dimensional models The coordinates of the points, , and is the average coordinate of all points in the high-precision 3D model, is the number of points in the high-precision three-dimensional model; the calculation logic of the structural deformation index is: ,in, is the structural deformation index, , and For high-precision three-dimensional models The initial coordinates of the points; the calculation logic of the safety assessment index is: ,in, is the safety assessment index, and is the weight coefficient of the structural integrity index and the structural deformation index.

Citation Information

Patent Citations

  • High-precision three-dimensional virtual model and establishment method

    CN115984453A

  • Three-dimensional point cloud registration method and device based on feature descriptors and storage medium

    CN116452644A

  • Three-dimensional reconstruction method integrating laser radar and oblique photography

    CN116740288A