Inspection data processing methods, devices, computer equipment, and storage media

Abstract

This application relates to a method, apparatus, computer equipment, storage medium, and computer program product for processing inspection data. The method includes: acquiring inspection data collected from a power inspection area; determining the data type of the inspection data based on its information; parsing the inspection data using a parsing method corresponding to the data type to obtain the location information of the power inspection area corresponding to the inspection data; matching the location information with the location information of each power inspection area on a pre-created three-dimensional earth model; and inserting the inspection data into the layer database of the matched power inspection areas in the three-dimensional earth model. This method can increase the usability of inspection data and improve the efficiency and accuracy of maintenance operations performed by personnel in the power inspection area.

Description

Technical Field

[0001] This application relates to the field of inspection system technology, and in particular to an inspection data processing method, apparatus, computer equipment, storage medium and computer program product. Background Technology

[0002] Power lines and equipment are crucial components of the power grid. Because they are constantly in operation and exposed to the elements, they not only bear normal mechanical and electrical loads but also endure external forces such as strong winds, heavy rain, and lightning strikes. Therefore, it is essential to conduct on-site inspections of power lines and equipment to promptly identify and eliminate potential safety hazards, prevent power outages, and ensure the safety and stability of the power system. Unmanned aerial vehicles (UAVs) are widely used in power line inspections due to their numerous advantages, including portability, ease of operation, abundant payload capacity, low environmental requirements for takeoff and landing, and autonomous flight capabilities.

[0003] In existing technologies, after using drones for power line inspections, most of the inspection data is stored in the drone's built-in memory. After the inspection task is completed, the inspection personnel copy the inspection results to a computer and manage them in chronological order. When it is necessary to review the inspection results, only a single piece of inspection data can be viewed at the same time, making it impossible to intuitively and clearly understand the specific situation of the power inspection area. This greatly reduces the usability of the inspection data, thereby reducing the efficiency and accuracy of the personnel in performing corresponding maintenance operations in the power inspection area. Summary of the Invention

[0004] Therefore, it is necessary to provide a method, device, computer equipment, computer-readable storage medium, and computer program product for processing inspection data that can increase the usability of inspection data and improve the efficiency and accuracy of maintenance operations performed by business personnel in the power inspection area, in order to address the above-mentioned technical problems.

[0005] Firstly, this application provides a method for processing inspection data, the method comprising:

[0006] Obtain inspection data collected from the power inspection area, and determine the data type of the inspection data based on the data information of the inspection data;

[0007] Based on the parsing method corresponding to the data type, the inspection data is parsed to obtain the location information of the power inspection area corresponding to the inspection data.

[0008] The location information is matched with the location information of each power inspection area on a pre-created three-dimensional earth model, and the inspection data is inserted into the layer database of the matched power inspection areas in the three-dimensional earth model.

[0009] In one embodiment, the method further includes:

[0010] When a command to display the inspection data of the power inspection area is received based on the three-dimensional earth model, the application corresponding to the data type of the inspection data is invoked to visualize the inspection data in the matching power inspection area of ​​the three-dimensional earth model.

[0011] In one embodiment, the data type of the inspection data includes: point cloud data;

[0012] The step of obtaining the location information of the power inspection area corresponding to the inspection data based on the data type of the inspection data includes:

[0013] If the data type is point cloud data, then the location information of the power inspection area corresponding to the point cloud data is obtained based on the location information of the first index file carried in the data information of the point cloud data.

[0014] In one embodiment, the data type of the inspection data includes: oblique photography model data;

[0015] The step of obtaining the location information of the power inspection area corresponding to the inspection data based on the data type of the inspection data includes:

[0016] If the data type is oblique photogrammetry model data, determine whether the oblique photogrammetry model data is being loaded for the first time based on the data information of the oblique photogrammetry model data;

[0017] If this is the first time the data is loaded, the oblique photography model data is interpreted to obtain the location information of the power inspection area corresponding to the oblique photography model data.

[0018] If this is not the first time the data is loaded, the corresponding second index file is searched in the database based on the index identifier carried by the data information of the oblique photography model data. Based on the location information recorded in the second index file, the location information of the power inspection area corresponding to the oblique photography model data is obtained.

[0019] In one embodiment, the data type of the inspection data includes: photo data, which includes ordinary photo data and panoramic photo data;

[0020] The step of obtaining the location information of the power inspection area corresponding to the inspection data based on the data type of the inspection data includes:

[0021] If the data type is photo data, then the location information of the power inspection area corresponding to the photo is obtained based on the location information recorded in the data information of the photo data.

[0022] In one embodiment, the data type of the inspection data includes: orthophoto data:

[0023] The step of obtaining the location information of the power inspection area corresponding to the inspection data based on the data type of the inspection data includes:

[0024] If the data type is orthophoto data, then the location information of the power inspection area corresponding to the orthophoto is obtained based on the location information recorded in the data information of the orthophoto data.

[0025] Secondly, this application also provides an inspection data processing device, the device comprising:

[0026] The data type determination module is used to acquire inspection data collected from the power inspection area and determine the data type of the inspection data based on the data information of the inspection data.

[0027] The location information acquisition module is used to parse the inspection data based on the parsing method corresponding to the data type, and obtain the location information of the power inspection area corresponding to the inspection data.

[0028] The location information matching module is used to match the location information with the location information of each power inspection area on a pre-created three-dimensional earth model, and insert the inspection data into the layer database of the matched power inspection areas in the three-dimensional earth model.

[0029] Thirdly, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of the above-described method.

[0030] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the above-described method.

[0031] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the above-described method.

[0032] The aforementioned inspection data processing methods, devices, computer equipment, storage media, and computer program products, after acquiring inspection data collected from the power inspection area, determine the data type of the inspection data based on the data information. Based on the parsing method corresponding to each data type, the inspection data is parsed to obtain the location information of the power inspection area corresponding to the inspection data. The inspection data is then inserted into the matching layer database of the power inspection area in the 3D earth model. By fusing multiple different types of inspection data in the same coordinate system, and performing integrated and visualized management of multiple different types of inspection data for the same inspection area, business personnel can directly load and view inspection data of multiple data types for the same area when reviewing inspection results. This provides a clear and intuitive understanding of the specific situation of the power inspection area, improving the efficiency and accuracy of business personnel in performing related maintenance operations in the power inspection area. Attached Figure Description

[0033] Figure 1 This is an application environment diagram of the inspection data processing method in one embodiment;

[0034] Figure 2 This is a flowchart illustrating an inspection data processing method in one embodiment;

[0035] Figure 3 This is a flowchart illustrating the steps of obtaining the location information of inspection data based on the data type of inspection data in one embodiment.

[0036] Figure 4 This is a flowchart illustrating the inspection data processing method in another embodiment;

[0037] Figure 5 This is a flowchart illustrating the inspection data processing method in another embodiment;

[0038] Figure 6 This is a structural block diagram of the inspection data processing device in one embodiment;

[0039] Figure 7 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0040] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0041] The inspection data processing method provided in this application embodiment can be applied to, for example... Figure 1The application environment is shown. The power inspection results management system 102 communicates with the server 104 via a network. A data storage system can store the data that the server 104 needs to process. The data storage system can be integrated onto the server 104 or placed on the cloud or other network servers. The power inspection results management system 102 acquires inspection data collected from power inspection areas, determines the data type of the inspection data based on the data information, parses the inspection data based on the parsing method corresponding to the data type, obtains the location information of the power inspection area corresponding to the inspection data, matches the location information with the location information of each power inspection area on a pre-created 3D earth model, and inserts the inspection data into the layer database of the matched power inspection areas in the 3D earth model. The power inspection results management system 102 is integrated on a user terminal, which can be, but is not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. Portable wearable devices can be smartwatches, smart bracelets, head-mounted devices, etc. The server 104 can be implemented using a standalone server or a server cluster composed of multiple servers.

[0042] In one embodiment, the power inspection results management system 102 adopts a client-server architecture. The power inspection results management system 102 can directly load and display the inspection data collected from the power inspection area locally. Specifically, the user copies the inspection data from the server to the user terminal, and the power inspection results management system 102 directly loads the corresponding power inspection data locally from the database of the user terminal.

[0043] In one embodiment, such as Figure 2 As shown, a method for processing inspection data is provided, which can be applied to... Figure 1 Taking the power inspection results management system 102 in the example, the following steps are included:

[0044] Step 202: Obtain the inspection data collected from the power inspection area, and determine the data type of the inspection data based on the data information of the inspection data.

[0045] A power inspection area is a designated area for power lines or equipment that requires regular inspection. To identify and eliminate potential safety hazards on outdoor power lines or equipment, personnel designate the area where the power lines or equipment are located as a power inspection area. They then regularly use power inspection equipment to conduct inspections in this area, monitoring the usage and operation of the power lines or equipment within the inspection zone. Understandably, power inspection equipment can include drones, power inspection robots, and other similar devices.

[0046] Inspection data refers to the data collected by power inspection equipment after it has inspected a designated power inspection area at a specified time, using its own configured data acquisition devices. This data reflects the operational status of power lines or equipment within the inspection area, as well as the environmental information of the area. In actual use, to gain a comprehensive understanding of the actual situation, personnel will configure the power inspection equipment with multiple data acquisition devices. These devices then collect inspection data from the power inspection area, generating inspection data of various types.

[0047] Taking power inspection equipment as an example, drones can be equipped with data acquisition devices such as ordinary cameras, panoramic cameras, radar, and thermal infrared cameras.

[0048] The data information is used to represent the basic information of the inspection data, such as data structure, data format, data size, and data source. This data information is generated along with the inspection data after it has been collected. In essence, each piece of inspection data carries its corresponding data information.

[0049] Specifically, the power inspection results management system acquires inspection data collected by power inspection equipment from the power inspection area, and determines the data type of the inspection data based on the data information it carries. Understandably, the data types of inspection data include, but are not limited to, ordinary photos, panoramic photos, video images, point cloud models, oblique photogrammetry models, orthophotos, and infrared thermal images.

[0050] In one embodiment, determining the data type of the inspection data based on the data information includes: determining the data type of the inspection data based on the data structure and / or data format of the inspection data. For example, point cloud data and panoramic photo data have different data formats; point cloud data is in PNTS or LAS format, while panoramic photo data is in JPG format. Furthermore, although both are photo data, panoramic photo data and ordinary photo data have different data structures; panoramic photo data has a 2:1 data structure.

[0051] Step 204: Based on the parsing method corresponding to the data type, parse the inspection data to obtain the location information of the power inspection area corresponding to the inspection data.

[0052] The parsing method involves analyzing the inspection data to obtain its location information. Specifically, inspection data comes in various data types, and the location information for each type may differ. For example, different coordinate systems used during data collection may result in the location of the inspection data not being represented in the same coordinate system. Therefore, after acquiring the inspection data, it is necessary to parse its information to obtain the location information of the corresponding power inspection area. Understandably, different data types require different parsing methods.

[0053] The location information refers to the geographical location of the power grid inspection area on Earth. For example, the latitude and longitude coordinates of the power grid inspection area on Earth.

[0054] In one embodiment, by using the parsing method corresponding to the data type of the inspection data, the position information of each inspection data in the same coordinate system can be obtained.

[0055] Specifically, the power line inspection results system determines the corresponding parsing method based on the data type of the inspection data. Using the corresponding parsing method, the received inspection data is parsed to obtain the location information of the corresponding power line inspection area, i.e., the data collection area. Understandably, the power line inspection results system pre-stores parsing methods corresponding to various data types. Based on the data type of the received inspection data, the system can directly retrieve the corresponding parsing method from the database to parse the inspection data and obtain location information belonging to the same coordinate system as the 3D earth model.

[0056] Step 206: Match the location information with the location information of each power inspection area on the pre-created 3D Earth model, and insert the inspection data into the layer database of the matched power inspection area in the 3D Earth model.

[0057] The 3D Earth model is based on imagery and terrain data from the nationally published Tianditu (National Earth Map). Specifically, the Tianditu imagery and terrain data serve as the base map, on which geographical locations such as mountains and roads are marked. Then, using model building tools, the marked map is constructed into a 3D Earth model.

[0058] In one embodiment, a three-dimensional earth model can help determine the geographical location of the data and generate an inspection trajectory for the inspection data. Specifically, based on the collection time and location information of the inspection data, an inspection trajectory for the inspection data is generated on the three-dimensional earth model.

[0059] In one embodiment, the location information of all power inspection areas is pre-marked on the three-dimensional earth model.

[0060] The layer database is used to load and store inspection data in the power inspection results system. Specifically, each data type corresponds to a layer database. The power inspection results system loads the inspection data into the layer database corresponding to the data type for subsequent visualization.

[0061] Specifically, after parsing the location information of the inspection data, the power inspection results management system automatically calculates parameters by comparing the location information with the location information of each power inspection area in the 3D earth model, confirms the location of the power inspection area in the 3D earth model that matches the location information of the inspection data, and loads the inspection data into the layer database of the matching power inspection area in the 3D earth model.

[0062] In one embodiment, the location information is compared with the location information of each power inspection area in the three-dimensional earth model to perform parameter calculation, including: automatically calculating the coordinate parameters of the coordinate information of the inspection data and the coordinate information of each power inspection area in the three-dimensional earth model to confirm the location of the power inspection area in the three-dimensional earth model that matches the location information of the inspection data.

[0063] In one embodiment, the coordinate parameters of the inspection data and the coordinate information in the three-dimensional earth model are automatically calculated to confirm the location of the area in the three-dimensional earth model that matches the location information of the inspection data.

[0064] In the above-described inspection data processing method, after acquiring the inspection data collected from the power inspection area, the data type of the inspection data is determined based on the data information. Based on the parsing method corresponding to each data type, the inspection data is parsed to obtain the location information of the corresponding power inspection area. The inspection data is then inserted into the matching layer database of the power inspection area in the 3D earth model. By fusing multiple different types of inspection data in the same coordinate system, and enabling integrated and visualized management of multiple types of inspection data for the same inspection area, business personnel can simultaneously view multiple data types of inspection data for the same area when reviewing inspection results. This provides a clear and intuitive understanding of the specific situation of the power inspection area, improving the efficiency and accuracy of related maintenance operations for the power inspection area.

[0065] In one embodiment, the inspection data processing method further includes: when receiving a display instruction for inspection data of a power inspection area triggered by a three-dimensional earth model, calling the application corresponding to the data type of the inspection data, and visually displaying the inspection data in the matching power inspection area of ​​the three-dimensional earth model.

[0066] Among them, the display command is a command triggered by the user through the terminal to perform a triggering operation on the 3D globe model, which is used to instruct the display of inspection data on the 3D globe model.

[0067] In one embodiment, a user can trigger a command to generate and display inspection data by clicking the display button of the power inspection results system on the terminal page.

[0068] Each type of inspection data corresponds to an application capable of loading and visualizing the data. Different data types require different applications for loading the data.

[0069] In one embodiment, the power inspection results management system integrates applications corresponding to various data types and stores the correspondence between each data type and each application in the database in advance. When the data type of the inspection data is determined, the application corresponding to the data type is determined according to the data type, and the application is called to visualize the corresponding inspection data.

[0070] Specifically, when the power inspection results management system receives a user's instruction to display inspection data of the power inspection area triggered by a 3D earth model on the terminal, it calls the application corresponding to the data type of the inspection data through the mapping relationship between the data type and the application, and visualizes the inspection data in the matching power inspection area of ​​the 3D earth model.

[0071] In one embodiment, if the data type is panoramic photo data, the panoramic photo is visualized on a three-dimensional earth model using a VR panoramic content platform.

[0072] In one embodiment, if the data type is ordinary photo data, the ordinary photo is visualized on a 3D Earth model using a Windows Image Viewer.

[0073] In one embodiment, if the data type is point cloud data or oblique photogrammetry model data, DJI Terra software is used to visualize the point cloud model or oblique photogrammetry model data on a 3D Earth model.

[0074] In one embodiment, if the data type is orthophoto data or terrain data, ArcGIS or Global Mapper is used to visualize the orthophoto or terrain on a 3D Earth model.

[0075] In one embodiment, if the data type is oblique photogrammetry model data, the system determines whether the oblique photogrammetry model data is being loaded for the first time based on its data information. If it is being loaded for the first time, the DJI Terra software is used to load the oblique photogrammetry model and visualize it on a 3D Earth model. If it is not being loaded for the first time, the system searches the database for the pre-stored index file corresponding to the oblique photogrammetry model based on its data information and calls the DJI Terra software to generate the corresponding oblique photogrammetry model based on the index file. In this embodiment, since the index file of the oblique photogrammetry model occupies little memory, the index file of the loaded oblique photogrammetry model is stored in the database. During the second loading, loading the entire oblique photogrammetry model can be avoided; it can be generated directly from the corresponding index file. This effectively reduces the time and memory costs associated with loading the oblique photogrammetry model, significantly improving the operational efficiency of the power inspection results display system.

[0076] In the above embodiments, when a command to display inspection data of a power inspection area is received based on a three-dimensional earth model, the application corresponding to the data type of the inspection data is called to visualize the inspection data in the matching power inspection field of the three-dimensional earth model. Users can intuitively and clearly understand the specific situation of the power inspection area through the visualization of inspection data of various data types, thereby improving the efficiency and accuracy of business personnel in performing relevant maintenance operations on the power inspection area.

[0077] In one embodiment, after calling the application corresponding to the data type of the inspection data to visualize the inspection data on the matching power inspection area of ​​the 3D earth model, the method further includes:

[0078] The dual-screen display software of the power inspection results management system is used to simultaneously display two 3D globe models on the same page of the user's terminal. Each globe model displays inspection data collected at different times for the same power inspection area. By comparing historical inspection data for the same area on both screens, synchronous and interactive observation of changes in the surrounding environment over different periods can be achieved.

[0079] In one embodiment, when generating a three-dimensional earth model, the power inspection results management system identifies the power inspection areas that require special attention in actual power projects as key inspection areas and makes visual annotations on the three-dimensional earth model.

[0080] In one embodiment, the power inspection results management system can also receive annotation commands generated by users via terminals when marking locations with identified problems during inspections. Responding to these commands, the system marks the problematic power inspection areas on a 3D globe model. This facilitates precise power maintenance of these areas by subsequent maintenance personnel.

[0081] In one embodiment, the data type of the inspection data includes point cloud data. Based on the data type of the inspection data, obtaining the location information of the power inspection area corresponding to the inspection data includes: if the data type is point cloud data, then obtaining the location information of the power inspection area corresponding to the point cloud data based on the location information recorded in the first index file carried in the data information of the point cloud data.

[0082] Point cloud data refers to point cloud models collected by drones using radar equipment during aerial inspections of power grid inspection areas. These point cloud models can accurately reconstruct the true color, geometric shape, and detailed composition of the power grid inspection area. Specifically, the drone conducts aerial inspections of designated power grid inspection areas, collects point cloud datasets of the area using radar equipment, and inputs these datasets into DJI Terra software, which then generates point cloud models. The radar equipment can be a 3D laser scanning radar.

[0083] The first index file is the corresponding index file generated by DJI Terra software when generating the point cloud model from the point cloud collection. This first index file includes key information about the point cloud model, such as the various sub-files in the point cloud model data, the spatial range of each sub-file, the nesting relationships between sub-files, and their location information. Understandably, by parsing the first index file, the location information of the power inspection area corresponding to the point cloud model can be obtained.

[0084] Specifically, if the power inspection results management system determines that the data type of the inspection data is point cloud data, then it obtains the first index file carried by the point cloud data, parses the first index file to obtain the model files of each level of the point cloud model, and determines the location information of the power inspection area corresponding to the point cloud model based on the position information of each model tile in each level of the model file. The model files at each level are files that conform to the 3dtiles standard.

[0085] In this embodiment, when the inspection data is point cloud data, the location information of the power inspection area corresponding to the point cloud data is obtained by parsing the first index file carried by the point cloud data. This provides a foundation for the subsequent visualization of the point cloud data on a 3D earth model.

[0086] In one embodiment, if the data type is point cloud data, the data source of the point cloud data is determined based on the data information of the point cloud data. If the point cloud data is not generated by DJI Terra software, the corresponding application is called according to the source of the point cloud data, and the corresponding application is used to parse the point cloud data to obtain the location information of the point cloud data.

[0087] In one embodiment, the data type of the inspection data includes: oblique photogrammetry model data. For example... Figure 3 As shown, based on the data type of the inspection data, the location information of the power inspection area corresponding to the inspection data is obtained, including the following steps:

[0088] Step 302: If the data type is oblique photogrammetry model data, determine whether the oblique photogrammetry model data is being loaded for the first time based on the data information of the oblique photogrammetry model data.

[0089] The oblique photogrammetry model data is photographic model data collected by a drone through its camera equipment after conducting multi-angle aerial inspections of the power grid inspection area. Oblique photogrammetry technology can capture high-resolution textures of the top and side views of the power grid inspection area. The oblique photogrammetry model obtained using this technology can realistically reflect the ground features and accurately acquire physical texture information. Specifically, the drone conducts aerial inspections of a designated power grid inspection area, capturing images of the area from multiple angles through its camera lens. Based on the collected multi-angle image set, the multi-angle image set is input into the drone's built-in modeling software to generate the corresponding oblique photogrammetry model. This modeling software can be DJI Terra software.

[0090] Specifically, if the power inspection results management system determines that the data type of the inspection data is oblique photography model data, then based on the identification information carried in the data information of the oblique photography model data, and based on the identification information and the index identification information pre-stored in the power inspection results management system, it determines whether the oblique photography model data is being loaded for the first time.

[0091] Step 304: If this is the first time loading, the oblique photography model data is interpreted to obtain the location information of the power inspection area corresponding to the oblique photography model data.

[0092] Specifically, if the power line inspection results management system cannot find an index identifier that matches the identifier information carried in the oblique photography model data, it determines that the oblique photography model is being loaded for the first time. The power line inspection results management system uses DJI Terra software to automatically interpret the oblique photography model data to obtain the location information of the power line inspection area corresponding to the oblique photography model data.

[0093] Step 306: If this is not the first time loading, then according to the index identifier carried by the data information of the oblique photogrammetry model data, search for the corresponding second index file in the database, and obtain the location information of the power inspection area corresponding to the oblique photogrammetry model data according to the location information recorded in the second index file.

[0094] Specifically, if the power line inspection results management system finds an index identifier that matches the identifier information carried in the oblique photography model data, it determines that the oblique photography model is not being loaded for the first time. Based on the index identifier carried in the oblique photography model data, the system searches for the corresponding second index file in the local database and determines the location information of the power line inspection area corresponding to the oblique photography model based on the second index file. The second index file contains data information including key generation data of the oblique photography model; the corresponding oblique photography model can be directly generated based on the second index information. It is understandable that the second index file records the location information of the power line inspection area corresponding to the oblique photography model.

[0095] In this embodiment, when the inspection data is of the type of oblique photogrammetry model data, the method for determining the location information of the oblique photogrammetry model is determined by judging whether the oblique photogrammetry model is being loaded for the first time. Based on different location information determination methods, the location information of the power inspection area corresponding to the oblique photogrammetry model data is obtained. This provides a foundation for the subsequent visualization of the oblique photogrammetry model data on a 3D earth model.

[0096] In one embodiment, the index file is in JSON string format, and the bounds information in the JSON string can determine the location information of the model corresponding to the index file.

[0097] In one embodiment, if it is the first time loading, after interpreting the oblique photography model data to obtain the location information of the power inspection area corresponding to the oblique photography model data, the method further includes: generating a third index file based on the location information of the power inspection area corresponding to the oblique photography model data; associating the third index file with the oblique photography model data; and storing the third index file in a database.

[0098] Specifically, when the oblique photography model data is loaded for the first time, the power inspection results management system, after obtaining the location information of the power inspection area corresponding to the oblique photography model data, traverses the oblique photography model, obtains each model component in the oblique photography model through traversal, slices each model component, creates a corresponding spatial index based on each model slice, obtains the third index file corresponding to the oblique model according to the spatial index and the location information of the power inspection area corresponding to the oblique photography model, and saves the third index file in the database so that it can be used directly when the oblique photography model is loaded again in the future.

[0099] In one embodiment, the data type of the inspection data includes: photo data, which includes ordinary photo data and panoramic photo data.

[0100] The standard photo data consists of images captured by a drone from a specific angle of the power inspection area after conducting an aerial inspection using its camera lens. The panoramic photo data is a 2:1 scale image obtained by processing data collected by a drone during a surround-view shot of the power inspection area.

[0101] Based on the data type of the inspection data, the location information of the power inspection area corresponding to the inspection data is obtained, including: if the data type is photo data, the location information of the photo is obtained based on the location information recorded in the photo data.

[0102] Specifically, if the power line inspection results management system determines that the data type of the inspection data is photo data, then the location information of the power line inspection area corresponding to the photo is obtained based on the location information recorded in the photo data. The location information refers to the POS information generated by the drone when collecting photos during the inspection.

[0103] In this embodiment, when the data type of the inspection data is photo data, the power inspection results display system directly extracts the location information of the power inspection area corresponding to the photo data from the data information of the photo data, which provides a basis for the subsequent visualization display of the photo data on the three-dimensional earth model.

[0104] In one embodiment, the data type of the inspection data includes orthophoto data.

[0105] Orthophoto data refers to image models acquired by drones through their camera lenses after taking aerial photos of the power line inspection area. Specifically, the drone conducts aerial inspections of a designated power line inspection area, capturing images of the area through its camera lens. These images are then input into the drone's built-in modeling software to generate corresponding orthophotos. This modeling software can be DJI Terra software.

[0106] Based on the data type of the inspection data, the location information of the power inspection area corresponding to the inspection data is obtained, including: if the data type is orthophoto data, the location information of the power inspection area corresponding to the orthophoto is obtained based on the location information recorded in the data information of the orthophoto data.

[0107] Specifically, if the power inspection results management system determines that the data type of the inspection data is orthophoto data, then the location information of the power inspection area corresponding to the orthophoto is obtained based on the location information recorded in the data information of the orthophoto data.

[0108] In this embodiment, when the data type of the inspection data is orthophoto data, the power inspection results display system directly extracts the location information of the power inspection area corresponding to the orthophoto from the data information of the orthophoto data, which provides a basis for the subsequent visualization display of the orthophoto on the three-dimensional earth model.

[0109] In one embodiment, a method for processing inspection data is provided, which is applied to a power inspection results management system integrated into a terminal.

[0110] Specifically, drones collect inspection data in designated power line inspection areas. The power line inspection results management system acquires the inspection data collected by the drones and determines the data type of the inspection data based on the data information.

[0111] like Figure 4 As shown, if the data type is video data, since video data basically does not carry POS information, the power inspection results management system receives the location information of the video data input by the user through the terminal page, and realizes geographic positioning and video data visualization loading on a three-dimensional earth based on the location information.

[0112] If the inspection data is photo data, the system first checks whether the data contains the POS information of the photos. If it does, the system selects to import the photo data in batches. The power inspection results management system uses the latitude, longitude, and altitude information of each photo to achieve geographic positioning and visualization on a three-dimensional earth, and generates the inspection trajectory of the photos based on the time the photos were taken.

[0113] like Figure 5 As shown, if the inspection data is point cloud data, the data source is determined based on the data information of the point cloud data. If the point cloud data is generated by DJI Terra software mounted on a drone, the power inspection results management system automatically loads the point cloud data based on its own index file and performs geolocation on a 3D globe according to the index file. If the point cloud data is generated by other software, the system receives the geographic location information and storage location of the point cloud data input by the user through the terminal page, automatically loads the point cloud data based on the geographic location information and storage location, and performs geolocation and visualization loading on a 3D map.

[0114] If the inspection data is oblique photogrammetry model data, the system determines whether this is the first time the data has been loaded. If it is, the power inspection results management system receives the storage location of the oblique photogrammetry model data input by the user through the terminal page, automatically interprets the data to determine its location, and performs geolocation and visualization loading on a 3D globe. Simultaneously, an index file for the oblique photogrammetry model is generated and stored in the local database for future loading. If the oblique photogrammetry model is not being loaded for the first time, the power inspection results management system uses the index identifier carried in the data information to find the corresponding index file in the local database. Based on the index file and the location information recorded in it, it performs geolocation and visualization loading on a 3D globe.

[0115] If the data type is orthophoto data, the power inspection results management system extracts the location information of the orthophoto data from the data information to achieve geographic positioning and visualization loading on a three-dimensional earth.

[0116] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0117] Based on the same inventive concept, this application also provides an inspection data processing device for implementing the inspection data processing method described above. The solution provided by this device is similar to the solution described in the above method; therefore, the specific limitations in one or more inspection data processing device embodiments provided below can be found in the limitations of the inspection data processing method described above, and will not be repeated here.

[0118] In one embodiment, such as Figure 6 As shown, an inspection data processing device 600 is provided, including: a data type determination module 601, a location information acquisition module 602, and a location information matching module 603, wherein:

[0119] The data type determination module 601 is used to acquire the inspection data collected from the power inspection area and determine the data type of the inspection data based on the data information of the inspection data.

[0120] The location information acquisition module 602 is used to parse the inspection data based on the parsing method corresponding to the data type and obtain the location information of the power inspection area corresponding to the inspection data.

[0121] The location information matching module 603 is used to match the location information with the location information of each power inspection area on the pre-created three-dimensional earth model, and insert the inspection data into the layer database of the matched power inspection area in the three-dimensional earth model.

[0122] The aforementioned inspection data processing device, after acquiring inspection data collected from the power inspection area, determines the data type of the inspection data based on the data information. Based on the parsing method corresponding to each data type, it parses the inspection data to obtain the location information of the corresponding power inspection area. The inspection data is then inserted into the matching layer database of the power inspection area in the 3D earth model. By fusing multiple different types of inspection data in the same coordinate system, and enabling integrated and visualized management of various types of inspection data for the same inspection area, business personnel can directly load and view inspection data of multiple data types for the same area when reviewing inspection results. This provides a clear and intuitive understanding of the specific situation of the power inspection area, improving the efficiency and accuracy of related maintenance operations for business personnel in the power inspection area.

[0123] In one embodiment, the inspection data processing device further includes a visualization module, which, when receiving an instruction to display inspection data of a power inspection area triggered by a three-dimensional earth model, calls the application corresponding to the data type of the inspection data and visualizes the inspection data in the matching power inspection area of ​​the three-dimensional earth model.

[0124] In one embodiment, the location information acquisition module is further configured to: if the data type is point cloud data, obtain the location information of the power inspection area corresponding to the point cloud data based on the location information recorded in the first index file carried in the data information of the point cloud data.

[0125] In one embodiment, the location information acquisition module is further configured to: if the data type is oblique photography model data, determine whether the oblique photography model data is being loaded for the first time based on the data information of the oblique photography model data; if it is being loaded for the first time, interpret the oblique photography model data to obtain the location information of the power inspection area corresponding to the oblique photography model data; if it is not being loaded for the first time, search for the corresponding second index file in the database based on the index identifier carried by the data information of the oblique photography model data, and obtain the location information of the power inspection area corresponding to the oblique photography model data based on the location information recorded in the second index file.

[0126] In one embodiment, the location information acquisition module is further configured to: if the data type is photo data, obtain the location information of the power inspection area corresponding to the photo based on the location information recorded in the photo data.

[0127] In one embodiment, the location information acquisition module is further configured to: if the data type is orthophoto data, obtain the location information of the power inspection area corresponding to the orthophoto based on the location information recorded in the data information of the orthophoto data.

[0128] Each module in the aforementioned inspection data processing device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of a computer device in software form, so that the processor can call and execute the corresponding operations of each module.

[0129] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 7 As shown, the computer device includes a processor, memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database stores inspection data. The network interface communicates with external terminals via a network connection. When the computer program is executed by the processor, it implements an inspection data processing method.

[0130] Those skilled in the art will understand that Figure 7 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0131] In one embodiment, a computer device is provided, which can be the power inspection result management system of this application, including a memory and a processor. The memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0132] Acquire inspection data collected from the power inspection area, and determine the data type of the inspection data based on the data information.

[0133] Based on the parsing method corresponding to the data type, the inspection data is parsed to obtain the location information of the power inspection area corresponding to the inspection data.

[0134] The location information is matched with the location information of each power inspection area on the pre-created 3D earth model, and the inspection data is inserted into the layer database of the matched power inspection area in the 3D earth model.

[0135] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0136] When a command to display inspection data of a power inspection area is received based on a 3D earth model, the application corresponding to the data type of the inspection data is invoked to visualize the inspection data in the matching power inspection area of ​​the 3D earth model.

[0137] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0138] If the data type is point cloud data, the location information of the power inspection area corresponding to the point cloud data is obtained based on the location information recorded in the first index file carried in the data information of the point cloud data.

[0139] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0140] If the data type is oblique photogrammetry model data, determine whether the oblique photogrammetry model data is being loaded for the first time based on the data information of the oblique photogrammetry model data;

[0141] If this is the first time loading, the oblique photography model data will be interpreted to obtain the location information of the power inspection area corresponding to the oblique photography model data;

[0142] If this is not the first time the data is loaded, the corresponding second index file is searched in the database based on the index identifier carried in the oblique photogrammetry model data. Based on the location information recorded in the second index file, the location information of the power inspection area corresponding to the oblique photogrammetry model data is obtained.

[0143] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0144] If the data type is photo data, then the location information of the power inspection area corresponding to the photo is obtained based on the location information recorded in the photo data.

[0145] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0146] If the data type is orthophoto data, then the location information of the power inspection area corresponding to the orthophoto is obtained based on the location information recorded in the orthophoto data.

[0147] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0148] Acquire inspection data collected from the power inspection area, and determine the data type of the inspection data based on the data information.

[0149] Based on the parsing method corresponding to the data type, the inspection data is parsed to obtain the location information of the power inspection area corresponding to the inspection data.

[0150] The location information is matched with the location information of each power inspection area on the pre-created 3D earth model, and the inspection data is inserted into the layer database of the matched power inspection area in the 3D earth model.

[0151] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0152] When a command to display inspection data of a power inspection area is received based on a 3D earth model, the application corresponding to the data type of the inspection data is invoked to visualize the inspection data in the matching power inspection area of ​​the 3D earth model.

[0153] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0154] If the data type is point cloud data, the location information of the power inspection area corresponding to the point cloud data is obtained based on the location information recorded in the first index file carried in the data information of the point cloud data.

[0155] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0156] If the data type is oblique photogrammetry model data, determine whether the oblique photogrammetry model data is being loaded for the first time based on the data information of the oblique photogrammetry model data;

[0157] If this is the first time loading, the oblique photography model data will be interpreted to obtain the location information of the power inspection area corresponding to the oblique photography model data;

[0158] If this is not the first time the data is loaded, the corresponding second index file is searched in the database based on the index identifier carried in the oblique photogrammetry model data. Based on the location information recorded in the second index file, the location information of the power inspection area corresponding to the oblique photogrammetry model data is obtained.

[0159] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0160] If the data type is photo data, then the location information of the power inspection area corresponding to the photo is obtained based on the location information recorded in the photo data.

[0161] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0162] If the data type is orthophoto data, then the location information of the power inspection area corresponding to the orthophoto is obtained based on the location information recorded in the orthophoto data.

[0163] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:

[0164] Acquire inspection data collected from the power inspection area, and determine the data type of the inspection data based on the data information.

[0165] Based on the parsing method corresponding to the data type, the inspection data is parsed to obtain the location information of the power inspection area corresponding to the inspection data.

[0166] The location information is matched with the location information of each power inspection area on the pre-created 3D earth model, and the inspection data is inserted into the layer database of the matched power inspection area in the 3D earth model.

[0167] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0168] When a command to display inspection data of a power inspection area is received based on a 3D earth model, the application corresponding to the data type of the inspection data is invoked to visualize the inspection data in the matching power inspection area of ​​the 3D earth model.

[0169] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0170] If the data type is point cloud data, the location information of the power inspection area corresponding to the point cloud data is obtained based on the location information recorded in the first index file carried in the data information of the point cloud data.

[0171] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0172] If the data type is oblique photogrammetry model data, determine whether the oblique photogrammetry model data is being loaded for the first time based on the data information of the oblique photogrammetry model data;

[0173] If this is the first time loading, the oblique photography model data will be interpreted to obtain the location information of the power inspection area corresponding to the oblique photography model data;

[0174] If this is not the first time the data is loaded, the corresponding second index file is searched in the database based on the index identifier carried in the oblique photogrammetry model data. Based on the location information recorded in the second index file, the location information of the power inspection area corresponding to the oblique photogrammetry model data is obtained.

[0175] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0176] If the data type is photo data, then the location information of the power inspection area corresponding to the photo is obtained based on the location information recorded in the photo data.

[0177] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0178] If the data type is orthophoto data, then the location information of the power inspection area corresponding to the orthophoto is obtained based on the location information recorded in the orthophoto data.

[0179] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0180] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0181] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0182] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for processing inspection data, characterized in that, The method includes: Acquire inspection data collected from the power inspection area, and determine the data type of the inspection data according to the data structure and / or data format of the inspection data; Based on the parsing method corresponding to the data type, the inspection data is parsed to obtain the location information of the power inspection area corresponding to the inspection data and the pre-created three-dimensional earth model belonging to the same coordinate system; The location information is matched with the location information of each power inspection area on the three-dimensional earth model, and the inspection data is inserted into the layer database of the matched power inspection areas on the three-dimensional earth model; each data type corresponds to a graphic database; When a command to display the inspection data of the power inspection area is received based on the three-dimensional earth model, the application corresponding to the data type of the inspection data is called through the mapping relationship between the data type of the inspection data and the application, and the inspection data is visualized and displayed in the matching power inspection area of ​​the three-dimensional earth model. The dual-screen display software is invoked to simultaneously display two 3D globe models on the same page. Each 3D globe model is used to display the inspection data collected at different inspection times for the same power inspection area. The data type of the inspection data includes oblique photogrammetry model data. The step of parsing the inspection data using the parsing method corresponding to the data type to obtain the location information of the power inspection area corresponding to the inspection data and the pre-created three-dimensional earth model belonging to the same coordinate system includes: If the data type is oblique photogrammetry model data, then determine whether the oblique photogrammetry model data is being loaded for the first time based on the data information of the oblique photogrammetry model data; If this is the first time the data is loaded, the oblique photography model data is interpreted to obtain the location information of the power inspection area corresponding to the oblique photography model data. If this is not the first time the data is loaded, the corresponding second index file is searched in the database based on the index identifier carried by the data information of the oblique photography model data. The location information of the power inspection area corresponding to the oblique photography model data is obtained based on the location information recorded in the second index file. The second index file includes the key generation data of the oblique photography model.

2. The method of claim 1, wherein, The data types of the inspection data include: point cloud data; The parsing method based on the data type parses the inspection data to obtain the location information of the power inspection area corresponding to the inspection data and the pre-created three-dimensional earth model belonging to the same coordinate system, including: If the data type is point cloud data, then the location information of the power inspection area corresponding to the point cloud data is obtained based on the location information of the first index file carried in the data information of the point cloud data.

3. The method of claim 1, wherein, The data types of the inspection data include: photo data, which includes ordinary photo data and panoramic photo data; The parsing method based on the data type parses the inspection data to obtain the location information of the power inspection area corresponding to the inspection data and the pre-created three-dimensional earth model belonging to the same coordinate system, including: If the data type is photo data, then the location information of the power inspection area corresponding to the photo is obtained based on the location information recorded in the data information of the photo data.

4. The method of claim 1, wherein, The data types of the inspection data include: orthophoto data; The parsing method based on the data type parses the inspection data to obtain the location information of the power inspection area corresponding to the inspection data and the pre-created three-dimensional earth model belonging to the same coordinate system, including: If the data type is orthophoto data, then the location information of the power inspection area corresponding to the orthophoto is obtained based on the location information recorded in the data information of the orthophoto data.

5. A data processing device for patrolling, characterized by The device includes: The data type determination module is used to acquire inspection data collected from the power inspection area and determine the data type of the inspection data according to the data structure and / or data format of the inspection data. The location information acquisition module is used to parse the inspection data based on the parsing method corresponding to the data type, and obtain the location information of the power inspection area corresponding to the inspection data and the pre-created three-dimensional earth model belonging to the same coordinate system. The location information matching module is used to match the location information with the location information of each power inspection area on the three-dimensional earth model, and insert the inspection data into the layer database of the matched power inspection areas on the three-dimensional earth model; each data type corresponds to a graphic database; The visualization module is used to, when receiving a command to display the inspection data of the power inspection area triggered by the 3D earth model, call the application corresponding to the data type of the inspection data through the mapping relationship between the data type of the inspection data and the application, and visualize the inspection data in the matching power inspection area of ​​the 3D earth model; it also calls the dual-screen display software to display two 3D earth models on the same page simultaneously, with each 3D earth model used to display the inspection data collected in the same power inspection area at different inspection times. The data type of the inspection data includes oblique photography model data. The location information acquisition module is used to determine whether the oblique photography model data is being loaded for the first time based on the data information of the oblique photography model data if the data type is oblique photography model data. If it is being loaded for the first time, the oblique photography model data is interpreted to obtain the location information of the power inspection area corresponding to the oblique photography model data. If it is not being loaded for the first time, the corresponding second index file is searched in the database based on the index identifier carried by the data information of the oblique photography model data, and the location information of the power inspection area corresponding to the oblique photography model data is obtained based on the location information recorded in the second index file. The second index file includes the key generation data of the oblique photography model.

6. The apparatus of claim 5, wherein, The data types of the inspection data include point cloud data; the location information acquisition module is used to: if the data type is point cloud data, obtain the location information of the power inspection area corresponding to the point cloud data based on the location information recorded in the first index file carried in the data information of the point cloud data.

7. The apparatus of claim 5, wherein, The data types of the inspection data include: photo data, which includes ordinary photo data and panoramic photo data; the location information acquisition module is used to: if the data type is photo data, obtain the location information of the power inspection area corresponding to the photo based on the location information recorded in the data information of the photo data.

8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 4.

9. A computer readable storage medium having stored thereon a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 4.

10. A computer program product comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 4.

Images