Intelligent inspection system and method for target area based on digital twinborn technology

Abstract

The invention discloses an intelligent inspection system and method for a target area based on a digital twin technology, and relates to the field of new energy, and the system comprises a data collection module which is used for collecting three-dimensional point cloud data of the target area, and constructing a three-dimensional point cloud model of the target area according to the three-dimensional point cloud data; the intelligent inspection terminal is connected with the data acquisition module and is used for monitoring environmental condition data of the target area and equipment state data of a plurality of pieces of equipment in the target area in real time and associating the equipment state data and the environmental condition data with the three-dimensional point cloud model to generate a three-dimensional twinborn model; and the twinborn inspection platform is connected with the intelligent inspection terminal and is used for displaying the three-dimensional twinborn model under the condition of determining that the equipment fault occurs in the target area, and displaying a fault area and a fault category corresponding to the equipment fault in the three-dimensional twinborn model.

Description

Technical Field

[0001] The present application relates to the field of new energy, and specifically, to an intelligent inspection system and method for a target area based on digital twin technology. Background Art

[0002] With the rapid development and integration of information technologies such as artificial intelligence, big data, and the Internet of Things, the power industry is keeping up with the trend of the times and making every effort to promote digital transformation and digital grid construction. As a new type of digital technology, digital twin technology has great potential in improving the perception, decision-making, and control capabilities of power systems. At the same time, at this stage, digital twin technology has completed the panoramic construction of equipment appearance and operating status and simple equipment status detection and evaluation services in some companies in the power industry, and the corresponding twin models are mostly system-level, and still lack further typical high-value business scenario applications.

[0003] The booster station is a key link in the power system, and its operating status directly affects the safety of the power grid. At present, there are several typical problems in the operation and maintenance of the booster station: 1. The monitoring of the centralized control end and the station end is mainly based on the traditional two-dimensional logical view, which cannot intuitively reflect the spatial layout and equipment information, and is not convenient for fast locking of fault points and intuitive display of status; 2. The intelligent inspection system composed of inspection robots and video imaging equipment, which has been popular in recent years, is independently configured as an auxiliary system, which is relatively independent of the main control system monitoring such as the data detection of the integrated self-system, which is not convenient for the operation and maintenance personnel to fully and quickly realize the monitoring and operation of the booster station.

[0004] In view of the problem in related technologies that the two-dimensional logical view of power system operation cannot intuitively reflect the spatial layout and equipment information, and is not convenient for quickly locking the fault point and intuitively displaying the status, no effective solution has been proposed so far.

[0005] Therefore, it is necessary to improve the related technology to overcome the above-mentioned defects in the related technology. Summary of the invention

[0006] The embodiments of the present application provide an intelligent inspection system and method for a target area based on digital twin technology, so as to at least solve the problem in the related art that the two-dimensional logical view of the power system operation cannot intuitively reflect the spatial layout and equipment information, and is not convenient for quickly locking the fault point and intuitively displaying the status.

[0007] According to one aspect of an embodiment of the present application, an intelligent inspection system for a target area based on digital twin technology is provided, including: a data acquisition module, used to collect three-dimensional point cloud data of the target area, and construct a three-dimensional point cloud model of the target area based on the three-dimensional point cloud data; an intelligent inspection terminal, connected to the data acquisition module, used to monitor the environmental condition data of the target area and the equipment status data of multiple devices in the target area in real time, and associate the multiple equipment status data and the environmental condition data with the three-dimensional point cloud model to generate a three-dimensional twin model; a twin inspection platform, connected to the intelligent inspection terminal, used to display the three-dimensional twin model when it is determined that an equipment failure occurs in the target area, and to display the fault area and fault category corresponding to the equipment failure in the three-dimensional twin model.

[0008] In an exemplary embodiment, the data acquisition module includes: a data preprocessing submodule, which is used to: decode the three-dimensional point cloud data to obtain decoded three-dimensional point cloud data; perform data cleaning on the decoded three-dimensional point cloud data to remove noise in the decoded three-dimensional point cloud data to obtain cleaned three-dimensional point cloud data; standardize the cleaned three-dimensional point cloud data to unify the data format of the cleaned three-dimensional point cloud data to obtain standardized three-dimensional point cloud data, wherein the standardized three-dimensional point cloud data is used to construct the three-dimensional point cloud model.

[0009] In an exemplary embodiment, the intelligent inspection terminal is also used to: create virtual identifiers for the multiple devices in the three-dimensional point cloud model; transmit the multiple device status data and the environmental condition data to the twin and algorithm server to instruct the twin and algorithm server to perform data conversion on the multiple device status data and the environmental condition data, and update the data conversion results to the three-dimensional point cloud model according to the virtual identifier to generate the three-dimensional twin model, wherein the data format of the data conversion result matches the three-dimensional point cloud model.

[0010] In an exemplary embodiment, the intelligent inspection terminal is also used to: process the multiple device status data and the environmental condition data through a fault detection model to perform equipment fault detection on the multiple devices; when an equipment failure is detected, obtain the fault warning data corresponding to the faulty device, and send the fault warning data to the twin and algorithm server for processing to determine the fault category of the equipment failure; determine the fault area of ​​the faulty device in the three-dimensional twin model according to the target virtual identifier corresponding to the faulty device, and update the three-dimensional twin model according to the fault category and the fault area.

[0011] In an exemplary embodiment, the twin and algorithm server is used to: upon receiving the fault warning data, process the fault warning data through an image recognition algorithm and / or a voiceprint recognition algorithm to extract the key fault features of the equipment failure; process the key fault features through a fault classification algorithm to determine the fault category of the equipment failure.

[0012] In an exemplary embodiment, the twin inspection platform is also used to: receive the three-dimensional twin model sent by the intelligent inspection terminal and display the three-dimensional twin model; when it is determined that the three-dimensional twin model is updated, receive the fault warning data sent by the intelligent inspection terminal; display the updated three-dimensional twin model, and link the fault warning data to the updated three-dimensional twin model according to the fault area.

[0013] According to another aspect of an embodiment of the present application, a smart inspection method for a target area based on digital twin technology is also provided, which is applied to the above-mentioned smart inspection system for a target area based on digital twin technology, including: collecting three-dimensional point cloud data of the target area, and constructing a three-dimensional point cloud model of the target area based on the three-dimensional point cloud data; monitoring the environmental condition data of the target area and the equipment status data of the multiple equipment in real time, and associating the multiple equipment status data and the environmental condition data with the three-dimensional point cloud model to generate the three-dimensional twin model; when it is determined that an equipment failure occurs in the target area, displaying the three-dimensional twin model, and displaying the fault area and fault category corresponding to the equipment failure in the three-dimensional twin model.

[0014] According to another aspect of an embodiment of the present application, a computer-readable storage medium is also provided, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned intelligent inspection method of the target area based on the digital twin technology when running.

[0015] According to another aspect of an embodiment of the present application, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the intelligent inspection method of the target area based on the digital twin technology through the computer program.

[0016] According to another aspect of the embodiments of the present application, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps of the method described in each embodiment of the present application are implemented.

[0017] Through the present application, an intelligent inspection system for a target area based on digital twin technology is provided, including: a data acquisition module, which is used to collect three-dimensional point cloud data of the target area, and construct a three-dimensional point cloud model of the target area based on the three-dimensional point cloud data; an intelligent inspection terminal, connected to the data acquisition module, for real-time monitoring of environmental condition data of the target area and equipment status data of multiple devices in the target area, and associating these equipment status data and environmental condition data with the three-dimensional point cloud model to generate a three-dimensional twin model; a twin inspection platform, connected to the intelligent inspection terminal, is used to display the three-dimensional twin model when it is determined that an equipment fault occurs in the target area, and to display the fault area and fault category corresponding to the equipment fault in the three-dimensional twin model; adopting the above scheme, through the integration of digital twins and intelligent inspections, a three-dimensional panoramic twin model (i.e., the above-mentioned three-dimensional twin model) that is updated in real time with the equipment status is constructed, and the three-dimensional panoramic twin model can be used to quickly locate the fault and intuitively display the fault; thereby solving the problem in the related art that the two-dimensional logical view of the operation of the power system cannot intuitively reflect the spatial layout and equipment information, and is not convenient for rapid locking of the fault point and intuitive display of the status. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0020] Figure 1 It is a hardware structure block diagram of a computer terminal of an intelligent inspection method of a target area based on digital twin technology in an embodiment of the present application;

[0021] Figure 2 It is a structural block diagram of an intelligent inspection system for a target area based on digital twin technology according to an embodiment of the present application;

[0022] Figure 3 It is a structural schematic diagram of a booster station inspection system based on digital twin according to an embodiment of the present application;

[0023] Figure 4 It is a schematic diagram of a process of constructing a booster station inspection system based on digital twin according to an embodiment of the present application;

[0024] Figure 5It is a schematic diagram of the workflow of a booster station inspection system based on digital twin according to an embodiment of the present application;

[0025] Figure 6 It is a flow chart of an intelligent inspection method of a target area based on digital twin technology according to an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] The method embodiments provided in the embodiments of the present application can be executed in a computer terminal or a similar computing device. Taking running on a computer terminal as an example, Figure 1 1 is a hardware structure block diagram of a computer terminal of an intelligent inspection method for a target area based on digital twin technology in an embodiment of the present application. Figure 1 As shown, the computer terminal may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor (Central Processing Unit, MCU) or a programmable logic device (Field Programmable Gate Array, FPGA)) and a memory 104 for storing data, wherein the above-mentioned computer terminal may also include a transmission device 106 and an input and output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1The structure shown is only for illustration and does not limit the structure of the above-mentioned computer terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0029] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the intelligent inspection method of the target area based on the digital twin technology in the embodiment of the present application. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories can be connected to the computer terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0030] A wireless network provided by a communication provider of a computer terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (Radio Frequency, referred to as RF) module, which is used to communicate with the Internet wirelessly.

[0031] In the related technologies, the existing digital twin technology and intelligent inspection technology of booster stations are separate. The digital twin is responsible for generating a three-dimensional twin model, and then mapping the power data of the production area. The twin model monitors and warns the production operation and maintenance by judging whether the data is abnormal, and pushes it to the three-dimensional model for digital display. In the data twin stage, the virtual three-dimensional model status can be displayed and fault diagnosis can be realized. Due to the different model generation methods, there are certain defects in the display level and resolution, and the operation status of the booster station cannot be displayed in an all-round and deeper level. The intelligent inspection system collects the data information of the booster station instrument values, indicator light colors, and knife switch throw-in and throw-out status lights through intelligent terminals such as robots, cameras, and voiceprint sensors, and identifies them through the central algorithm to judge the operation status of the booster station equipment and screen pictures with data defects for display.

[0032] In view of the problem in the related art that the two-dimensional logical view of the power system operation cannot intuitively reflect the spatial layout and equipment information, and is not convenient for quickly locking the fault point and intuitively displaying the status, the present application provides a booster station inspection system based on digital twins. The system combines digital twin technology and image recognition technology to establish a visual three-dimensional panoramic model (i.e., the above-mentioned three-dimensional twin model). The model simultaneously maps the booster station power production data and the inspection images of the booster station camera, temperature sensor, and other data. When a fault alarm occurs, the system can quickly locate the fault location and display the fault location image at the same time, with full access to the full range of information on the equipment fault point. Fault alarms can include power equipment failures, perimeter security, personnel identification and entry, etc.

[0033] Optionally, in this embodiment, a smart inspection system for a target area based on digital twin technology is provided. Figure 2 is a structural block diagram of an intelligent inspection system for a target area based on digital twin technology according to an embodiment of the present application, such as Figure 2 As shown, the system includes:

[0034] A data acquisition module 22 is used to acquire three-dimensional point cloud data of a target area and construct a three-dimensional point cloud model of the target area according to the three-dimensional point cloud data;

[0035] An intelligent inspection terminal 24, connected to the data acquisition module, is used to monitor the environmental condition data of the target area and the device status data of multiple devices in the target area in real time, and associate the multiple device status data and the environmental condition data with the three-dimensional point cloud model to generate a three-dimensional twin model;

[0036] The twin inspection platform 26 is connected to the intelligent inspection terminal, and is used to display the three-dimensional twin model when it is determined that an equipment failure occurs in the target area, and to display the fault area and fault category corresponding to the equipment failure in the three-dimensional twin model.

[0037] Through the present application, an intelligent inspection system for a target area based on digital twin technology is provided, including: a data acquisition module, which is used to collect three-dimensional point cloud data of the target area, and construct a three-dimensional point cloud model of the target area based on the three-dimensional point cloud data; an intelligent inspection terminal, connected to the data acquisition module, for real-time monitoring of environmental condition data of the target area and equipment status data of multiple devices in the target area, and associating these equipment status data and environmental condition data with the three-dimensional point cloud model to generate a three-dimensional twin model; a twin inspection platform, connected to the intelligent inspection terminal, is used to display the three-dimensional twin model when it is determined that an equipment fault occurs in the target area, and to display the fault area and fault category corresponding to the equipment fault in the three-dimensional twin model; adopting the above scheme, through the integration of digital twins and intelligent inspections, a three-dimensional panoramic twin model (i.e., the above-mentioned three-dimensional twin model) that is updated in real time with the equipment status is constructed, and the three-dimensional panoramic twin model can be used to quickly locate the fault and intuitively display the fault; thereby solving the problem in the related art that the two-dimensional logical view of the operation of the power system cannot intuitively reflect the spatial layout and equipment information, and is not convenient for rapid locking of the fault point and intuitive display of the status.

[0038] In an exemplary embodiment, the data acquisition module 22 includes: a data preprocessing submodule, which is used to: decode the three-dimensional point cloud data to obtain decoded three-dimensional point cloud data; perform data cleaning on the decoded three-dimensional point cloud data to remove noise in the decoded three-dimensional point cloud data to obtain cleaned three-dimensional point cloud data; standardize the cleaned three-dimensional point cloud data to unify the data format of the cleaned three-dimensional point cloud data to obtain standardized three-dimensional point cloud data, wherein the standardized three-dimensional point cloud data is used to construct the three-dimensional point cloud model.

[0039] The key processing steps of the data preprocessing submodule can be summarized as follows:

[0040] 1. Decoding and clarifying: Decode the collected raw data (i.e. the above-mentioned 3D point cloud data), convert its storage format, and remove noise and error points to improve data quality.

[0041] 2. Standardization and conversion: Unify the data into a standard format and convert it to an appropriate coordinate system to ensure that the data can be accurately mapped in the digital twin model.

[0042] 3. Quality check and packaging: Check data integrity, handle outliers, and finally package the data with metadata, ready for transmission to the twin and algorithm servers for further analysis.

[0043] It should be noted that the data preprocessing submodule is an indispensable part of the digital twin intelligent inspection system. Its main task is to ensure that the raw data collected from the intelligent inspection terminal can be effectively parsed, cleaned and converted for subsequent data mapping and analysis. The following is a detailed process of data processing by the data preprocessing submodule:

[0044] 1. Data decoding: The raw data collected by the intelligent inspection terminal may be stored in a specific encoding format. For example, the point cloud data generated by the laser radar (LiDAR) or 3D scanner may be in point cloud data format (such as PLY, PCD, etc.), while the image data captured by the camera may be in JPEG or PNG format. Data decoding is to convert these encoded data into a format that can be read and processed by the system, such as converting point cloud data from binary format to point list.

[0045] 2. Data cleaning: There may be noisy, redundant or erroneous data points in the decoded data. The purpose of data cleaning is to remove these unnecessary data and improve data quality. For example, point cloud data may contain erroneous points caused by leaves, dust or equipment blind spots, which need to be filtered out. For image data, it may be necessary to remove blurred images or adjust the image brightness and contrast to ensure that the image is clear and convenient for subsequent analysis.

[0046] 3. Data conversion: Data conversion refers to converting the decoded and cleaned data into a format or coordinate system that matches the digital twin model. For example, converting point cloud data from the equipment coordinate system to the global coordinate system of the booster station, or converting the pixel coordinates of image data into actual three-dimensional coordinates. This step ensures that the data can be mapped to the digital twin model in the correct position.

[0047] 4. Data format standardization: During the conversion process, the data preprocessing submodule may also perform data format standardization to unify the raw data formats from different devices and sensors for easy system integration and processing. For example, convert all image data to a unified resolution and color space, or convert all temperature readings to Celsius units.

[0048] 5. Data quality check and outlier processing: After completing the above steps, the data preprocessing submodule will also check the data quality, identify and process outliers. For example, for temperature data, if the reading of a sensor suddenly jumps or exceeds the normal physical range, it may need to be corrected or marked as invalid to avoid misleading subsequent analysis and algorithm models.

[0049] 6. Data packaging and transmission: Finally, the preprocessed data will be packaged into a specific data packet format and transmitted to the twin and algorithm server through the network. When the data is packaged, it usually includes metadata such as the data's timestamp, device ID, and location information to ensure that the server can correctly parse the data and associate the correct elements in the rest of the digital twin model.

[0050] Through the above steps, the data preprocessing submodule ensures that the data collected from the intelligent inspection terminal can be accurately understood, processed and mapped into the digital twin model by the system, providing a high-quality data foundation for equipment status monitoring, fault prediction and intelligent inspection of the substation.

[0051] Optionally, the intelligent inspection terminal 24 is also used to: create virtual identifiers for the multiple devices in the three-dimensional point cloud model; transmit the multiple device status data and the environmental condition data to the twin and algorithm server to instruct the twin and algorithm server to perform data conversion on the multiple device status data and the environmental condition data, and update the data conversion results to the three-dimensional point cloud model according to the virtual identifier to generate the three-dimensional twin model, wherein the data format of the data conversion result matches the three-dimensional point cloud model.

[0052] The implementation of data mapping includes the following steps:

[0053] 1. Define mapping rules: Create a virtual identity for each physical device in the digital twin model to ensure that data corresponds to model elements one by one;

[0054] 2. Real-time data stream processing and matching: Data is collected through intelligent inspection terminals, transmitted to the server in real time after pre-processing, and the algorithm is used to convert the data and match it with the corresponding position in the model;

[0055] 3. Model update and visualization: Update the data mapping results to the digital twin model, highlight the fault warning points and link related inspection data to achieve rapid fault location and intuitive display.

[0056] It should be noted that data mapping is a key link in digital twin technology. It connects data in the physical world with the virtual representation in the digital twin model, enabling the model to reflect the operating status of the real world in real time.

[0057] In an optional embodiment, completing data mapping, especially mapping the real-time data of the booster station into the three-dimensional digital twin model, can be completed by the following steps, including:

[0058] 1. Define mapping rules: First, create a virtual identifier in the digital twin model for each physical device (i.e., the multiple devices mentioned above) and key locations. These identifiers need to match the ID or location information of the real device so that the data can be accurately associated with the correct model element.

[0059] 2. Data collection and preprocessing: Intelligent inspection terminals (cameras, sensors, etc.) collect operating data, environmental data, and safety data of booster station equipment. These data need to be preprocessed, such as decoding, cleaning, and conversion, to ensure the accuracy and consistency of the data.

[0060] 3. Establish data interface: On the twin and algorithm servers, establish a data interface to facilitate communication between the system server and the intelligent inspection terminal. The interface should be able to handle various data types, including images, voiceprints, temperature readings, voltage and current measurements, etc.

[0061] 4. Real-time data stream transmission: The collected real-time data stream is transmitted to the twin and algorithm server through the data interface. Data transmission should be real-time to ensure that the digital twin model can be updated in time.

[0062] 5. Data conversion and mapping: In the twin and algorithm servers, the received data is converted into a format that matches the model elements. For example, the device status recognition results in the image captured by the camera are converted into the status identification in the model, or the data in the voiceprint sensor is converted into the sound description in the model.

[0063] 6. Anomaly detection and algorithm application: Use pre-trained algorithm models (such as machine learning models) to detect anomalies in real-time data. Once a potential fault warning point is detected, the algorithm determines its location in the model and links relevant data to that location.

[0064] 7. Update the digital twin model: Update the detected abnormal data and location information to the digital twin model in real time. This step may include local or global updates of the model, depending on the nature of the data and the scope of impact.

[0065] 8. Visual display: Finally, the twin inspection platform will display the updated three-dimensional model. The fault warning points will be highlighted in the model and linked to their related images, voiceprint records or other inspection data to provide intuitive fault information for operation and maintenance personnel.

[0066] Through these steps, the digital twin-based substation inspection system (i.e., the above-mentioned intelligent inspection system of the target area based on digital twin technology) can realize the accurate mapping of data from the physical world to the virtual model, thereby reflecting the operating status of the equipment and environment in real time in the model, and providing more intuitive and efficient fault location and operation and maintenance management means.

[0067] Optionally, the intelligent inspection terminal 24 is also used to: process the multiple device status data and the environmental condition data through a fault detection model to perform equipment fault detection on the multiple devices; when an equipment failure is detected, obtain the fault warning data corresponding to the faulty device, and send the fault warning data to the twin and algorithm server for processing to determine the fault category of the equipment failure; determine the fault area of ​​the faulty device in the three-dimensional twin model according to the target virtual identifier corresponding to the faulty device, and update the three-dimensional twin model according to the fault category and the fault area.

[0068] The intelligent inspection terminal is not only used to generate a three-dimensional twin model, but also monitors the equipment status in real time through the fault detection model to determine whether there is an equipment failure. If the fault detection model detects an equipment failure, the fault warning data corresponding to the equipment failure will be sent to the twin and algorithm server for processing to further determine the fault type of the equipment failure. After determining the fault type, the fault area of ​​the equipment failure in the three-dimensional twin model is determined according to the target virtual identifier corresponding to the faulty equipment, and then the fault type is intuitively marked in the fault area in the three-dimensional twin model.

[0069] Optionally, the twin and algorithm server is used to: upon receiving the fault warning data, process the fault warning data through an image recognition algorithm and / or a voiceprint recognition algorithm to extract key fault features of the equipment failure; process the key fault features through a fault classification algorithm to determine the fault category of the equipment failure.

[0070] Furthermore, after receiving the fault warning data, the twin and algorithm server can identify and process the fault-related data through image recognition algorithms, voiceprint recognition algorithms, etc., extract the key fault features of the equipment failure (such as image features, voiceprint features, etc.), and then use the pre-trained fault classification algorithm to process the key fault features, complete the classification of the equipment failure, and determine the fault category.

[0071] Optionally, the twin inspection platform is also used to: receive the three-dimensional twin model sent by the intelligent inspection terminal and display the three-dimensional twin model; when it is determined that the three-dimensional twin model is updated, receive the fault warning data sent by the intelligent inspection terminal; display the updated three-dimensional twin model, and link the fault warning data to the updated three-dimensional twin model according to the fault area.

[0072] Optionally, when displaying the three-dimensional twin model, the twin inspection platform can not only mark the location and fault category of the equipment fault, but also link the inspection data of the fault warning point such as images and voiceprints in the fault area. The images include but are not limited to visible light images, infrared images, etc. These inspection data are collected by the intelligent inspection terminal during the inspection of the booster station. By linking these inspection data, after the technician observes the equipment fault in the booster station through the three-dimensional twin model displayed by the twin inspection platform, he can click on the fault area to access and display the image data corresponding to the equipment fault. By visually viewing these image data, the technician can make a more accurate judgment on the equipment fault and take corresponding measures.

[0073] It should be noted that the intelligent inspection terminal completes the inspection process by real-time status monitoring of the booster station. The terminal equipment corresponding to the intelligent inspection terminal includes visible light cameras, visible light and infrared pan-tilt cameras, voiceprint sensors, infrared beams, intelligent access control, power environment monitoring systems, etc. The power environment system includes temperature sensors, humidity sensors, smoke sensors, water immersion sensors, etc.

[0074] It should be noted that the information displayed by the twin inspection platform includes: virtual three-dimensional model of the equipment (i.e. the above-mentioned three-dimensional twin model), fault warning point location display (i.e. the above-mentioned fault area), fault warning point image and recognition results, fault warning point voiceprint and recognition results, fault warning point temperature and recognition results, etc. (i.e. inspection data).

[0075] In an optional embodiment, the present application embodiment proposes a booster station inspection system based on digital twin, including an intelligent inspection terminal, a system server, a twin and algorithm server, a storage server and a twin inspection platform, and the system structure is as follows: Figure 3 shown.

[0076] The intelligent inspection terminal is used to monitor the operation of power equipment in the substation, perimeter safety, and entry of personnel and vehicles.

[0077] The system server is used to deploy the twin system platform, which includes platform algorithms and databases, and is used to store twin data and inspection data and generate inspection reports.

[0078] The twin and algorithm server deploys twin models and inspection recognition algorithm models for power generation data mapping and image and voiceprint recognition of intelligent terminals at stations.

[0079] The twin inspection platform is used to display the effect as a visual three-dimensional panoramic model.

[0080] The intelligent inspection terminal monitors the status of the booster station in real time. The terminal equipment includes visible light cameras, visible light and infrared PTZ cameras, voiceprint sensors, infrared beams, intelligent access control, power environment monitoring systems, etc. The power environment system includes temperature sensors, humidity sensors, smoke sensors, water immersion sensors, etc. The inspection scope of the booster station by the intelligent inspection terminal includes outdoor primary equipment (such as GIS, lightning arresters, main transformers, SVG and other equipment), secondary equipment rooms (such as relay protection rooms, main transformer rooms, SVG control warehouses, etc.), fire rooms, hazardous waste rooms, tool rooms, and station buildings (such as perimeter walls, indoor and outdoor doors, etc.). Intelligent terminal equipment is installed in the above areas, and visible light cameras, dual-light pan-tilt cameras and voiceprint sensors are installed around the outdoor primary equipment to monitor the key equipment and key equipment status such as meter count values, knife switch status, main transformer operating sound, insulation support temperature, main transformer bushing temperature in the primary equipment; dual-light pan-tilt cameras, voiceprint sensors and power environment monitoring systems are installed in the secondary equipment room to monitor indoor environment (temperature, humidity, smoke, etc.), electric cabinet meter count values, pressure plate insertion and withdrawal status, indicator light color, cabinet temperature, equipment sound and other parameters; visible light cameras are installed in the fire room and tool room to monitor room and tool room environment, fire system water pressure and other parameters; dual-light pan-tilt is installed in the hazardous waste room to monitor the equipment environment; infrared and visible light cameras are installed on the walls of the buildings in the station to monitor perimeter safety and foreign object intrusion; intelligent access control is installed on the main gates and interior doors of the buildings in the station for the entry of personnel and vehicles.

[0081] The twin inspection platform includes the following information: virtual three-dimensional model of equipment, fault warning point location display, fault warning point image and recognition results, fault warning point voiceprint and recognition results, fault warning point temperature and recognition results, etc.

[0082] In an optional embodiment, the construction process of the booster station inspection system based on digital twin is as follows: Figure 4 As shown, the following steps are included:

[0083] 1. Collect 3D point cloud data of the booster station, including but not limited to indoor and outdoor electrical equipment, station buildings, auxiliary equipment, surrounding environment and other information of the booster station;

[0084] 2. Collect point cloud data for decoding, cleaning and conversion, load target nodes and refine the point cloud model;

[0085] 3. Map the twin model with the actual equipment and operation data of the booster station, including but not limited to the mapping of electrical, magnetic, thermal, optical, acoustic and other physical quantities;

[0086] 4. The images, voiceprints, temperature, electromagnetic and other data collected by the intelligent inspection terminal are secondary mapped with the twin model and station data;

[0087] 5. Form a visual data twin three-dimensional panoramic model (i.e. the three-dimensional twin model mentioned above) that can display multiple aspects such as station production and operation data, inspection images, and inspection data.

[0088] In another optional embodiment, the following combination Figure 5 The workflow of the booster station inspection system based on digital twin is introduced, which includes the following steps:

[0089] 1. When production equipment, production environment, perimeter environment, or personnel / vehicles enter or exit abnormally, relevant data will change;

[0090] 2. New data enters the twin and algorithm recognition model for recognition;

[0091] 3. The twin model quickly locates the fault warning point and links the inspection data of the fault warning point such as images and voiceprints;

[0092] 4. The system platform (i.e. the above-mentioned twin inspection platform) provides a visual three-dimensional panoramic display of the substation.

[0093] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of each embodiment of the present application.

[0094] Optionally, in this embodiment, a smart inspection method for a target area based on digital twin technology is also provided, which is applied to the above-mentioned system embodiments and preferred implementation modes, and will not be repeated hereafter. As used below, the term "module" may implement a combination of software and / or hardware for a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0095] Figure 6 It is a flow chart of an intelligent inspection method of a target area based on digital twin technology according to an embodiment of the present application. The method is applied to the intelligent inspection system of the target area based on digital twin technology, and includes the following steps:

[0096] Step S602: collecting three-dimensional point cloud data of the target area, and constructing a three-dimensional point cloud model of the target area according to the three-dimensional point cloud data;

[0097] Step S604: monitor the environmental condition data of the target area and the device status data of the multiple devices in real time, and associate the multiple device status data and the environmental condition data with the three-dimensional point cloud model to generate the three-dimensional twin model;

[0098] Step S606: When it is determined that an equipment failure occurs in the target area, the three-dimensional twin model is displayed, and the fault area and fault category corresponding to the equipment failure are displayed in the three-dimensional twin model.

[0099] Through the above scheme, the three-dimensional point cloud data of the target area is first collected, and a three-dimensional point cloud model of the target area is constructed based on the three-dimensional point cloud data; the environmental condition data of the target area and the equipment status data of multiple devices in the target area are monitored in real time, and these equipment status data and environmental condition data are associated with the three-dimensional point cloud model to generate a three-dimensional twin model; when it is determined that an equipment failure occurs in the target area, the three-dimensional twin model is displayed, and the fault area and fault category corresponding to the equipment failure are displayed in the three-dimensional twin model; using the above scheme, through the integration of digital twins and intelligent inspections, a three-dimensional panoramic twin model (i.e., the above-mentioned three-dimensional twin model) that is updated in real time with the equipment status is constructed, and the three-dimensional panoramic twin model can be used to quickly locate the fault and intuitively display the fault; thereby solving the problem in the related technology that the two-dimensional logical view of the power system operation cannot intuitively reflect the spatial layout and equipment information, and is not convenient for rapid locking of the fault point and intuitive display of the status.

[0100] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.

[0101] Optionally, in this embodiment, the storage medium may be configured to store a computer program for performing the following steps:

[0102] S1, collecting three-dimensional point cloud data of the target area, and constructing a three-dimensional point cloud model of the target area according to the three-dimensional point cloud data;

[0103] S2, monitoring the environmental condition data of the target area and the device status data of the multiple devices in real time, and associating the multiple device status data and the environmental condition data with the three-dimensional point cloud model to generate the three-dimensional twin model;

[0104] S3, when it is determined that an equipment failure occurs in the target area, the three-dimensional twin model is displayed, and the fault area and fault category corresponding to the equipment failure are displayed in the three-dimensional twin model.

[0105] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.

[0106] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail herein.

[0107] An embodiment of the present application further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0108] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:

[0109] S1, collecting three-dimensional point cloud data of the target area, and constructing a three-dimensional point cloud model of the target area according to the three-dimensional point cloud data;

[0110] S2, monitoring the environmental condition data of the target area and the device status data of the multiple devices in real time, and associating the multiple device status data and the environmental condition data with the three-dimensional point cloud model to generate the three-dimensional twin model;

[0111] S3, when it is determined that an equipment failure occurs in the target area, the three-dimensional twin model is displayed, and the fault area and fault category corresponding to the equipment failure are displayed in the three-dimensional twin model.

[0112] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0113] An embodiment of the present application further provides a computer program product, comprising a non-volatile computer-readable storage medium, wherein the non-volatile computer-readable storage medium stores a computer program product, and when the computer program is executed by a processor, the steps of the method described in each embodiment of the present application are implemented.

[0114] Optionally, in this embodiment, the above computer program may be configured to implement the following steps when executed by a processor:

[0115] S1, collecting three-dimensional point cloud data of the target area, and constructing a three-dimensional point cloud model of the target area according to the three-dimensional point cloud data;

[0116] S2, monitoring the environmental condition data of the target area and the device status data of the multiple devices in real time, and associating the multiple device status data and the environmental condition data with the three-dimensional point cloud model to generate the three-dimensional twin model;

[0117] S3, when it is determined that an equipment failure occurs in the target area, the three-dimensional twin model is displayed, and the fault area and fault category corresponding to the equipment failure are displayed in the three-dimensional twin model.

[0118] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail herein.

[0119] Obviously, those skilled in the art should understand that the above modules or steps of the present application can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order from that herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present application is not limited to any specific combination of hardware and software.

[0120] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. An intelligent inspection system for target areas based on digital twin technology, characterized in that: include: A data acquisition module, used to acquire three-dimensional point cloud data of a target area and construct a three-dimensional point cloud model of the target area according to the three-dimensional point cloud data; An intelligent inspection terminal, connected to the data acquisition module, for real-time monitoring of the environmental condition data of the target area and the device status data of multiple devices in the target area, and associating the multiple device status data and the environmental condition data with the three-dimensional point cloud model to generate a three-dimensional twin model; The twin inspection platform is connected to the intelligent inspection terminal, and is used to display the three-dimensional twin model when it is determined that an equipment failure occurs in the target area, and to display the fault area and fault category corresponding to the equipment failure in the three-dimensional twin model.

2. The system according to claim 1, characterized in that The data acquisition module includes: a data preprocessing submodule, and the data preprocessing submodule is used to: Decoding the three-dimensional point cloud data to obtain decoded three-dimensional point cloud data; Performing data cleaning on the decoded three-dimensional point cloud data to remove noise in the decoded three-dimensional point cloud data to obtain cleaned three-dimensional point cloud data; The cleaned three-dimensional point cloud data is standardized to unify the data format of the cleaned three-dimensional point cloud data to obtain standardized three-dimensional point cloud data, wherein the standardized three-dimensional point cloud data is used to construct the three-dimensional point cloud model.

3. The system according to claim 1, characterized in that The intelligent inspection terminal is also used for: Creating virtual identifiers for the plurality of devices in the three-dimensional point cloud model; The multiple device status data and the environmental condition data are transmitted to the twin and algorithm server to instruct the twin and algorithm server to perform data conversion on the multiple device status data and the environmental condition data, and update the data conversion result to the three-dimensional point cloud model according to the virtual identifier to generate the three-dimensional twin model, wherein the data format of the data conversion result matches the three-dimensional point cloud model.

4. The system according to claim 3, characterized in that The intelligent inspection terminal is also used for: Processing the plurality of device status data and the environmental condition data through a fault detection model to perform device fault detection on the plurality of devices; When a device failure is detected, fault warning data corresponding to the faulty device is obtained, and the fault warning data is sent to the twin and algorithm server for processing to determine the fault category of the device failure; The fault area of ​​the faulty device in the three-dimensional twin model is determined according to the target virtual identifier corresponding to the faulty device, and the three-dimensional twin model is updated according to the fault type and the fault area.

5. The system according to claim 4, characterized in that The twin and algorithm server is used to: when receiving the fault warning data, process the fault warning data through an image recognition algorithm and / or a voiceprint recognition algorithm to extract key fault features of the equipment fault; The key fault features are processed by a fault classification algorithm to determine the fault category of the equipment fault.

6. The system according to claim 4, characterized in that The twin inspection platform is also used for: Receive the three-dimensional twin model sent by the intelligent inspection terminal and display the three-dimensional twin model; when determining that the three-dimensional twin model is updated, receive the fault warning data sent by the intelligent inspection terminal; The updated three-dimensional twin model is displayed, and the fault warning data is linked to the updated three-dimensional twin model according to the fault area.

7. An intelligent inspection method for a target area based on digital twin technology, characterized in that: An intelligent inspection system for a target area based on digital twin technology applied to any one of claims 1 to 6, comprising: Collecting three-dimensional point cloud data of the target area, and constructing a three-dimensional point cloud model of the target area according to the three-dimensional point cloud data; monitoring the environmental condition data of the target area and the device status data of the multiple devices in real time, and associating the multiple device status data and the environmental condition data with the three-dimensional point cloud model to generate the three-dimensional twin model; When it is determined that an equipment failure occurs in the target area, the three-dimensional twin model is displayed, and the fault area and fault category corresponding to the equipment failure are displayed in the three-dimensional twin model.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein the program executes the method of claim 7 when executed.

9. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to execute the method of claim 7 through the computer program.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to claim 7 are implemented.

Images