Power station intelligent inspection method and system based on AR (Augmented Reality) technology, and electronic equipment

Abstract

The invention relates to the technical field of augmented reality, and discloses a power station intelligent inspection method and system based on the AR technology, and electronic equipment, and the method comprises the steps: constructing a virtual power station model: constructing the virtual power station model based on the physical layout and equipment configuration of a power station; arranging AR inspection machines: arranging a plurality of AR inspection machines on the site of the power station; setting an interactive inspection route: arranging an inspection route and inspection points on the site of the power station; polling dynamic data synchronization: based on the Internet of Things technology, synchronizing physical environment data and equipment parameter data of a power station site to the virtual power station model; and intelligent inspection evaluation operation: remotely controlling an AR inspection machine by inspection personnel to inspect each inspection point, and performing state evaluation on object equipment in each inspection point through physical data displayed in the virtual power station model. The system and the electronic equipment correspond to the method. According to the invention, the inspection efficiency of the power station can be improved, the manpower inspection cost is reduced, and the reliability and safety are high.

Description

Technical Field

[0001] The present application relates to the field of augmented reality technology, and specifically to an AR technology-based intelligent inspection method and system for power stations and a 3D point cloud acquisition system for electronic equipment. Background Art

[0002] A power station can be simply understood as a power station or a power grid management / relay station. Common power stations include hydropower stations, thermal power stations, or some substations. For power stations, they play an indispensable role in daily life, social production and other aspects. It can even be said that at a time when electricity demand is growing, the stable operation of power stations is a basic social survival and development foundation. Therefore, in the daily operation of power stations, they need to be inspected to ensure the stable operation of various equipment in the power station, improve power supply stability and avoid safety accidents. The inspection of some power stations currently needs to be implemented based on human inspections, which is a great test of the professionalism of the inspectors. Therefore, it takes a lot of time, energy and cost to train the inspectors, and there are also hidden dangers to personnel safety through personnel inspections. Therefore, there is an urgent need for a technology that can reliably replace personnel inspections to implement power station inspections. Summary of the invention

[0003] The purpose of this application is to provide a power station intelligent inspection method, system and 3D point cloud acquisition system for electronic equipment based on AR technology to solve the technical problems raised in the above background.

[0004] To achieve the above objectives, this application discloses the following technical solutions:

[0005] In a first aspect, the present application discloses a power station intelligent inspection method based on AR technology, the method comprising the following steps:

[0006] Build a virtual power plant model: Build a virtual power plant model based on the physical layout and equipment configuration of the power plant;

[0007] Arrange AR inspection machines: Arrange several AR inspection machines at the power station site;

[0008] Setting interactive inspection routes: Arranging inspection routes and inspection points for the AR inspection machine to inspect at the power station site;

[0009] Inspection dynamic data synchronization: Based on the Internet of Things technology, the physical environment data and equipment parameter data of the power station site are synchronized to the virtual power station model;

[0010] Intelligent inspection and evaluation operation: The inspection personnel remotely control the AR inspection machine to inspect each inspection point, and evaluate the status of the object equipment in each inspection point through the physical data displayed in the virtual power plant model.

[0011] Preferably, the AR inspection machine is an inspection robot, and the AR inspection robot is provided with at least one high-definition camera and a variety of detection sensors.

[0012] Preferably, the inspection dynamic data synchronization also includes: valid data verification of physical environment data and equipment parameter data collected at the power plant site, and the synchronization to the virtual power plant model is to synchronize the valid data after the verification to the virtual power plant model.

[0013] Preferably, the valid data verification specifically includes:

[0014] Acquire physical environment data and equipment parameter data collected by the AR inspection machine and / or sensors arranged at the inspection points, and define them as collected data;

[0015] Clean and normalize the collected data;

[0016] Performing consistency check on the collected data;

[0017] Performing repeatability check on the collected data;

[0018] Performing integrity check on the collected data;

[0019] The collected data after consistency check, repeatability check and integrity check is defined as valid data.

[0020] Preferably, the intelligent inspection and evaluation operation further includes:

[0021] Performing real-time analysis on the data displayed by the virtual power plant model through a machine learning algorithm to identify current problems existing in the target equipment;

[0022] Comparison is performed based on the data displayed by the virtual power plant model and the corresponding historical data to identify potential problems existing in the target equipment.

[0023] Preferably, the status assessment of the object equipment through the physical data displayed at each checkpoint includes: inspection personnel perform status assessment on the corresponding object equipment based on the data displayed by the virtual power station model; wherein the result of the status assessment includes normal equipment, abnormal equipment morphology, equipment aging, equipment operation failure or abnormal equipment operation.

[0024] Preferably, the performing status assessment on the object equipment through the physical data displayed at each checkpoint further comprises:

[0025] The inspection personnel construct virtual test data of the target equipment based on the equipment data of the target equipment;

[0026] Through a machine learning algorithm, based on the current physical data of the object device, a simulated state prediction is performed on the object device under the virtual test data, and based on the result of the simulated state prediction, an in-depth evaluation is performed on the object device. The result of the in-depth evaluation includes whether the device is normal, the device is aging, or the device has a potential failure.

[0027] Preferably, the virtual test data includes one or more of temperature conditions, humidity conditions, water immersion conditions, wind conditions, dry conditions, overvoltage conditions, electrical test input data or electrical test output data.

[0028] In a second aspect, the present application discloses an AR-based intelligent inspection system for power plants, which is applicable to the AR-based intelligent inspection method for power plants as described above. The system includes:

[0029] The object acquisition module is configured to: collect data on the physical layout and equipment configuration of the power station;

[0030] A model building module is configured to: build a virtual power plant model based on the data collected by the object collection module;

[0031] The AR inspection machine is configured to: inspect the power station site based on the preset inspection paths and inspection points under the remote control of the inspection personnel, and collect the equipment parameter data and physical environment data corresponding to the inspected inspection points based on the Internet of Things technology, and upload the acquired equipment parameter data and physical environment data;

[0032] The inspection processing module is configured to: receive the equipment parameter data and physical environment data uploaded by the AR inspection machine, and synchronize the equipment parameter data and physical environment data of the power station site to the constructed virtual power station model;

[0033] The remote inspection module is configured to: allow inspection personnel to remotely control the AR inspection machine and display the constructed virtual power plant model, and dynamically display the synchronized constructed virtual power plant model based on the synchronization results, so that the inspection personnel can evaluate the status of the object equipment through the physical data displayed at each checkpoint in the constructed virtual power plant model.

[0034] In a third aspect, the present application discloses an electronic device, comprising at least one processor and a memory communicatively connected to the processor, wherein the memory stores a computer program that can be executed by the processor, and when the computer program is executed by the processor, the intelligent inspection method of a power station based on AR technology as described above is implemented.

[0035] Beneficial effects: The AR-based intelligent inspection method, system and electronic equipment for power plants of the present application are based on AR technology, combined with the construction of a virtual power plant model and the dynamic synchronization of data, so that inspection personnel can remotely understand the real-time data of the power plant site, and evaluate the inspected equipment according to the data displayed in the virtual power plant model after dynamic synchronization, which can improve inspection efficiency, reduce manpower inspection costs, and have high reliability and safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0037] Figure 1 A flowchart of a power station intelligent inspection method based on AR technology provided in an embodiment of the present application;

[0038] Figure 2 A structural block diagram of a power station intelligent inspection system based on AR technology provided in an embodiment of the present application;

[0039] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0040] The technical solutions in the embodiments of the present application are described clearly and completely below. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.

[0041] In this article, the term "comprising" is intended to cover non-exclusive inclusion, so that a process, method, article or device that includes a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of more restrictions, the elements defined by the sentence "comprising..." do not exclude the presence of other identical elements in the process, method, article or device that includes the elements.

[0042] In a first aspect, this embodiment provides a Figure 1 The power station intelligent inspection method based on AR technology shown in the figure includes the following steps:

[0043] Build a virtual power plant model: Build a virtual power plant model based on the physical layout and equipment configuration of the power plant;

[0044] Arrange AR inspection machines: Arrange several AR inspection machines at the power station site;

[0045] Setting interactive inspection routes: Arranging inspection routes and inspection points for the AR inspection machine to inspect at the power station site;

[0046] Inspection dynamic data synchronization: Based on the Internet of Things technology, the physical environment data and equipment parameter data of the power station site are synchronized to the virtual power station model;

[0047] Intelligent inspection and evaluation operation: The inspection personnel remotely control the AR inspection machine to inspect each inspection point, and evaluate the status of the object equipment in each inspection point through the physical data displayed in the virtual power plant model.

[0048] It is feasible that the AR inspection machine is an inspection robot, which is provided with at least one high-definition camera and multiple detection sensors. Although it is possible to arrange inherent collection devices (such as cameras, sensors, etc.) at the power station site, considering the complexity of the power station environment, it is necessary to avoid these collection devices from being damaged by wind and sun for a long time. Therefore, the AR collection process is performed by a mobile inspection machine, which can ensure the reliability and accuracy of data collection during the evaluation process.

[0049] In this embodiment, the inspection dynamic data synchronization also includes: valid data verification of the physical environment data and equipment parameter data collected at the power plant site, and the synchronization to the virtual power plant model is to synchronize the valid data after the verification to the virtual power plant model. During the inspection process, reliable data can make the virtual power plant model dynamically updated to be consistent with the actual conditions of the power plant site. Therefore, through the method of valid data verification, the reliability and accuracy of the data collected by the AR inspection machine can be further ensured. Specifically, the valid data verification specifically includes:

[0050] Acquire physical environment data and equipment parameter data collected by the AR inspection machine and / or sensors arranged at the inspection points, and define them as collected data;

[0051] Clean and normalize the collected data;

[0052] Performing consistency check on the collected data;

[0053] Performing repeatability check on the collected data;

[0054] Performing integrity check on the collected data;

[0055] The collected data after consistency check, repeatability check and integrity check is defined as valid data.

[0056] Through the above, the reliability and accuracy of the data collected by the AR inspection machine are ensured.

[0057] In order to improve the effectiveness of inspection and effectively and timely discover problems or hidden dangers in the power station, in this embodiment, the intelligent inspection and evaluation operation also includes:

[0058] Performing real-time analysis on the data displayed by the virtual power plant model through a machine learning algorithm to identify current problems existing in the target equipment;

[0059] Comparison is performed based on the data displayed by the virtual power plant model and the corresponding historical data to identify potential problems existing in the target equipment.

[0060] Through intelligent detection methods, it is possible to assist inspection personnel to accurately analyze the problems existing in the power station. It is feasible that the state evaluation of the object equipment through the physical data displayed at each checkpoint includes: the inspection personnel evaluate the state of the corresponding object equipment based on the data displayed by the virtual power station model; wherein the result of the state evaluation includes normal equipment, abnormal equipment morphology, equipment aging, equipment operation failure or abnormal equipment operation.

[0061] Furthermore, in order to improve the inspection effect, the state evaluation of the object equipment through the physical data displayed at each inspection point also includes:

[0062] The inspection personnel construct virtual test data of the target equipment based on the equipment data of the target equipment;

[0063] Through a machine learning algorithm, based on the current physical data of the object device, a simulated state prediction is performed on the object device under the virtual test data, and based on the result of the simulated state prediction, a deep evaluation is performed on the object device, and the result of the deep evaluation includes whether the device is normal, the device is aging, or the device has a potential failure. The virtual test data includes one or more of temperature conditions, humidity conditions, water immersion conditions, wind conditions, dry conditions, overvoltage conditions, electrical test input data, or electrical test output data.

[0064] In this way, by using virtual test data for virtual testing, the power station can be fully inspected for hidden dangers and the evaluation results can be verified, thereby ensuring that the final inspection results are comprehensive, accurate, and reliable, and that possible problems with the equipment can be discovered to ensure the effectiveness of the inspection.

[0065] In summary, the intelligent power plant inspection method based on AR technology in this embodiment is based on AR technology, combined with the construction of a virtual power plant model and dynamic synchronization of data, so that inspection personnel can remotely understand the real-time data of the power plant site, and evaluate the inspected equipment based on the data displayed in the virtual power plant model after dynamic synchronization, which can improve inspection efficiency, reduce manpower inspection costs, and has high reliability and safety.

[0066] In a second aspect, this embodiment discloses a method such as Figure 2 The power station intelligent inspection system based on AR technology shown in the figure includes:

[0067] The object acquisition module is configured to: collect data on the physical layout and equipment configuration of the power station;

[0068] A model building module is configured to: build a virtual power plant model based on the data collected by the object collection module;

[0069] The AR inspection machine is configured to: inspect the power station site based on the preset inspection paths and inspection points under the remote control of the inspection personnel, and collect the equipment parameter data and physical environment data corresponding to the inspected inspection points based on the Internet of Things technology, and upload the acquired equipment parameter data and physical environment data;

[0070] The inspection processing module is configured to: receive the equipment parameter data and physical environment data uploaded by the AR inspection machine, and synchronize the equipment parameter data and physical environment data of the power station site to the constructed virtual power station model;

[0071] The remote inspection module is configured to: allow inspection personnel to remotely control the AR inspection machine and display the constructed virtual power plant model, and dynamically display the synchronized constructed virtual power plant model based on the synchronization results, so that the inspection personnel can evaluate the status of the object equipment through the physical data displayed at each checkpoint in the constructed virtual power plant model.

[0072] It should be noted that the power station intelligent inspection system based on AR technology of this embodiment corresponds to the aforementioned power station intelligent inspection method based on AR technology. Therefore, the technical content not specifically described in the power station intelligent inspection system based on AR technology of this embodiment (including but not limited to: technical effects, technical means, etc.) can refer to the records in the aforementioned power station intelligent inspection method based on AR technology, and this text will not repeat them here.

[0073] The present embodiment discloses an electronic device in a third aspect, which is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0074] like Figure 3 As shown, the electronic device includes at least one processor, and a memory connected to the processor in communication, and the memory may be, but is not limited to, a read-only memory (ROM), a random access memory (RAM), etc., wherein the memory stores a computer program that can be executed by the processor, and the processor can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) or the computer program loaded from the storage unit to the random access memory (RAM). In the RAM, various programs and data required for the operation of the electronic device can also be stored. The processor, ROM, and RAM are connected to each other via a bus. The input / output (I / O) interface is also connected to the bus. The input unit (such as a keyboard, a mouse, etc.), the output unit (such as various types of displays, speakers, etc.), the storage unit (such as a disk, an optical disk, etc.), and the communication unit (such as a network card, a modem, a wireless communication transceiver, etc.) in the electronic device are all connected to the I / O interface. Wherein, the communication unit allows the electronic device to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0075] The processor can be a variety of general and / or special processing components with processing and computing capabilities. Some examples of processors include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc.

[0076] In some embodiments, the above method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit. In some embodiments, part or all of the computer program may be loaded and / or installed on an electronic device via a ROM and / or a communication unit. When the computer program is loaded into RAM and executed by a processor, one or more steps of the method described above may be performed. Alternatively, in other embodiments, the processor may be configured to perform the above method in any other appropriate manner (e.g., by means of firmware).

[0077] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0078] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0079] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0080] Finally, it should be noted that the above are only preferred embodiments of the present application and are not intended to limit the present application. Although the present application has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments, or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A power station intelligent inspection method based on AR technology, characterized in that: The method comprises the following steps: Build a virtual power plant model: Build a virtual power plant model based on the physical layout and equipment configuration of the power plant; Arrange AR inspection machines: Arrange several AR inspection machines at the power station site; Setting interactive inspection routes: Arranging inspection routes and inspection points for the AR inspection machine to inspect at the power station site; Inspection dynamic data synchronization: Based on the Internet of Things technology, the physical environment data and equipment parameter data of the power station site are synchronized to the virtual power station model; Intelligent inspection and evaluation operation: The inspection personnel remotely control the AR inspection machine to inspect each inspection point, and evaluate the status of the object equipment in each inspection point through the physical data displayed in the virtual power plant model.

2. The power station intelligent inspection method based on AR technology according to claim 1 is characterized in that: The AR inspection machine is an inspection robot, and the AR inspection robot is provided with at least one high-definition camera and a variety of detection sensors.

3. The power station intelligent inspection method based on AR technology according to claim 1 is characterized in that: The inspection dynamic data synchronization also includes: valid data verification of the physical environment data and equipment parameter data collected at the power plant site, and the synchronization to the virtual power plant model is to synchronize the valid data after the verification to the virtual power plant model.

4. The power station intelligent inspection method based on AR technology according to claim 3 is characterized in that: The valid data verification specifically includes: Acquire physical environment data and equipment parameter data collected by the AR inspection machine and / or sensors arranged at the inspection points, and define them as collected data; Clean and normalize the collected data; Performing consistency check on the collected data; Performing repeatability check on the collected data; Performing integrity check on the collected data; The collected data after consistency check, repeatability check and integrity check is defined as valid data.

5. The power station intelligent inspection method based on AR technology according to claim 1 is characterized in that: The intelligent inspection and evaluation operation also includes: Performing real-time analysis on the data displayed by the virtual power plant model through a machine learning algorithm to identify current problems existing in the target equipment; Comparison is performed based on the data displayed by the virtual power plant model and the corresponding historical data to identify potential problems existing in the target equipment.

6. The power station intelligent inspection method based on AR technology according to claim 5 is characterized in that: The status assessment of the object equipment through the physical data displayed at each checkpoint includes: the inspection personnel conduct a status assessment on the corresponding object equipment based on the data displayed by the virtual power station model; wherein the result of the status assessment includes normal equipment, abnormal equipment morphology, equipment aging, equipment operation failure or abnormal equipment operation.

7. The power station intelligent inspection method based on AR technology according to claim 6 is characterized in that: The state assessment of the object equipment through the physical data displayed at each checkpoint also includes: The inspection personnel construct virtual test data of the target equipment based on the equipment data of the target equipment; Through a machine learning algorithm, based on the current physical data of the object device, a simulated state prediction is performed on the object device under the virtual test data, and based on the result of the simulated state prediction, an in-depth evaluation is performed on the object device. The result of the in-depth evaluation includes whether the device is normal, the device is aging, or the device has a potential failure.

8. The power station intelligent inspection method based on AR technology according to claim 7 is characterized in that: The virtual test data includes one or more of temperature conditions, humidity conditions, water immersion conditions, wind conditions, dry conditions, overvoltage conditions, electrical test input data, or electrical test output data.

9. A power station intelligent inspection system based on AR technology, applicable to the power station intelligent inspection method based on AR technology as described in any one of claims 1 to 8, characterized in that: The system includes: The object acquisition module is configured to: collect data on the physical layout and equipment configuration of the power station; A model building module is configured to: build a virtual power plant model based on the data collected by the object collection module; The AR inspection machine is configured to: inspect the power station site based on the preset inspection paths and inspection points under the remote control of the inspection personnel, and collect the equipment parameter data and physical environment data corresponding to the inspected inspection points based on the Internet of Things technology, and upload the acquired equipment parameter data and physical environment data; The inspection processing module is configured to: receive the equipment parameter data and physical environment data uploaded by the AR inspection machine, and synchronize the equipment parameter data and physical environment data of the power station site to the constructed virtual power station model; The remote inspection module is configured to: allow inspection personnel to remotely control the AR inspection machine and display the constructed virtual power plant model, and dynamically display the synchronized constructed virtual power plant model based on the synchronization results, so that the inspection personnel can evaluate the status of the object equipment through the physical data displayed at each checkpoint in the constructed virtual power plant model.

10. An electronic device, characterized in that: The invention comprises at least one processor and a memory connected to the processor in communication, wherein the memory stores a computer program executable by the processor, and when the computer program is executed by the processor, the intelligent inspection method of a power station based on AR technology as described in any one of claims 1 to 8 is implemented.

Images