AR virtual training system for cable fault identification and diagnosis

Abstract

The invention discloses an AR virtual training system for cable fault identification and diagnosis, and relates to the technical field of cable fault training. Comprising VR glasses, a display module, a space positioning module, an AR module, a storage module and a background expert system module. The VR glasses comprise a VR glasses information storage module, a VR glasses display module, a VR glasses image acquisition module and a VR glasses information sending module, and image marks in the storage module and position information acquired by the VR glasses are transmitted to a data receiving module of the space positioning module through the VR glasses information sending module; the AR augmented reality module comprises a VR glasses information receiving module, an AR glasses positioning module, an AR glasses image acquisition module, an AR glasses positioning information sending module, an AR glasses image acquisition module, an AR glasses image acquisition module information sending module, an AR glasses image information receiving module, an AR glasses image processing module and an AR glasses display module.

Description

Technical Field

[0001] The present invention relates to the technical field of cable fault training, and particularly to an AR virtual training system for cable fault identification and diagnosis. Background Art

[0002] Cables are mostly buried underground. Once a fault occurs, it is very difficult to find. The fault conditions and burial environments are relatively complex and changeable. Testers should be familiar with the burial direction and environment of the cables, accurately judge the nature of the fault, select appropriate instruments and measurement methods, and work according to a certain procedure to successfully detect the cable fault point.

[0003] Currently, both domestic and foreign have been committed to the intellectualization of cable fault testing. However, due to uncertain factors such as the changeable on-site environment, complex fault nature, and limitations of existing testing principles, the level of intelligent fault testing has stagnated. On-site testing still relies on the experience and technical level of testers. In terms of training, due to the restrictions of venue and teaching staff, current training is still in the stage of simple mechanical theory, videos, pictures, etc. Training tools that can be quickly and timely unaffected by factors such as venue and teaching staff are still in a blank stage.

[0004] Patent CN205598189U discloses a virtual reality fire simulation training system based on wireless local area network technology, which combines simulation training with augmented reality and provides a virtual reality fire simulation training system based on wireless local area network technology including a helmet display, individual soldier tactical operation equipment, information transmission module, information reception module, and host computer. Although it realizes partial virtual reality fire simulation training, it cannot realize the training of physical cables. When an actual cable encounters a fault problem, it cannot provide the accurate fault point location, and users cannot conduct physical training.

[0005] Patent CN110189945A discloses a method and system for transformer fault repair based on augmented reality, which locates the fault point according to virtual information and fault images, and displays the information after the fusion of virtual information and fault images on the actual transformer through augmented reality. Although it solves the problem of transformer fault detection, it cannot solve the accurate fault repair when a cable encounters a fault. As one of the main ways of power transmission, cables are often repaired, and the accuracy of repair is very important. Therefore, there is an urgent need for an augmented reality system that can solve cable fault detection and cable fault repair.

[0006] Therefore, to solve these problems, AR augmented reality technology is introduced into cable fault location training and on-site operations. Summary of the Invention

[0007] In view of the deficiencies of the prior art, the purpose of the present invention is to provide an AR virtual training system and training method for cable fault identification and diagnosis. By utilizing AR enhancement technology, 5G technology, and holographic projection technology, a cable fault training system is formed to improve the training efficiency and quality of the cable fault training system, thereby enhancing the efficiency and quality in actual operations.

[0008] To achieve the above object, the present invention provides the following technical solutions:

[0009] An AR virtual training system for cable fault identification and diagnosis includes VR glasses, a display module, a spatial positioning module, an AR augmented reality module, a storage module, and a background expert system module; the VR glasses include a storage module, a display module, a VR glasses image acquisition module, and a VR glasses information sending module. The image markers and position information collected by the VR glasses in the storage module are transmitted to the data receiving module of the spatial positioning module through the VR glasses information sending module. The AR augmented reality module includes a VR glasses information receiving module, an AR glasses positioning module, an AR glasses image acquisition module, an AR glasses positioning information sending module, an AR glasses image acquisition module, an AR glasses image acquisition module information sending module, an AR glasses image information receiving module, an AR glasses image processing module, and an AR glasses display module; among them, the VR glasses information receiving module transmits the image markers and position information from the data sending module to the AR glasses positioning module for spatial positioning. The AR glasses image acquisition module acquires images during actual operations and transmits the actual image information to the AR glasses image information receiving module through the AR glasses image acquisition module information sending module. Then, it is compared with the image markers in the storage module through the AR glasses image processing module, and the marked image and positioning information after comparison are transmitted to the AR glasses display module for display, thereby realizing real-time guidance for actual operation training.

[0010] By adopting the above technical solutions, using AR (Augmented Reality) technology, virtual images can be combined with actual images, enabling the combination of actual cable images and virtual cable images, thereby conducting cable fault training. At the same time, VR (Virtual Reality) technology is used for cable fault training. In the virtual reality function of the VR glasses, users can experience scenes that do not exist in reality, and can combine actual cable images with VR glasses virtual images, thus achieving the combination of virtual and reality.

[0011] Further, the display devices of both the VR glasses and the AR glasses are holographic projection devices. The VR glasses use a microdisplay as the display element of the AR glasses, and the display element of the AR glasses uses a holographic projection element; the VR glasses use the holographic projection element to present spatial stereoscopic image information, and the AR glasses use the holographic projection element to combine the processed image markers with the cable image to achieve virtual-real combined display.

[0012] Further, the spatial positioning module includes a data receiving module of the spatial positioning module, an information processing module of the spatial positioning module, and an information sending module of the spatial positioning module.

[0013] By adopting the above technical solution, the data receiving module in the spatial positioning module is used to receive information, and the information processing module is used for information processing to achieve information integration.

[0014] Further, the storage module includes a cable image storage module and an image marker storage module.

[0015] By adopting the above technical solution, the cable image storage module is used to store the actual cable images, and the image marker storage module is used to store image identifications such as the fault points of the cable.

[0016] Further, the background expert system module includes an expert system image receiving module, an expert system positioning information receiving module, an expert system image processing module, an expert system image storage module, an expert system database module, an expert system positioning information storage module, and an expert information sending module.

[0017] By adopting the above technical solution, the expert system image receiving module is used to receive the image information transmitted by the AR glasses, the expert system positioning information receiving module is used to receive the positioning information transmitted by the spatial positioning module, the expert system image processing module is used to compare and process the fault points and other images, the expert system database module mainly compares the received image information with the information in the expert system to determine the fault points, the expert system positioning information storage module is used to locate the fault points and transmit the fault points to the AR glasses through the spatial positioning module for positioning, and the expert information sending module is used to send the located fault points to the AR glasses.

[0018] A cable fault training method based on 5G+AR augmented reality technology includes the following steps:

[0019] S1: Organize the cable fault types to form a fault database, and store the fault database in the spatial positioning module.

[0020] S2: Image-label the fault points in the sorted fault database through manual or AI recognition to form a cable image database, which is stored in the information storage modules of VR glasses and AR glasses respectively.

[0021] S3: The VR glasses achieve real-time positioning according to the wearing position information, and the AR glasses achieve real-time positioning according to the cable detection information of the wearer. The virtual information is sent to the spatial positioning module through the VR glasses sending module and the data information receiving module. The spatial positioning module processes the position information and transmits the data to the AR glasses through the spatial positioning information sending module. The AR glasses fuse the virtual information with the actually collected cable images and display them in real time, realizing the combination of virtual information and actual operation.

[0022] S4: The AR glasses collect pictures of the actual operation and send the collected pictures to the background expert system information receiving module through the information sending module. The expert system compares the received information in the expert system.

[0023] S5: The background expert module sends the information of the expert system after comparison to the AR glasses through the expert information sending module. The AR glasses display module receives the expert system information, and the AR glasses display module displays the faults related to the virtual images.

[0024] S6: The operator accurately locates the fault point according to the fault information, the marking information and the positioning information of the AR glasses and solves it, so as to realize the fault repair of the cable. After the fault repair, the operator reports the image and the repair result through the display module on the AR glasses.

[0025] Furthermore, the virtual space coordinates of the cable images are stored in the VR glasses information storage module. When the wearer moves in the actual space, the VR glasses information sending module sends the coordinate information of the virtual space, and the information is transmitted through the data information receiving module and the information processing module. The AR glasses send the position information to the AR glasses positioning module, and the AR glasses combine and display the virtual image markings with the actual cable image information.

[0026] The AR glasses collect pictures of actual operations. When a fault point is detected by the cable or the cable cannot be detected, the AR glasses perform image collection. The cable images collected are transmitted to the AR glasses image information receiving module through the AR glasses image collection module information sending module. The AR glasses image information receiving module transmits the received information to the AR glasses image processing module. After being processed by the AR glasses image processing module, it is displayed on the AR glasses display module. The image processing module transmits the information to the background expert system image receiving module. The expert system compares the images. The positioning information receiving module of the expert system receives the positioning information in the virtual space. The expert system positioning information storage module stores and analyzes the positioning information, and sends it to the AR glasses through the expert system positioning information sending module. The AR glasses display module displays the expert system positioning information, thereby transmitting the cable maintenance information. The AR glasses display module displays the faults related to the virtual images.

[0027] By adopting the above technical solution, the VR glasses and the AR glasses are combined. The cable information identified as faulty is transmitted to the background expert system through the AR glasses. The expert system locates and compares the cable images in the received virtual images and the actual cable operation information, and sends them to the AR glasses through the expert system positioning information sending module. The AR glasses display the faults of the virtual images, thereby conducting training on the fault points.

[0028] Compared with the prior art, the beneficial effects of the present invention are:

[0029] 1. The cable faults form a fault database through the background expert system. The fault points and solutions in the fault database are collected, and the processed images are respectively stored in the AR glasses and the VR glasses. The AR glasses are composed of an AR glasses positioning module, an AR glasses image collection module, an AR glasses positioning information sending module, an AR glasses image collection module, an AR glasses image collection module information sending module, an AR glasses image information receiving module, an AR glasses image processing module, and an AR glasses display module. The VR glasses information sending module sends virtual information to the space positioning module. The space positioning module processes the position information and sends it to the positioning module of the AR glasses. The AR glasses positioning module combines and displays the virtual image markers with the actual cable image information. Thus, the function of combining virtual images with actual images is achieved.

[0030] 2. By combining the space positioning module, the information collection module, and the background expert system module, the purpose of training on fault points combining virtual and actual is achieved, making the cable fault training closer to reality, achieving a better training effect, and thus improving the efficiency and quality in actual operations. Brief Description of the Drawings

[0031] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0032] Figure 1 It is a structural block diagram of an orderly charging control system for an electric vehicle according to the present invention. Detailed implementation manners

[0033] The following will clearly and completely describe the technical solutions of the present invention in conjunction with the embodiments of the present invention. Obviously, the described embodiments are some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present invention.

[0034] Embodiment 1

[0035] As Figure 1 shown, an AR virtual training system for cable fault identification and diagnosis mainly includes a storage module, a VR glasses module, an AR glasses module, a spatial positioning module, and a background expert system module. The VR glasses module includes a VR glasses information storage module, a VR glasses display module, a VR glasses image acquisition module, and a VR glasses information sending module. The AR glasses module includes an AR glasses information receiving module, an AR glasses positioning module, an AR glasses image acquisition module, an AR glasses image information receiving module, an AR glasses image processing module, and an AR glasses display module.

[0036] VR glasses: The VR glasses storage module stores the markings of cable images and the storage coordinates in the corresponding virtual space of the image markings. Through the VR glasses video module and the positioning module, the coordinate information of the position is transmitted to the spatial positioning module through the VR glasses sending module. The processing module of the spatial positioning module processes the information and transmits the information to the AR glasses positioning module for positioning through the information sending module of the spatial positioning module. The AR glasses collect the actual on-site images through the AR glasses image acquisition module, transmit the information to the AR glasses positioning information receiving module through the AR glasses positioning information sending module, perform positioning and acquisition on the collected images through the processing module of the AR glasses, and the processing module transmits the positioning and acquisition information to the AR glasses display module, and the AR glasses display the markings.

[0037] AR glasses: The AR glasses receive information from the spatial positioning module through the AR glasses information receiving module and transmit it to the positioning module of the AR glasses. The spatial positioning module locates the spatial coordinates. Then, the AR glasses collect actual images through the AR glasses collection module, and transmit the sampled images to the AR glasses image information receiving module through the information collection module information sending module. The AR glasses image information receiving module transmits the collected information to the processing module of the AR glasses. The AR glasses processing module fuses the collected images and virtual spatial coordinates. The AR glasses processing module transmits the processed information to the AR glasses display module for display.

[0038] Spatial positioning module: The spatial positioning module locates the position from the VR glasses positioning module and the spatial coordinates in the spatial system, and transmits the positioning information to the AR glasses positioning module.

[0039] Backend expert system module: The backend expert module receives the image information from the AR glasses. The backend expert system module processes and compares the images, and transmits the positioning information to the AR glasses positioning module through the positioning information sending of the expert system module. The AR glasses display module displays the spatial positioning information.

[0040] Working steps of an AR virtual training system for cable fault identification and diagnosis:

[0041] (1) The AR glasses information storage module pre-stores images related to cable inspection and maintenance. The AR glasses send information to the backend expert system. The expert system compares the image information and gives a correct feedback. The information is sent to the data receiving module of the spatial positioning module through the VR glasses image sending module. The data receiving module transmits the received information to the data processing module. After the data processing module integrates and processes the information, it transmits the information to the positioning module of the AR glasses through the sending module. The AR glasses positioning module locates the received information, locates and fuses the virtual image markers with the images collected by the AR glasses. The AR glasses display module displays the information. The training personnel use the positioning module of the AR glasses to achieve positioning and transmit the cable image information to the positioning module of the AR glasses. The positioning module fuses the information with the virtual images, thus realizing the fusion of the actual cable images and virtual images.

[0042] (2) The AR glasses send the actual cable image acquisition information to the information sending module of the AR glasses image acquisition module. The information sending module of the AR glasses image acquisition module sends the acquired information to the AR glasses image information receiving module. The AR glasses image information receiving module transmits the acquired information to the AR glasses image processing module for processing. After the AR glasses image processing module processes the image, it displays the fault through the AR glasses display module. The positioning module of the AR glasses locates the training personnel, and the training personnel perform cable fault detection based on the positioning information.

[0043] (3) The information acquisition module of the AR glasses sends the information to the background expert system. The image information receiving module of the background expert system receives the image. The image information receiving module transmits the received information to the expert system database module through the information processing module and the information transmission module. The expert system locates and eliminates the fault, and sends the located and eliminated information through the information sending module. The AR glasses information receiving module receives the information and displays it through the display module of the AR glasses. The training personnel perform maintenance according to the displayed fault. The information acquisition module of the AR glasses sends the fault maintenance information to the background expert system. The expert system information receiving module receives the fault maintenance information, compares the information through the expert system information processing module, and sends the information through the expert system information sending module. The AR glasses information receiving module receives the information and displays the result through the display module of the AR glasses.

[0044] (4) The VR glasses information sending module sends virtual information to the data receiving module of the spatial positioning module. The data receiving module sends the position information to the data processing module for processing, and sends it to the positioning module of the AR glasses through the sending module for positioning. The information acquisition module of the AR glasses collects the marks of the cable images in the virtual space, compares and locates them with the actual images of the cables, and the display module of the AR glasses displays them.

[0045] According to the above cable construction and maintenance training system and method, this patent can develop a training software. In a specific implementation case, its functions are as follows:

[0046] (1) In actual construction and maintenance, there are various types of fault repairs for power cables. For example, the cable tray is deformed, there are sundries attached to the inner wall of the cable tray, there are sundries at the bottom of the cable tray, the cable is stepped on and damaged, the cable is pulled, the metal cable tray is damaged, the cable is stepped on and damaged, the ground is dug up, etc. When the operator wears the AR glasses properly during construction or maintenance, image information is collected through the acquisition module. The AR glasses collect the on-site images and fuse them with the VR real-time virtual scene through the processing module of the AR glasses, so as to display the fault conditions of the cables in the real-time virtual scene. The training system displays the information. The processing module of the AR glasses can process the actually collected image information and virtual scene in real time and transmit it to the display module of the AR glasses for display. Thus, the fault conditions of the cables can be displayed in real time.

[0047] (2) The positioning module of the AR glasses provides a positioning coordinate for the cable construction personnel and guides how to accurately position. When there is an error in the virtual image display of the AR glasses, it can be corrected in time, ensuring the accuracy of the operation of the training personnel. The storage module of the training system of the AR glasses can store the cable fault repair process in real time and provide the correct fault repair results, enabling the training personnel to compare the actual fault conditions with the correct ones, thereby improving the accuracy of the staff's judgment.

[0048] (3) The training software can provide various different fault display situations, and provide comparison software and data for various fault situations. And according to the fault problems of the cables displayed by the software, the training personnel can collect fault pictures in real time through the AR glasses and detect them through the calibration module of the AR glasses. The display module of the AR glasses can display the correct fault images in real time, enabling the training personnel to clearly judge the cable fault conditions in the images, so as to achieve the purpose of judging cable faults. When the AR glasses are collecting and displaying pictures, the training personnel can compare with the expert system for calibration display and repair. The expert system can help the training personnel judge the current training situation, thereby improving the accuracy of training.

[0049] (4) The AR glasses can collect images through the acquisition module and locate the fault condition of the cable through the processing module of the AR glasses. At the same time, when the virtual cable fault is located and displayed, the processing module of the AR glasses can calibrate the positions of the virtual fault point and the actual fault point, so as to realize the positioning of the AR glasses and the positioning of the spatial coordinates, which provides convenience for cable fault maintenance personnel. At the same time, the AR glasses can record the operation conditions of the cable equipment and compare the data information of the virtual cable equipment with the data information of the actual power equipment. The processing module of the AR glasses can display the operation differences between the actual cable equipment and the theoretical cable equipment in real time, and can mark and alarm the incorrect cable operation information, so as to ensure the accuracy of cable operation in real time.

[0050] This training system can help cable maintenance and construction personnel understand the cable faults before cable maintenance and repair, so that they can operate cable maintenance in a real-time virtual scenario, thus ensuring the cable maintenance results. At the same time, it can combine the actual cable scenario with the virtual cable scenario through the AR glasses, providing convenience for cable actual operation maintenance and construction personnel, enriching their actual operation experience, and thus enabling better cable maintenance and construction.

[0051] The above is only a preferred specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention, according to the technical solution of the present invention and its inventive concept, makes equivalent substitutions or changes, and should be covered by the protection scope of the present invention.

Claims

1. An AR virtual training system for cable fault identification and diagnosis, characterized by: It includes VR glasses, a display module, a space positioning module, an AR augmented reality module, a storage module and a background expert system module; the VR glasses include a VR glasses information storage module, a VR glasses display module, a VR glasses image acquisition module and a VR glasses information sending module, and the image mark in the storage module and the position information collected by the VR glasses are transmitted to the data receiving module of the space positioning module through the VR glasses information sending module, and the AR augmented reality module includes a VR glasses information receiving module, an AR glasses positioning module, an AR glasses image acquisition module, an AR glasses positioning information sending module, an AR glasses image acquisition module, an AR glasses image acquisition module information sending module, an AR glasses image information receiving module, an AR glasses image processing module and an AR glasses display module.

2. The AR virtual training system for cable fault identification and diagnosis according to claim 1 is characterized by: The VR glasses information receiving module passes the image tags and position information from the data sending module to the AR glasses positioning module for spatial positioning. The AR glasses image acquisition module acquires images in actual operation, and transmits the actual image information to the AR glasses image information receiving module through the AR glasses image acquisition module information sending module. After that, the AR glasses image processing module compares the image tags in the storage module, and passes the compared tag images and positioning information to the AR glasses display module for display, thereby realizing real-time guidance for actual operation training.

3. The AR virtual training system for cable fault identification and diagnosis according to claim 1 is characterized by: The space positioning module comprises a data receiving module of the space positioning module, an information processing module of the space positioning module and an information sending module of the space positioning module.

4. The AR virtual training system for cable fault identification and diagnosis according to claim 3 is characterized by: The working steps of the spatial positioning module include: the data receiving module of the spatial positioning module receives the position information from the VR glasses and transmits the received information to the information processing module of the spatial positioning module; after the spatial positioning module processes the data, the information sending module of the spatial positioning module sends the processed positioning information to the AR glasses, and the AR glasses display the image mark in combination with the cable image.

5. The AR virtual training system for cable fault identification and diagnosis according to claim 1 is characterized by: The storage module includes a cable image storage module and an image mark storage module.

6. The AR virtual training system for cable fault identification and diagnosis according to claim 1, characterized in that: The background expert system module includes an expert system image receiving module, an expert system positioning information receiving module, an expert system image processing module, an expert system image storage module, an expert system database module, an expert system positioning information storage module and an expert information sending module.

7. The AR virtual training system for cable fault identification and diagnosis according to claim 1 is characterized by: The VR glasses information storage module stores the virtual space coordinates of the cable image. When the wearer moves in the actual space, the VR glasses information sending module sends the coordinate information of the virtual space, receives the information at the data information receiving module, and transmits the received information to the positioning module of the AR glasses. After the space positioning module processes the data, the positioning information is sent through the information sending module of the space positioning module. The AR glasses display the image mark in the virtual space in combination with the actual cable image information.

8. The AR virtual training system for cable fault identification and diagnosis according to claim 7, characterized in that: The AR glasses collect pictures of actual operations. When the cable detects a fault point or the cable cannot be detected, the AR glasses collect images. The information sending module of the AR glasses image collection module transmits the collected cable image to the AR glasses image information receiving module. The image information receiving module transmits the received information to the AR glasses image processing module. After processing by the AR glasses image processing module, the information is displayed on the AR glasses display module. The image processing module transmits the information to the background expert system image receiving module. The expert system compares the image. The positioning information receiving module of the expert system receives the positioning information of the virtual space. The expert system positioning information storage module stores and analyzes the positioning information, and sends it to the AR glasses through the expert system positioning information sending module. The AR glasses display module displays the expert system positioning information, thereby transmitting the cable maintenance information. The AR glasses display module displays the fault related to the virtual image.

Images