Cable operation and maintenance auxiliary system based on AR technology

Abstract

The invention discloses a cable operation and maintenance auxiliary system based on an AR technology. The cable operation and maintenance auxiliary system is composed of a cable operation and maintenance management platform and an AR equipment end. During daily inspection, the inspection personnel can receive the inspection instruction sent by the cable operation and maintenance management platform after wearing the AR glasses, and the inspection personnel can complete operation step by step only according to the screen mousse indication steps. According to the system, the augmented reality technology is utilized, the cable operation and maintenance work efficiency is effectively improved, the inspection quality is improved, the whole inspection process can be recorded, the cable temperature and the harmful gas concentration are measured in real time through the extension module in the inspection process, and an alarm is given in time to avoid accidents when dangerous information exists. The system can monitor the dynamic state of inspection personnel in real time, carry out remote video call, carry out operation guidance by experts, carry out intelligent inspection flow, avoid missing inspection and error inspection, record each inspection process in real time, track the inspection result, automatically upload each inspection record to the system, and generate an intelligent report.

Description

Technical Field

[0001] The invention belongs to the field of power system cable operation and maintenance. Background Art

[0002] With the continuous development of my country's power system, the degree of cableization of the power grid is also increasing. Ensuring the safe operation of cable lines is a basic requirement for the operation of the power system. Due to the decline in the application cost of power cables in recent years and the high reliability of power supply, beautification of the urban environment, no influence of ground and space buildings, no damage by bad weather, safe, hidden and durable, power cables have been more and more widely used, but the maintenance of power cables in the later stage is very difficult. As an important part of the power system, once a cable fails, it will directly affect the safe operation of the entire power system. If the fault is not discovered in time, it may lead to serious consequences such as fire and large-scale power outages, causing huge losses to the national economy.

[0003] At present, cable operation and maintenance still mainly adopts the traditional inspection method. Inspectors carry a variety of equipment, and their hands are occupied, which hinders the inspection. Inspectors often need to carry a large number of paper work orders to record while inspecting, and then feed back to the system after the inspection. This traditional method does not allow the fastest feedback on information such as cable operation status and defects. It is difficult for managers to understand the status of inspectors in real time. There are limited ways to feedback and communicate problems found on site. Missed inspections and wrong inspections occur from time to time. The inspection process is difficult to track, and the inspection results are not guaranteed. The inspection results are not intuitive enough and the degree of visualization is not high. In short, relying solely on traditional inspection methods is no longer suitable for the current development of cable operation and maintenance. Summary of the invention

[0004] The present invention provides a cable operation and maintenance auxiliary system based on AR technology. The system utilizes augmented reality technology to effectively improve the efficiency of cable operation and maintenance and improve the quality of inspection. The system can record the entire inspection process through video. During the inspection process, the cable temperature and harmful gas concentration can be measured in real time through an expansion module. When there is dangerous information, an alarm can be issued in time to avoid accidents.

[0005] The technical solution of the present invention is a cable operation and maintenance auxiliary system based on AR technology, which is characterized by being composed of two parts: a cable operation and maintenance management platform and an AR device end; The cable operation and maintenance management platform includes: inputting inspection plans, task timing and directional push; automatic generation of execution records, intelligent reminders of abnormal status; support for offline operation of work tasks; AR devices include AR glasses and helmets, which support real-time task reminders to ensure that personnel execute tasks on time; workflow guidance to ensure that operations meet standards; execution results can be automatically uploaded or saved locally and uploaded after returning to a networked environment; the entire process is recorded from a first-person perspective to ensure that operations can be traced and analyzed; During daily inspections, inspectors can wear AR glasses and receive inspection instructions issued by the cable operation and maintenance management platform. They only need to follow the instructions on the screen to complete the work step by step.

[0006] Furthermore, firstly, according to the needs of cable operation and maintenance management, relevant models are established, including inspection process and judgment model, as well as equipment and cable connector identification graphic model; The inspection process and judgment model include the setting of inspection process, inspection time, inspection type, abnormal judgment, and inspection personnel information; the inspection instruction is the inspection operation instruction issued to the inspection personnel through the management system according to the inspection operation procedures; the management function module in the data server sends the inspection process and judgment basis, as well as all physical parameters; The equipment and cable connector identification graphic model includes all equipment and cable connectors used in the inspection, as well as models of various identification graphics pasted manually, to facilitate automatic identification by AR smart glasses during the inspection process.

[0007] Furthermore, the cable operation and maintenance management platform integrates and centrally manages the resources of each subsystem through custom workflow modules, remote expert collaboration platforms, enterprise knowledge bases, and management modules, achieving unified deployment, unified configuration, unified management, and scheduling; (1) Custom workflow module The custom workflow module provides flexible process solution customization for cable operation and maintenance, including basic components for various application directions. The solution formulation, preview and release can be completed by simply dragging and dropping. The platform needs to support work order management functions, including adding, deleting, modifying and checking work orders, viewing work reports, previewing work processes and viewing work records, etc. The work order administrator can assign task work orders issued by the work order system, and perform secondary task assignment for the assigned work order tasks that the operator cannot perform. (2) Remote expert collaboration platform It is used for remote experts to guide on-site personnel in the application scenarios of inspection, maintenance, and operation guidance. It supports multi-person audio and video calls, screen sharing, video sharing, camera images, and screen sharing. It supports static annotation, AR annotation, collaborative whiteboard, text chat, video recording, and file sharing. Remote assistance also requires background management functions, including remote assistance organization management, account management, and remote assistance process data analysis. (3) Enterprise knowledge base Preserving the accumulated information / knowledge is conducive to accelerating the circulation of information and knowledge within the enterprise, realizing the sharing of knowledge within the organization, facilitating the access of each business unit at any time, allowing enterprise members to quickly and accurately obtain information, providing the required knowledge support for business decision-making, and making better use of existing successful experiences and cases to make business development and customer service more efficient; the knowledge base needs to have the functions of input, management and maintenance, screening, association management, data call and presentation; (4) Management module The management module includes organizational structure management, organizational management of each business unit, employee management, menu settings, menu management, log query module, and maintenance management; it supports role creation, and can configure button-level permissions for roles; the same user can be associated with multiple roles, and the permissions are the union of multiple roles; each account can only be logged in on one computer or IP, and if an account is logged in at multiple locations at the same time, it will be prompted to go offline, and there is only one place where the platform can be accessed normally; Furthermore, employee management can perform operations such as adding, deleting, modifying, and checking employees, using hierarchical authority control.

[0008] Furthermore, menu settings provide maintenance functions for the system navigation menu and the system global data bar. Menu management is used to configure the entrance to each module, provide basic addition, deletion and modification functions, and can also be used to configure the menu permissions of the role.

[0009] Furthermore, the log query module monitors all request information, including operation menu, operation user, URL, operation time information, user access log records, module access count records, and logs are only visible to system administrators. The log management query function is displayed in list statistics and chart forms.

[0010] The cable operation and maintenance auxiliary method based on AR technology is characterized in that in daily inspections, the inspectors use smart glasses and AR technology to identify the equipment objects that need to be inspected, and through augmented reality SDK and computer vision SDK, the model data including text, pictures or videos are seamlessly fitted with the power equipment inspection objects identified on-site by the AR glasses. The AR smart glasses recognize the specified object and various physical parameters corresponding to the equipment. The AR smart glasses judge all the collected physical parameters according to the judgment model, determine the working conditions of the inspection equipment, and process them respectively according to the operating procedures, and then store all the judgment conclusions and all the collected data in the AR smart glasses; at the same time, the relevant data is automatically uploaded to form an inspection record. When an abnormality is found, the abnormal information can be described through voice input to form an abnormal record. During the whole process of inspection, the AR device helmet end supports full video recording / photographing for record, and forms a queryable inspection record, and can regularly remind the inspectors to review the last problem to form a comparison record to form a complete rectification chain.

[0011] The present invention has the following effects 1. The present invention combines AR glasses to break spatial and regional barriers through a remote assistance platform, and effectively connects business experts, owner-related personnel, and after-sales service system personnel in different regions, providing high-definition audio and video services and efficient communication methods such as multi-party annotation and sharing for the service site and acceptance site.

[0012] 2. The present invention uses AR glasses to achieve accurate, real-time, visual, and localized detection, collection, and storage of device temperature, video, and audio data, handle exceptions in advance, and improve work efficiency.

[0013] 3. The present invention will effectively improve the efficiency of cable operation and maintenance, improve the quality of inspection, and can record the entire inspection process. During the inspection, the expansion module can be used to measure the cable temperature and harmful gas concentration in real time, and alarm in time when there is dangerous information to avoid accidents.

[0014] 4. The cable operation and maintenance auxiliary system based on AR technology of the present invention can monitor the dynamics of patrol personnel in real time, conduct remote video calls, and provide operation guidance by experts. It has intelligent patrol process, says goodbye to missed inspection and wrong inspection, and each patrol process is recorded in real time. The patrol results can be traced, and each patrol record is automatically uploaded to the system to generate intelligent reports. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 It is a system structure diagram of the present invention; Figure 2 It is the business logic structure diagram of the system of the present invention. DETAILED DESCRIPTION

[0016] like Figure 1 As shown, firstly, according to the needs of cable operation and maintenance management, relevant models are established, including inspection process and judgment model, as well as equipment and cable connector identification graphic model.

[0017] The inspection process and judgment model include the setting of the inspection process, inspection time, inspection type, abnormal judgment, and inspection personnel information. The inspection process and judgment model are the basis of the inspection process, guiding the inspection personnel to conduct inspections according to the operating procedures to ensure personal safety and equipment safety. The inspection instructions are inspection operation instructions issued to the inspection personnel through the management system based on the inspection operating procedures. The management function module in the data server sends the inspection process and judgment basis, as well as all physical parameters.

[0018] The equipment and cable connector identification graphic model includes all equipment and cable connectors used in the inspection, as well as models of various identification graphics that are manually pasted. It is convenient for AR smart glasses to automatically identify during the inspection process. The identification content mainly includes equipment objects and physical parameters, such as the normal temperature of the wire.

[0019] During the inspection process, the inspection personnel use smart glasses and AR technology to identify the equipment objects that need to be inspected. The objects here refer to the properties of the equipment itself and the various power physical parameters related to power supply reflected by the equipment. Through the augmented reality SDK and computer vision SDK, the model data including text, pictures or videos are seamlessly matched with the power equipment inspection objects identified on-site by AR glasses. AR smart glasses recognize the specified object and the various physical parameters corresponding to the equipment. AR smart glasses judge all the collected physical parameters according to the judgment model, determine the working conditions of the inspection equipment, process them separately according to the operating procedures, and then store all the judgment conclusions and all the collected data in the AR smart glasses.

[0020] like Figure 2 As shown in the figure, the cable operation and maintenance management platform based on AR technology integrates and centrally manages the resources of each subsystem through custom workflow modules, remote expert collaboration platform, enterprise knowledge base, and management modules, realizing unified deployment, unified configuration, unified management, and scheduling.

[0021] (1) Custom workflow module The custom workflow module provides flexible process solution customization for cable operation and maintenance. It includes basic components for various application directions. Solution formulation, preview and release can be completed by simply dragging and dropping.

[0022] The platform needs to support work order management functions, including adding, deleting, modifying, checking work orders, viewing work reports, previewing the work process, and viewing work records. The work order administrator can assign task work orders issued by the work order system, taking into account actual needs such as team management, personnel management, and personnel qualification management. At the same time, if the operator cannot perform the assigned work order tasks, a secondary task assignment can be performed.

[0023] (2) Remote expert collaboration platform Remote assistance is mainly used for inspection, maintenance, operation guidance and other application scenarios, where remote experts provide guidance to on-site personnel. It supports multi-person audio and video calls, screen sharing, video sharing, camera images and screen sharing. It supports static annotation, AR annotation, collaborative whiteboard, text chat, video recording, file sharing and other functions. Remote assistance requires background management functions, including remote assistance organization management, account management, remote assistance process data analysis, etc.

[0024] (3) Enterprise knowledge base The establishment of an enterprise knowledge base can effectively store information / knowledge accumulation, and is conducive to accelerating the circulation of information and knowledge within the enterprise and realizing knowledge sharing within the organization. Information and knowledge are centralized and organized, which is convenient for each business unit to access at any time. The enterprise knowledge base allows enterprise members to quickly and accurately obtain information, provide the required knowledge support for business decisions, and better utilize existing successful experiences and cases to make business development and customer service more efficient. The knowledge base needs to have functions such as input, management and maintenance, screening, association management, data call and presentation.

[0025] (4) Management module The management module includes organizational structure management, organizational management of each business unit, personnel management, menu, log and other maintenance management. It supports role creation and can configure button-level permissions for roles. The same user can be associated with multiple roles, and the permissions are the union of multiple roles. Each account can only log in on one computer or IP. If an account logs in multiple places at the same time, it will be prompted to go offline, and there is only one place that can access the platform normally. Employee management can add, delete, modify, and query employees. Adopting hierarchical permission control, ordinary users have normal application permissions of the system, and the modules and application functions that can be accessed depend entirely on the configuration of the system administrator or tenant administrator. Menu settings provide maintenance functions for the system navigation menu and the system global data bar. Menu management is used to configure the entrance to each module, provide basic addition, deletion and modification functions, and can also be used to configure the menu permissions of roles. The log query module monitors all request information, including operation menus, operation users, URLs, operation time and other information, user access log records, module access times records, logs are only visible to system administrators, and the log management query function is displayed in list statistics and charts.

[0026] The cable operation and maintenance inspection auxiliary system built based on augmented reality technology provides strong support for staff patrol, inspection, maintenance and other work. During daily inspections, employees can wear AR glasses to receive inspection instructions issued by the background. Operators only need to follow the steps indicated on the screen to complete the work step by step, which greatly improves the inspection efficiency. AR glasses can also add expansion modules to realize infrared temperature measurement function, and add harmful gas sensor modules to realize harmful gas detection function.

[0027] Relevant execution data is automatically uploaded to form inspection records, reducing manual input, ensuring the accuracy of data acquisition, truthfully judging the equipment operation status, and improving employee inspection efficiency. When an abnormality is found, you can use voice input to describe the abnormal information and form an abnormal record. The AR device supports accurate voice recognition under 90 decibel high noise to ensure the accuracy of voice input. During the entire inspection process, the AR device helmet supports full video recording / photography for record keeping, and forms a searchable inspection record. It can also regularly remind the inspectors to review the last problem, form a comparison record, and form a complete rectification chain.

[0028] Among them, cloud storage realizes the storage and call of video image resources; the AR digital application management platform realizes the information integration and linkage of cable operation and maintenance; the server supports the AR digital application management platform and performs video switching and control through the network keyboard.

[0029] In the present invention, it is also possible to combine sensors such as video cameras, compasses, accelerometers, etc. of mobile phones, tablet computers, and wearable devices to obtain attribute information, environment, or historical records of the current workspace through the AR+LBS mode; and to quickly obtain relevant attribute information of equipment such as cable trenches and cable connectors by combining technologies such as quick response codes (QR codes) and specific graphic recognition.

[0030] Human-computer interaction can be achieved by using traditional external devices such as mouse, keyboard, data gloves, etc., or by using pre-set specific signs and triggering events.

[0031] The main technical parameters of the system are described as follows: AR Devices Storage memory Storage: 128G storage / 4G memory Display: 40 degree FOV, 400:1 contrast ratio, 1600 nits maximum brightness Network connection: support 5G module, WIFI 6 ultra-high-speed information transmission, BT 5.0 Battery life: 38Wh Camera: HD dual camera, 8 megapixel main and secondary cameras, support auto focus and 1080P video Protection level: IP-66 Sensors: Enhanced 9-axis IMU, light sensor, distance sensor, infrared module.

Claims

1. A cable operation and maintenance auxiliary system based on AR technology, characterized by It includes two parts: cable operation and maintenance management platform and AR equipment end; The cable operation and maintenance management platform includes: inputting inspection plans, task timing and directional push; automatic generation of execution records, and intelligent reminders of abnormal conditions; Support offline operation of work tasks; AR devices include AR glasses and helmets, which support real-time task reminders to ensure that personnel execute tasks on time; workflow guidance to ensure that operations meet standards; execution results can be automatically uploaded or saved locally and uploaded after returning to a networked environment; the entire process is recorded from a first-person perspective to ensure that operations can be traced and analyzed; During daily inspections, inspectors can wear AR glasses and receive inspection instructions issued by the cable operation and maintenance management platform. They only need to follow the instructions on the screen to complete the work step by step.

2. The cable operation and maintenance auxiliary system based on AR technology as claimed in claim 1 is characterized in that: First, according to the needs of cable operation and maintenance management, relevant models are established, including inspection process and judgment model, as well as equipment and cable connector identification graphic model; The inspection process and judgment model include the setting of inspection process, inspection time, inspection type, abnormal judgment, and inspection personnel information; Inspection instructions are inspection operation instructions issued to inspection personnel through the management system according to the inspection operation procedures; the management function module in the data server sends the inspection process and judgment basis, as well as all physical parameters; The equipment and cable connector identification graphic model includes all equipment and cable connectors used in the inspection, as well as models of various identification graphics pasted manually, to facilitate automatic identification by AR smart glasses during the inspection process.

3. The cable operation and maintenance auxiliary system based on AR technology as claimed in claim 1 is characterized in that: The cable operation and maintenance management platform integrates and centrally manages the resources of each subsystem through custom workflow modules, remote expert collaboration platform, enterprise knowledge base, and management modules to achieve unified deployment, unified configuration, unified management, and scheduling; (1) Custom workflow module The custom workflow module provides flexible process solution customization for cable operation and maintenance, including basic components for various application directions. The solution formulation, preview and release can be completed by simply dragging and dropping. The platform needs to support work order management functions, including adding, deleting, modifying and checking work orders, viewing work reports, previewing work processes and viewing work records, etc. The work order administrator can assign task work orders issued by the work order system, and perform secondary task assignment for the assigned work order tasks that the operator cannot perform. (2) Remote expert collaboration platform It is used for remote experts to guide on-site personnel in the application scenarios of inspection, maintenance, and operation guidance. It supports multi-person audio and video calls, screen sharing, video sharing, camera images, and screen sharing. It supports static annotation, AR annotation, collaborative whiteboard, text chat, video recording, and file sharing. Remote assistance also requires background management functions, including remote assistance organization management, account management, and remote assistance process data analysis. (3) Enterprise knowledge base Preserving the accumulated information / knowledge is conducive to accelerating the circulation of information and knowledge within the enterprise, realizing the sharing of knowledge within the organization, facilitating the access of each business unit at any time, allowing enterprise members to quickly and accurately obtain information, providing the required knowledge support for business decision-making, and making better use of existing successful experiences and cases to make business development and customer service more efficient; the knowledge base needs to have the functions of input, management and maintenance, screening, association management, data call and presentation; (4) Management module The management module includes organizational structure management, business unit organizational management, employee management, menu settings, menu management, log query module, and maintenance management; it supports role creation, and can configure button-level permissions for roles; the same user can be associated with multiple roles, and permissions are taken from the union of multiple roles; each account can only be logged in on one computer or IP, and if an account is logged in at multiple locations at the same time, it will be prompted to go offline, and there is only one place where the platform can be accessed normally.

4. The cable operation and maintenance auxiliary system based on AR technology as claimed in claim 3 is characterized in that: Employee management can add, delete, modify and query employees, using hierarchical authority control.

5. The cable operation and maintenance auxiliary system based on AR technology as claimed in claim 3 is characterized in that: Menu settings provide maintenance functions for the system navigation menu and the system global data bar. Menu management is used to configure the entrance to each module, provide basic addition, deletion and modification functions, and can also be used to configure the menu permissions of the role.

6. The cable operation and maintenance auxiliary system based on AR technology as claimed in claim 3 is characterized in that: The log query module monitors all request information, including operation menu, operation user, URL, operation time information, user access log records, module access count records. The log is visible only to system administrators. The log management query function is displayed in list statistics and chart forms.

7. A cable operation and maintenance auxiliary method using the cable operation and maintenance auxiliary system based on AR technology as described in any one of claims 1 to 6, characterized in that During daily inspections, inspectors use smart glasses and AR technology to identify equipment objects that need to be inspected. Through augmented reality SDK and computer vision SDK, model data including text, pictures or videos are seamlessly matched with the power equipment inspection objects identified on-site by AR glasses. AR smart glasses recognize the specified object and various physical parameters corresponding to the equipment. AR smart glasses judge all the collected physical parameters according to the judgment model, determine the working conditions of the inspection equipment, and process them separately according to the operating procedures. Then all the judgment conclusions and all the collected data are stored in the AR smart glasses; at the same time, the relevant data is automatically uploaded to form an inspection record. When an abnormality is found, voice input can be used to describe the abnormal information to form an abnormal record. During the entire inspection process, the AR device helmet supports full video recording / photography for record keeping, and forms a searchable inspection record. It can also regularly remind inspectors to review the last problem to form a comparison record to form a complete rectification chain.

Images