AR (Augmented Reality)-based visual interaction system and method for operation without power failure

Abstract

The invention discloses an AR (Augmented Reality)-based non-power-cut operation visual interaction system and method, and belongs to the technical field of computer data interaction. The AR-based non-power-cut operation visual interaction system comprises two-way communication AR equipment and a distribution network non-power-cut operation real-time command system; the real-time command system for the uninterrupted operation of the distribution network comprises an operation recording module, a real-time video recording management module, a first audio and video interaction module, a message pushing module and a labeling auxiliary function module. The AR equipment comprises a camera, an auxiliary identification module, a second audio and video interaction module and a message receiving module; according to the AR-based non-power-cut operation visual interaction system and method provided by the invention, operation can be carried out more efficiently and accurately, and the safety and the operation efficiency of field operation personnel are improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of computer data interaction, and in particular relates to an AR-based non-stop operation visualization interaction system and method. Background Art

[0002] Non-stop operation is a key link in the operation and maintenance of power grids. It refers to the maintenance, inspection or replacement of power equipment without interrupting the power supply of the power grid by means of live operation, bypass operation or mobile power supply. This operation method can reduce power outage time, improve power supply reliability, and improve the operation efficiency and economic benefits of the power grid. With the expansion of the scale and complexity of the power grid, the electrical connection within the power grid is closer. Once a fault occurs, it may quickly spread to other areas, and the difficulty and safety risks of non-stop operation will also increase. The traditional operation method is that the on-site staff performs specific operations according to the on-site conditions. This method relies on manual experience and technical level. Especially when working at high altitudes, only one operator performs specific operations, which has the risk of operating errors and is difficult to achieve real-time monitoring and guidance. Therefore, it is necessary to introduce new technical means to improve the efficiency and safety of non-stop operations. Summary of the invention

[0003] The present invention provides an AR-based non-power outage operation visualization interactive system and method, which can perform operations more efficiently and accurately, thereby improving the safety and operation efficiency of on-site workers.

[0004] In order to achieve the above object, the present invention adopts the following technical solution: An AR-based non-stop power operation visualization interactive system, including a two-way communication AR device and a distribution network non-stop power operation real-time command system; The distribution network uninterrupted power operation real-time command system includes: Operation record module, used to record key data in the process of non-stop operation; Real-time video management module, used to record and upload the video stream recorded by the camera; The first audio and video interaction module is used to cooperate with the second audio and video interaction module to enable the staff of the real-time command system for non-stop power distribution network operations to conduct audio and video calls with the on-site staff wearing AR devices; The message push module is used to push messages from the staff on the distribution network to the on-site staff wearing AR devices during real-time command of the distribution network non-stop operation. The annotation auxiliary function module is used by the staff of the real-time command system for distribution network non-stop operation to select and annotate the video stream of the real-time operation scene transmitted by the AR device, and then push it back to the AR device worn by the on-site staff in real time; The AR device includes: Camera, used to capture the video stream of the working scene in real time; Auxiliary recognition module, used to recognize the safety stop sign. When the safety stop sign is recognized, the marking auxiliary function is stopped; The message receiving module is used to receive messages from the command system.

[0005] Furthermore, key data include the start and end time of the operation, the operators involved in the operation, the operation status, the operating steps of the operators, and abnormal events.

[0006] Furthermore, the real-time video management module is also used for uploading, downloading, online previewing, full screen, reducing, adding information, modifying and deleting the video files of the non-power-off operation video. Furthermore, the first audio and video interaction module and the second audio and video interaction module maintain the call status between the two ends based on the WebSocket technology, and use WebRTC to perform encrypted transmission of audio and video.

[0007] Furthermore, the message push module is also used for peer selection, message content sending, data encryption and historical message acquisition; the peer selection is used to select the specific peer to receive the message; the data encryption is used to ensure the security of sending messages; the historical message acquisition function is used to check the content of the message pushed last time.

[0008] Furthermore, the message receiving module is also used for receiving message content, data decryption and historical message reception; the data decryption ensures that the messages from the real-time command system for non-stop power supply operations of the distribution network can be correctly parsed.

[0009] Furthermore, the annotation auxiliary function module includes: The video stream display module is used to display the operation scene video stream pushed by the AR device end; The item marking module has built-in tool icons covering common working tools in non-stop power supply operations, which are used by operators of the real-time command system for non-stop power supply operations of the distribution network to select corresponding tool icons for marking according to their needs; The video stream processing module is used to edit the annotations of the operators of the real-time command system for non-stop power supply and distribution network operations into the non-stop power supply operation scene video; The video stream push module is used to push the edited video to the AR device.

[0010] Furthermore, the auxiliary recognition module includes: An image recognition module, used to recognize the safety stop sign according to the set image recognition rules; The stop signal instruction module is used to close the marking auxiliary function mode of the real-time command system for non-stop power supply operations of the distribution network after receiving the instruction transmitted from the image recognition function.

[0011] An AR-based non-stop operation visualization interaction method, comprising: On-site workers wear AR devices and send a signal to the operation recording module to start the operation without power outages. The operation record module records the current non-stop operation personnel, start time and other information; On-site commanders collect and record on-site operation videos through the camera configured on the AR glasses, and record and upload them through the video management module; The real-time command system for non-stop power distribution network operations provides safety guidance to on-site workers through the first audio and video interaction module, the second audio and video interaction module and the message push module; The staff of the real-time command system for distribution network non-stop power supply operation establishes a connection with the AR devices worn by the on-site staff through the marking function module to assist in marking and mark out the equipment involved in the distribution network non-stop power supply operation; The staff of the real-time command system for non-stop power distribution network operations will mark the real-time scenes in the on-site operations, marking the operating tools and safety stop signs; On-site workers wearing AR devices receive the system's annotation assistance through the message receiving module and perform on-site work based on the annotation assistance; After the real-time system staff of the distribution network non-stop operation is disconnected or the on-site workers recognize the stop sign through the auxiliary identification module, the on-site workers stop the operation and the operation recording module records the current operation information.

[0012] Furthermore, the staff of the real-time command system for non-stop power distribution network operations establish a connection with the AR devices worn by the on-site staff through the annotation function module to assist in annotation. In the steps of annotating the instruments involved in the non-stop power distribution network operations, the annotation assistance process is as follows: the on-site operation video stream is split using the YOLO computational vision algorithm, images are extracted frame by frame, each frame of the image is uniformly compressed, gridded, and eigenvalues ​​are extracted, and finally a bounding box and category label are drawn on the frame with the highest eigenvalue confidence, and the processed frame is redrawn as a video stream.

[0013] Compared with the prior art, the present invention has at least the following beneficial technical effects: The AR-based non-stop power operation visualization interactive system provided in the present application includes an operation recording module, a real-time video recording management module, an audio and video interaction module, a message push module, a labeling auxiliary function module, an auxiliary recognition module, an audio and video interaction module, and a message receiving module.

[0014] After data collection, the operation recording module and the real-time video management module ensure traceability and can record the start and end time of the operation, the operating steps of the staff, and any abnormal events for subsequent analysis and evaluation; the audio and video interaction module enables system users to conduct real-time audio and video calls with on-site staff. This function enhances the technical support and communication capabilities of on-site staff and ensures that on-site workers can quickly obtain guidance and help in complex or emergency situations; the message push module enables system users to send instant text messages to on-site staff. These messages include operating instructions, safety warnings, or any information that needs to be conveyed immediately to improve the correctness of operations and the safety of workers; the annotation function module enables system staff to process the real-time scene video stream received from the AR device, emphasize key information through means such as box selection and annotation, and push the processed video stream to the AR device worn by the on-site staff in real time, providing instant assistance and guidance for the on-site staff; the auxiliary recognition module in the AR device uses image recognition technology to quickly identify the safety stop sign when the on-site staff wearing the AR device encounter an emergency, and immediately stop the remote assistance function to ensure the safety of on-site workers.

[0015] The present invention provides an AR-based non-stop power operation visualization interactive method, which realizes non-stop power operation by utilizing the distribution network non-stop power real-time command system and AR device remote command. The AR device captures the on-site image and transmits the image to the command system, which is annotated by the staff on the command system end. After the on-site staff wearing the AR device receive the annotated emphasis processing from the system personnel, they can perform the operation more efficiently and accurately according to the guidance and safety auxiliary information provided by the command system. If an unexpected situation is encountered during the operation, the stop sign can be recognized by the auxiliary recognition module in time to stop the command from the remote system, so as to improve the safety of the on-site workers. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A schematic diagram of the structure of an embodiment of the present invention; Figure 2 It is a structural diagram of the annotated auxiliary function module; Figure 3 A schematic diagram of the auxiliary recognition module of an AR device; Figure 4 Flowchart of interactive method for visualizing non-stop operations. DETAILED DESCRIPTION

[0017] The present invention is described in detail below with reference to the accompanying drawings and specific embodiments.

[0018] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0019] It should be noted that when an element is referred to as being "disposed on" another element, it may be directly on the other element or there may be another element centered thereon. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may be another element centered thereon at the same time. The terms "upper", "lower", "front", "back", "left", "right", "top", "bottom", "inside", "outside", etc. used herein indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention.

[0020] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by those skilled in the art of the present invention. The terms used herein in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used herein includes any and all combinations of one or more related listed items.

[0021] AR technology, or augmented reality technology, is a technology that superimposes virtual information on the real world. In recent years, with the continuous progress in computer vision, image processing, sensor technology, and artificial intelligence, AR technology has gradually matured and been widely used in various fields. AR technology provides an innovative solution for non-stop operations through its unique visual interaction capabilities. Through AR devices (such as AR glasses, tablets, etc.), operators can obtain virtual information about the equipment in real time, such as operating instructions, fault diagnosis, etc., thereby improving work efficiency and safety.

[0022] An AR-based non-stop power operation visualization interactive system includes an AR device with an AR augmented reality function and a distribution network non-stop power operation real-time command system that communicates with the AR device. The distribution network non-stop power operation real-time command system includes an operation recording module, a real-time video management module, a first audio and video interaction module, a message push module, and a marking auxiliary function module; the AR device includes a camera, an auxiliary recognition module, a second audio and video interaction module, and a message receiving module.

[0023] Among them, the operation recording module is used to record key data during the non-power outage operation process.

[0024] The real-time video management module uses the camera configured in the AR glasses to record the video stream and then upload it to the system to record the video information during on-site operations.

[0025] The first audio and video interaction module and the second audio and video interaction module are used to enable personnel using the real-time command system for non-stop power distribution network operations to conduct audio and video calls with on-site staff wearing AR devices. The call status between the two ends is maintained based on WebSocket technology, and WebRTC is used for encrypted transmission of audio and video.

[0026] The message push module is used by users of the real-time command system for non-stop power distribution network operations to push messages to on-site staff wearing AR devices, and performs real-time message push based on WebSocket.

[0027] The annotation auxiliary function module is used for the real-time command system of the distribution network without power outage. The staff of the system selects and annotates the real-time scene video stream transmitted by the AR device, and then pushes it back to the AR device worn by the on-site staff in real time. Among them, the auxiliary recognition module is a challenge to accurately identify the target object or scene in a complex or dynamically changing working environment. Real-time recognition and efficient processing of related identified targets require efficient image processing and computer vision algorithms. This module adopts the YOLO computational vision algorithm, which processes the video stream transmitted by the on-site staff. The image is split and extracted frame by frame. Each frame of the image is uniformly compressed and gridded, and the eigenvalues ​​are extracted. Finally, a frame with the highest eigenvalue confidence is obtained. Then, a bounding box and a category label are drawn on the frame, and the processed frame is redrawn as a video stream. In this way, insulating poles, insulating gloves, testers, clamp ammeters, insulating blankets, insulating blanket clips, insulating pads, insulating ropes, conductor shielding covers, insulator shielding covers, tension clamp shielding covers, crossarm shielding covers, overhead pole shielding covers, insulating partitions, transformers and other items involved in the non-stop operation of the distribution network are detected and identified in the video stream to achieve auxiliary means.

[0028] Camera, used to capture video stream; The auxiliary recognition module recognizes the safety stop sign. When the safety stop sign is recognized, the marking auxiliary function is stopped in time. This module uses YOLO to recognize each frame in the video stream and can quickly recognize the safety stop sign; The message receiving module can connect to the real-time command system for non-stop power distribution operations through the WebScoket network of the AR device and receive prompt messages from the command system.

[0029] Preferably, the operation recording module records key data during each non-power-off operation, including the start and end time of the operation, the operators involved, the operation status, the operator's operating steps and any abnormal events.

[0030] Preferably, the functions of the real-time video management module also include uploading, downloading, online preview, full screen, reduction, additional information, modification, and deletion of the video files of the non-power-off operation video.

[0031] Preferably, the functions of the audio and video interaction module also include scene recognition, audio recognition, and call status control of the command system and AR device. Among them, scene recognition provides scene video stream content for video calls; audio recognition is used to obtain audio content from the command system and AR device, and push the content from both ends to the other end through WebRTC technology to complete the display of audio and video calls; call status control is used to control the currently initiated audio and video call, including initiation, answering, hanging up, full-screen display and other functions.

[0032] Preferably, the functions of the message push module also include peer selection, message content sending, data encryption, and historical message acquisition; peer selection is used to select the specific peer to receive the message; data encryption ensures the security of each message sent; and the historical message acquisition function is used to check the content of the message pushed last time.

[0033] Preferably, the functions of the message receiving module also include receiving message content, data decryption and receiving historical messages; data decryption ensures that messages from the real-time command system for non-stop power supply operations of the distribution network can be correctly parsed.

[0034] Preferably, the annotation auxiliary function module has video stream display function, item annotation function, video stream processing function, and video stream push function; the video stream display function is responsible for displaying the operation scene video stream pushed by the AR device end; the item annotation function provides a rich set of tool icons, covering common operation tools in non-stop power supply operations. The operators of the real-time command system for non-stop power supply operations of the distribution network can select the corresponding tool icons for annotation as needed; the video stream processing function is responsible for editing the relevant annotations into the non-stop power supply operation scene video; the video stream push function pushes the edited video to the AR device.

[0035] Reference Figure 3 Preferably, the auxiliary recognition module of the AR device includes an image recognition module and a stop signal instruction module; the image recognition module recognizes the safety stop sign according to the set image recognition rules; after the stop signal instruction module receives the instruction transmitted from the image recognition function, it turns off the marking auxiliary function mode of the AR device from the remote distribution network non-stop operation real-time command system.

[0036] Example 1 like Figure 1 As shown, the present invention proposes an AR-based non-stop power operation visualization interactive system, including a distribution network non-stop power operation real-time command system and an AR device. The distribution network non-stop power operation real-time command system includes an operation recording module, a real-time video recording management module, an audio and video interaction module, a message push module, and a marking auxiliary function module; the AR device includes a camera, an auxiliary recognition module, an audio and video interaction module, and a message receiving module.

[0037] The operation recording module is used to record the information of non-stop operation, including the start and end time of the operation, the operators involved, the operation status, the operating steps of the operators and any abnormal events; the real-time video management module uses the camera configured by AR glasses to record the video stream and upload it to the system to record the work video information in the field operation; the first audio and video interaction module and the first audio and video interaction module are used to allow the users of the real-time command system for non-stop operation of the distribution network to conduct audio and video calls with the field workers wearing AR devices, including initiation, answering, hanging up and full-screen display; the call status between the two ends is maintained based on WebSocket technology, and WebRTC is used for encrypted transmission of audio and video; The message push module is used by users of the real-time command system for non-stop power distribution network operations to push messages to on-site workers wearing AR devices. The pushed messages include operation guides, safety warnings, etc. The marking auxiliary function module is used for the real-time command system of distribution network non-stop power supply operations. After the staff of the system select and mark the real-time scene video stream transmitted by the AR device, it is pushed to the AR device worn by the on-site staff in real time to achieve auxiliary means; if unexpected safety problems arise during the auxiliary process, the auxiliary recognition module in the AR device will identify the recognized safety stop sign and stop the marking auxiliary function in time.

[0038] In this embodiment, after the operation recording module and the real-time video management module collect data, traceability is ensured, and the start and end time of the operation, the operating steps of the staff, and any abnormal events can be recorded to facilitate subsequent analysis and evaluation; the audio and video interaction module allows the users of the real-time command system for non-stop power distribution network operations to conduct real-time audio and video calls with the on-site staff. This function enhances the technical support and communication capabilities of the on-site staff, ensuring that they can quickly obtain guidance and help in complex or emergency situations; the message push module enables the users of the real-time command system for non-stop power distribution network operations to send instant text messages to the on-site staff. These messages may include operating instructions, safety warnings, or any information that needs to be conveyed immediately; the annotation function module enables the staff of the real-time command system for non-stop power distribution network operations to process the real-time scene video stream received from the AR device, emphasize key information by means of box selection and annotation, and push the processed video stream in real time to the AR device worn by the on-site staff to provide instant assistance and guidance; the auxiliary recognition module in the AR device can quickly identify the safety stop sign when the on-site staff encounters an emergency through image recognition technology, and immediately stop the remote assistance function to ensure the safety of the operators.

[0039] Example 2 like Figure 2 As shown, the present invention proposes an AR-based non-stop power operation visualization interactive system. Compared with Example 1, the annotation auxiliary function module includes a video stream display module, an item annotation module, a video stream processing module, and a video stream push module. After the AR device and the annotation auxiliary function module in the real-time command system for non-stop power operation of the distribution network are connected, the AR device will push the real-time on-site operation scene video stream to the annotation auxiliary function module in real time; the video stream display module is responsible for displaying the operation scene video stream recognized and pushed by the AR device end; the item annotation module has built-in common operation tools and instruments in non-stop power operation. The operator of the real-time command system for non-stop power operation of the distribution network can select the corresponding tool and instrument icons for annotation as needed; the video stream processing module is responsible for editing the relevant annotations into the non-stop power operation scene video; the video stream push function pushes the edited video to the AR device.

[0040] In this embodiment, after the annotation auxiliary function module in the real-time command system for distribution network without power is connected to the AR device, it receives the on-site operation scene from the AR device and displays it in the video stream display function. In the real-time command system for distribution network without power supply, the appropriate tool icon can be selected according to the item annotation function to annotate the relevant video stream. After annotation, it is pushed to the AR device in real time through the push function. On-site staff wearing AR devices can perform operations more efficiently and accurately according to the guidance and safety assistance information provided by the real-time command system for distribution network without power supply. The application of AR devices enables on-site staff to intuitively receive and understand instructions from the real-time command system for distribution network without power supply, thereby improving the safety and efficiency of operations.

[0041] Example 3 like Figure 4 As shown, a method for visualizing and interacting with non-stop power supply operations based on AR based on the above-mentioned visualizing and interacting with non-stop power supply operations system includes the following steps: S1. On-site workers wear AR devices and start operations without power outages. They send a signal to the operation recording module to start the operation. S2, the operation record module records the current non-stop operation personnel, start time and other information; S3. On-site command personnel collect and record on-site operation videos through the camera configured with AR glasses, and record and upload them through the video management module; S4. The real-time command system for non-stop power supply operation of the distribution network provides safety guidance to on-site staff wearing AR devices in the form of voice or text messages through the first audio and video interaction module, the second audio and video interaction module and the message push module; S5. The staff of the real-time command system for non-stop power supply operation of the distribution network establishes a connection with the AR devices worn by the on-site staff through the annotation function module and starts annotation assistance; S6. The staff of the real-time command system for distribution network uninterrupted power operation will mark and process the real-time scenes in the on-site operation, marking key information such as operating tools and safety stop signs; S7. On-site workers wearing AR devices receive the annotation assistance of the real-time command system for power distribution network uninterrupted operation through the message receiving module, and perform on-site operations based on the annotation assistance; S8. After the staff of the real-time command system for non-stop power distribution network operation is disconnected or the on-site workers recognize the stop sign through the auxiliary recognition module, the on-site workers wearing AR devices stop working and the operation recording module records the current operation information.

[0042] In this implementation example, through the combined use of the distribution network de-energized real-time command system and the AR device remote command, after receiving the marked emphasis processing from the distribution network non-stop operation real-time command system personnel, the on-site staff wearing AR devices can perform their operations more efficiently and accurately according to the guidance and safety assistance information provided by the distribution network non-stop operation real-time command system; if an unexpected situation occurs during the period, the stop sign can be identified through the auxiliary recognition module to stop the command from the remote system, thereby improving the safety of on-site workers.

[0043] The term "consisting of" describing a combination shall include the identified elements, ingredients, parts or steps and other elements, ingredients, parts or steps that do not substantially affect the basic novel characteristics of the combination. The use of the terms "comprising" or "including" to describe a combination of elements, ingredients, parts or steps herein also contemplates embodiments that consist essentially of these elements, ingredients, parts or steps. By using the term "may", it is intended to illustrate that any of the attributes described that "may" be included are optional.

[0044] Multiple elements, ingredients, parts or steps can be provided by a single integrated element, ingredient, part or step. Alternatively, a single integrated element, ingredient, part or step can be divided into separate multiple elements, ingredients, parts or steps. The disclosure "one" or "an" used to describe an element, ingredient, part or step is not intended to exclude other elements, ingredients, parts or steps.

[0045] It should be understood that the above description is for illustration and not for limitation. Many embodiments and many applications beyond the examples provided will be apparent to those skilled in the art upon reading the above description. Therefore, the scope of the present teachings should not be determined with reference to the above description, but rather with reference to the foregoing claims and the full scope of equivalents to which such claims are entitled. For the purpose of comprehensiveness, all articles and references, including disclosures of patent applications and publications, are incorporated herein by reference. The omission of any aspect of the subject matter disclosed herein in the foregoing claims is not intended to be a waiver of such subject matter, nor should it be considered that the applicant has not considered such subject matter to be part of the disclosed inventive subject matter.

Claims

1. An AR-based non-stop operation visualization interactive system, characterized in that: Including two-way communication AR equipment and real-time command system for distribution network non-stop operation; The distribution network uninterrupted power operation real-time command system includes: Operation record module, used to record key data in the process of non-stop operation; Real-time video management module, used to record and upload the video stream recorded by the camera; The first audio and video interaction module is used to cooperate with the second audio and video interaction module to enable the staff of the real-time command system for non-stop power distribution network operations to conduct audio and video calls with the on-site staff wearing AR devices; The message push module is used to push messages from the staff on the distribution network to the on-site staff wearing AR devices during the real-time command system operation without power outages. The annotation auxiliary function module is used by the staff of the real-time command system for distribution network non-stop operation to select and annotate the video stream of the real-time operation scene transmitted by the AR device, and then push it back to the AR device worn by the on-site staff in real time; The AR device includes: Camera, used to capture the video stream of the working scene in real time; Auxiliary recognition module, used to recognize the safety stop sign. When the safety stop sign is recognized, the marking auxiliary function is stopped; The message receiving module is used to receive messages from the command system.

2. The AR-based non-stop operation visualization interactive system according to claim 1 is characterized in that: The key data includes the start and end time of the operation, the operators involved, the operation status, the operating steps of the operators and abnormal events.

3. The AR-based non-stop operation visualization interactive system according to claim 1 is characterized in that: The real-time video management module is also used for uploading, downloading, online previewing, full screen, reducing, adding information, modifying and deleting the video files of the non-power-off operation video.

4. The AR-based non-stop operation visualization interactive system according to claim 1 is characterized in that: The first audio and video interaction module and the second audio and video interaction module maintain the call status between the two ends based on the WebSocket technology, and use WebRTC to perform encrypted transmission of audio and video.

5. The AR-based non-stop operation visualization interactive system according to claim 1 is characterized in that: The message push module is also used for peer selection, message content sending, data encryption and historical message acquisition; the peer selection is used to select the specific peer to receive the message; the data encryption is used to ensure the security of sending messages; the historical message acquisition function is used to check the content of the message pushed last time.

6. The AR-based non-stop operation visualization interactive system according to claim 1, characterized in that: The message receiving module is also used for receiving message content, data decryption and historical message reception; the data decryption ensures that the message from the real-time command system for non-stop power supply operation of the distribution network can be correctly parsed.

7. The AR-based non-stop operation visualization interactive system according to claim 1 is characterized in that: The annotation auxiliary function module includes: The video stream display module is used to display the operation scene video stream pushed by the AR device end; The item marking module has built-in tool icons covering common working tools in non-stop power supply operations, which are used by operators of the real-time command system for non-stop power supply operations of the distribution network to select corresponding tool icons for marking according to their needs; The video stream processing module is used to edit the annotations of the operators of the real-time command system for non-stop power supply and distribution network operations into the non-stop power supply operation scene video; The video stream push module is used to push the edited video to the AR device.

8. The AR-based non-stop operation visualization interactive system according to claim 1 is characterized in that: The auxiliary recognition module comprises: An image recognition module, used to recognize the safety stop sign according to the set image recognition rules; The stop signal instruction module is used to close the marking auxiliary function mode of the real-time command system for non-stop power supply operations of the distribution network after receiving the instruction transmitted from the image recognition function.

9. An AR-based non-stop operation visualization interactive method, characterized in that: include: On-site workers wear AR devices and send a signal to the operation recording module to start the operation without power outages. The operation record module records the current non-stop operation personnel and start time information; On-site commanders collect and record on-site operation videos through the cameras configured on AR glasses, and then record and upload them through the video management module; The real-time command system for non-stop power distribution network operations provides safety guidance to on-site workers through the first audio and video interaction module, the second audio and video interaction module and the message push module; The staff of the real-time command system for distribution network non-stop power supply operation establishes a connection with the AR devices worn by the on-site staff through the marking function module to assist in marking and mark out the equipment involved in the distribution network non-stop power supply operation; The staff of the real-time command system for non-stop power distribution network operations will mark the real-time scenes in the on-site operations, marking the operating tools and safety stop signs; On-site workers wearing AR devices receive the system's annotation assistance through the message receiving module and perform on-site work based on the annotation assistance; After the real-time system staff of the distribution network non-stop operation is disconnected or the on-site workers recognize the stop sign through the auxiliary identification module, the on-site workers stop the operation and the operation recording module records the current operation information.

10. The AR-based non-stop operation visualization interactive method according to claim 9, characterized in that: The staff of the real-time command system for non-stop power supply operations of the distribution network establish a connection with the AR devices worn by the on-site staff through the annotation function module to perform annotation assistance. In the steps of annotating the instruments involved in the non-stop power supply operations of the distribution network, the annotation assistance process is: using the YOLO computational vision algorithm to split the on-site operation video stream, extracting images frame by frame, uniformly compressing each frame of the image, gridding and extracting eigenvalues, and finally drawing a bounding box and category label on the frame with the highest eigenvalue confidence, and then redrawing the processed frame as a video stream.

Images