Metering operation and maintenance method and system, computer equipment and readable storage medium

Abstract

The invention relates to a metering operation and maintenance method and system, computer equipment, a computer readable storage medium and a computer program product. The method is applied to augmented reality equipment and comprises the steps that a remote guidance request is initiated to a server side, the remote guidance request carries authentication information and token information, and the authentication information is generated by the augmented reality equipment based on biological identification information and augmented reality equipment identification; the token information is generated and issued by the server side based on the user identity identifier, the augmented reality device identifier and the timestamp; the operation site picture data is sent to the security interaction gateway through the first encryption transmission channel; and decrypting the encrypted mark information to obtain the mark information, superposing the mark information on the operation site picture, and displaying the operation site picture after superposing the mark information. By adopting the method, the data security under the internal and external network security isolation requirement can be improved, and the working efficiency of metering operation and maintenance can also be improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of operation and maintenance, in particular to a metering operation and maintenance method and system, computer equipment and computer readable storage medium. BACKGROUND

[0002] In the traditional metering operation and maintenance mode, it mainly relies on manual on-site operation. For example, in the power industry, metering personnel need to regularly go to substations, distribution stations and a large number of user end metering devices to perform data transcription, equipment inspection and other work on various metering equipment.

[0003] In terms of security, metering operation and maintenance involves data of critical infrastructure such as power grids, and security is of vital importance. However, existing part of remote collaboration technology has vulnerabilities in data encryption, identity authentication and access control. Data may be stolen and tampered with during transmission, and unauthorized personnel may illegally access metering data and systems, posing a serious threat to the safe operation of power grids. Especially in the aspect of internal and external network interaction, power grid systems usually adopt strict internal and external network isolation measures to ensure internal network security.

[0004] However, existing remote collaboration technology cannot achieve safe interaction of internal and external network data under the premise of meeting the security isolation requirements, and cannot meet the strict requirements of metering operation and maintenance on data security. SUMMARY

[0005] Therefore, it is necessary to provide a metering operation and maintenance method, system, computer equipment and computer readable storage medium capable of improving data security in view of the above technical problems.

[0006] In a first aspect, the present application provides a metering operation and maintenance method applied to an augmented reality device, the method comprising:

[0007] initiating a remote guidance request to a server end, the remote guidance request carrying authentication information and token information, the authentication information being generated by the augmented reality device based on biometric information and augmented reality device identifier; the token information being generated and issued by the server end based on user identity identifier, augmented reality device identifier and timestamp; the server end is used to send a channel establishment instruction to a secure interaction gateway in the case that the authentication information and the token information pass the audit; the secure interaction gateway is used to establish a first encrypted transmission channel between the secure interaction gateway and the augmented reality device and a second encrypted transmission channel between the secure interaction gateway and the server end according to the channel establishment instruction to respond to the remote guidance request; the server end is deployed in an internal network, and the augmented reality device is deployed in an external network; the secure interaction gateway is deployed at the boundary of the internal network and the external network;

[0008] sending the job site picture data to the secure interaction gateway through the first encrypted transmission channel; the secure interaction gateway is configured to forward the job site picture data to the server end through the second encrypted transmission channel; the server end is configured to receive the job site picture data and convert it into a job site picture, generate marking information based on the job site picture in response to an operation instruction, and send the marking information to the secure interaction gateway through the second encrypted transmission channel; the secure interaction gateway is configured to encrypt the marking information and send the encrypted marking information to the augmented reality device through the first encrypted transmission channel;

[0009] decrypting the encrypted marking information to obtain the marking information, superimposing the marking information on the job site picture, and displaying the job site picture after superimposing the marking information.

[0010] In one of the embodiments, before the remote guidance request is initiated to the server end, the method further comprises:

[0011] sending the obtained user identity, augmented reality device identifier, and timestamp to the server end; the server end is configured to encapsulate the user identity, augmented reality device identifier, and timestamp using an encryption algorithm to generate the token information, and send the token information to the augmented reality device;

[0012] receiving the token information sent by the server end.

[0013] In one of the embodiments, the method further comprises:

[0014] obtaining a target job site image and identifying data in the target job site image to obtain target measurement data;

[0015] obtaining reference measurement data; wherein the reference measurement data is extracted from a previous frame of image of the target job site image;

[0016] determining to-be-transmitted difference data based on the target measurement data and the reference measurement data;

[0017] sending the to-be-transmitted difference data to the secure interaction gateway, and the secure interaction gateway encrypting the to-be-transmitted difference data to obtain encrypted transmission data and sending the encrypted transmission data to the server end.

[0018] In one of the embodiments, the method of obtaining a target job site image and identifying data in the target job site image to obtain target measurement data comprises:

[0019] obtaining an initial job site image;

[0020] performing noise removal and contrast enhancement on the initial work site image to obtain a target work site image;

[0021] extracting data in the target work site image through target detection to obtain the target measurement data.

[0022] In a second aspect, the application provides a measurement operation and maintenance method applied to a server side, the method comprising:

[0023] receiving a remote guidance request initiated by an augmented reality device; the remote guidance request carrying authentication information and token information, the authentication information being generated by the augmented reality device based on biological identification information and augmented reality device identification; the token information being generated by the server side based on a user identity, the augmented reality device identification and a timestamp, and being delivered to the augmented reality device;

[0024] in the case where the authentication information and the token information pass the audit, sending a channel establishment instruction to a secure interaction gateway; the secure interaction gateway being configured to establish a first encrypted transmission channel between the secure interaction gateway and the augmented reality device, and a second encrypted transmission channel between the secure interaction gateway and the server side according to the channel establishment instruction, to respond to the remote guidance request; the server side being deployed in an internal network, the augmented reality device being deployed in an external network; the secure interaction gateway being deployed at the boundary between the internal network and the external network;

[0025] receiving work site picture data sent by the secure interaction gateway through the second encrypted transmission channel, and converting the work site picture data into a work site picture; the work site picture data being sent by the augmented reality device through the first encrypted transmission channel;

[0026] in response to an operation instruction, generating mark information based on the work site picture, and sending the mark information to the secure interaction gateway through the second encrypted transmission channel; the gateway being configured to encrypt the mark information, and send the encrypted mark information to the augmented reality device through the first encrypted transmission channel; the augmented reality device being configured to decrypt the encrypted mark information to obtain the mark information, superimpose the mark information on the work site picture, and display the work site picture with the superimposed mark information.

[0027] In a third aspect, the application provides a measurement operation and maintenance method applied to a secure interaction gateway, the method comprising:

[0028] receive a channel establishment instruction sent by a server end; the channel establishment instruction is sent by the server end under the condition that authentication information and token information are audited; the authentication information and the token information are obtained by the server end according to a remote guidance request; the remote guidance request is sent by an augmented reality device to the server end; the authentication information is generated by the augmented reality device based on biometric information and an augmented reality device identifier; the token information is generated by the server end based on a user identifier, the augmented reality device identifier and a timestamp, and is issued to the augmented reality device; the server end is deployed in an intranet, and the augmented reality device is deployed in an extranet; the secure interaction gateway is deployed at the boundary of the intranet and the extranet;

[0029] establish a first encrypted transmission channel between the secure interaction gateway and the augmented reality device, and a second encrypted transmission channel between the secure interaction gateway and the server end according to the channel establishment instruction, to respond to the remote guidance request;

[0030] receive job site picture data sent by the augmented reality device through the first encrypted transmission channel, and forward the job site picture data to the server end through the second encrypted transmission channel; the server end is configured to receive job site picture data and convert it into a job site picture, generate mark information based on the job site picture in response to an operation instruction, and send the mark information to the secure interaction gateway through the second encrypted transmission channel;

[0031] receive the mark information, encrypt the mark information, and send the encrypted mark information to the augmented reality device through the first encrypted transmission channel; the augmented reality device is configured to decrypt the encrypted mark information to obtain the mark information, superimpose the mark information on a job site picture, and display the job site picture with the superimposed mark information.

[0032] In one embodiment, the receiving the mark information and encrypting the mark information comprises:

[0033] processing the mark information through a secure hash algorithm to generate a first digest;

[0034] digitally signing the first digest through a remote expert private key to obtain the encrypted mark information.

[0035] In a fourth aspect, the application provides a metering operation and maintenance system, comprising: an augmented reality device, a secure interaction gateway and a server end, the augmented reality device is deployed in an extranet; the secure interaction gateway is deployed at the boundary of the intranet and the extranet; the server end is deployed in an intranet;

[0036] The augmented reality device is configured to initiate a remote guidance request to the server end, the remote guidance request carrying authentication information and token information, the authentication information being generated by the augmented reality device based on biometric information and augmented reality device identification; the token information being generated and issued by the server end based on a user identity, the augmented reality device identification and a timestamp;

[0037] The server end is configured to receive the remote guidance request initiated by the augmented reality device; and send a channel establishment instruction to a secure interaction gateway in the case that the authentication information and the token information pass the audit;

[0038] The secure interaction gateway is configured to receive the channel establishment instruction sent by the server end; and establish a first encrypted transmission channel between the secure interaction gateway and the augmented reality device and a second encrypted transmission channel between the secure interaction gateway and the server end according to the channel establishment instruction, so as to respond to the remote guidance request;

[0039] The augmented reality device is further configured to send job site picture data to the secure interaction gateway through the first encrypted transmission channel;

[0040] The secure interaction gateway is further configured to receive the job site picture data sent by the augmented reality device through the first encrypted transmission channel, and forward the job site picture data to the server end through the second encrypted transmission channel;

[0041] The server end is further configured to receive the job site picture data sent by the secure interaction gateway through the second encrypted transmission channel, and convert the job site picture data into a job site picture; and in response to an operation instruction, generate mark information based on the job site picture, and send the mark information to the secure interaction gateway through the second encrypted transmission channel;

[0042] The secure interaction gateway is further configured to encrypt the mark information, and send the encrypted mark information to the augmented reality device through the first encrypted transmission channel;

[0043] The augmented reality device is further configured to decrypt the encrypted mark information to obtain the mark information, superimpose the mark information on the job site picture, and display the job site picture with the superimposed mark information.

[0044] In a fifth aspect, the present application provides a computer device, comprising a memory and a processor, the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.

[0045] In a sixth aspect, the present application provides a computer readable storage medium, having stored thereon a computer program, which, when executed by a processor, implements the steps of the method described above.

[0046] The metering operation method and system, computer device and computer readable storage medium described above first send a remote guidance request through the augmented reality device, and the server end performs two-factor authentication through authentication information and token information, so that the authentication information and token information ensure one-to-one correspondence between the operation device and the personnel identity, preventing device impersonation and identity impersonation from the source, improving the security of data under the requirement of internal and external network security isolation, and establishing a first encrypted channel and a second encrypted channel through the secure interaction gateway after verification, so that subsequent operation site picture data and marker information are transmitted through the first encrypted channel and the second encrypted channel, further improving the data security under the requirement of internal and external network security isolation through the exclusive transmission channel. At the same time, through the real-time guidance of the server end remote expert, the troubleshooting time can be shortened to several hours, greatly improving the work efficiency. BRIEF DESCRIPTION OF DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related art, the following will briefly introduce the drawings needed to be used in the description of the embodiments of the present application or the related art. Obviously, the drawings in the following description only some embodiments of the present application, and for those skilled in the art, other related drawings can also be obtained without creative labor on the basis of these drawings.

[0048] Figure 1 The application environment diagram of the operation and maintenance metering method in an embodiment;

[0049] Figure 2 The flowchart of the metering operation method in which the augmented reality device interacts with the server end through the secure interaction gateway in an embodiment;

[0050] Figure 3 The flowchart of the transmission of the target operation site image by the augmented reality device in an embodiment;

[0051] Figure 4 The flowchart of the target metering data obtained by the augmented reality device in an embodiment;

[0052] Figure 5 The internal structure diagram of the computer device in an embodiment. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical scheme and advantages of the present application more clear, the following will further describe the present application in combination with the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

[0054] The operation and measurement method provided by the embodiments of the present application can be applied to an application environment as shown in the figure. Figure 1 The augmented reality (AR) device 102 can communicate with the server end 104 through a network, and the augmented reality (AR) device 102 can also communicate with the server end 104 through the secure interaction gateway 106. The server end 104 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services.

[0055] In an exemplary embodiment, as shown in the figure, Figure 2 A measurement operation method is provided, and the method is applied to the augmented reality device, the server end and the secure interaction gateway in Figure 1 The method includes the following steps S202 to S216. Among them:

[0056] Step S202, the augmented reality device initiates a remote guidance request to the server end, the remote guidance request carries authentication information and token information, the authentication information is generated by the augmented reality device based on biological identification information and augmented reality device identification; the token information is generated and issued by the server end based on the user identity, the augmented reality device identification and the timestamp.

[0057] Among them, the augmented reality device, such as AR glasses, is located in the external network, and can use 5G network communication or WIFI communication. The server end is located in the internal network.

[0058] Optionally, the measurement personnel arrives at the field operation area of the substation, the distribution station, the user end measurement device, etc., the measurement personnel turns on the AR glasses power, the AR glasses obtains the user identity UID, the AR glasses device identification DID and the timestamp TS of the measurement personnel, and sends the obtained user identity UID, the AR glasses device identification DID and the timestamp TS to the server end; the server end generates token information based on the user identity UID, the AR glasses device identification DID and the timestamp TS and issues it to the AR glasses. The data for generating the token information can also include the access control policy ACL. The token information is valid within a target time period, for example, within 4 hours from the time when the AR glasses receives the token information.

[0059] Further, before starting the AR glasses operation mode, the iris recognition module deployed in the AR glasses is used to obtain the biometric image of the metering personnel, such as the iris image, the detailed features of the iris image are analyzed based on the iris image, the unique biological identification information is generated, the authentication information is generated based on the biological identification information and the AR glasses device identification DID, and is recorded in the storage module of the AR glasses.

[0060] Wherein, the authentication information is generated based on the biological identification information and the AR glasses device identification DID, including: the biological identification information and the AR glasses device identification DID are bound to generate a unique authentication combination, denoted as (BIO||DID), and the summary value is calculated by a hash function , the authentication information is determined based on the summary value, and the authentication information is bound with the token information to ensure that the operation device and the personnel identity one-to-one correspondence, preventing device impersonation and identity impersonation from the source.

[0061] Finally, when the metering personnel encounters a problem during the operation, a remote guidance request can be initiated through the voice interaction unit or the touch interaction unit of the AR glasses. The voice interaction unit includes a high-precision microphone and a voice recognition chip, and the AR glasses receives the voice instruction of the remote guidance request initiated by the metering personnel through the high-precision microphone, and recognizes the voice instruction through the voice recognition chip. The touch interaction unit includes a capacitive touch screen, which has good touch sensitivity and response speed. The metering personnel initiates a remote guidance request through the touch capacitive touch screen, and after the AR glasses receives the instruction or voice instruction of the remote guidance request initiated by the metering personnel, the AR glasses initiates a remote guidance request to the server end of the internal network through the communication module of the AR glasses using the 5G network. Wherein, the remote guidance request includes authentication information and token information generated by the server end after the power of the AR glasses is turned on and sent to the AR glasses.

[0062] Step S204, the server end receives the remote guidance request initiated by the augmented reality device; in the case that the authentication information and the token information pass the audit, a channel establishment instruction is sent to the secure interaction gateway.

[0063] Wherein, the server end is deployed with a metering operation management system, and the metering operation management system includes a remote expert end management module. The secure interaction gateway is deployed at the boundary of the internal network and the external network.

[0064] In the security isolation architecture of the internal and external networks, in order to realize the safe and efficient transmission of 5G high-speed data in the isolated environment, a secure interaction gateway with protocol conversion and dynamic tunneling capability needs to be deployed at the network boundary of the internal and external networks. The secure interaction gateway is used to bear the protocol conversion function, that is, the AR glasses use the physical and MAC layer information in the bottom layer of the NR (New Radio) protocol stack to abstract the transmission protocol used by the 5G network, only the key information at the data layer and above is retained, and it is mapped into the form of a secure communication protocol supported by the internal network. In terms of implementation, it is converted into the HTTPS over TLS1.3 protocol, which can ensure the encryption, integrity and anti-replay capability of data in the transmission process, and at the same time, the early data transmission (0-RTT) mechanism of TLS1.3 is used to avoid the delay caused by the traditional handshake, and to ensure that the low latency characteristic is not destroyed.

[0065] Optionally, the remote expert end management module receives a remote guidance request initiated by the augmented reality device through the server end. The remote expert end management module audits based on a pre-authorized trust list, such as generating short-term valid token information and authentication information including biometric information and double-factor authentication of AR glasses device identifier DID through the unified identity authentication module in the metering operation and maintenance system before the operation, and in the case that the authentication information and token information pass the audit, the remote expert end management module sends a channel establishment instruction to the secure interaction gateway through the server end.

[0066] Step S206, the secure interaction gateway receives the channel establishment instruction sent by the server end; according to the channel establishment instruction, the first encrypted transmission channel between the secure interaction gateway and the augmented reality device, and the second encrypted transmission channel between the secure interaction gateway and the server end are established to respond to the remote guidance request.

[0067] Among them, the secure interaction gateway is used to construct a data transmission path by using a dynamic tunneling technology based on software-defined border (SDP). SDP extends the traditional network access control from static configuration to dynamic policy control, and only when the identity of the communication parties is confirmed and has the authority, a virtual tunnel is established. The tunnel adopts a temporary key dynamic generation method, and the key generation is completed through a key agreement protocol such as ECDH or SM2 before each data transmission.

[0068] Optionally, the secure interaction gateway receives a channel establishment instruction sent by the server end, and establishes a secure real-time communication connection, including an audio and video connection and a data transmission channel, using a dynamic key negotiation algorithm based on a software-defined perimeter (SDP) dynamic tunneling technology according to the channel establishment instruction, such as establishing a first encrypted transmission channel between the secure interaction gateway and the augmented reality device and a second encrypted transmission channel between the secure interaction gateway and the server end, to respond to the remote guidance request, and releasing the first encrypted channel and the second encrypted channel resources immediately after the current data transmission is completed, to avoid security risks caused by long-term opening of a port.

[0069] In step S208, the augmented reality device sends the work site picture data to the secure interaction gateway through the first encrypted transmission channel.

[0070] The work site picture data is real-time.

[0071] Optionally, the augmented reality device sends the work site picture data of continuous time to the secure interaction gateway through the first encrypted transmission channel in sequence, and transmits the work site picture data through a dedicated tunnel to ensure the work site picture data.

[0072] In step S210, the secure interaction gateway receives the work site picture data sent by the augmented reality device through the first encrypted transmission channel, and forwards the work site picture data to the server end through the second encrypted transmission channel.

[0073] Optionally, the secure interaction gateway receives the work site picture data sent by the augmented reality device through the first encrypted transmission channel, and forwards the work site picture data to the remote expert end management module deployed in the server end through the second encrypted transmission channel.

[0074] In step S212, the server end receives the work site picture data sent by the secure interaction gateway through the second encrypted transmission channel, and converts the work site picture data into a work site picture; in response to an operation instruction, generates mark information based on the work site picture, and sends the mark information to the secure interaction gateway through the second encrypted transmission channel.

[0075] Optionally, the remote expert end management module in the server end receives the work site picture data sent by the secure interaction gateway through the second encrypted transmission channel, and converts the work site picture data into a work site picture.

[0076] Further, the remote expert views the job site picture transmitted by the AR glasses in real time through the remote expert terminal device, marks and annotates the key parts and fault points in the job site picture by using various marking tools (such as a brush, an arrow, a text annotation, etc.) provided by the operation interface, generates marking information, and transmits the marking information in the form of a vector graph. The remote expert terminal management module in the server end responds to the operation instruction of the remote expert, generates marking information based on the job site picture, and sends the marking information in the form of a vector graph to the secure interaction gateway through a second encrypted transmission channel.

[0077] In the actual application, in order to ensure that the marking information in the remote guidance interaction is not tampered with, the marking information is encrypted by the secure interaction gateway, the encryption mode is a combination of hash check and digital signature, and the encrypted marking information is sent to the AR glasses through the first encrypted transmission channel.

[0078] In the actual application, in order to ensure that the marking information in the remote guidance interaction is not tampered with, the marking information is encrypted by the secure interaction gateway, the encryption mode is a combination of hash check and digital signature, and the encrypted marking information is sent to the AR glasses through the first encrypted transmission channel.

[0079] Step S216, the augmented reality device decrypts the encrypted marking information to obtain the marking information, superimposes the marking information on the job site picture, and displays the job site picture after superimposing the marking information.

[0080] Optionally, the AR glasses receive the encrypted marking information and decrypt the encrypted marking information. Similarly, the combination of hash check and digital signature is used for decryption to obtain the marking information, and the marking information is not tampered with in the transmission process and is trusted.

[0081] Further, the display unit of the AR glasses accurately superimposes and displays the marking information on the real-time job site picture by using optical projection technology, and the superimposition error is not more than 1 pixel. The measurement personnel performs on-site operation according to the marking information displayed by the AR glasses and the guidance of the remote expert, and completes the measurement and operation task. After the operation is completed, the power of the AR glasses is turned off, and the operation task is ended.

[0082] In the metering operation and management system, in order to ensure the stable communication between AR glasses and remote expert management module in various network environments, the system introduces a transmission strategy dynamic adjustment mechanism, which is based on the real-time optimization of 5G network status. The AR glasses integrate a signal monitoring module, which continuously monitors the core indicators of the current communication link, including signal strength RSSI, latency Latency, packet loss rate Packet Loss, etc. When any parameter reaches the set threshold indicating a decline in network quality, the multi-dimensional transmission strategy optimization process is automatically started. First, in the code rate adaptive strategy, the system dynamically adjusts the video encoding parameters according to the current network bandwidth. When the detected bandwidth drops below the set threshold , the original resolution is switched from 1080P to 720P, or the frame rate is reduced from 60 frames per second to 30 frames per second, reducing the amount of data transmitted per unit time, improving the transmission priority of key audio streams and marker information in remote guidance, and ensuring the balance between picture clarity and smooth communication.

[0083] To further enhance communication stability, the system supports multi-link aggregation function. Based on the 5G main link, if the AR glasses detect a safe and reliable Wi-Fi network on site, or establish a relay connection with a mobile terminal through Bluetooth, the AR glasses will implement parallel transmission of data fragments through link scheduling algorithm. At this time, the system uses a weighted allocation strategy to dynamically allocate available bandwidth, so that the total transmission rate is as shown in formula (1):

[0084] Formula (1)

[0085] Where represents the current rate of the i-th link, is its allocation weight, satisfying , so as to realize multi-channel aggregated transmission, improve anti-packet loss capability and overall throughput. If a link is temporarily interrupted, the system can quickly transfer the load to other available links to ensure uninterrupted remote guidance experience.

[0086] In the deployment process of the metering operation and maintenance system, in order to ensure its stable operation in various actual power grid environments, complex environment simulation tests need to be carried out in the laboratory stage. For the strong electromagnetic radiation interference in the substation and the signal shielding phenomenon caused by the metal wall, cable bridge and other internal structures of the distribution station, a test environment with controllable variables is constructed to simulate typical electromagnetic field intensity, metal closed structure and reflection characteristics. Through interference injection test of the 5G communication module of AR glasses in different frequency bands, the signal reception sensitivity and the error rate trend are evaluated, the antenna arrangement mode and the metal shell grounding strategy are optimized, and the penetration rate and signal stability are improved. On this basis, for the security gateway device deployed at the boundary, the anti-interference capability test is carried out to verify that it can still stably complete the protocol conversion and dynamic encryption channel establishment under strong magnetic field. If the error rate exceeds the set tolerance in the interference environment, the system automatically adjusts the encryption parameter length and the error correction code redundancy to ensure that the communication data can still be completely restored. This process involves the ratio of signal strength S, interference strength I and noise power N, as shown in formula (2):

[0087] Formula (2)

[0088] Among them, SINR represents the communication link quality, and the SINR value is enhanced through antenna gain and channel coding, thereby enhancing the robustness against environmental interference.

[0089] At the same time, in order to ensure that the system still runs stably in the key operation scene of high concurrency and high flow, a stress test platform needs to be constructed to simulate typical business processes such as power grid emergency repair. During the test process, multiple AR glasses upload real-time audio and video data at the same time through virtual terminals, and receive the marking and instruction information returned by the expert end, continuously monitor the maximum concurrent connection number of the system, the data throughput per unit time, and the end-to-end delay of the key instructions. Especially for the visual marking information in remote guidance, it requires very low delay in interaction, and the test verifies that the transmission delay is stably controlled within 200 milliseconds. The system dynamically schedules computing and transmission resources under high load, and through the buffer strategy and task priority mechanism, it ensures that the instruction channel is preferentially scheduled and transmitted. In the throughput performance analysis, the data processing capacity T per unit time is measured, as shown in formula (3):

[0090] Formula (3)

[0091] Among them, D represents the amount of data successfully transmitted per unit time, to measure the time interval, so as to evaluate the upper limit of the network and edge device under peak conditions, and provide parameter basis for subsequent deployment and expansion. The overall test process verifies the communication reliability and real-time performance of the system in complex scenarios, providing stability guarantee for deployment.​

[0092] In the metering operation method, first, a remote guidance request is sent through an augmented reality device, and the server side performs double-factor verification through authentication information and token information. The authentication information and token information ensure that the operation device and the personnel identity one-to-one correspond, prevent device impersonation and identity impersonation from the source, improve the security of data under the requirement of internal and external network security isolation, and establish a first encrypted channel and a second encrypted channel through a secure interaction gateway after verification, so that subsequent operation site picture data and marker information are transmitted through the first encrypted channel and the second encrypted channel. Through the exclusive transmission channel, the data security under the requirement of internal and external network security isolation is further improved. At the same time, through the real-time guidance of the server-side expert, the troubleshooting time can be shortened to several hours, greatly improving the work efficiency.

[0093] In an exemplary embodiment, before initiating a remote guidance request to the server side, the following steps are included: sending the obtained user identity, augmented reality device identifier, and timestamp to the server side; the server side uses an encryption algorithm to encapsulate the user identity, augmented reality device identifier, and timestamp to generate token information; and sending the token information to the augmented reality device; receiving the token information sent by the server side.

[0094] In actual application, in the power grid metering operation management system, in order to avoid complex identity verification process every time data interaction is performed, and to improve the remote guidance response efficiency, a pre-authorization and fast authentication mechanism is designed. When the metering personnel arrives at the on-site operation area such as the substation, distribution station, and user end metering device, the metering personnel turns on the power of the AR glasses, the AR glasses obtain the user identity UID, AR glasses device identifier DID, and timestamp TS of the metering personnel, and send the obtained user identity UID, AR glasses device identifier DID, and timestamp TS to the server side. The server side can also send the access control policy of the AR glasses to the server side.

[0095] The server side uses a symmetric or asymmetric encryption algorithm based on the user identity UID, AR glasses device identifier DID, and timestamp TS to encapsulate a set of short-term valid ciphertext, that is, token information, through the unified identity authentication module in the metering operation management system. The generation process can be represented as formula (4):

[0096] Formula (4)

[0097] Wherein represents an encryption function using key K, UID is the user identity, DID is the device fingerprint information, TS is the timestamp, and ACL is the access control policy.

[0098] The token information binds the current user, device identity and job period information, and the time limit is generally controlled within four hours to balance security and practicality. The token information is automatically attached when the communication is established, without manual intervention, thereby realizing the quick authentication experience of "connect and use".

[0099] The server end generates and issues the token information to the AR glasses. The AR glasses receive the token information. The token information is valid within the target time period, for example, within 4 hours from when the AR glasses receive the token information.

[0100] In this embodiment, the token information is generated by an encryption algorithm, which can improve the security of data.

[0101] In one exemplary embodiment, as shown in Figure 3 The augmented reality device transmits the target job site image, including steps S302 to S308. Among them:

[0102] Step S302, obtain the target job site image, and identify the data in the target job site image to obtain the target measurement data.

[0103] The target measurement data is in a structured form.

[0104] Optionally, the AR glasses obtain the target job site image that has been preprocessed. The preprocessing is performed by the local processing unit of the AR glasses. The local processing unit of the AR glasses transmits the processed target job site image to the recognition algorithm module built-in the AR glasses. The recognition algorithm module includes a deep learning algorithm, such as a convolutional neural network (CNN), which has been trained with a large number of measurement data image samples and has an accuracy of not less than 98%. The recognition algorithm module identifies the measurement data (such as voltage, current, power, and electric energy meter readings) in the target job site image. After the recognition is completed, the data is automatically entered into the local storage unit of the AR glasses using a large-capacity flash memory chip. The data is stored in a structured manner and can store at least 1000 measurement data records.

[0105] In the architecture of AR glasses as an edge device, the built-in recognition algorithm module undertakes the task of real-time lightweight processing of target job site images to improve data transmission efficiency and alleviate the communication pressure between the internal and external networks caused by the isolation mechanism. The measurement data information extraction relies on deep learning AI algorithms for target detection processing, such as using the YOLO (You Only Look Once) model, which can complete the identification and positioning of target objects in the target job site image in a single forward propagation. For the measurement scene, the YOLO model is trained to identify the digital region of the electric energy meter, the on-off state of the indicator light, the scale position of the instrument panel, and other key areas. The extracted information is stored in a structured form, usually in JSON format, which converts the corresponding data fields in the original image into key-value pairs, such as {"voltage": 220, "current": 5.3, "status_light": "on"}, only retaining the necessary content that can be used for identification or backend analysis, avoiding redundant image data transmission, thereby significantly reducing bandwidth occupancy.

[0106] Step S304, obtaining reference metrology data.

[0107] Among them, the reference metrology data is extracted from the last frame of the target job site image, and the reference metrology data is in a structured form.

[0108] In practical applications, to deal with the case where the data content changes little in the periodic inspection or continuous acquisition process, the system introduces a differential compression strategy on the edge side. The basic idea is to compare the data content in the current frame with the last frame or the reference frame, and only transmit the changed part. If the structured data of continuous acquisition is represented by a vector, the target metrology data at a certain time point can be defined as , and the reference metrology data at the previous time point is .

[0109] Step S306, determining the difference data to be transmitted based on the target metrology data and the reference metrology data.

[0110] Alternatively, if the target metrology data at a certain time point is , and the reference metrology data at the previous time point is . Then the AR glasses determine the difference data to be transmitted based on the target metrology data and the reference metrology data as formula (5):

[0111] Formula (5)

[0112] Among them, represents the difference data to be transmitted, the target metrology data at the current time, The reference measurement data of the previous time point representing the current time. For example, if the current value of the current value is 5.3 A and 5.4 A, the voltage value remains 220 V unchanged, only { "current": 0.1} needs to be transmitted.

[0113] In step S308, the difference data to be transmitted is sent to the secure interaction gateway, the secure interaction gateway encrypts the difference data to be transmitted to obtain encrypted transmission data, and sends the encrypted transmission data to the server side.

[0114] Optionally, the AR glasses establish a connection with the metering operation and maintenance system through a G communication module supporting the 5G NR standard and having a data transmission rate of not less than 1Gbps.

[0115] In another real-time example, the AR glasses acquire a target job site image, identify data in the target job site image, obtain target metering data in a structured form, and send the target metering data in the structured form to a secure interaction gateway deployed at the boundary between the internal network and the external network, which is used to support conversion of the 5G transmission protocol into a secure protocol (HTTPS with TLS1.3) recognizable by the internal network and establish a temporary encrypted tunnel based on software-defined perimeter (SDP). Lightweight encryption algorithm (SM4 national encryption algorithm or AES-128) is used for structured metering data during data transmission. The AR glasses securely transmit the target metering data in the local storage unit to the metering operation and maintenance system in the internal network through the 5G network.

[0116] In one embodiment, during the process of securely transmitting the target metering data in the local storage unit to the metering operation and maintenance system in the internal network through the 5G network, for example, the TLS protocol conversion is used, the encryption algorithm module of the TLS protocol uses a symmetric encryption mechanism such as AES-128, and at the same time, the ECDHE key exchange method is combined to dynamically negotiate a session key to ensure communication security. After data encryption, its transmission is shown in formula (6):

[0117] Formula (6)

[0118] Where C is the encrypted ciphertext, M is the target metering data or the difference data to be transmitted, represents the encryption operation using the session key K. This process is completed on the gateway side to decrypt and reconstruct the protocol, realizing seamless conversion of data semantics and format between the internal network and the external network.

[0119] In another embodiment, the encryption algorithm such as SM4 or AES-128 has the characteristics of short key length, fast encryption speed, and high hardware implementation efficiency. SM4, as a national standard, adopts a 32-round iterative Feistel structure, combines permutation and substitution operations to construct a nonlinear function, and has good differential and linear analysis resistance. AES-128 is suitable for fast encryption processing of edge devices under limited computing resources through 10 rounds of sub-key transformation, byte substitution, row shifting and column confusion operations. In practical applications, the plaintext metering data or the difference data M to be transmitted is encrypted to form the ciphertext C, and its expression is shown in formula (7):

[0120] Formula (7)

[0121] Among them, represents a symmetric encryption operation using the key K to ensure that the data is not stolen during 5G link transmission.

[0122] In one embodiment, the metering operation and management system uses a distributed database to store metering data transmitted from the AR glasses and related data (marker information, audio and video records, etc.) during remote guidance. The database can store at least 1 million data records and support fast retrieval and query. The metering operation and management system uses time series analysis algorithms, clustering analysis algorithms, etc. to analyze these data, and the analysis results are displayed in the form of reports and visual charts to provide decision support for metering operation and management.

[0123] Optionally, a temporary buffer area is preset in the local storage module of the AR glasses for storing failed to-be-transmitted difference data that fails to be successfully sent during network fluctuations. If the to-be-transmitted difference data fails to be successfully sent to the secure interaction gateway or the server side, the buffer area automatically manages all failed to-be-transmitted difference data through a queue mechanism and prioritizes the to-be-transmitted difference data. The priority rule is that real-time data is higher than historical records, ensuring that important instructions and visual feedback information are processed first. After the system detects network recovery, the data retransmission is automatically scheduled according to the priority. The retransmission mechanism is based on data fragment identification with sequence number and timestamp, ensuring that there is no repetition, omission, and maintaining data consistency and integrity, effectively improving the robustness and data reliability of remote collaboration.

[0124] In this embodiment, through the differential mechanism, the differential content is usually very small in the stable device state, thereby further compressing the transmission data volume and reducing the network load. Through the cooperative work of the above-mentioned technologies, the AR glasses can realize efficient, secure, and real-time data interaction in the process of collecting, processing, and uploading data without sacrificing recognition accuracy and guidance effect, meeting the dual requirements of low latency and high security for metering operation and maintenance.

[0125] In one example embodiment, as shown in Figure 4 The augmented reality device acquires a target job site image and identifies data in the target job site image to obtain target metering data, including steps S402-S406. Among them:

[0126] Step S402, acquiring an initial job site image.

[0127] In actual application, after the metering personnel arrives at the job site area of the substation, distribution station or user end metering device, presses the power key of the AR glasses to turn on the device, the AR glasses start the job mode and automatically enter the job mode. The high-definition camera of the AR glasses image acquisition unit is automatically turned on, ready for image acquisition. The camera has wide-angle and zoom functions, and the image resolution is not less than the target pixel, such as 1920x1080 pixels.

[0128] Step S404, removing noise and enhancing contrast of the initial job site image to obtain the target job site image.

[0129] Optionally, the local processing unit of the AR glasses uses image processing algorithms such as median filter algorithm to remove noise and histogram equalization algorithm to enhance contrast to process the initial job site image, and the processing time is not more than 2 seconds.

[0130] Step S406, extracting data in the target job site image through target detection to obtain target metering data.

[0131] Optionally, the AR glasses perform target detection processing through the trained deep learning AI algorithm, for example, using the YOLO (You Only Look Once) model, which can complete the identification and positioning tasks of target objects in the target job site image in a single forward propagation. For metering scenarios, the YOLO model is trained to identify key areas such as digital regions of electric energy meters, on-off states of indicator lights, and dial scale positions. The extracted information is stored in a structured form, usually in JSON format, to obtain the target metering data.

[0132] In this embodiment, by extracting the target metering data from the initial job site image as the basis for interaction between the augmented reality device and the server, remote collaboration using the augmented reality device can be achieved.

[0133] In one example embodiment, the secure interaction gateway receives the mark information, and encrypts the mark information, including: processing the mark information through a secure hash algorithm to generate a first digest; digitally signing the first digest through a remote expert private key to obtain encrypted mark information.

[0134] Optionally, the secure interaction gateway receives the mark information, encrypts the mark information, including: processing the mark information through a secure hash algorithm to generate a first digest; digitally signing the first digest through a remote expert private key to obtain encrypted mark information, and sending the encrypted mark information to the augmented reality device through a first encrypted transmission channel.

[0135] A combination mechanism of hash check and digital signature is adopted. The secure interaction gateway generates a digest H(D) of the mark data D using a secure hash algorithm, and then digitally signs the digest through a remote expert private key to form a signature value . The specific formula is as follows formula (8):

[0136] Formula (8)

[0137] Where S K is a signature private key, H(D) is a digest value generated by a hash function on mark data, and S is a generated digital signature.

[0138] Optionally, the secure interaction gateway sends the encrypted mark information to the augmented reality device through the first encrypted transmission channel; the augmented reality device is configured to decrypt the encrypted mark information using a remote expert public key to obtain a second digest; under the condition that the second digest is the same as the first digest, the second digest is processed through a secure hash algorithm to obtain the mark information, the mark information is superimposed on the work site picture, and the work site picture after superimposing the mark information is displayed.

[0139] In this embodiment, the combination mechanism of hash check and digital signature has the advantages of small processing overhead and simple transmission structure while ensuring data authenticity, and is suitable for real-time needs of AR glasses in remote collaboration scenarios. The overall transmission mechanism realizes the unification of low computing resource occupation and high transmission efficiency under the premise of maintaining high security level.

[0140] In one example embodiment, a metering operation and maintenance system includes an augmented reality device, a secure interaction gateway and a server end. The augmented reality device is deployed in an external network. The secure interaction gateway is deployed at the boundary between an internal network and the external network. The server end is deployed in the internal network. The augmented reality device is configured to initiate a remote guidance request to the server end, the remote guidance request carrying authentication information and token information. The authentication information is generated by the augmented reality device based on biometric information and an augmented reality device identifier. The token information is generated and issued by the server end based on a user identifier, the augmented reality device identifier and a timestamp. The server end is configured to receive the remote guidance request initiated by the augmented reality device. In the case that the authentication information and the token information pass the audit, the server end is configured to send a channel establishment instruction to the secure interaction gateway. The secure interaction gateway is configured to receive the channel establishment instruction sent by the server end, and establish a first encrypted transmission channel between the secure interaction gateway and the augmented reality device, and a second encrypted transmission channel between the secure interaction gateway and the server end, in response to the remote guidance request. The augmented reality device is further configured to send job site picture data to the secure interaction gateway through the first encrypted transmission channel. The secure interaction gateway is further configured to receive the job site picture data sent by the augmented reality device through the first encrypted transmission channel, and forward the job site picture data to the server end through the second encrypted transmission channel. The server end is further configured to receive the job site picture data sent by the secure interaction gateway through the second encrypted transmission channel, and convert the job site picture data into a job site picture. In response to an operation instruction, the server end is configured to generate mark information based on the job site picture, and send the mark information to the secure interaction gateway through the second encrypted transmission channel. The secure interaction gateway is further configured to encrypt the mark information, and send the encrypted mark information to the augmented reality device through the first encrypted transmission channel. The augmented reality device is further configured to decrypt the encrypted mark information, obtain the mark information, superimpose the mark information on the job site picture, and display the job site picture with the superimposed mark information.

[0141] It should be understood that, although the steps in the flowcharts involved in the above-described embodiments are shown in sequence according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least some of the steps in the flowcharts involved in the above-described embodiments can include multiple steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be executed in rotation or alternation with at least some of the other steps or the steps or stages in the other steps.

[0142] Based on the same inventive concept, the embodiment of the present application also provides a first metering operation and maintenance device for implementing the metering operation and maintenance method. The first metering operation and maintenance device is applied to an augmented reality device and includes a sending module, a data transmission module, and a decryption display module.

[0143] The sending module is configured to initiate a remote guidance request to a server end, and the remote guidance request carries authentication information and token information. The authentication information is generated by the augmented reality device based on biological identification information and augmented reality device identification. The token information is generated and issued by the server end based on a user identity, augmented reality device identification, and a timestamp.

[0144] The data transmission module is configured to send job site picture data to a secure interaction gateway through a first encrypted transmission channel.

[0145] The decryption display module is configured to decrypt encrypted marker information to obtain the marker information, superimpose the marker information on the job site picture, and display the job site picture after superimposing the marker information.

[0146] In an exemplary embodiment, the identification information sending and token information receiving module is configured to send the obtained user identity, augmented reality device identification, and timestamp to the server end. The server end is configured to encapsulate the user identity, augmented reality device identification, and timestamp using an encryption algorithm to generate token information, and send the token information to the augmented reality device. The token information sent by the server end is received.

[0147] In an exemplary embodiment, the job site image transmission module is configured to obtain a target job site image, identify data in the target job site image to obtain target metering data, obtain reference metering data, and determine to-be-transmitted difference data based on the target metering data and the reference metering data. The to-be-transmitted difference data is sent to a secure interaction gateway, the secure interaction gateway encrypts the to-be-transmitted difference data to obtain encrypted transmission data, and the encrypted transmission data is sent to the server end.

[0148] In an exemplary embodiment, the job site image transmission module is configured to obtain an initial job site image, perform noise removal and enhanced contrast processing on the initial job site image to obtain a target job site image, and extract data in the target job site image through target detection to obtain target metering data.

[0149] The embodiment of the present application also provides a second metering operation and maintenance device for implementing the metering operation and maintenance method. The second metering operation and maintenance device is applied to a server end and includes a receiving module, an auditing module, a conversion module, and a response sending module.

[0150] The receiving module is configured to receive a remote guidance request initiated by the augmented reality device; the remote guidance request carries authentication information and token information; the authentication information is generated by the augmented reality device based on biometric information and an augmented reality device identifier; and the token information is generated by the server side based on a user identifier, an augmented reality device identifier, and a timestamp, and is delivered to the augmented reality device.

[0151] The auditing module is configured to send a channel establishment instruction to the secure interaction gateway if the authentication information and the token information pass the audit.

[0152] The conversion module is configured to receive job site picture data sent by the secure interaction gateway through the second encrypted transmission channel, and convert the job site picture data into a job site picture; the job site picture data is sent by the augmented reality device through the first encrypted transmission channel.

[0153] The response sending module is configured to, in response to an operation instruction, generate mark information based on the job site picture, and send the mark information to the secure interaction gateway through the second encrypted transmission channel; the gateway is configured to encrypt the mark information, and send the encrypted mark information to the augmented reality device through the first encrypted transmission channel.

[0154] Embodiments of the present application also provide a third metering and operation device for implementing the metering and operation method described above. The third metering and operation device is applied to a secure interaction gateway. The third metering and operation device comprises a receiving module, an auditing module, a conversion module, and a response sending module, wherein:

[0155] The receiving module is configured to receive a channel establishment instruction sent by the server side; the channel establishment instruction is sent by the server side to the secure interaction gateway if the authentication information and the token information pass the audit.

[0156] The establishment module is configured to establish a first encrypted transmission channel between the secure interaction gateway and the augmented reality device, and a second encrypted transmission channel between the secure interaction gateway and the server side, to respond to the remote guidance request, according to the channel establishment instruction.

[0157] The receiving and forwarding module is configured to receive job site picture data sent by the augmented reality device through the first encrypted transmission channel, and forward the job site picture data to the server side through the second encrypted transmission channel; the server side is configured to receive the job site picture data and convert the job site picture data into a job site picture, generate mark information based on the job site picture in response to an operation instruction, and send the mark information to the secure interaction gateway through the second encrypted transmission channel.

[0158] The encryption sending module is configured to receive the mark information, encrypt the mark information, and send the encrypted mark information to the augmented reality device through a first encryption transmission channel; and the augmented reality device is configured to decrypt the encrypted mark information to obtain the mark information, superimpose the mark information on a work site image, and display the work site image with the superimposed mark information.

[0159] In an example embodiment, the encryption sending module is further configured to process the mark information through a secure hash algorithm to generate a first digest, and digitally sign the first digest through a remote expert private key to obtain the encrypted mark information.

[0160] The modules in the first metering operation and maintenance device, the second metering operation and maintenance device, and the third metering operation and maintenance device can be all or partially implemented by software, hardware, or a combination thereof. The modules can be embedded in or independent of a processor in a computer device in hardware form, or stored in a memory in the computer device in software form, so as to be called and executed by a processor to perform operations corresponding to the modules.

[0161] In an example embodiment, a computer device, which can be a server, is provided, and an internal structure diagram of the computer device can be as shown in Figure 5 The computer device includes a processor, a memory, an input / output interface (I / O), and a communication interface. The processor, the memory, and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for running the operating system and the computer program in the non-volatile storage medium. The database of the computer device is configured to store operation and maintenance metering data. The input / output interface of the computer device is configured to exchange information between the processor and external devices. The communication interface of the computer device is configured to communicate with external terminals through a network connection. The computer program is executed by the processor to implement a metering operation and maintenance method.

[0162] Those skilled in the art can understand that Figure 5 the structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. A specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0163] In an embodiment, a computer device is also provided, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

[0164] In an embodiment, a computer readable storage medium is provided, which stores a computer program, and the computer program is executed by a processor to implement the steps in the above method embodiments.

[0165] In an embodiment, a computer program product is provided, which comprises a computer program, and the computer program is executed by a processor to implement the steps in the above method embodiments.

[0166] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when executed, can include the processes of the above-mentioned embodiment methods. Any reference to memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. The non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. The volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration but not limitation, the RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., without being limited thereto.

[0167] The technical features of the above embodiments can be combined in any manner. To make the description concise, all possible combinations of the technical features in the above embodiments are not described, but as long as the combinations of the technical features do not exist, they should be considered as the scope of the present application.

[0168] The above-described embodiments are merely illustrative of several embodiments of the present application, and the description is relatively specific and detailed, but should not be understood as a limitation on the scope of the patent. It should be noted that for those skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the scope of the present application. Therefore, the scope of protection of the present application should be subject to the appended claims.

Claims

1. A metering operation and maintenance method, characterized in that, Applied to augmented reality devices, the method includes: A remote guidance request is initiated to the server. This request carries authentication information and a token. The authentication information is generated by the augmented reality device (ARD) based on biometric information and an ARD device identifier. The token information is generated and issued by the server based on the user's identity identifier, the ARD device identifier, and a timestamp. Upon successful verification of the authentication and token information, the server sends a channel establishment instruction to a secure interaction gateway. The secure interaction gateway establishes a first encrypted transmission channel between itself and the ARD device, and a second encrypted transmission channel between itself and the server, in response to the remote guidance request. The server is deployed on an intranet, and the ARD device is deployed on an extranet. The secure interaction gateway is deployed at the boundary between the intranet and the extranet. The work site image data is sent to the secure interaction gateway through the first encrypted transmission channel; the secure interaction gateway forwards the work site image data to the server through the second encrypted transmission channel; the server receives the work site image data and converts it into a work site image, responds to an operation command, generates marking information based on the work site image, and sends the marking information to the secure interaction gateway through the second encrypted transmission channel; the secure interaction gateway encrypts the marking information and sends the encrypted marking information to the augmented reality device through the first encrypted transmission channel. The encrypted tagging information is decrypted to obtain the tagging information. The tagging information is then overlaid onto the work site image, and the work site image after overlaying the tagging information is displayed.

2. The method according to claim 1, characterized in that, Before initiating the remote guidance request to the server, the following steps are included: The system sends the acquired user identity identifier, augmented reality device identifier, and timestamp to the server; the server uses an encryption algorithm to encapsulate the user identity identifier, augmented reality device identifier, and timestamp to generate the token information; and sends the token information to the augmented reality device. Receive the token information sent by the server.

3. The method according to claim 1, characterized in that, The method further includes: Acquire images of the target work site and identify data in the images to obtain target measurement data; Acquire benchmark measurement data; wherein the benchmark measurement data is extracted from the previous frame of the target work site image; Based on the target measurement data and the benchmark measurement data, the difference data to be transmitted is determined; The differential data to be transmitted is sent to the secure interaction gateway, which encrypts the differential data to obtain encrypted transmission data, and then sends the encrypted transmission data to the server.

4. The method according to claim 3, characterized in that, The step of acquiring the target work site image and identifying the data in the target work site image to obtain the target measurement data includes: Acquire initial images of the work site; The initial work site image is subjected to noise removal and contrast enhancement processing to obtain the target work site image; The target measurement data is obtained by extracting data from the target work site image through target detection.

5. A metering operation and maintenance method, characterized in that, Applied to the server side, the method includes: The server receives a remote guidance request initiated by an augmented reality device. The remote guidance request carries authentication information and token information. The authentication information is generated by the augmented reality device based on biometric information and an augmented reality device identifier. The token information is generated by the server based on the user's identity identifier, the augmented reality device identifier, and a timestamp, and then sent to the augmented reality device. If the authentication information and the token information are approved, a channel establishment instruction is sent to the secure interaction gateway. The secure interaction gateway is used to establish a first encrypted transmission channel between the secure interaction gateway and the augmented reality device, and a second encrypted transmission channel between the secure interaction gateway and the server, in response to the remote guidance request. The server is deployed on the intranet, and the augmented reality device is deployed on the extranet. The secure interaction gateway is deployed at the boundary between the intranet and the extranet. The augmented reality device receives the work site image data sent by the secure interactive gateway through the second encrypted transmission channel and converts it into a work site image; the work site image data is sent by the augmented reality device through the first encrypted transmission channel. In response to an operation command, marking information is generated based on the work site image, and the marking information is sent to the secure interaction gateway through the second encrypted transmission channel; the secure interaction gateway is used to encrypt the marking information, and send the encrypted marking information to the augmented reality device through the first encrypted transmission channel; the augmented reality device is used to decrypt the encrypted marking information to obtain the marking information, overlay the marking information onto the work site image, and display the work site image after overlaying the marking information.

6. A metering operation and maintenance method, characterized in that, Applied to a secure interaction gateway, the method includes: The system receives a channel establishment instruction from the server. This instruction is sent by the server to the secure interaction gateway after the authentication and token information have been verified. The authentication and token information are obtained by the server based on a remote guidance request, which is sent by the augmented reality device to the server. The authentication information is generated by the augmented reality device based on biometric information and the device identifier. The token information is generated by the server based on the user's identity identifier, the device identifier, and a timestamp, and then sent to the device. The server is deployed on an intranet, and the augmented reality device is deployed on an extranet. The secure interaction gateway is deployed at the boundary between the intranet and the extranet. The secure interactive gateway and the augmented reality device establish a first encrypted transmission channel and a second encrypted transmission channel between the secure interactive gateway and the server according to the channel establishment instruction, in response to the remote guidance request. The system receives the work site image data sent by the augmented reality device through the first encrypted transmission channel, and forwards the work site image data to the server through the second encrypted transmission channel; the server receives the work site image data and converts it into a work site image, responds to the operation command, generates marking information based on the work site image, and sends the marking information to the secure interaction gateway through the second encrypted transmission channel; The system receives the tagging information, encrypts the tagging information, and sends the encrypted tagging information to the augmented reality device through the first encrypted transmission channel. The augmented reality device decrypts the encrypted tagging information to obtain the tagging information, overlays the tagging information onto the work site image, and displays the work site image after overlaying the tagging information.

7. The method according to claim 6, characterized in that, Receiving the tag information and encrypting the tag information includes: The tagging information is processed using a secure hash algorithm to generate a first digest; The first digest is digitally signed using a remote expert's private key to obtain encrypted tag information.

8. A metering operation and maintenance system, characterized in that, include: Augmented reality device, secure interactive gateway, and server, wherein the augmented reality device is deployed on an external network; The server is deployed on an intranet. The secure interaction gateway is deployed at the boundary between the intranet and the extranet; The augmented reality device is used to initiate a remote guidance request to the server. The remote guidance request carries authentication information and token information. The authentication information is generated by the augmented reality device based on biometric information and the augmented reality device identifier. The token information is generated and issued by the server based on the user's identity identifier, the augmented reality device identifier, and a timestamp; The server is used to receive remote guidance requests initiated by augmented reality devices; If the authentication information and the token information are approved, a channel establishment instruction is sent to the security interaction gateway; The secure interaction gateway is used to receive channel establishment instructions sent by the server. The secure interactive gateway and the augmented reality device establish a first encrypted transmission channel and a second encrypted transmission channel between the secure interactive gateway and the server according to the channel establishment instruction, in response to the remote guidance request. The augmented reality device is also used to send on-site work data to the secure interactive gateway via the first encrypted transmission channel; The secure interactive gateway is also used to receive the work site image data sent by the augmented reality device through the first encrypted transmission channel, and forward the work site image data to the server through the second encrypted transmission channel; The server is also used to receive the work site image data sent by the security interaction gateway through the second encrypted transmission channel, and convert it into a work site image; in response to the operation command, generate marking information based on the work site image, and send the marking information to the security interaction gateway through the second encrypted transmission channel; The secure interaction gateway is also used to encrypt the tagging information and send the encrypted tagging information to the augmented reality device through the first encrypted transmission channel; The augmented reality device is also used to decrypt the encrypted marking information to obtain the marking information, overlay the marking information onto the work site scene, and display the work site scene after overlaying the marking information.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

Images