Operation method, device, system and storage medium based on multiple anti-error verification

By introducing multiple anti-error verification methods into the intelligent anti-error robot system and combining five-prevention logic, image and video analysis, the problem of insufficient reliability of a single anti-error verification method is solved, the safety and reliability of electrical equipment switching operations are improved, and the operation and maintenance efficiency is thereby improved.

CN115907626BActive Publication Date: 2025-09-30ZHUHAI UNITECH POWER TECHNOLOGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111154869.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-09-29
Publication Date
2025-09-30
Estimated Expiration
2041-09-29

AI Technical Summary

Technical Problem

The existing single anti-error verification method has insufficient reliability in unmanned substations, resulting in low safety and reliability of intelligent anti-error robots in switching operations of electrical equipment, which in turn leads to low operation and maintenance efficiency.

Method used

Multiple error-proofing verification methods are adopted, including obtaining the target operation task sequence and performing five-prevention logic verification, combined with real-time image and video analysis of the equipment, and verification through various methods to ensure the accuracy and safety of the operation.

Benefits of technology

The safety and reliability of the intelligent anti-error robot's switching operation of electrical equipment are improved, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115907626B_ABST
    Figure CN115907626B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of power safety technology, and provides an operation method, device, system and storage medium based on multiple anti-error verification, which is used to improve the operation and maintenance efficiency of electrical equipment switching operations. The operation method based on multiple anti-error verification includes: obtaining a target operation task sequence, and issuing a target operation task instruction to a preset intelligent anti-error robot; obtaining a real-time image of the device to be operated; performing a device status check on the real-time image of the device, and when the device status check passes, obtaining a target single-step operation sequence; performing a five-prevention logic check on the target single-step operation sequence, and when the five-prevention logic check of the target single-step operation sequence passes, sending a first indication message to the intelligent anti-error robot; obtaining the current device operation video of the intelligent anti-error robot; receiving a task completion request sent by the intelligent anti-error robot, and sending a task completion confirmation instruction to the intelligent anti-error robot.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of power safety technology, and in particular to an operation method, device, system and storage medium based on multiple anti-error verification. Background Art

[0002] With the ever-increasing demand for electricity in recent years, the manual operation and maintenance model of traditional substations has become unable to meet the grid's maintenance needs. Unmanned substations have become a growing trend in substation management. Currently, unmanned substation management is being implemented by comparing on-site signage and voice information collected by robots with pre-set external data and performing logic verification to prevent accidental robot switching operations.

[0003] However, the above method is to perform logical verification after comparison through various information, and realize a single anti-error verification method. The single anti-error verification method has the problem of insufficient reliability. As a result, the intelligent anti-error robot has low safety and reliability in the switching operation of electrical equipment, which leads to low operation and maintenance efficiency of the switching operation of electrical equipment. Summary of the Invention

[0004] The present invention provides an operation method, device, equipment and storage medium based on multiple anti-error verification, which are used to improve the operation and maintenance efficiency of switching operations of electrical equipment.

[0005] A first aspect of the present invention provides an operation method based on multiple error prevention checks, which is applied to a business system and includes:

[0006] Obtain the target operation task sequence and issue the target operation task instructions to the preset intelligent anti-error robot;

[0007] Obtain real-time images of the equipment to be operated;

[0008] Performing a device status check on the real-time image of the device, and obtaining a target single-step operation sequence when the device status check passes;

[0009] Performing a five-prevention logic check on the target single-step operation sequence, and sending a first instruction message to the intelligent error-preventing robot when the five-prevention logic check of the target single-step operation sequence passes;

[0010] Obtaining a current device operation video of the intelligent anti-error robot, verifying the current device operation video, and sending a second instruction message to the intelligent anti-error robot;

[0011] Receive a task completion request sent by the intelligent error-preventing robot, and send a task completion confirmation instruction to the intelligent error-preventing robot.

[0012] Optionally, in a first implementation of the first aspect of the present invention, obtaining a target operation task sequence and issuing target operation task instructions to a preset intelligent error-preventing robot includes:

[0013] Acquire an initial operation task sequence, perform a five-prevention logic check on the initial operation task sequence, obtain a target operation task sequence that passes the five-prevention logic check, and generate a target operation task instruction, wherein the target operation task instruction includes the target operation task sequence;

[0014] Based on the target task execution mode, the target operation task sequence is issued to the preset intelligent error-preventing robot, and the target task execution mode is a step-by-step operation mode.

[0015] Optionally, in a second implementation of the first aspect of the present invention, when the target task execution mode is a step-by-step operation mode, performing a five-prevention logic check on the target single-step operation sequence, and when the five-prevention logic check of the target single-step operation sequence passes, sending a first indication message to the intelligent error-preventing robot includes:

[0016] Performing five-prevention logic verification on the target single-step operation sequence;

[0017] When the five-prevention logic check of the target single-step operation sequence passes, the first indication message including the second device operation instruction is sent to the intelligent anti-error robot, so that the intelligent anti-error robot performs the target single-step operation sequence on the device to be operated based on the first indication message and generates a current device operation video.

[0018] Optionally, in a third implementation of the first aspect of the present invention, when the target task execution mode is a step-by-step operation mode, obtaining a current device operation video of the intelligent error-preventing robot, verifying the current device operation video, and sending a second instruction message to the intelligent error-preventing robot includes:

[0019] Obtaining a current device operation video of the intelligent anti-error robot;

[0020] Performing an operation process analysis and a device status analysis on the current device operation video to obtain operation video analysis information, wherein the operation video analysis information includes operation process information and device status information;

[0021] Determining whether the operation video analysis information meets preset conditions;

[0022] If the operation video analysis information meets the preset conditions, a second instruction message including a continue operation instruction will be sent to the intelligent anti-error robot, so that the intelligent anti-error robot can determine whether there is a next single-step operation sequence, and continue to execute the next single-step operation sequence or return a task completion request based on the judgment result.

[0023] Optionally, in a fourth implementation of the first aspect of the present invention, after determining whether the operation video analysis information meets a preset condition, the method further includes:

[0024] If the operation video analysis information does not meet the preset conditions, a repeated operation instruction is triggered and sent to the intelligent anti-error robot, and a new operation video returned by the intelligent anti-error robot after re-executing the target single-step operation sequence based on the repeated operation instruction is received.

[0025] Optionally, in a fifth implementation of the first aspect of the present invention, obtaining a target operation task sequence and issuing target operation task instructions to a preset intelligent error-preventing robot includes:

[0026] Acquire an initial operation task sequence, perform a five-prevention logic check on the initial operation task sequence, obtain a target task operation sequence that passes the five-prevention logic check, and generate a target operation task instruction, wherein the target operation task instruction includes the target task operation sequence and a first device operation instruction;

[0027] Based on the target task execution mode, the target task operation sequence and the first device operation instruction are issued to the preset intelligent error-preventing robot, and the target task execution mode is a sequential control operation mode.

[0028] Optionally, in a sixth implementation of the first aspect of the present invention, when the target task execution mode is the sequential control operation mode, performing a five-prevention logic check on the target single-step operation sequence, and when the five-prevention logic check of the target single-step operation sequence passes, sending a first indication message to the intelligent error-preventing robot includes:

[0029] Performing five-prevention logic verification on the target single-step operation sequence;

[0030] When the five-prevention logic check of the target single-step operation sequence passes, the first indication message containing the result of the check is sent to the intelligent anti-error robot, so that the intelligent anti-error robot performs the operation of the target single-step operation sequence on the device to be operated based on the first indication message, and generates a current device operation video of the operation execution.

[0031] Optionally, in a seventh implementation of the first aspect of the present invention, when the target task execution mode is a sequential control operation mode, obtaining a current device operation video of the intelligent error-preventing robot, verifying the current device operation video, and sending a second instruction message to the intelligent error-preventing robot includes:

[0032] Obtaining a current device operation video of the intelligent anti-error robot;

[0033] Performing an operation process analysis and a device status analysis on the current device operation video to obtain operation video analysis information, wherein the operation video analysis information includes operation process information and device status information;

[0034] Determining whether the operation video analysis information meets preset conditions;

[0035] If the operation video analysis information meets the preset conditions, a second indication message including the result that meets the preset conditions will be sent to the intelligent anti-error robot, so that the intelligent anti-error robot can determine whether there is a next single-step operation sequence, and continue to execute the next single-step operation sequence or return a task completion request based on the judgment result.

[0036] Optionally, in an eighth implementation manner of the first aspect of the present invention, after determining whether the operation video analysis information meets a preset condition, the method further includes:

[0037] When the operation video analysis information does not meet the preset conditions, the result of not meeting the preset conditions is sent to the intelligent anti-error robot, so that the intelligent anti-error robot suspends the execution of the task.

[0038] Optionally, in a ninth implementation of the first aspect of the present invention, performing device status verification on the real-time image of the device, and obtaining a target single-step operation sequence when the device status verification passes, includes:

[0039] Performing device status recognition on the real-time image of the device to obtain the device image status;

[0040] Acquire the device acquisition state of the device to be operated, and compare the device image state with the device acquisition state to obtain a comparison result;

[0041] When the comparison result shows that the device image state is consistent with the device acquisition state, the step sequence of the current operation is obtained from the target operation task sequence to obtain a target single-step operation sequence.

[0042] A second aspect of the present invention provides an operation method based on multiple error prevention checks, which is applied to an intelligent error prevention robot, comprising:

[0043] Receive a target operation task instruction sent by a preset business system, and obtain information about the device to be operated based on the target operation task instruction;

[0044] Based on the information of the device to be operated, navigate to the location of the device to be operated, collect a real-time image of the device to be operated, and send the real-time image of the device to be operated and an operation request to the business system;

[0045] receiving a first instruction message sent by the business system, performing the target single-step operation sequence on the device to be operated and generating a current device operation video, and sending the current device operation video to the business system;

[0046] receiving a second indication message sent by the business system, and determining whether there is a next single-step operation sequence, and if so, continuing to execute the next single-step operation sequence;

[0047] Receive the mission completion confirmation instruction sent by the business system and automatically return to the initial position.

[0048] Optionally, in a first implementation manner of the second aspect of the present invention, the receiving a target operation task instruction sent by a preset business system and obtaining information of the device to be operated based on the target operation task instruction includes:

[0049] Based on the target task execution mode, receiving the target operation task instruction sent by the preset business system, the target task execution mode is a step-by-step operation mode, and the target operation task instruction includes a target operation task sequence;

[0050] The information of the device to be operated is obtained based on the target operation task sequence.

[0051] Optionally, in a second implementation of the second aspect of the present invention, when the target task execution mode is a step-by-step operation mode, receiving the second indication message sent by the business system and determining whether there is a next single-step operation sequence, and if so, continuing to execute the next single-step operation sequence, further includes:

[0052] When a repeat operation instruction is received from the business system, the target single-step operation sequence is re-executed and a new operation video is generated, and the new operation video is sent to the business system.

[0053] Optionally, in a third implementation of the second aspect of the present invention, the receiving a target operation task instruction sent by a preset business system and obtaining information about the device to be operated based on the target operation task instruction includes:

[0054] Based on the target task execution mode, when receiving the target operation task sequence in the target operation task instruction sent by the preset business system, the standby state is entered, the target task execution mode is the sequential control operation mode, and the target operation task instruction includes the target operation task sequence and the first device operation instruction;

[0055] When the first device operation instruction is received, information of the device to be operated is obtained.

[0056] Optionally, in a fourth implementation of the second aspect of the present invention, when the target task execution mode is the sequential operation mode, receiving the second indication message sent by the business system and determining whether there is a next single-step operation sequence, and if so, continuing to execute the next single-step operation sequence, further includes:

[0057] When a result not meeting the preset conditions is received from the business system, the execution of the task is suspended.

[0058] A third aspect of the present invention provides a service device, including:

[0059] The issuing module is used to obtain the target operation task sequence and issue the target operation task instructions to the preset intelligent anti-error robot;

[0060] A first acquisition module is used to acquire a real-time image of the device to be operated;

[0061] A first verification module is configured to perform a device status verification on the real-time image of the device, and obtain a target single-step operation sequence when the device status verification passes;

[0062] a second verification module, configured to perform a five-prevention logic verification on the target single-step operation sequence, and send a first indication message to the intelligent error-preventing robot when the five-prevention logic verification of the target single-step operation sequence passes;

[0063] A second acquisition module is used to obtain a current device operation video of the intelligent anti-error robot, verify the current device operation video, and send a second instruction message to the intelligent anti-error robot;

[0064] The sending module is used to receive the task completion request sent by the intelligent anti-error robot and send a task completion confirmation instruction to the intelligent anti-error robot.

[0065] Optionally, in a first implementation of the third aspect of the present invention, the sending module is specifically configured to:

[0066] Acquire an initial operation task sequence, perform a five-prevention logic check on the initial operation task sequence, obtain a target operation task sequence that passes the five-prevention logic check, and generate a target operation task instruction, wherein the target operation task instruction includes the target operation task sequence;

[0067] Based on the target task execution mode, the target operation task sequence is issued to the preset intelligent error-preventing robot, and the target task execution mode is a step-by-step operation mode.

[0068] Optionally, in a second implementation of the third aspect of the present invention, the second verification module is specifically configured to:

[0069] Performing five-prevention logic verification on the target single-step operation sequence;

[0070] When the five-prevention logic check of the target single-step operation sequence passes, the first indication message including the second device operation instruction is sent to the intelligent anti-error robot, so that the intelligent anti-error robot performs the target single-step operation sequence on the device to be operated based on the first indication message and generates a current device operation video.

[0071] Optionally, in a third implementation of the third aspect of the present invention, the second acquisition module includes:

[0072] A first acquisition unit is used to acquire a current device operation video of the intelligent anti-error robot;

[0073] a first analyzing unit, configured to perform an operation process analysis and a device status analysis on the current device operation video to obtain operation video analysis information, wherein the operation video analysis information includes operation process information and device status information;

[0074] A first judging unit, configured to judge whether the operation video analysis information meets a preset condition;

[0075] The first sending unit is used to send a second instruction message including a continue operation instruction to the intelligent anti-error robot if the operation video analysis information meets the preset conditions, so that the intelligent anti-error robot can determine whether there is a next single-step operation sequence, and continue to execute the next single-step operation sequence or return a task completion request based on the result of the judgment.

[0076] Optionally, in a fourth implementation of the second aspect of the present invention, the second acquisition module further includes:

[0077] The second sending unit is used to trigger a repeated operation instruction and send the repeated operation instruction to the intelligent anti-error robot if the operation video analysis information does not meet the preset conditions, and receive a new operation video returned by the intelligent anti-error robot after re-executing the target single-step operation sequence based on the repeated operation instruction.

[0078] Optionally, in a fifth implementation of the third aspect of the present invention, the sending module is further specifically configured to:

[0079] Acquire an initial operation task sequence, perform a five-prevention logic check on the initial operation task sequence, obtain a target task operation sequence that passes the five-prevention logic check, and generate a target operation task instruction, wherein the target operation task instruction includes the target task operation sequence and a first device operation instruction;

[0080] Based on the target task execution mode, the target task operation sequence and the first device operation instruction are issued to the preset intelligent error-preventing robot, and the target task execution mode is a sequential control operation mode.

[0081] Optionally, in a sixth implementation of the third aspect of the present invention, the second verification module is further specifically configured to:

[0082] Performing five-prevention logic verification on the target single-step operation sequence;

[0083] When the five-prevention logic check of the target single-step operation sequence passes, the first indication message containing the result of the check is sent to the intelligent anti-error robot, so that the intelligent anti-error robot performs the operation of the target single-step operation sequence on the device to be operated based on the first indication message, and generates a current device operation video of the operation execution.

[0084] Optionally, in a seventh implementation of the third aspect of the present invention, the second acquisition module further includes:

[0085] A second acquisition unit is used to acquire a current device operation video of the intelligent anti-error robot;

[0086] a second analyzing unit, configured to perform an operation process analysis and a device status analysis on the current device operation video to obtain operation video analysis information, wherein the operation video analysis information includes operation process information and device status information;

[0087] A second judgment unit is used to judge whether the operation video analysis information meets the preset conditions;

[0088] The third sending unit is used to send a second indication message including a result that meets the preset conditions to the intelligent anti-error robot if the operation video analysis information meets the preset conditions, so that the intelligent anti-error robot can determine whether there is a next single-step operation sequence, and continue to execute the next single-step operation sequence or return a task completion request based on the result of the judgment.

[0089] Optionally, in an eighth implementation of the third aspect of the present invention, the second acquisition module further includes:

[0090] The fourth sending unit is used to send a result that does not meet the preset conditions to the intelligent anti-error robot when the operation video analysis information does not meet the preset conditions, so that the intelligent anti-error robot suspends the execution of the task.

[0091] Optionally, in a ninth implementation of the third aspect of the present invention, the first verification module is specifically configured to:

[0092] Performing device status recognition on the real-time image of the device to obtain the device image status;

[0093] Acquire the device acquisition state of the device to be operated, and compare the device image state with the device acquisition state to obtain a comparison result;

[0094] When the comparison result shows that the device image state is consistent with the device acquisition state, the step sequence of the current operation is obtained from the target operation task sequence to obtain a target single-step operation sequence.

[0095] A fourth aspect of the present invention provides an intelligent error-proof robot, comprising:

[0096] A receiving and obtaining module, configured to receive a target operation task instruction sent by a preset business system, and obtain information of a device to be operated based on the target operation task instruction;

[0097] a navigation collection module, configured to navigate to the location of the device to be operated based on the information of the device to be operated, collect a real-time image of the device to be operated, and send the real-time image of the device to be operated and an operation request to the business system;

[0098] a generating and sending module, configured to receive a first instruction message sent by the business system, perform the target single-step operation sequence on the device to be operated and generate a current device operation video, and send the current device operation video to the business system;

[0099] an execution module, configured to receive the second indication message sent by the business system, and determine whether there is a next single-step operation sequence, and if so, continue to execute the next single-step operation sequence;

[0100] The return module is used to receive the task completion confirmation instruction sent by the business system and automatically return to the initial position.

[0101] Optionally, in a first implementation of the fourth aspect of the present invention, the receiving and obtaining module is specifically configured to:

[0102] Based on the target task execution mode, receiving the target operation task instruction sent by the preset business system, the target task execution mode is a step-by-step operation mode, and the target operation task instruction includes a target operation task sequence;

[0103] The information of the device to be operated is obtained based on the target operation task sequence.

[0104] Optionally, in a second implementation of the fourth aspect of the present invention, the intelligent error-preventing robot further includes:

[0105] The re-execution module is used to re-execute the target single-step operation sequence and generate a new operation video when receiving a repeat operation instruction sent by the business system, and send the new operation video to the business system.

[0106] Optionally, in a third implementation of the fourth aspect of the present invention, the receiving and obtaining module is further specifically configured to:

[0107] Based on the target task execution mode, when receiving the target operation task sequence in the target operation task instruction sent by the preset business system, the standby state is entered, the target task execution mode is the sequential control operation mode, and the target operation task instruction includes the target operation task sequence and the first device operation instruction;

[0108] When the first device operation instruction is received, information of the device to be operated is obtained.

[0109] Optionally, in a fourth implementation of the fourth aspect of the present invention, the intelligent error-preventing robot further includes:

[0110] The execution suspension module is used to suspend the execution of the task when receiving a result sent by the business system that does not meet the preset conditions.

[0111] The fifth aspect of the present invention provides an operation system based on multiple anti-error checks, including: a business system and the intelligent anti-error robot as described above, the business system and the intelligent anti-error robot are network connected, and the business system includes the business device as described above.

[0112] A sixth aspect of the present invention provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer is caused to execute the above-mentioned operation method based on multiple anti-error checking.

[0113] The technical solution provided by the present invention comprises: obtaining a target operation task sequence and issuing target operation task instructions to a preset intelligent anti-error robot; obtaining a real-time image of the device to be operated; performing a device status check on the real-time image; and obtaining a target single-step operation sequence when the device status check passes. The target single-step operation sequence is then subjected to a five-prevention logic check; and when the target single-step operation sequence passes the five-prevention logic check, a first instruction message is sent to the intelligent anti-error robot; obtaining a current device operation video of the intelligent anti-error robot, verifying the current device operation video, and sending a second instruction message to the intelligent anti-error robot; and receiving a task completion request sent by the intelligent anti-error robot, and sending a task completion confirmation instruction to the intelligent anti-error robot. In this embodiment of the present invention, an anti-error check is implemented by combining five-prevention logic, image and video, and video analysis methods during anti-error (switching) operations. This solves the problem of insufficient reliability of a single anti-error check method and improves the safety and reliability of intelligent anti-error robots in the field of power anti-error operations. Specifically, the intelligent anti-error robot has low safety and reliability in switching operations of electrical equipment, thereby improving the operation and maintenance efficiency of switching operations of electrical equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0114] Figure 1 Schematic diagram of an embodiment of an operation method based on multiple anti-error verification in an embodiment of the present invention;

[0115] Figure 2 Schematic diagram of another embodiment of an operation method based on multiple error prevention checks in a step-by-step operation mode according to an embodiment of the present invention;

[0116] Figure 3 Schematic diagram of another embodiment of an operation method based on multiple anti-error checks in a sequential control operation mode according to an embodiment of the present invention;

[0117] Figure 4 Schematic diagram of the structure of an operating system based on multiple anti-error checks in an embodiment of the present invention;

[0118] Figure 5 A schematic diagram of the structure of a business system according to an embodiment of the present invention;

[0119] Figure 6 This is a schematic diagram of another embodiment of the business system in the embodiment of the present invention;

[0120] Figure 7This is a schematic structural diagram of an embodiment of an intelligent anti-error robot in an embodiment of the present invention. DETAILED DESCRIPTION

[0121] The embodiments of the present invention provide an operation method, device, system and storage medium based on multiple anti-error verification, which improve the operation and maintenance efficiency of switching operations of electrical equipment.

[0122] The terms "first," "second," "third," "fourth," and so on (if any) in the description and claims of the present invention and in the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a particular order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments described herein can be implemented in an order other than that shown or described herein. In addition, the terms "including" or "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus that includes a series of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, product, or apparatus.

[0123] For ease of understanding, the specific process of the embodiment of the present invention is described below. Figure 1 An embodiment of the operation method based on multiple anti-error verification in the embodiment of the present invention includes:

[0124] 101. Obtain the target operation task sequence and issue the target operation task instruction to the preset intelligent anti-error robot.

[0125] It is understood that the execution entity of the present invention can be an operation device based on multiple error-proofing, or a terminal or server, without limitation herein. The embodiments of the present invention are described using a server of a business system (hereinafter referred to as a business system server) as the execution entity for an operation based on multiple error-proofing.

[0126] In the operation method based on multiple anti-error verification of the present invention, the operation and maintenance personnel can remotely control the intelligent anti-error robot through the business system applied to the operation method based on multiple anti-error verification, and the intelligent anti-error robot replaces manual labor to perform the switching operation of electrical equipment. During the operation process, multiple anti-error verifications are performed by combining five-prevention logic verification, image recognition and video analysis technology.

[0127] Among them, the target operation task sequence can be a plurality of step sequences corresponding to the entire process of the intelligent anti-error robot performing the electrical equipment switching operation on the operating equipment. The target operation task sequence includes multiple single-step operation sequences. For example, taking single-step operation sequence A, single-step operation sequence B and single-step operation sequence C as examples, the single-step operation sequence A includes step a1, step a2 and step a3, the single-step operation sequence B includes step b1, step b2, step b3 and step b4, the single-step operation sequence C includes step c1, step c2, step c3, step c4 and step c5, and the single-step operation sequence A includes step a2, step a3, and step a4. The combination of step operation sequence A, single-step operation sequence B, and single-step operation sequence C constitutes a target operation task sequence. A single-step operation sequence is used to indicate the multiple sub-steps corresponding to a single major step in the target operation task sequence, i.e., a step sequence. For example, a target operation task sequence includes step sequences corresponding to two major steps (the first step and the second step). The second step corresponds to four sub-steps: sub-step d1, sub-step d2, sub-step d3, and sub-step d4. Sub-steps d1, d2, d3, and d4 together constitute a single-step operation sequence. The target operation task sequence can be stored in the blockchain.

[0128] The target operation task sequence may be an operation task sequence that has passed the five-prevention logic check. The execution process of obtaining the target operation task sequence may include: obtaining the initial operation task sequence, performing the five-prevention logic check on the initial operation task sequence, and obtaining the target operation task sequence that has passed the five-prevention logic check.

[0129] The target operation task sequence may also be an operation task sequence that has undergone anomaly detection and five-prevention logic verification. The execution process of obtaining the target operation task sequence may include: generating a corresponding initial operation task sequence based on the operation task information input by the operation and maintenance personnel by calling the Create Task Sequence Wizard; performing an abnormal event check on the time sequence and the sequential sequence in the initial operation task sequence respectively; if the abnormal event check passes, performing a five-prevention logic check on the initial operation task sequence to obtain a target operation task sequence that has passed the five-prevention logic check; if the abnormal event check fails, re-calling the Create Task Sequence Wizard based on the operation task information input by the operation and maintenance personnel to generate a corresponding new initial operation task sequence; performing an abnormal event check on the time sequence and the sequential sequence in the new initial operation task sequence respectively; repeating the execution in sequence until the abnormal event check passes; performing a five-prevention logic check on the new initial operation task sequence that has passed the abnormal event check to obtain a target operation task sequence that has passed the five-prevention logic check. Furthermore, the five-prevention logic check can be performed using a preset five-prevention logic judgment formula.

[0130] The business system server generates a target operation task instruction based on the target operation task sequence and sends the target operation task instruction to a preset intelligent anti-error robot, wherein the target operation task instruction includes the target operation task sequence of the step-by-step operation mode or the target task operation sequence of the sequential control operation mode and the first device operation instruction.

[0131] 102. Receive a target operation task instruction sent by a preset business system, and obtain information of a device to be operated based on the target operation task instruction.

[0132] After receiving the target operation task instruction, the intelligent anti-error robot navigates and moves to the current operation task sequence in the target operation task sequence or the position of the device interval where the target operation task sequence is located. The intelligent anti-error robot identifies the device and the optimal operation position of the current operation task sequence in the target operation task sequence or the device where the target operation task sequence is located, thereby obtaining the optimal operation position of the device. The information of the device to be operated may include only the optimal operation position of the device, or may include the optimal operation position of the device and the basic information of the device to be operated. The basic information of the device to be operated may include: the model, shape and components of the device to be operated.

[0133] 103. Based on the information of the device to be operated, navigate to the location of the device to be operated, collect a real-time image of the device to be operated, and send the real-time image of the device to be operated and the operation request to the business system.

[0134] The intelligent anti-error robot navigates the robotic arm or other operating parts to the optimal operating position of the equipment, that is, the information of the equipment to be operated, and collects real-time images of the equipment to be operated at the optimal operating position, thereby obtaining a real-time image of the equipment to be operated, and sends the operation request and the real-time image of the equipment to be operated to the business system server.

[0135] 104. Acquire a real-time image of the device to be operated.

[0136] The business system server receives the operation request and the real-time image of the device to be operated sent by the intelligent anti-error robot.

[0137] 105. Perform device status verification on the real-time image of the device. When the device status verification passes, obtain the target single-step operation sequence.

[0138] When the business system server receives the operation request and the real-time image of the device to be operated sent by the intelligent anti-error robot, it calls the preset image processing model to perform device status identification on the real-time image of the current device to be operated to obtain the device image status, wherein the image processing model is a neural network model based on an image processing algorithm based on deep learning or machine learning or federated learning of artificial intelligence. The image processing model can be a model composed of at least one different algorithm, and at least one different algorithm can be a target detection algorithm, an edge detection algorithm or other image processing-related algorithm, which is not limited here.

[0139] The business system server performs a device status verification on the device image status through preset verification information to obtain a status verification result, wherein the preset verification information may include the device acquisition status information of the device and / or preset status information that complies with the rules; if the status verification result is passed (indicating that the device status verification is passed, the device image status complies with the preset verification information, or the device image status is consistent with the preset verification information), the current step sequence is obtained from the target operation task sequence to obtain a target single-step operation sequence, wherein the target single-step operation sequence is used to indicate multiple sub-steps corresponding to a single major step currently to be operated in the target operation task sequence, that is, the step sequence of the current operation; if the status verification result is failed (indicating that the device status verification is failed, the device image status does not comply with the preset verification information, or the device image status is inconsistent with the preset verification information), it is not executed or waits for manual confirmation.

[0140] 106. Perform a five-prevention logic check on the target single-step operation sequence. When the five-prevention logic check of the target single-step operation sequence passes, send a first instruction message to the intelligent error-prevention robot.

[0141] The first instruction message includes an instruction indicating that the five-defense logic verification of the step-by-step operation mode has passed and an operation has been executed, i.e., a second device operation instruction, and an instruction indicating that the five-defense logic verification of the sequential control mode has passed, i.e., a verification result. The business system server invokes a preset reverse Polish algorithm to create a five-defense logic expression for the preset five-defense logic. The five-defense logic expression is used to determine and analyze the target single-step operation sequence to obtain a verification result. Alternatively, the business system server uses a preset five-defense logic judgment formula to determine and analyze the target single-step operation sequence to obtain a verification result, which may be a verification result of passing or a verification result of failing. If the verification result is a verification result of passing (i.e., the five-defense logic verification of the target single-step operation sequence has passed), the business system server responds to the operation request sent by the intelligent anti-error robot and sends the verification result of passing or the second device operation instruction to the intelligent anti-error robot, so that the intelligent anti-error robot performs the operation on the device to be operated (operates and generates a video of the current device operation) based on the target single-step operation sequence. If the verification result is a verification result of failing, an alarm is issued and the task is paused to await manual confirmation or prohibit the operation.

[0142] 107. Receive a first instruction message sent by the business system, perform a target single-step operation sequence on the device to be operated, generate a current device operation video, and send the current device operation video to the business system.

[0143] When the intelligent anti-error robot receives the first indication message sent by the business system server, it operates the device to be operated based on the target single-step operation sequence, collects the operation video of the operation process, generates the current device operation video, and returns the current device operation video to the business system server.

[0144] 108. Obtain the current device operation video of the intelligent anti-error robot, verify the current device operation video, and send a second instruction message to the intelligent anti-error robot.

[0145] The business system server obtains the current device operation video by receiving the current device operation video sent by the intelligent anti-error robot.

[0146] When the business system server receives the current equipment operation video sent by the intelligent protection robot, it calls the preset image processing model to perform image conversion, image preprocessing (including but not limited to image enhancement processing, denoising processing and grayscale value processing, etc.), image recognition, operation process sequence generation and equipment status identification after the operation on the current equipment operation video in sequence, and obtains the operation process sequence information (i.e., operation process information) and equipment status information after the operation (i.e., real-time image status of the equipment). Determine whether the operation process sequence information conforms to the operation process of the current operation task sequence (i.e., the target single-step operation sequence) in the target operation task sequence, and determine whether the device status information after the operation conforms to expectations or the operation is in place, and obtain the analysis result of the current device operation video. The analysis result of the current device operation video includes in-place information (i.e., the result that conforms to the preset conditions) and out-of-place information (i.e., the result that does not conform to the preset conditions). The in-place information is used to indicate that the operation process sequence information conforms to the operation process of the current operation task sequence (i.e., the target single-step operation sequence) in the target operation task sequence, and the device status information after the operation conforms to expectations or the operation is in place (i.e., the preset conditions). The out-of-place information is used to indicate that the operation process sequence information conforms to the operation process of the current operation task sequence (i.e., the target single-step operation sequence) in the target operation task sequence, and the device status information after the operation does not conform to expectations or the operation is not in place, so as to realize the verification of the current device operation video.

[0147] Based on the analysis results and the target task execution mode, the intelligent anti-error robot is controlled to continue to execute the next single-step operation sequence or re-execute the target single-step operation sequence or return to the initial position or suspend the task.

[0148] When the target task execution mode is a step-by-step operation mode, and the analysis result of the current device operation video is in-place information (i.e., a result that meets the preset conditions), the second instruction message includes a continue operation instruction, and the business system server sends the second instruction message including the continue operation instruction to the intelligent protection robot.

[0149] When the target task execution mode is the sequential control operation mode, and the analysis result of the current device operation video is in-place information (i.e., the result that meets the preset conditions), the second indication message includes the result that meets the preset conditions, and the business system server sends the second indication message including the result that meets the preset conditions to the intelligent protection robot.

[0150] Furthermore, when the target task execution mode is a step-by-step operation mode, and the analysis result of the current device operation video is inadequate information (i.e., a result that does not meet the preset conditions), a prohibition operation instruction or a repeat operation instruction can be sent to the intelligent anti-error robot to prohibit the intelligent anti-error robot from operating or re-execute the target single-step operation sequence and return the corresponding new operation video.

[0151] When the target task execution mode is the sequential control operation mode, and the analysis result of the current equipment operation video is inadequate information (i.e., the result does not meet the preset conditions), an alarm can be issued and the task can be suspended to wait for manual confirmation, and the inadequate information (i.e., the result does not meet the preset conditions) can be sent to the intelligent protection robot to cause the intelligent protection robot to suspend operation.

[0152] 109. Receive the second instruction message sent by the business system, and determine whether there is a next single-step operation sequence. If so, continue to execute the next single-step operation sequence.

[0153] When the intelligent protection robot receives the second indication message sent by the business system server, if the second indication message includes a continue operation instruction (that is, the target task execution mode is a step-by-step operation mode), the intelligent protection robot determines whether there is a next single-step operation sequence. If so, it executes the next single-step operation sequence based on the execution process of the above steps 104-106 and step 108. If not, it sends a task completion confirmation instruction to the business system server.

[0154] When the intelligent protection robot receives the second indication message sent by the business system server, if the second indication message includes a result that meets the preset conditions (that is, the target task execution mode is the sequential control operation mode), the intelligent protection robot determines whether there is a next single-step operation sequence. If so, it executes the next single-step operation sequence based on the execution process of the above steps 104-106 and step 108. If not, it sends a task completion confirmation instruction to the business system server.

[0155] 110. Receive a task completion request sent by the intelligent anti-error robot, and send a task completion confirmation instruction to the intelligent anti-error robot.

[0156] When the business system server receives the task completion request sent by the intelligent anti-error robot, it confirms the task completion request and sends a task completion confirmation instruction to the intelligent anti-error robot after confirmation.

[0157] 111. Receive the mission completion confirmation instruction sent by the business system and automatically return to the initial position.

[0158] When the intelligent protection robot receives the task completion confirmation instruction sent by the business system server, it automatically returns to the initial position (that is, the intelligent anti-error robot navigates and moves to the current operation task sequence in the target operation task sequence or the position before the position of the device interval where the target operation task sequence is located).

[0159] In the embodiment of the present invention, it is realized that when performing anti-error (switching) operations, anti-error verification is performed in a combination of five-prevention logic, image video and video analysis, which solves the problem of insufficient reliability of a single anti-error verification method and improves the safety and reliability of the intelligent anti-error robot in the field of power anti-error. That is, the intelligent anti-error robot has low safety and reliability in the switching operation of electrical equipment, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

[0160] See also Figure 2 Another embodiment of the operation method based on multiple anti-error verification in the step-by-step operation mode in the embodiment of the present invention includes:

[0161] 201. Obtain a target operation task sequence and issue a target operation task instruction to a preset intelligent anti-error robot.

[0162] Specifically, the business system server obtains the initial operation task sequence, performs a five-prevention logic check on the initial operation task sequence, obtains a target operation task sequence that passes the five-prevention logic check, and generates a target operation task instruction, which includes a target operation task sequence; based on the target task execution mode, the target operation task sequence is issued to the preset intelligent anti-error robot, and the target task execution mode is a step-by-step operation mode.

[0163] The operation and maintenance personnel input the specified operation task sequence (i.e., the initial operation task sequence) through the user interface (UI) corresponding to the business system server. The business system server performs a five-defense logic check on the initial operation task sequence sent by the business system user interface UI, obtaining a target operation task sequence that passes the five-defense logic check. Furthermore, the business system server generates a corresponding five-defense logic expression based on the preset five-defense logic using a preset reverse Polish expression algorithm. The five-defense logic expression is used to perform judgment and analysis on the initial operation task sequence, thereby obtaining a target operation task sequence that passes the five-defense logic check. If the five-defense logic check fails, the check result is returned, and a new operation task sequence is obtained. The five-defense logic check is performed on the new operation task sequence, and the execution is repeated in sequence until the five-defense logic check passes, obtaining the target operation task sequence.

[0164] The operation and maintenance personnel input or select the target task execution mode through the user interface corresponding to the business system. Among them, the target task execution mode is a step-by-step operation mode. The step-by-step operation mode monitors each operation process of the intelligent anti-error robot by the business system. The characteristic of this mode is that the business system issues the entire operation task sequence (i.e., the target operation task sequence). The intelligent anti-error robot needs to wait for instructions from the business system before starting each step of the operation, and needs to wait for confirmation from the business system after each step of the operation is completed.

[0165] When the target task execution mode is the step-by-step operation mode, the business system server sends the target operation task instruction as the target operation task sequence to the intelligent anti-error robot, so that the intelligent anti-error robot operates the device to be operated based on the target single-step operation sequence.

[0166] By controlling the preset intelligent anti-error robot based on the target operation task sequence that has passed the five-prevention logic verification, the device to be operated is navigated and the real-time image of the current device to be operated is collected, and the operation task sequence is pre-verified, thereby improving the accuracy of the target operation task sequence and the quality of the real-time image of the current device to be operated, avoiding invalid and redundant operations, improving operational efficiency, and improving the safety and reliability of the intelligent anti-error robot in the switching operation of electrical equipment, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

[0167] 202. Receive a target operation task instruction sent by a preset business system, and obtain information of a device to be operated based on the target operation task instruction.

[0168] Specifically, the intelligent anti-error robot receives target operation task instructions sent by a preset business system based on a target task execution mode. The target task execution mode is a step-by-step operation mode, and the target operation task instructions include a target operation task sequence; based on the target operation task sequence, the information of the device to be operated is obtained.

[0169] After receiving the target operation task instruction including the target operation task sequence, the intelligent anti-error robot navigates and moves to the current operation task sequence in the target operation task sequence or the position of the device interval where the target operation task sequence is located. The intelligent anti-error robot performs device identification and optimal operation position identification on the current operation task sequence in the target operation task sequence or the device where the target operation task sequence is located, thereby obtaining the optimal operation position of the device. The information of the device to be operated may include only the optimal operation position of the device, or may include the optimal operation position of the device and the basic information of the device to be operated. The basic information of the device to be operated may include: the model, shape and components of the device to be operated.

[0170] 203. Navigate to the location of the device to be operated based on the information of the device to be operated, collect a real-time image of the device to be operated, and send the real-time image of the device to be operated and an operation request to the business system.

[0171] The intelligent error-proof robot navigates and moves to the current operation task sequence in the target operation task sequence or the position of the device interval where the target operation task sequence is located based on the information of the device to be operated. The intelligent anti-error robot calls a preset camera and / or scanner, and uses the camera and / or scanner to image the current operation task sequence in the target operation task sequence or the device where the target operation task sequence is located to obtain an initial image or initial video, wherein the initial image includes an image generated by the camera and / or an image generated by the scanner; the intelligent anti-error robot calls a preset neural network model, and performs artificial intelligence device identification and optimal operation position identification on the initial image or initial video in sequence, thereby obtaining the optimal operation position of the device. Further, the intelligent anti-error robot calls a preset video processing model to convert the initial video into an image of each frame. The intelligent anti-error robot calls a preset neural network model, and performs image enhancement processing, device target frame identification and device operation position identification within the target frame on the initial image or each frame of the image in sequence, thereby obtaining the optimal operation position of the device; the robotic arm or other operating part is navigated to the optimal operation position of the device, and real-time image acquisition is performed on the optimal operation position of the device, thereby obtaining a real-time image of the device to be operated, and the real-time image of the device to be operated and the operation request are sent to the business system server.

[0172] 204. Acquire a real-time image of the device to be operated.

[0173] The business system server receives the operation request and the real-time image of the device to be operated sent by the intelligent anti-error robot, thereby obtaining the real-time image of the device to be operated.

[0174] 205. Perform device status verification on the real-time image of the device. When the device status verification passes, obtain the target single-step operation sequence.

[0175] Specifically, the business system server identifies the device status of the real-time image of the device to obtain the device image status; obtains the device acquisition status of the device to be operated, and compares the device image status with the device acquisition status to obtain a comparison result; when the comparison result is that the device image status is consistent with the device acquisition status, obtains the step sequence of the current operation from the target operation task sequence to obtain the target single-step operation sequence.

[0176] When the business system server receives the real-time image of the device to be operated sent by the intelligent anti-error robot, it calls the preset models for image processing, image detection and image recognition, performs image processing, device detection and device status recognition on the real-time image of the device to be operated, and obtains the device image status; obtains the device acquisition status of the device to be operated, where the device acquisition status is used to indicate the device status of self-determination, self-detection and self-acquisition of the device to be operated; compares the device image status with the device acquisition status, that is, determines whether the device image status is consistent with the device acquisition status, and thus obtains the comparison result;

[0177] If the comparison result shows that the device image state is consistent with the device acquisition state, the step sequence of the current operation is obtained from the target operation task sequence to obtain the target single-step operation sequence. If the comparison result shows that the device image state is inconsistent with the device acquisition state, the operation is prohibited, that is, unlocking is prohibited.

[0178] By identifying the device status of the real-time image of the current device to be operated and obtaining the target single-step operation sequence based on the comparison results, further multi-dimensional anti-error verification is achieved, and invalid redundant operations are avoided, thereby improving operational efficiency and improving the safety and reliability of the intelligent anti-error robot in the switching operation of electrical equipment, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

[0179] 206. Perform a five-prevention logic check on the target single-step operation sequence. When the five-prevention logic check of the target single-step operation sequence passes, send a first instruction message to the intelligent error-prevention robot.

[0180] Specifically, the business system server performs a five-prevention logic check on the target single-step operation sequence; when the five-prevention logic check of the target single-step operation sequence passes, a first indication message including a second device operation instruction is sent to the intelligent anti-error robot, so that the intelligent anti-error robot performs the target single-step operation sequence on the device to be operated based on the first indication message and generates a current device operation video.

[0181] The business system server calls the preset binary tree algorithm, creates a preset five-defense logic binary tree, performs post-order traversal on the binary tree, and obtains the five-defense logic expression; the target single-step operation sequence is judged and analyzed through the five-defense logic expression to realize the five-defense logic verification of the target single-step operation sequence.

[0182] When the target single-step operation sequence passes the five-prevention logic verification and the target task execution mode is the step-by-step operation mode, the operation and maintenance personnel click or select the corresponding button through the corresponding user interface of the business system. Through this button, a request to start the operation instruction is sent to the business system server. Based on the request to start the operation instruction, the business system server sends a second device operation instruction to the intelligent anti-error robot to trigger the second device operation instruction and send the second device operation instruction to the intelligent anti-error robot. The business system server receives the result returned by the intelligent anti-error robot based on the verification result, performs the target single-step operation sequence on the device to be operated, and generates the current device operation video and operation results of the operation execution. If the target single-step operation sequence fails the five-prevention logic verification, the intelligent anti-error robot is prohibited from operating.

[0183] 207 : Receive the first instruction message sent by the business system, perform the target single-step operation sequence on the device to be operated and generate a current device operation video, and send the current device operation video to the business system.

[0184] When the intelligent anti-error robot receives a first instruction message including a second device operation instruction from the business system server, it enters the start operation state and performs the operation on the device to be operated based on the target single-step operation sequence. It also calls a preset camera and video recording tool to capture the operation execution process. When the operation is detected to be complete, the operation result is generated, and the video capture is stopped. The current device operation video is obtained and the operation result and current device operation video are returned to the business system server. If the target single-step operation sequence fails the five-prevention logic check, the intelligent anti-error robot prohibits the operation.

[0185] 208. Obtain the current device operation video of the intelligent anti-error robot.

[0186] The business system server obtains the current device operation video by receiving the current device operation video sent by the intelligent anti-error robot.

[0187] By obtaining the current equipment operation video of the intelligent anti-error robot based on the verification results and the target task execution mode, further anti-error verification and flexible operation in different execution modes are achieved, which improves the execution flexibility, operation efficiency and multiplicity of verification, improves the safety and reliability of the intelligent anti-error robot's switching operation of electrical equipment, and improves the quality and effectiveness of the current equipment operation video, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

[0188] 209. Perform an operation process analysis and a device status analysis on the current device operation video to obtain operation video analysis information, where the operation video analysis information includes operation process information and device status information.

[0189] When the business system server receives the current equipment operation video sent by the intelligent protection robot, it calls the preset image processing model to perform image conversion, image preprocessing (including but not limited to image enhancement processing, denoising processing and grayscale value processing, etc.), image recognition, operation process sequence generation and equipment status identification after the operation on the current equipment operation video in sequence, and obtains the operation process information and equipment status information, that is, the operation video analysis information.

[0190] 210. Determine whether the operation video analysis information meets the preset conditions.

[0191] The preset conditions include judgment conditions corresponding to operation process information and device status information. For example, the judgment condition corresponding to the operation process information is whether the operation process sequence information conforms to the operation process of the current operation task sequence (i.e., the target single-step operation sequence) in the target operation task sequence. The judgment condition corresponding to the device status information is whether the device status information after the operation meets expectations or the operation is complete. The business system server can use a preset discrimination algorithm to classify the operation video analysis information based on the preset conditions to determine whether the operation video analysis information conforms to the preset conditions. The discrimination algorithm can be a logistic regression algorithm or a decision tree algorithm, which is not limited here.

[0192] 211. If the operation video analysis information meets the preset conditions, a second instruction message including a continue operation instruction will be sent to the intelligent anti-error robot, so that the intelligent anti-error robot can determine whether there is a next single-step operation sequence, and continue to execute the next single-step operation sequence or return a task completion request based on the judgment result.

[0193] When the operation video analysis information meets the preset conditions and the target task execution mode is the step-by-step operation mode, the operation and maintenance personnel send an instruction issuance request to the business system server through the user interface of the business system. Based on the issuance request, the business system server sends a second instruction message including a continue operation instruction to the intelligent anti-error robot, so that the intelligent anti-error robot determines whether there is a next single-step operation sequence. If so, when the business system server receives the execution result after continuing to execute the next single-step operation sequence returned by the intelligent anti-error robot based on the judgment result (the execution result after continuing to execute the next single-step operation sequence can be the operation video after continuing to execute the next single-step operation sequence, that is, corresponding to the execution process of the above steps 204-206 and steps 208-210 to realize the operation of the next single-step operation sequence), the execution result after continuing to execute the next single-step operation sequence is analyzed. The operation process and device status analysis are analyzed to obtain analysis information of the next single-step operation sequence operation, and determine whether the analysis information of the next single-step operation sequence operation meets the preset conditions; if not, the business system server receives the task completion request sent back by the intelligent protection robot.

[0194] When the operation video analysis information meets the non-preset conditions and the target task execution mode is the step-by-step operation mode, the business system server triggers the repeated operation instruction and sends the repeated operation instruction to the intelligent anti-error robot, and receives the new operation video returned by the intelligent anti-error robot after re-executing the target single-step operation sequence based on the repeated operation instruction.

[0195] 212. Receive the second instruction message sent by the business system, and determine whether there is a next single-step operation sequence. If so, continue to execute the next single-step operation sequence;

[0196] The intelligent protection robot receives a second indication message sent by the business system server, where the second indication message includes a continue operation instruction, and determines whether there is a next single-step operation sequence. If so, the execution process of steps 203 and 207 is executed to continue executing the next single-step operation sequence based on the target single-step operation sequence, and the execution result after continuing to execute the next single-step operation sequence is returned to the business system server. The execution result after continuing to execute the next single-step operation sequence may be an operation video after continuing to execute the next single-step operation sequence. When the judgment result of the analysis information of the next single-step operation sequence operation sent by the business system server is received (whether the analysis information of the next single-step operation sequence operation meets the preset conditions), if the judgment result of the analysis information of the next single-step operation sequence operation is no, the execution process of steps 203 and 207 is executed. If the judgment result of the analysis information of the next single-step operation sequence operation is yes, subsequent operations are performed according to the execution result after the next single-step operation sequence; if not, the intelligent protection robot returns a task completion request to the business system server.

[0197] When a repeated operation instruction is received from the business system (i.e., the operation video analysis information does not meet the preset conditions), the target single-step operation sequence is re-executed and a new operation video is generated, and the new operation video is sent to the business system.

[0198] When a repeated operation instruction is received from the business system (i.e., the operation video analysis information does not meet the preset conditions) and the target task execution mode is a step-by-step operation mode, the operation and maintenance personnel send a repeated operation instruction to the intelligent anti-error robot through the business system server, and receive the new operation video returned by the intelligent anti-error robot after re-executing the target single-step operation sequence based on the repeated operation instruction. The operation process analysis and equipment status analysis are performed on the new operation video to obtain analysis information of the new operation video. The analysis information of the new operation video includes operation process information and equipment status information, and it is judged whether the analysis information of the new operation video meets the preset conditions.

[0199] 213. Receive a task completion request sent by the intelligent error prevention robot, and send a task completion confirmation instruction to the intelligent error prevention robot.

[0200] When the business system server receives the task completion request sent by the intelligent anti-error robot, it confirms the task completion request and sends a task completion confirmation instruction to the intelligent anti-error robot after confirmation.

[0201] 214. Receive the mission completion confirmation instruction sent by the business system and automatically return to the initial position.

[0202] When the intelligent anti-error robot receives the task completion instruction sent by the business system server, it ends the execution of the target operation task sequence and automatically returns to the initial position (that is, the intelligent anti-error robot navigates and moves to the current operation task sequence in the target operation task sequence or the position before the position of the device interval where the target operation task sequence is located).

[0203] In the embodiment of the present invention, it is realized that when performing anti-error (switching) operations, anti-error verification is performed in a combination of five-prevention logic, image video and video analysis, which solves the problem of insufficient reliability of a single anti-error verification method and improves the safety and reliability of the intelligent anti-error robot in the field of power anti-error. That is, the intelligent anti-error robot has low safety and reliability in the switching operation of electrical equipment, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

[0204] See also Figure 3 Another embodiment of the operation method based on multiple anti-error verification in the sequential control operation mode of the embodiment of the present invention includes:

[0205] 301. Obtain a target operation task sequence and issue a target operation task instruction to a preset intelligent anti-error robot.

[0206] Specifically, the business system server obtains the initial operation task sequence, performs a five-prevention logic check on the initial operation task sequence, obtains the target task operation sequence that passes the five-prevention logic check, and generates a target operation task instruction, which includes a target task operation sequence and a first device operation instruction; based on the target task execution mode, the target task operation sequence and the first device operation instruction are issued to the preset intelligent anti-error robot, and the target task execution mode is a sequential control operation mode.

[0207] The operation and maintenance personnel input the specified operation task sequence (i.e., the initial operation task sequence) through the user interface (UI) corresponding to the business system. The business system server performs a five-defense logic check on the initial operation task sequence sent by the business system user interface UI, obtaining a target operation task sequence that passes the five-defense logic check. Furthermore, the business system server generates a corresponding five-defense logic expression based on the preset five-defense logic using a preset reverse Polish expression algorithm. The five-defense logic expression is used to perform judgment and analysis on the initial operation task sequence, thereby obtaining a target operation task sequence that passes the five-defense logic check. If the five-defense logic check fails, the check result is returned, and a new operation task sequence is obtained. The five-defense logic check is performed on the new operation task sequence, and the execution is repeated in sequence until the five-defense logic check passes, obtaining the target operation task sequence.

[0208] The operation and maintenance personnel input or select the target task execution mode through the user interface corresponding to the business system. Among them, the target task execution mode is the sequential control operation mode. In the sequential control operation mode, after the business system issues the operation task sequence (i.e., the target operation task sequence) and the operation start instruction, the intelligent anti-error robot automatically operates the equipment in sequence according to the operation sequence. The anti-error check of each step is automatically performed in the background of the business system. After the anti-error check is passed, each operation does not need to wait for the business system to issue an operation instruction. After completing the entire operation task, the intelligent anti-error robot submits a completion request to the business system. After confirmation by the business system, the intelligent anti-error robot automatically returns to the initial position. During the task execution process, manual confirmation by the business system is required only if the entire anti-error check fails or the equipment status is inconsistent.

[0209] When the target task execution mode is the sequential control operation mode, the business system server sends the target operation instruction including the target task operation sequence and the first device operation instruction to the intelligent anti-error robot, so that the intelligent anti-error robot operates the device to be operated based on the target single-step operation sequence and the first device operation instruction.

[0210] By controlling the preset intelligent anti-error robot based on the target operation task sequence that has passed the five-prevention logic verification, the device to be operated is navigated and the real-time image of the current device to be operated is collected, and the operation task sequence is pre-verified, thereby improving the accuracy of the target operation task sequence and the quality of the real-time image of the current device to be operated, avoiding invalid and redundant operations, improving operational efficiency, and improving the safety and reliability of the intelligent anti-error robot in the switching operation of electrical equipment, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

[0211] 302. Receive a target operation task instruction sent by a preset business system, and obtain information of a device to be operated based on the target operation task instruction.

[0212] Specifically, the intelligent anti-error robot is based on the target task execution mode. When it receives the target operation task sequence in the target operation task instruction sent by the preset business system, it enters the standby state. The target task execution mode is the sequential control operation mode. The target operation task instruction includes the target operation task sequence and the first device operation instruction; when the first device operation instruction is received, the information of the device to be operated is obtained.

[0213] When the intelligent anti-error robot receives the target operation task sequence in the target operation task instruction containing the target operation task sequence and the first device operation instruction, it enters the standby state; when receiving the first device operation instruction, it navigates and moves to the current operation task sequence in the target operation task sequence or the position of the device interval where the target operation task sequence is located, and the intelligent anti-error robot performs device identification and optimal operation position identification on the current operation task sequence in the target operation task sequence or the device where the target operation task sequence is located, thereby obtaining the optimal operation position of the device, wherein the information of the device to be operated may only include the optimal operation position of the device, or may include the optimal operation position of the device and the basic information of the device to be operated, and the basic information of the device to be operated may include: the model, shape and components of the device to be operated, etc.

[0214] 303. Navigate to the location of the device to be operated based on the information of the device to be operated, collect a real-time image of the device to be operated, and send the real-time image of the device to be operated and an operation request to the business system.

[0215] When the target task execution mode of the intelligent anti-error robot is the sequential control operation mode, it navigates the device to be operated based on the information of the device to be operated and collects the real-time image of the current device to be operated, and sends the real-time image of the current device to be operated and the operation request to the business system.

[0216] The intelligent anti-error robot calls a preset camera and / or scanner, and uses the camera and / or scanner to image the current operation task sequence in the target operation task sequence or the device where the target operation task sequence is located to obtain an initial image or an initial video, wherein the initial image includes an image generated by the camera and / or an image generated by the scanner; the intelligent anti-error robot calls a preset neural network model, and performs artificial intelligence device identification and optimal operation position identification on the initial image or the initial video in sequence, thereby obtaining the optimal operation position of the device. Further, the intelligent anti-error robot calls a preset video processing model to convert the initial video into an image of each frame. The intelligent anti-error robot calls a preset neural network model, and performs image enhancement processing, device target frame identification and device operation position identification within the target frame on the initial image or each frame of the image in sequence, thereby obtaining the optimal operation position of the device; the robotic arm or other operating part is navigated to the optimal operation position of the device, and real-time image acquisition is performed on the optimal operation position of the device, thereby obtaining a real-time image of the device to be operated, and the real-time image of the device to be operated and the operation request are sent to the business system server.

[0217] 304. Acquire a real-time image of the device to be operated.

[0218] The business system server receives the operation request and the real-time image of the device to be operated sent by the intelligent anti-error robot, thereby obtaining the real-time image of the device to be operated.

[0219] 305. Perform device status verification on the real-time image of the device. When the device status verification passes, obtain the target single-step operation sequence.

[0220] Specifically, the business system server identifies the device status of the real-time image of the device to obtain the device image status; obtains the device acquisition status of the device to be operated, and compares the device image status with the device acquisition status to obtain a comparison result; when the comparison result is that the device image status is consistent with the device acquisition status, obtains the step sequence of the current operation from the target operation task sequence to obtain the target single-step operation sequence.

[0221] When the business system server receives the real-time image of the device to be operated sent by the intelligent anti-error robot, it calls the preset models for image processing, image detection and image recognition, performs image processing, device detection and device status recognition on the current real-time image of the device to be operated, and obtains the device image status; obtains the device acquisition status of the device to be operated, where the device acquisition status is used to indicate the device status of self-determination, self-detection and self-acquisition of the device to be operated; compares the device image status with the device acquisition status, that is, determines whether the device image status is consistent with the device acquisition status, and thus obtains the comparison result;

[0222] When the target task execution mode is the sequential control operation mode, if the comparison result is that the device image status is consistent with the device acquisition status, the step sequence of the current operation is obtained from the target operation task sequence to obtain the target single-step operation sequence. If the comparison result is that the device image status is inconsistent with the device acquisition status, the task is paused and an alarm is issued to wait for manual confirmation.

[0223] By identifying the device status of the real-time image of the device to be operated and obtaining the target single-step operation sequence based on the comparison results, further multi-dimensional anti-error verification is achieved, and invalid redundant operations are avoided, thereby improving operational efficiency and improving the safety and reliability of the intelligent anti-error robot in the switching operation of electrical equipment, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

[0224] 306. Perform a five-prevention logic check on the target single-step operation sequence. When the five-prevention logic check of the target single-step operation sequence passes, send a first instruction message to the intelligent error-prevention robot.

[0225] Specifically, the business system server performs a five-prevention logic check on the target single-step operation sequence; when the five-prevention logic check of the target single-step operation sequence passes, a first indication message containing the result of the passed check is sent to the intelligent anti-error robot, so that the intelligent anti-error robot performs the target single-step operation sequence on the device to be operated based on the first indication message, and generates a current device operation video of the operation execution.

[0226] The business system server calls the preset binary tree algorithm, creates a preset five-defense logic binary tree, performs post-order traversal on the binary tree, and obtains the five-defense logic expression; the target single-step operation sequence is judged and analyzed through the five-defense logic expression to realize the five-defense logic verification of the target single-step operation sequence.

[0227] When the five-prevention logic verification of the target single-step operation sequence passes and the target task execution mode is the sequential control operation mode, a first indication message containing the verification result is sent to the intelligent anti-error robot.

[0228] 307 : Receive the first instruction message sent by the business system, perform the target single-step operation sequence on the device to be operated and generate a current device operation video, and send the current device operation video to the business system.

[0229] When the intelligent anti-error robot receives the first indication message sent by the business system containing the verification result (that is, the target single-step operation sequence five-prevention logic verification is passed), and the target task execution mode is the sequential control operation mode, it automatically starts and enters the start operation state. There is no need for the operation and maintenance personnel to send instructions through the business system server before entering the start operation state. After the intelligent anti-error robot automatically starts and enters the start operation state, it operates the device to be operated based on the target single-step operation sequence, and calls the preset camera and video recording tool to capture the video of the operation execution process. When it detects that the operation is completed, it generates the operation result, stops the video capture, obtains the current device operation video, and returns the operation result and the current device operation video to the business system server.

[0230] When a verification failure result is received from the business system server (i.e., the five-defense logic verification of the single-step operation sequence fails), and the target task execution mode is the sequential control operation mode, an alarm is issued and the task is paused to wait for manual confirmation.

[0231] 308. Obtain the current device operation video of the intelligent anti-error robot.

[0232] The business system server obtains the current device operation video by receiving the current device operation video sent by the intelligent anti-error robot.

[0233] By obtaining the current equipment operation video of the intelligent anti-error robot based on the verification results and the target task execution mode, further anti-error verification and flexible operation in different execution modes are achieved, which improves the execution flexibility, operation efficiency and multiplicity of verification, improves the safety and reliability of the intelligent anti-error robot's switching operation of electrical equipment, and improves the quality and effectiveness of the current equipment operation video, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

[0234] 309. Perform an operation process analysis and a device status analysis on the current device operation video to obtain operation video analysis information, where the operation video analysis information includes operation process information and device status information.

[0235] When the business system server receives the current equipment operation video sent by the intelligent protection robot, it calls the preset image processing model to perform image conversion, image preprocessing (including but not limited to image enhancement processing, denoising processing and grayscale value processing, etc.), image recognition, operation process sequence generation and equipment status identification after the operation on the current equipment operation video in sequence, and obtains the operation process information and equipment status information, that is, the operation video analysis information.

[0236] 310. Determine whether the operation video analysis information meets the preset conditions.

[0237] The preset conditions include judgment conditions corresponding to operation process information and device status information. For example, the judgment condition corresponding to the operation process information is whether the operation process sequence information conforms to the operation process of the current operation task sequence (i.e., the target single-step operation sequence) in the target operation task sequence. The judgment condition corresponding to the device status information is whether the device status information after the operation meets expectations or the operation is complete. The business system server can use a preset discrimination algorithm to classify the operation video analysis information based on the preset conditions to determine whether the operation video analysis information conforms to the preset conditions. The discrimination algorithm can be a logistic regression algorithm or a decision tree algorithm, which is not limited here.

[0238] 311. If the operation video analysis information meets the preset conditions, a second indication message including the result meeting the preset conditions will be sent to the intelligent anti-error robot, so that the intelligent anti-error robot can determine whether there is a next single-step operation sequence, and continue to execute the next single-step operation sequence or return a task completion request based on the result of the judgment.

[0239] When the operation video analysis information meets the preset conditions and the target task execution mode is the sequential control operation mode, the business system server will send a second indication message including the result that meets the preset conditions to the intelligent anti-error robot, and the intelligent anti-error robot will automatically continue with the next operation without the need for the operation and maintenance personnel to send instructions through the business system server before continuing with the next operation. The next operation is: judging whether there is a next single-step operation sequence based on the target single-step operation sequence, so that the intelligent anti-error robot can judge whether there is a next single-step operation sequence, and judge whether there is a next single-step operation sequence. If so, when the business system server receives the result based on the judgment of the intelligent anti-error robot, it returns When the execution result after continuing to execute the next single-step operation sequence is obtained (the execution result after continuing to execute the next single-step operation sequence can be the operation video after continuing to execute the next single-step operation sequence, that is, the execution process corresponding to the above steps 304-306 and steps 308-310 is executed to realize the operation of the next single-step operation sequence), the operation process analysis and equipment status analysis are performed on the execution result after continuing to execute the next single-step operation sequence to obtain the analysis information of the next single-step operation sequence operation, and determine whether the analysis information of the next single-step operation sequence operation meets the preset conditions; if not, the business system server receives the task completion request sent back by the intelligent protection robot.

[0240] When the intelligent error-prevention robot receives a result from the business system that does not meet the preset conditions and the target task execution mode is the sequential control operation mode, it stops the operation and suspends the execution of the task.

[0241] 312. Receive the second instruction message sent by the business system, and determine whether there is a next single-step operation sequence. If so, continue to execute the next single-step operation sequence.

[0242] If the target task execution mode is the sequential control operation mode, and the intelligent anti-error robot receives the second indication message sent by the business system server that the result meets the preset conditions, it will automatically continue to the next operation without the need for the operation and maintenance personnel to send instructions through the business system server before continuing to the next operation. The next operation is: determine whether there is a next single-step operation sequence based on the target single-step operation sequence. If so, execute the execution process of the above steps 303 and 307 to continue to execute the next single-step operation sequence based on the target single-step operation sequence, and return the execution result after continuing to execute the next single-step operation sequence to the business system server, and continue to execute the next The execution result after the single-step operation sequence can be the operation video after continuing to execute the next single-step operation sequence. When the judgment result of the analysis information of the next single-step operation sequence operation sent by the business system server is received (whether the analysis information of the next single-step operation sequence operation meets the preset conditions), if the judgment result of the analysis information of the next single-step operation sequence operation is no, the execution process of the above steps 303 and 307 is executed. If the judgment result of the analysis information of the next single-step operation sequence operation is yes, subsequent operations are performed according to the execution result after the next single-step operation sequence; if not, the intelligent protection robot returns the task completion request to the business system server.

[0243] When the intelligent anti-error robot receives a result sent by the business system that does not meet the preset conditions and the target task execution mode is the sequential control operation mode, it will issue an alarm and suspend the execution of the task.

[0244] 313. Receive a task completion request sent by the intelligent error prevention robot, and send a task completion confirmation instruction to the intelligent error prevention robot.

[0245] When the business system server receives the task completion request sent by the intelligent anti-error robot, it confirms the task completion request and sends a task completion confirmation instruction to the intelligent anti-error robot after confirmation.

[0246] 314. Receive the mission completion confirmation instruction sent by the business system and automatically return to the initial position.

[0247] When the intelligent anti-error robot receives the task completion instruction sent by the business system server, it ends the execution of the target operation task sequence and automatically returns to the initial position (that is, the intelligent anti-error robot navigates and moves to the current operation task sequence in the target operation task sequence or the position before the position of the device interval where the target operation task sequence is located).

[0248] In the embodiment of the present invention, it is realized that when performing anti-error (switching) operations, anti-error verification is performed in a combination of five-prevention logic, image video and video analysis, which solves the problem of insufficient reliability of a single anti-error verification method and improves the safety and reliability of the intelligent anti-error robot in the field of power anti-error. That is, the intelligent anti-error robot has low safety and reliability in the switching operation of electrical equipment, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

[0249] See also Figure 4 , Figure 4 It is a structural diagram of an operation system based on multiple anti-error verification provided by an embodiment of the present invention. The above-mentioned operation method based on multiple anti-error verification is applied to the operation system 4000 based on multiple anti-error verification. The operation system 4000 based on multiple anti-error verification executes the operation method based on multiple anti-error verification described in the above steps 101-114, the above steps 201-214 and the above steps 301-314. The operation system 4000 based on multiple anti-error verification includes: a business system 4100 and an intelligent anti-error robot 4200; the business system 4100 and the intelligent anti-error robot 4200 are network connected, and the business system 4100 includes a business device 4110.

[0250] Furthermore, if Figure 5 As shown, Figure 5 It is a structural diagram of a business system provided by an embodiment of the present invention, and the business device 4110 includes a sending module 4111, which is used to obtain the target operation task sequence and send the target operation task instruction to the preset intelligent anti-error robot; a first acquisition module 4112, which is used to obtain the real-time image of the device to be operated; a first verification module 4113, which is used to perform device status verification on the real-time image of the device, and when the device status verification passes, obtain the target single-step operation sequence; a second verification module 4114, which is used to perform five-prevention logic verification on the target single-step operation sequence, and when the five-prevention logic verification of the target single-step operation sequence passes, send the first indication message to the intelligent anti-error robot; a second acquisition module 4115, which is used to obtain the current device operation video of the intelligent anti-error robot, verify the current device operation video, and send the second indication message to the intelligent anti-error robot; a sending module 4116, which is used to receive the task completion request sent by the intelligent anti-error robot, and send a task completion confirmation instruction to the intelligent anti-error robot.

[0251] The second acquisition module 4115 specifically includes:

[0252] The first acquisition unit 41151 is used to acquire the current device operation video of the intelligent anti-error robot;

[0253] The first analysis unit 41152 is configured to analyze the operation process and device status of the current device operation video to obtain operation video analysis information, which includes operation process information and device status information;

[0254] The first judgment unit 41153 is used to judge whether the operation video analysis information meets the preset conditions;

[0255] The first sending unit 41154 is used to send a second instruction message including a continue operation instruction to the intelligent anti-error robot if the operation video analysis information meets the preset conditions, so that the intelligent anti-error robot can determine whether there is a next single-step operation sequence, and continue to execute the next single-step operation sequence or return a task completion request based on the judgment result.

[0256] Optionally, the sending module 4111 may also be specifically used for:

[0257] Acquire an initial operation task sequence, perform a five-prevention logic check on the initial operation task sequence, obtain a target operation task sequence that passes the five-prevention logic check, and generate a target operation task instruction, the target operation task instruction including the target operation task sequence;

[0258] Based on the target task execution mode, a target operation task sequence is issued to the preset intelligent anti-error robot, and the target task execution mode is a step-by-step operation mode.

[0259] Optionally, the second verification module 4114 may also be specifically configured to:

[0260] Perform five-prevention logic verification on the target single-step operation sequence;

[0261] When the five-prevention logic check of the target single-step operation sequence passes, the first indication message including the second device operation instruction is sent to the intelligent anti-error robot, so that the intelligent anti-error robot performs the target single-step operation sequence on the device to be operated based on the first indication message and generates a current device operation video.

[0262] Optionally, the second obtaining module 4115 further includes:

[0263] The second sending unit 41155 is used to trigger a repeat operation instruction and send the repeat operation instruction to the intelligent anti-error robot if the operation video analysis information does not meet the preset conditions, and receive the new operation video returned by the intelligent anti-error robot after re-executing the target single-step operation sequence based on the repeat operation instruction.

[0264] Optionally, the first verification module 4113 may also be specifically configured to:

[0265] Perform device status recognition on the real-time image of the device to obtain the device image status;

[0266] Obtain the device acquisition status of the device to be operated, and compare the device image status with the device acquisition status to obtain a comparison result;

[0267] When the comparison result shows that the device image state is consistent with the device acquisition state, the step sequence of the current operation is obtained from the target operation task sequence to obtain the target single-step operation sequence.

[0268] Furthermore, if Figure 6 As shown, Figure 6 It is a structural diagram of a business system provided by an embodiment of the present invention, and the business device 4110 includes a sending module 4111, which is used to obtain the target operation task sequence and send the target operation task instruction to the preset intelligent anti-error robot; a first acquisition module 4112, which is used to obtain the real-time image of the device to be operated; a first verification module 4113, which is used to perform device status verification on the real-time image of the device, and when the device status verification passes, obtain the target single-step operation sequence; a second verification module 4114, which is used to perform five-prevention logic verification on the target single-step operation sequence, and when the five-prevention logic verification of the target single-step operation sequence passes, send the first indication message to the intelligent anti-error robot; a second acquisition module 4115, which is used to obtain the current device operation video of the intelligent anti-error robot, verify the current device operation video, and send the second indication message to the intelligent anti-error robot; a sending module 4116, which is used to receive the task completion request sent by the intelligent anti-error robot, and send a task completion confirmation instruction to the intelligent anti-error robot.

[0269] The second acquisition module 4115 specifically includes:

[0270] The second acquisition unit 41156 is used to acquire the current device operation video of the intelligent anti-error robot;

[0271] The second analysis unit 41157 is used to analyze the operation process and device status of the current device operation video to obtain operation video analysis information, which includes operation process information and device status information;

[0272] The second judgment unit 41158 is used to judge whether the operation video analysis information meets the preset conditions;

[0273] The third sending unit 41159 is used to send a second indication message including a result that meets the preset conditions to the intelligent anti-error robot if the operation video analysis information meets the preset conditions, so that the intelligent anti-error robot can determine whether there is a next single-step operation sequence, and continue to execute the next single-step operation sequence or return a task completion request based on the result of the judgment.

[0274] Optionally, the sending module 4111 may also be specifically used for:

[0275] Acquire an initial operation task sequence, perform a five-prevention logic check on the initial operation task sequence, obtain a target task operation sequence that passes the five-prevention logic check, and generate a target operation task instruction, the target operation task instruction including the target task operation sequence and the first device operation instruction;

[0276] Based on the target task execution mode, the target task operation sequence and the first device operation instruction are issued to the preset intelligent anti-error robot, and the target task execution mode is the sequential control operation mode.

[0277] Optionally, the second verification module 4114 may also be specifically configured to:

[0278] Perform five-prevention logic verification on the target single-step operation sequence;

[0279] When the five-prevention logic verification of the target single-step operation sequence passes, the first indication message containing the verification result is sent to the intelligent anti-error robot, so that the intelligent anti-error robot performs the target single-step operation sequence on the operated device based on the first indication message, and generates a current device operation video of the operation execution.

[0280] Optionally, the second obtaining module 4115 further includes:

[0281] The fourth sending unit 41150 is used to send the result of not meeting the preset conditions to the intelligent anti-error robot when the operation video analysis information does not meet the preset conditions, so that the intelligent anti-error robot suspends the execution of the task.

[0282] Optionally, the first verification module 4113 may also be specifically configured to:

[0283] Perform device status recognition on the real-time image of the device to obtain the device image status;

[0284] Obtain the device acquisition status of the device to be operated, and compare the device image status with the device acquisition status to obtain a comparison result;

[0285] When the comparison result shows that the device image state is consistent with the device acquisition state, the step sequence of the current operation is obtained from the target operation task sequence to obtain the target single-step operation sequence.

[0286] Furthermore, if Figure 7 As shown, Figure 7: This is a structural diagram of an intelligent error-preventing robot provided by an embodiment of the present invention. The intelligent error-preventing robot 4200 includes a receiving and acquiring module 4201, which is used to receive a target operation task instruction sent by a preset business system and acquire information of a device to be operated based on the target operation task instruction; a navigation and acquiring module 4202, which is used to navigate to the location of the device to be operated based on the information of the device to be operated, and acquire a real-time image of the device to be operated, and send the real-time image of the device to be operated and an operation request to the business system; a generating and sending module 4203, which is used to receive a first instruction message sent by the business system, perform a target single-step operation sequence on the device to be operated, generate a current device operation video, and send the current device operation video to the business system; an executing module 4204, which is used to receive a second instruction message sent by the business system and determine whether there is a next single-step operation sequence. If so, continue to execute the next single-step operation sequence; and a returning module 4205, which is used to receive a task completion confirmation instruction sent by the business system and automatically return to the initial position.

[0287] The receiving and obtaining module 4201 may be specifically configured to:

[0288] Based on the target task execution mode, receiving the target operation task instruction sent by the preset business system, the target task execution mode is a step-by-step operation mode, and the target operation task instruction includes a target operation task sequence;

[0289] Obtain information about the device to be operated based on the target operation task sequence.

[0290] Optional, intelligent anti-error robot 4200, also includes:

[0291] The re-execution module 4206 is used to re-execute the target single-step operation sequence and generate a new operation video when receiving a repeat operation instruction sent by the business system, and send the new operation video to the business system.

[0292] Optionally, the receiving and obtaining module 4201 may also be specifically configured to:

[0293] Based on the target task execution mode, when receiving the target operation task sequence in the target operation task instruction sent by the preset business system, the system enters the standby state, the target task execution mode is the sequential control operation mode, and the target operation task instruction includes the target operation task sequence and the first device operation instruction;

[0294] When the first device operation instruction is received, information of the device to be operated is obtained.

[0295] Optional, intelligent anti-error robot 4200, also includes:

[0296] The execution suspension module 4207 is used to suspend the execution of the task when receiving a result sent by the business system that does not meet the preset conditions.

[0297] The functional implementation of each module and unit in the above-mentioned business device 4110 and the intelligent anti-error robot 4200 corresponds to the steps in the above-mentioned operation method embodiment based on multiple anti-error verification, and their functions and implementation processes will not be repeated here one by one.

[0298] In the embodiment of the present invention, through an operating system based on multiple anti-error checks, it is achieved that when performing anti-error (switching) operations, anti-error checks are performed in combination with five-prevention logic, image video and video analysis in multiple ways, thereby solving the problem of insufficient reliability of a single anti-error check method, and improving the safety and reliability of the intelligent anti-error robot in the field of power anti-error, that is, the intelligent anti-error robot has lower safety and reliability in the switching operation of electrical equipment, thereby improving the operation and maintenance efficiency of the switching operation of electrical equipment.

[0299] Furthermore, the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function, etc.; the data storage area may store data created according to the use of the blockchain node, etc.

[0300] The blockchain, as used in this article, refers to a novel application model for computer technologies, including distributed data storage, peer-to-peer transmission, consensus mechanisms, and encryption algorithms. Blockchain is essentially a decentralized database, a series of data blocks generated using cryptographic methods. Each block contains information about a batch of online transactions, used to verify the validity of that information (to prevent counterfeiting) and generate the next block. Blockchain can include the underlying blockchain platform, the platform product and service layer, and the application service layer.

[0301] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0302] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several computer programs that enable a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the method of the present invention. The aforementioned storage medium includes various media that can store program code, such as USB flash drives, mobile hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0303] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions described in the above embodiments can still be modified, or some of the technical features thereof can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for preventing multiple mis-checks, characterized in that: Applied to a business system, the operation method based on multiple error-proofing includes: Obtain the target operation task sequence and issue the target operation task instructions to the preset intelligent anti-error robot; Obtain real-time images of the equipment to be operated; Performing a device status check on the real-time image of the device, and obtaining a target single-step operation sequence when the device status check passes; Performing a five-prevention logic check on the target single-step operation sequence, and sending a first instruction message to the intelligent error-preventing robot when the five-prevention logic check of the target single-step operation sequence passes; Obtaining a current device operation video of the intelligent anti-error robot, verifying the current device operation video, and sending a second instruction message to the intelligent anti-error robot; Receive a task completion request sent by the intelligent error-preventing robot, and send a task completion confirmation instruction to the intelligent error-preventing robot.

2. The operation method based on multiple error-proofing according to claim 1, characterized in that: The step of obtaining a target operation task sequence and issuing a target operation task instruction to a preset intelligent anti-error robot includes: Acquire an initial operation task sequence, perform a five-prevention logic check on the initial operation task sequence, obtain a target operation task sequence that passes the five-prevention logic check, and generate a target operation task instruction, wherein the target operation task instruction includes the target operation task sequence; Based on the target task execution mode, the target operation task sequence is issued to the preset intelligent error-preventing robot, and the target task execution mode is a step-by-step operation mode.

3. The operation method based on multiple error-proofing according to claim 2, characterized in that: When the target task execution mode is a step-by-step operation mode, performing a five-prevention logic check on the target single-step operation sequence, and when the five-prevention logic check of the target single-step operation sequence passes, sending a first indication message to the intelligent error-preventing robot, including: Performing five-prevention logic verification on the target single-step operation sequence; When the five-prevention logic check of the target single-step operation sequence passes, the first indication message including the second device operation instruction is sent to the intelligent anti-error robot, so that the intelligent anti-error robot performs the target single-step operation sequence on the device to be operated based on the first indication message and generates a current device operation video.

4. The operation method based on multiple error-proofing according to claim 2, characterized in that: When the target task execution mode is a step-by-step operation mode, obtaining the current device operation video of the intelligent anti-error robot, verifying the current device operation video, and sending a second instruction message to the intelligent anti-error robot include: Obtaining a current device operation video of the intelligent anti-error robot; Performing an operation process analysis and a device status analysis on the current device operation video to obtain operation video analysis information, wherein the operation video analysis information includes operation process information and device status information; Determining whether the operation video analysis information meets preset conditions; If the operation video analysis information meets the preset conditions, a second instruction message including a continue operation instruction will be sent to the intelligent anti-error robot, so that the intelligent anti-error robot can determine whether there is a next single-step operation sequence, and continue to execute the next single-step operation sequence or return a task completion request based on the judgment result.

5. The operation method based on multiple error-proofing according to claim 4, characterized in that: After determining whether the operation video analysis information meets the preset conditions, the method further includes: If the operation video analysis information does not meet the preset conditions, a repeated operation instruction is triggered and sent to the intelligent anti-error robot, and a new operation video returned by the intelligent anti-error robot after re-executing the target single-step operation sequence based on the repeated operation instruction is received.

6. The operation method based on multiple error-proofing according to claim 1, characterized in that: The step of obtaining a target operation task sequence and issuing a target operation task instruction to a preset intelligent anti-error robot includes: Acquire an initial operation task sequence, perform a five-prevention logic check on the initial operation task sequence, obtain a target task operation sequence that passes the five-prevention logic check, and generate a target operation task instruction, wherein the target operation task instruction includes the target task operation sequence and a first device operation instruction; Based on the target task execution mode, the target task operation sequence and the first device operation instruction are issued to the preset intelligent error-preventing robot, and the target task execution mode is a sequential control operation mode.

7. The operation method based on multiple error-proofing according to claim 6, characterized in that: When the target task execution mode is the sequential control operation mode, performing a five-prevention logic check on the target single-step operation sequence, and when the five-prevention logic check of the target single-step operation sequence passes, sending a first indication message to the intelligent error-preventing robot, including: Performing five-prevention logic verification on the target single-step operation sequence; When the five-prevention logic check of the target single-step operation sequence passes, the first indication message containing the result of the check is sent to the intelligent anti-error robot, so that the intelligent anti-error robot performs the operation of the target single-step operation sequence on the device to be operated based on the first indication message, and generates a current device operation video of the operation execution.

8. The operation method based on multiple error-proofing according to claim 6, characterized in that: When the target task execution mode is the sequential control operation mode, obtaining the current device operation video of the intelligent anti-error robot, verifying the current device operation video, and sending the second instruction message to the intelligent anti-error robot include: Obtaining a current device operation video of the intelligent anti-error robot; Performing an operation process analysis and a device status analysis on the current device operation video to obtain operation video analysis information, wherein the operation video analysis information includes operation process information and device status information; Determining whether the operation video analysis information meets preset conditions; If the operation video analysis information meets the preset conditions, a second indication message including the result that meets the preset conditions will be sent to the intelligent anti-error robot, so that the intelligent anti-error robot can determine whether there is a next single-step operation sequence, and continue to execute the next single-step operation sequence or return a task completion request based on the judgment result.

9. The operation method based on multiple error-proofing according to claim 8, characterized in that: After determining whether the operation video analysis information meets the preset conditions, the method further includes: When the operation video analysis information does not meet the preset conditions, the result of not meeting the preset conditions is sent to the intelligent anti-error robot, so that the intelligent anti-error robot suspends the execution of the task.

10. The operation method based on multiple anti-error verification according to any one of claims 1 to 9, characterized in that: The device status verification is performed on the real-time image of the device, and when the device status verification passes, a target single-step operation sequence is obtained, including: Performing device status recognition on the real-time image of the device to obtain the device image status; Acquiring a device acquisition state of the device to be operated, and comparing the device image state with the device acquisition state to obtain a comparison result, wherein the device acquisition state is used to indicate a device state of self-determination, self-detection, and self-acquisition of the device to be operated; When the comparison result shows that the device image state is consistent with the device acquisition state, the step sequence of the current operation is obtained from the target operation task sequence to obtain a target single-step operation sequence.

11. A method for preventing multiple errors based on verification, characterized in that: Applied to the intelligent anti-error robot, the operation method based on multiple anti-error verification includes: Receive a target operation task instruction sent by a preset business system, and obtain information about the device to be operated based on the target operation task instruction; Based on the information of the device to be operated, navigate to the location of the device to be operated, collect a real-time image of the device to be operated, and send the real-time image of the device to be operated and an operation request to the business system; receiving a first instruction message sent by the business system, performing a target single-step operation sequence on the device to be operated and generating a current device operation video, and sending the current device operation video to the business system; receiving a second indication message sent by the business system, and determining whether there is a next single-step operation sequence, and if so, continuing to execute the next single-step operation sequence; Receive the mission completion confirmation instruction sent by the business system and automatically return to the initial position.

12. The operation method based on multiple error-proofing according to claim 11, characterized in that: The receiving of the target operation task instruction sent by the preset business system and obtaining information of the device to be operated based on the target operation task instruction includes: Based on the target task execution mode, receiving the target operation task instruction sent by the preset business system, the target task execution mode is a step-by-step operation mode, and the target operation task instruction includes a target operation task sequence; The information of the device to be operated is obtained based on the target operation task sequence.

13. The operation method based on multiple error-proofing according to claim 12, characterized in that: When the target task execution mode is a step-by-step operation mode, the receiving of the second instruction message sent by the business system and determining whether there is a next single-step operation sequence, and if so, continuing to execute the next single-step operation sequence, further comprising: When a repeat operation instruction is received from the business system, the target single-step operation sequence is re-executed and a new operation video is generated, and the new operation video is sent to the business system.

14. The operation method based on multiple error-proofing according to claim 11, characterized in that: The receiving of the target operation task instruction sent by the preset business system and obtaining information of the device to be operated based on the target operation task instruction includes: Based on the target task execution mode, when receiving the target operation task sequence in the target operation task instruction sent by the preset business system, the standby state is entered, the target task execution mode is the sequential control operation mode, and the target operation task instruction includes the target operation task sequence and the first device operation instruction; When the first device operation instruction is received, information of the device to be operated is obtained.

15. The operation method based on multiple error-proofing according to claim 14, characterized in that: When the target task execution mode is the sequential control operation mode, the method further includes: receiving the second indication message sent by the business system, determining whether there is a next single-step operation sequence, and if so, continuing to execute the next single-step operation sequence. When a result not meeting the preset conditions is received from the business system, the execution of the task is suspended.

16. A service device, characterized in that: The service device includes: The issuing module is used to obtain the target operation task sequence and issue the target operation task instructions to the preset intelligent anti-error robot; A first acquisition module is used to acquire a real-time image of the device to be operated; A first verification module is configured to perform a device status verification on the real-time image of the device, and obtain a target single-step operation sequence when the device status verification passes; a second verification module, configured to perform a five-prevention logic verification on the target single-step operation sequence, and send a first indication message to the intelligent error-preventing robot when the five-prevention logic verification of the target single-step operation sequence passes; A second acquisition module is used to obtain a current device operation video of the intelligent anti-error robot, verify the current device operation video, and send a second instruction message to the intelligent anti-error robot; The sending module is used to receive the task completion request sent by the intelligent anti-error robot and send a task completion confirmation instruction to the intelligent anti-error robot.

17. An intelligent anti-error robot, characterized in that: The intelligent anti-error robot comprises: A receiving and obtaining module, configured to receive a target operation task instruction sent by a preset business system, and obtain information of a device to be operated based on the target operation task instruction; a navigation collection module, configured to navigate to the location of the device to be operated based on the information of the device to be operated, collect a real-time image of the device to be operated, and send the real-time image of the device to be operated and an operation request to the business system; a generating and sending module, configured to receive a first instruction message sent by the business system, perform a target single-step operation sequence on the device to be operated and generate a current device operation video, and send the current device operation video to the business system; an execution module, configured to receive the second indication message sent by the business system, and determine whether there is a next single-step operation sequence, and if so, continue to execute the next single-step operation sequence; The return module is used to receive the task completion confirmation instruction sent by the business system and automatically return to the initial position.

18. An operating system based on multiple error-proofing, characterized in that: The operation system based on multiple anti-error verification includes: a business system and the intelligent anti-error robot as described in claim 17, the business system and the intelligent anti-error robot are network connected, and the business system includes the business device as described in claim 16.

19. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the operating method based on multiple error prevention checks as described in any one of claims 1 to 15 is implemented.

Citation Information

Patent Citations

  • Intelligent identification based anti-misoperation system and method for robot

    CN105553113A

  • Sequence control system and method for switching operation of transformer substation

    CN111614157A