Digital twin-based methods, devices, equipment, and media for identifying switching operations.

By receiving switching operation signals using digital twin technology, acquiring equipment images, and combining them with measurement point information to identify switching operations, the problem of low accuracy in identifying switching operations is solved, enabling efficient remote confirmation and supporting the unmanned and minimally manned development of power grid safety.

CN115761450BActive Publication Date: 2026-11-17ANNING BUREAU OF ULTRA HIGH VOLTAGE TRANSMISSION
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211474568.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-23
Publication Date
2026-11-17
Estimated Expiration
2042-11-23

AI Technical Summary

Technical Problem

Traditional technologies have low accuracy in identifying switching operations, making it difficult to accurately confirm the success or failure of equipment switching operations remotely, which affects power grid security.

Method used

By using digital twin technology, the system receives equipment switching operation signals, identifies the target equipment, acquires equipment images using target image acquisition equipment, performs image recognition, and combines measurement point information to determine the switching operation recognition result, thus achieving accurate switching operation recognition.

Benefits of technology

It improves the accuracy and efficiency of switching operation identification results, supports accurate confirmation at remote terminals, and conforms to the development direction of unmanned and minimally staffed intelligent converter stations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115761450B_ABST
    Figure CN115761450B_ABST
Patent Text Reader

Abstract

This application relates to the field of power technology and provides a method, apparatus, computer device, storage medium, and computer program product for identifying switching operations based on digital twins. This application can improve the accuracy and efficiency of determining the identification results of switching operations of equipment. The method includes: receiving a switching operation signal from equipment; determining the operation signal source device corresponding to the switching operation signal as the target device; using a target image acquisition device corresponding to the target device to acquire an image of the target device; performing image recognition on the image to obtain the switching operation image recognition result of the target device; and determining the switching operation identification result of the target device based on the measurement point information of the target device and the switching operation image recognition result.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of power technology, and in particular to a method, apparatus, computer equipment, storage medium and computer program product for identifying switching operations based on digital twins. Background Technology

[0002] With the development of power technology, switching operations are a key and challenging aspect of power work, affecting the safety of personnel, equipment, and the power grid. To achieve the technological development direction of "unmanned" and "reduced-personnel" intelligent converter stations, how to remotely confirm the results of switching operations at the field equipment has become an important research direction.

[0003] Traditional technology typically involves operators performing switching operations on the equipment and then remotely confirming the successful completion of the switching operation. However, situations such as switching operation failures may occur, leading to lower accuracy in confirming the switching operation results. Summary of the Invention

[0004] Therefore, it is necessary to provide a method, device, computer equipment, computer-readable storage medium, and computer program product based on digital twin for identifying switching operations, addressing the aforementioned technical problems.

[0005] Firstly, this application provides a method for identifying switching operations based on digital twins. The method includes:

[0006] Receive switching operation signals from the equipment;

[0007] Identify the operating signal source device corresponding to the equipment switching operation signal as the target device;

[0008] Use the target image acquisition device corresponding to the target device to acquire images of the target device;

[0009] Image recognition is performed on the image to obtain the image recognition results of the switching operation of the target equipment;

[0010] Based on the measurement point information of the target equipment and the image recognition results of the switching operation, the recognition results of the switching operation of the target equipment are determined.

[0011] In one embodiment, an image of the target device is acquired using a target image acquisition device corresponding to the target device, including:

[0012] Based on the location information of the target device, the target image acquisition device corresponding to the target device is determined from the set of image acquisition devices;

[0013] Use a target image acquisition device to acquire images of the target device.

[0014] In one embodiment, an image of the target device is acquired using a target image acquisition device corresponding to the target device, including:

[0015] The intelligent monitoring system within the digital twin system uses the target image acquisition device corresponding to the target device to acquire images of the target device; the intelligent monitoring system includes the target image acquisition device.

[0016] Image recognition is performed on the image to obtain the image recognition results of the switching operation of the target equipment, including:

[0017] The intelligent monitoring system performs image recognition on the images to obtain the image recognition results of the switching operation of the target equipment.

[0018] In one embodiment, receiving the device switching operation signal includes:

[0019] The digital twin system monitors the equipment switching operation information of the measuring point system; the measuring point system is used to generate equipment switching operation signals based on the equipment switching operation information when the equipment switching operation information changes, and sends the equipment switching operation signals to the digital twin system.

[0020] The digital twin system receives equipment switching operation signals sent by the measuring point system.

[0021] In one embodiment, the switching operation recognition result of the target device is determined based on the measurement point information of the target device and the image recognition result of the switching operation, including:

[0022] Based on the measurement point information, determine the identification result of the switching operation measurement point of the target equipment;

[0023] If the switching operation measurement point recognition result and the switching operation image recognition result are the same, the switching operation measurement point recognition result or the switching operation image recognition result shall be taken as the switching operation recognition result.

[0024] In one embodiment, the method further includes:

[0025] Based on the images, determine the post-operation images of the target device;

[0026] After determining the switching operation recognition result of the target equipment based on the measurement point information of the target equipment and the image recognition result of the switching operation, the process also includes:

[0027] The digital twin system interface displays the switching operation recognition results and post-operation site images.

[0028] Secondly, this application also provides a switching operation identification device based on digital twins. The device includes:

[0029] The signal receiving module is used to receive switching operation signals from the equipment;

[0030] The device determination module is used to determine the operation signal source device corresponding to the switching operation signal of the device, and use it as the target device;

[0031] The image acquisition module is used to acquire images of the target device using the target image acquisition device corresponding to the target device;

[0032] The image recognition module is used to perform image recognition on the image to obtain the image recognition result of the switching operation of the target device;

[0033] The result determination module is used to determine the switching operation recognition result of the target device based on the measurement point information of the target device and the switching operation image recognition result.

[0034] Thirdly, this application also provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to perform the following steps:

[0035] Receive the switching operation signal from the equipment; determine the operation signal source equipment corresponding to the switching operation signal as the target equipment; use the target image acquisition equipment corresponding to the target equipment to acquire the image of the target equipment; perform image recognition on the image to obtain the switching operation image recognition result of the target equipment; determine the switching operation recognition result of the target equipment based on the measurement point information of the target equipment and the switching operation image recognition result.

[0036] Fourthly, this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, performs the following steps:

[0037] Receive the switching operation signal from the equipment; determine the operation signal source equipment corresponding to the switching operation signal as the target equipment; use the target image acquisition equipment corresponding to the target equipment to acquire the image of the target equipment; perform image recognition on the image to obtain the switching operation image recognition result of the target equipment; determine the switching operation recognition result of the target equipment based on the measurement point information of the target equipment and the switching operation image recognition result.

[0038] Fifthly, this application also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, performs the following steps:

[0039] Receive the switching operation signal from the equipment; determine the operation signal source equipment corresponding to the switching operation signal as the target equipment; use the target image acquisition equipment corresponding to the target equipment to acquire the image of the target equipment; perform image recognition on the image to obtain the switching operation image recognition result of the target equipment; determine the switching operation recognition result of the target equipment based on the measurement point information of the target equipment and the switching operation image recognition result.

[0040] The aforementioned digital twin-based method, apparatus, computer equipment, storage medium, and computer program product for identifying switching operations receive equipment switching operation signals, determine the corresponding operation signal source device as the target device, acquire images of the target device using a corresponding target image acquisition device, perform image recognition on the images to obtain the switching operation image recognition result of the target device, and determine the switching operation identification result of the target device based on the measurement point information of the target device and the switching operation image recognition result. This scheme improves the accuracy and efficiency of determining the switching operation identification result by identifying the target device based on the received equipment switching operation signal, acquiring images of the target device using an image acquisition device, recognizing the images to accurately obtain the switching operation image recognition result, and automatically combining the measurement point information of the target device with the switching operation image recognition result. Attached Figure Description

[0041] Figure 1 This is a flowchart illustrating a switching operation identification method based on digital twins in one embodiment;

[0042] Figure 2 This is a flowchart illustrating a switching operation identification method based on digital twins in another embodiment;

[0043] Figure 3 This is a schematic diagram of the interface of a three-dimensional control platform in one embodiment;

[0044] Figure 4 This is a structural block diagram of a switching operation identification device based on digital twin in one embodiment;

[0045] Figure 5 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0046] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0047] In one embodiment, such as Figure 1As shown, a switching operation identification method based on digital twins is provided. This embodiment illustrates the application of this method to a terminal, including the following steps:

[0048] Step S101: Receive the equipment switching operation signal.

[0049] In this step, the equipment switching operation signal can be a signal triggered when the operator performs a switching operation on the equipment.

[0050] Specifically, the terminal receives equipment switching operation signals sent by the measurement point system. The terminal can be a terminal equipped with a digital twin system, and both the intelligent monitoring system and the measurement point system can be business subsystems integrated with the digital twin system.

[0051] Step S102: Determine the operation signal source device corresponding to the equipment switching operation signal as the target device.

[0052] In this step, the operating signal source device can be a device that has been used by the operator to perform a switching operation (the device that triggered the switching operation).

[0053] Specifically, the terminal determines the operation signal source device corresponding to the equipment switching operation signal based on the equipment switching operation signal, and uses the operation signal source device as the target device.

[0054] Step S103: Use the target image acquisition device corresponding to the target device to acquire the image of the target device.

[0055] In this step, the target image acquisition device can be a target camera.

[0056] Specifically, after the terminal identifies the target device, it selects the target image acquisition device corresponding to the target device from among multiple image acquisition devices, and then uses the target image acquisition device to acquire the image of the target device.

[0057] Step S104: Perform image recognition on the image to obtain the image recognition result of the switching operation of the target device.

[0058] In this step, the image recognition result of the switching operation can be the result of whether the switching operation was successful, obtained through image recognition.

[0059] Specifically, after the terminal acquires an image of the target device using the target image acquisition device, it performs image recognition on the image to identify whether the target device has successfully performed a switching operation. Based on the image recognition result, it determines the image recognition result of the switching operation of the target device.

[0060] Step S105: Determine the switching operation recognition result of the target device based on the measurement point information of the target device and the image recognition result of the switching operation.

[0061] In this step, the measurement point information can be measurement point signals, such as measurement point data of the disconnector position of the target device.

[0062] Specifically, the terminal receives the measurement point information of the target device, and determines whether the target device has successfully carried out the switching operation based on whether the measurement point information of the target device and the image recognition result of the switching operation are the same or match.

[0063] In the aforementioned digital twin-based switching operation identification method, a switching operation signal is received from the equipment. The corresponding operation signal source equipment is identified as the target equipment. An image acquisition device corresponding to the target equipment is used to acquire an image of the target equipment. Image recognition is performed on the image to obtain the switching operation image recognition result of the target equipment. Based on the measurement point information of the target equipment and the switching operation image recognition result, the switching operation identification result of the target equipment is determined. This scheme improves the accuracy and efficiency of determining the switching operation identification result by identifying the target equipment based on the received switching operation signal, acquiring an image of the target equipment using an image acquisition device, recognizing the image, and automatically combining the measurement point information of the target equipment with the switching operation image recognition result.

[0064] In one embodiment, step S103, which involves using the target image acquisition device corresponding to the target device to acquire images of the target device, specifically includes: determining the target image acquisition device corresponding to the target device from the set of image acquisition devices based on the location information of the target device; and acquiring images of the target device using the target image acquisition device.

[0065] In this embodiment, the location information of the target device can be the geographical location of the target device or the specific location of the target device in the equipment site.

[0066] Specifically, based on the location information of the target device, the terminal determines the target image acquisition device corresponding to the target device from the set of image acquisition devices, and uses the target image acquisition device to acquire the image of the target device.

[0067] The technical solution of this embodiment determines the target image acquisition device corresponding to the target device based on the location information of the target device, which is conducive to quickly and accurately determining the target image acquisition device. The target image acquisition device can acquire images of the target device more accurately and clearly, which is beneficial to improving the accuracy and efficiency of the identification results of the switching operation of the device in the future.

[0068] In one embodiment, step S103, acquiring images of the target device using the target image acquisition device corresponding to the target device, specifically includes: acquiring images of the target device using the target image acquisition device corresponding to the target device through the intelligent monitoring system in the digital twin system; step S104, performing image recognition on the images to obtain the switching operation image recognition result of the target device, specifically includes: performing image recognition on the images through the intelligent monitoring system to obtain the switching operation image recognition result of the target device.

[0069] In this embodiment, the intelligent monitoring system includes a target image acquisition device.

[0070] Specifically, the terminal uses the intelligent monitoring system in the digital twin system to acquire images of the target device using the target image acquisition device corresponding to the target device. The acquired images are fed back to the intelligent monitoring system, which performs image recognition on the images to obtain the image recognition results of the switching operation of the target device.

[0071] The technical solution of this embodiment uses the intelligent monitoring system in the digital twin system to perform image acquisition and image recognition, which is conducive to obtaining the image recognition results of the switching operation of the target equipment more quickly and accurately, thereby improving the accuracy and efficiency of the subsequent determination of the switching operation recognition results of the equipment.

[0072] In one embodiment, receiving the equipment switching operation signal in step S101 specifically includes: monitoring the equipment switching operation information of the measuring point system through the digital twin system; and receiving the equipment switching operation signal sent by the measuring point system through the digital twin system.

[0073] In this embodiment, the measuring point system is used to generate a switching operation signal based on the equipment switching operation information when the equipment switching operation information changes, and send the equipment switching operation signal to the digital twin system. The switching operation information can be real-time measuring point signal data.

[0074] Specifically, when the equipment switching operation information changes, the measuring point system generates an equipment switching operation signal based on the equipment switching operation information and sends the equipment switching operation signal to the digital twin system. The terminal monitors the equipment switching operation signal of the measuring point system through the digital twin system, and receives the equipment switching operation signal sent by the measuring point system through the digital twin system when the equipment switching operation information changes.

[0075] The technical solution of this embodiment receives the equipment switching operation signal sent by the measuring point system through the digital twin system, which helps to improve the accuracy and efficiency of receiving the equipment switching operation signal, thereby helping to improve the accuracy and efficiency of subsequently determining the equipment switching operation identification result.

[0076] In one embodiment, step S105, which determines the switching operation recognition result of the target device based on the measurement point information of the target device and the switching operation image recognition result, specifically includes: determining the switching operation measurement point recognition result of the target device based on the measurement point information; and when the switching operation measurement point recognition result and the switching operation image recognition result are the same, taking the switching operation measurement point recognition result or the switching operation image recognition result as the switching operation recognition result.

[0077] In this embodiment, the switching operation measurement point identification result can be the result of whether the switching operation was successful, determined based on the measurement point information.

[0078] Specifically, the terminal determines the switching operation measurement point identification result of the target equipment based on the measurement point information, and judges whether the switching operation measurement point identification result and the switching operation image identification result are the same. If the switching operation measurement point identification result and the switching operation image identification result are the same, the switching operation measurement point identification result or the switching operation image identification result is taken as the switching operation identification result. If the switching operation measurement point identification result and the switching operation image identification result are different, an alarm can be triggered to instruct personnel to go to the target equipment site to confirm the actual result.

[0079] The technical solution of this embodiment determines the switching operation identification result when the switching operation measurement point identification result and the switching operation image identification result are the same. This is beneficial to improve the accuracy of determining the switching operation identification result of the equipment by using the double confirmation method of switching operation measurement point identification result and switching operation image identification result.

[0080] In one embodiment, the above method can also determine the post-operation field image by the following steps: specifically, determining the post-operation field image for the target device based on the image; the above method can also display the switching operation identification result and the post-operation field image by the following steps: specifically, displaying the switching operation identification result and the post-operation field image in the interface of the digital twin system.

[0081] In this embodiment, the post-operation field image can be the field image of the target device after the device switching operation signal is triggered; the interface of the digital twin system can be the front-end interface of the three-dimensional control platform in the digital twin system.

[0082] Specifically, the terminal determines the post-operation scene image of the target device based on the image, and after determining the switching operation recognition result of the target device based on the measurement point information of the target device and the switching operation image recognition result, the switching operation recognition result and the post-operation scene image are displayed in the interface of the digital twin system.

[0083] The technical solution of this embodiment improves the timeliness and functionality of the switching operation recognition results by displaying the switching operation recognition results and the on-site images after the operation in the interface of the digital twin system.

[0084] The following example illustrates the switching operation identification method based on digital twins provided in this application. This example demonstrates the application of this method to a terminal, and the main steps include:

[0085] The first step is for the terminal to monitor the switching operation information of the equipment in the monitoring point system through the digital twin system.

[0086] The second step is for the terminal to receive the equipment switching operation signal sent by the measuring point system through the digital twin system.

[0087] The third step is for the terminal to identify the operation signal source device corresponding to the switching operation signal of the equipment as the target device.

[0088] The fourth step is for the terminal to determine the target image acquisition device corresponding to the target device from the set of image acquisition devices based on the location information of the target device.

[0089] Fifth, the terminal uses the intelligent monitoring system in the digital twin system to acquire images of the target device using the target image acquisition device corresponding to the target device.

[0090] The sixth step involves the terminal using an intelligent monitoring system to perform image recognition on the image, obtaining the image recognition results of the switching operation of the target device.

[0091] The seventh step is for the terminal to determine the identification result of the switching operation measurement point of the target equipment based on the measurement point information.

[0092] Step 8: If the switching operation measurement point recognition result and the switching operation image recognition result are the same, the terminal will take the switching operation measurement point recognition result or the switching operation image recognition result as the switching operation recognition result.

[0093] The ninth step is for the terminal to determine the post-operation scene image of the target device based on the image.

[0094] Step 10: The terminal displays the switching operation recognition results and post-operation site images on the interface of the digital twin system.

[0095] The measuring point system is used to generate a switching operation signal based on the equipment switching operation information when the equipment switching operation information changes, and then send the equipment switching operation signal to the digital twin system; the intelligent monitoring system includes target image acquisition equipment.

[0096] The technical solution of this embodiment determines the target device for the corresponding switching operation based on the received device switching operation signal, acquires an image of the target device using an image acquisition device, identifies the image to accurately obtain the switching operation image recognition result, and automatically combines the measurement point information of the target device with the switching operation image recognition result to determine the switching operation recognition result of the target device, thereby improving the accuracy and efficiency of determining the switching operation recognition result of the device.

[0097] The following application example illustrates the switching operation identification method based on digital twins provided in this application. This application example demonstrates the application of this method to a terminal, such as... Figure 2 As shown, the main steps include:

[0098] The first step is for the terminal to monitor the equipment switching operation signal of the measurement point system through the digital twin of the converter station. When the equipment switching operation signal is generated, the equipment switching operation judgment task is generated.

[0099] The second step involves the terminal sending an image recognition task to the intelligent monitoring system through the converter station's digital twin. This task calls upon a camera near the signal source device to perform image recognition and determine the result of the switching operation.

[0100] The third step involves the terminal using the converter station's digital twin to analyze the measurement values ​​of the equipment in the measurement system and the results of intelligent monitoring images. This assists the user in automatically judging the switching operation results remotely and displays the judgment results based on the corresponding switching operation equipment within the digital twin.

[0101] The converter station digital twin is a system built upon a 3D scene, equipment operation monitoring system, and integrated station-side maintenance business sub-modules. It reflects the real-time operating status of the converter station and assists maintenance personnel in management. Developers achieve data fusion by establishing a mapping relationship between digital objects within the twin and data sources. The mapping relationship between data sources and equipment is a capability of the digital twin. The intelligent monitoring system and measurement point system are both business sub-systems integrated into the converter station digital twin. For example, the converter station digital twin is a system built upon a 3D scene, equipment operation monitoring system, and integrated station-side maintenance business sub-modules. The system built by the terminal operation and maintenance business sub-module can reflect the real-time operating status of the converter station and assist operation and maintenance personnel in management and control; Intelligent monitoring system: A monitoring system with image analysis function, which can perform image analysis on the media data collected by cameras and identify the results of equipment switching operations; Converter station measurement point system: The main function of this system is to receive real-time measurement point signal data of the converter station from the operation and maintenance master station / data center; Switching operation: The equipment status in the power system is divided into three states: operation, standby, and maintenance. The process of changing the equipment from one state to another is called switching, and the operation performed is called switching operation.

[0102] Specifically, such as Figure 2 As shown, when converter station staff operate primary equipment, generating SER (Event Sequence Recorder) events (such as equipment switching operation signals), these SER events can be transmitted to the SIS (Safety Instrumented System). The SIS then sends the SER events to the data acquisition equipment of the integrated platform (one of the subsystems of the converter station's digital twin). The data acquisition equipment transmits the corresponding SER events and measurement point data to a massive database (the massive database has a buffer time of approximately fifteen minutes for data storage). The massive database then transmits the SER data and measurement point data (such as disconnector position measurement point data) to the 3D control platform (one of the subsystems of the converter station's digital twin). The 3D control platform scans the massive database for SER events at fixed intervals (polling the massive database to check for operational SER events). If no updates are found, the polling continues; if updates are found, an operation is generated. The system generates an intelligent operation confirmation task (generated in the background) and sends the intelligent monitoring task to the intelligent monitoring console of the intelligent monitoring system (one of the subsystems of the converter station's digital twin). The intelligent monitoring console then sends the task to the camera to capture real-time monitoring footage. The system analyzes the monitoring footage and pushes the real-time camera footage to the streaming media server in the 3D control platform. Simultaneously, the intelligent monitoring analysis results are sent to the backend TCP (Transmission Control Protocol) service module in the 3D control platform. The 3D control platform analyzes whether the measurement point data and the intelligent monitoring analysis results are the same or match (judging between the disconnector position measurement point data and the intelligent monitoring analysis results). If they match, the switching operation identification result is confirmed and displayed. The corresponding disconnector model in the 3D control platform is closed or opened according to the data to provide feedback to the converter station staff, assisting them in verifying that the operation results match the actual situation.

[0103] For example, the interface of the 3D control platform is as follows: Figure 3 As shown, the interface includes a 3D intelligent management and control platform marker, toolbar, viewpoint navigation, event list, and real-time monitoring images. The interface displays real-time 3D video and can automatically retrieve the camera footage to view the real-time images.

[0104] For example, the terminal establishes a mapping relationship between multi-source data and field equipment based on the converter station's digital twin, realizing multi-source data fusion. It can display the associated data of virtual devices within the digital twin and carry out operational business. Based on the video system's image recognition function for the position status of circuit breakers, disconnectors, grounding switches, etc., it can identify the equipment status after operation. Data fusion is achieved based on the mapping relationship between digital objects and multi-source data within the converter station's digital twin. On this basis, joint analysis and result display are completed through image recognition and measurement point information. For example, the terminal identifies the equipment switching operation results by calling the image analysis function of the station's intelligent monitoring system, combines the obtained analysis results with the measurement point signals of the converter station's measurement point system for joint judgment, analyzes whether the equipment switching operation is correct, and dynamically displays the judgment results, post-operation field images, and operation illustration animations on the digital twin.

[0105] The technical solution in this application example allows the terminal to determine the results of equipment switching operations upon completion of the equipment switching operation by integrating image discrimination data from the intelligent monitoring system and measurement signal data from the corresponding equipment locations in the converter station's measurement point system. This achieves multi-source data fusion by establishing a mapping relationship between digital objects and data sources, with the converter station's digital twin as the core. Data and equipment resources across systems can be linked and invoked based on this mapping relationship. It also provides a reliable "double confirmation" method for judging the results of converter station equipment switching operations, helping operators remotely confirm the results of on-site equipment switching operations. This aligns with the current technological development direction of "unmanned" and "less manned" intelligent converter stations.

[0106] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0107] Based on the same inventive concept, this application also provides a digital twin-based switching operation identification device for implementing the aforementioned digital twin-based switching operation identification method. The solution provided by this device is similar to the implementation described in the above method. Therefore, the specific limitations of one or more embodiments of the digital twin-based switching operation identification device provided below can be found in the limitations of the digital twin-based switching operation identification method described above, and will not be repeated here.

[0108] In one embodiment, such as Figure 4 As shown, a switching operation identification device based on digital twin is provided. The device 400 may include:

[0109] Signal receiving module 401 is used to receive switching operation signals from the equipment;

[0110] The device determination module 402 is used to determine the operation signal source device corresponding to the switching operation signal of the device, and use it as the target device;

[0111] Image acquisition module 403 is used to acquire images of the target device using a target image acquisition device corresponding to the target device;

[0112] Image recognition module 404 is used to perform image recognition on the image to obtain the switching operation image recognition result of the target device;

[0113] The result determination module 405 is used to determine the switching operation recognition result of the target device based on the measurement point information of the target device and the switching operation image recognition result.

[0114] In one embodiment, the image acquisition module 403 is further configured to determine the target image acquisition device corresponding to the target device from the image acquisition device set based on the location information of the target device; and to acquire an image of the target device using the target image acquisition device.

[0115] In one embodiment, the image acquisition module 403 is further configured to acquire the image of the target device through the intelligent monitoring system in the digital twin system using the target image acquisition device corresponding to the target device; the intelligent monitoring system includes the target image acquisition device; the image recognition module 404 is further configured to perform image recognition on the image through the intelligent monitoring system to obtain the switching operation image recognition result of the target device.

[0116] In one embodiment, the signal receiving module 401 is further configured to monitor the equipment switching operation information of the measuring point system through the digital twin system; the measuring point system is configured to generate the equipment switching operation signal according to the equipment switching operation information when the equipment switching operation information changes, and send the equipment switching operation signal to the digital twin system; and receive the equipment switching operation signal sent by the measuring point system through the digital twin system.

[0117] In one embodiment, the result determination module 405 is further configured to determine the switching operation measurement point identification result of the target device based on the measurement point information; if the switching operation measurement point identification result and the switching operation image identification result are the same, the switching operation measurement point identification result or the switching operation image identification result shall be used as the switching operation identification result.

[0118] In one embodiment, the device 400 further includes: an image determination module, configured to determine a post-operation field image of the target device based on the image; the device 400 further includes: a result display module, configured to display the switching operation recognition result and the post-operation field image in the interface of the digital twin system.

[0119] The modules in the aforementioned digital twin-based switching operation identification device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0120] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 5As shown, the computer device includes a processor, memory, input / output interface, communication interface, display unit, and input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interface. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The input / output interface is used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements a digital twin-based switching operation identification method. The display unit is used to form a visually visible image and can be a display screen, projection device, or virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.

[0121] Those skilled in the art will understand that Figure 5 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0122] In one embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.

[0123] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.

[0124] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0125] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data shall comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0126] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0127] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0128] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A switching operation identification method based on digital twin, characterized in that, The method, applied to a terminal equipped with a digital twin system, wherein the digital twin system is a converter station digital twin system, includes: The system receives equipment switching operation signals sent by the measurement point system; wherein, the intelligent monitoring system and the measurement point system are business subsystems integrated into the digital twin system, and the measurement point system is used to generate the equipment switching operation signal according to the equipment switching operation information when the equipment switching operation information changes, and send the equipment switching operation signal to the digital twin system; Identify the operation signal source device corresponding to the switching operation signal of the equipment as the target device; The intelligent monitoring system within the digital twin system acquires images of the target device using a target image acquisition device corresponding to the target device; the intelligent monitoring system includes the target image acquisition device. The intelligent monitoring system performs image recognition on the image to obtain the switching operation image recognition result of the target device; Based on the measurement point information of the target device and the image recognition result of the switching operation, the recognition result of the switching operation of the target device is determined; the measurement point information includes the measurement point data of the disconnector position of the target device; The method further includes: The real-time image from the target image acquisition device is streamed to the streaming media server in the 3D control platform. Simultaneously, the intelligent monitoring and analysis results are sent to the backend TCP service module in the 3D control platform. The 3D control platform analyzes whether the measurement point data and the intelligent monitoring and analysis results are the same or match. If so, the switching operation identification result is determined and displayed. The corresponding disconnector model in the 3D control platform is closed or opened according to the data to provide feedback to the converter station staff, assisting them in seeing that the operation results match the actual situation.

2. The method according to claim 1, characterized in that, The step of acquiring an image of the target device using the target image acquisition device corresponding to the target device includes: Based on the location information of the target device, the target image acquisition device corresponding to the target device is determined from the set of image acquisition devices; The target image acquisition device is used to acquire an image of the target device.

3. The method according to claim 1, characterized in that, The target image acquisition device is a target camera.

4. The method according to claim 1, characterized in that, The equipment switching operation signal sent by the receiving measurement point system includes: The digital twin system monitors the equipment switching operation information of the measuring point system; the measuring point system is used to generate the equipment switching operation signal according to the equipment switching operation information when the equipment switching operation information changes, and send the equipment switching operation signal to the digital twin system. The digital twin system receives the equipment switching operation signal sent by the measuring point system.

5. The method according to claim 1, characterized in that, The step of determining the switching operation recognition result of the target device based on the measurement point information of the target device and the switching operation image recognition result includes: Based on the measurement point information, determine the switching operation measurement point identification result of the target equipment; If the switching operation measurement point identification result and the switching operation image identification result are the same, the switching operation measurement point identification result or the switching operation image identification result shall be taken as the switching operation identification result.

6. The method according to claim 1, characterized in that, The method further includes: Based on the image, determine the post-operation scene image for the target device; After determining the switching operation recognition result of the target device based on the measurement point information of the target device and the switching operation image recognition result, the method further includes: The identification results of the switching operation and the on-site images after the operation are displayed in the interface of the digital twin system.

7. A switching operation identification device based on digital twin, characterized in that, An apparatus for use in terminals equipped with a digital twin system, wherein the digital twin system is a converter station digital twin system, the apparatus comprising: The signal receiving module is used to receive the equipment switching operation signal sent by the measuring point system; wherein, the intelligent monitoring system and the measuring point system are business subsystems integrated into the digital twin system, and the measuring point system is used to generate the equipment switching operation signal according to the equipment switching operation information when the equipment switching operation information changes, and send the equipment switching operation signal to the digital twin system; The device determination module is used to determine the operation signal source device corresponding to the switching operation signal of the device, and use it as the target device; An image acquisition module is used to acquire images of the target device through the intelligent monitoring system in the digital twin system, using a target image acquisition device corresponding to the target device; the intelligent monitoring system includes the target image acquisition device; The image recognition module is used to perform image recognition on the image through the intelligent monitoring system to obtain the image recognition result of the switching operation of the target device; The result determination module is used to determine the switching operation recognition result of the target device based on the measurement point information of the target device and the switching operation image recognition result; the measurement point information includes the measurement point data of the disconnector position of the target device; It also includes: streaming the real-time image from the target image acquisition device to the streaming media server in the 3D control platform, and simultaneously sending the intelligent monitoring and analysis results to the backend TCP service module in the 3D control platform. The 3D control platform analyzes whether the measurement point data and the intelligent monitoring and analysis results are the same or match. If so, it determines and displays the switching operation identification result, and closes or opens the corresponding disconnector model in the 3D control platform according to the data to provide feedback to the converter station staff and assist the converter station staff in seeing that the operation result matches the site conditions.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Method and device for monitoring opening and closing state of switch equipment

    CN111600388A

  • Electric power system operation data visualization system and method based on digital twinning technology

    CN112069247A