Pumped storage power station operation monitoring method and device, electronic equipment and storage medium

Abstract

The invention provides a pumped storage power station operation monitoring method and device, electronic equipment and a storage medium, and the method comprises the steps: firstly obtaining the monitoring image information of a target operator in a pumped storage power station, and then inputting the monitoring image information into a working behavior abnormality recognition model obtained through training, the method comprises the following steps: acquiring monitoring image information of a target operator, obtaining an identification result corresponding to the monitoring image information, and when it is determined that the identification result corresponding to the monitoring image information is working behavior abnormity, sending an abnormity prompt instruction to MR equipment worn by the target operator, so that the MR equipment displays abnormal behavior prompt information to a user. Therefore, the abnormal working behaviors of the operating personnel can be accurately and quickly identified through the identification and judgment of the working behavior abnormity identification model on the monitoring image information, and the abnormal working behaviors are timely transmitted to the operating user through the MR equipment, so that the operating user can timely correct the abnormal working behaviors, the real-time monitoring of the working behaviors of the operating user is realized, and the working efficiency is improved. And the monitoring efficiency is improved.

Description

Technical Field

[0001] The present application relates to the technical field of pumped storage power station operation monitoring, and in particular to a pumped storage power station operation monitoring method, device, electronic equipment and storage medium. Background Art

[0002] A pumped storage power station is a hydropower station that uses electricity during low load periods to pump water to the upper reservoir, and releases water to the lower reservoir for power generation during peak load periods. It is also called a storage hydropower station. It can convert excess electricity during low load periods into high-value electricity during peak load periods. It is also suitable for frequency and phase modulation, stabilizing the frequency and voltage of the power system, and is suitable for emergency standby. It can also improve the efficiency of thermal power plants and nuclear power plants in the system.

[0003] When a pumped storage power station is actually in use, it is necessary to conduct regular personnel inspections to determine whether the pumped storage power station is operating normally. During the inspection, it is necessary to judge the construction work specifications of the personnel. For example, maintenance personnel need to perform a series of actions before working at heights. The first step is to place a warning sign, the second step is to check whether the safety belt is damaged, the third step is to fix the safety belt, and the fourth step is to wear a safety helmet and fasten the safety rope. At present, the relevant technology usually manually determines the behavior specifications of the inspection personnel, which is inaccurate and cannot promptly remind the operator when abnormal work behavior occurs. Summary of the invention

[0004] In view of this, the purpose of the present application is to propose a pumped storage power station operation monitoring method, device, electronic equipment and storage medium to solve or partially solve the above technical problems.

[0005] Based on the above purpose, the present application provides a method for monitoring the operation of a pumped storage power station, comprising:

[0006] Obtain monitoring image information of target operators in pumped storage power stations;

[0007] Inputting the monitoring image information into the trained work behavior abnormality recognition model to obtain a recognition result corresponding to the monitoring image information;

[0008] In response to determining that the recognition result corresponding to the monitoring image information is abnormal work behavior, an abnormal prompt instruction is sent to the MR device worn by the target operator, so that the MR device displays abnormal behavior prompt information to the user.

[0009] Based on the same concept, the present application also proposes a pumped storage power station operation monitoring device, comprising:

[0010] An acquisition module, which acquires monitoring image information of target operators in a pumped storage power station;

[0011] A recognition module, inputting the monitoring image information into a trained abnormal work behavior recognition model to obtain a recognition result corresponding to the monitoring image information;

[0012] The prompt module, in response to determining that the recognition result corresponding to the monitoring image information is abnormal work behavior, sends an abnormal prompt instruction to the MR device worn by the target operator, so that the MR device displays abnormal behavior prompt information to the user.

[0013] Based on the same concept, the present application also proposes an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the pumped storage power station operation monitoring method as described above is implemented.

[0014] Based on the same concept, the present application also proposes a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a computer to execute the pumped-storage power station operation monitoring method as described above.

[0015] Based on the same concept, the present application also proposes a computer program product, which includes a computer program. The computer program is executed by one or more processors so that the processors execute the pumped storage power station operation monitoring method as described above.

[0016] From the above, it can be seen that the pumped-storage power station operation monitoring method, device, electronic device and storage medium provided by the present application first obtain the monitoring image information of the target operator in the pumped-storage power station, and then input the monitoring image information into the trained work behavior abnormality recognition model to obtain the recognition result corresponding to the monitoring image information. When it is determined that the recognition result corresponding to the monitoring image information is abnormal work behavior, an abnormal prompt instruction is sent to the MR device worn by the target operator, so that the MR device displays the abnormal behavior prompt information to the user, thereby accurately and quickly identifying the abnormal work behavior of the operator through the recognition and judgment of the work behavior abnormality recognition model on the monitoring image information, and promptly conveying it to the operation user through the MR device to ensure that the operation user corrects the abnormal work behavior in time, realizes real-time monitoring of the work behavior of the operation user, and improves the monitoring efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 A schematic diagram of an application scenario of an embodiment of the present application;

[0019] Figure 2 A schematic diagram of a flow chart of a method for monitoring operation of a pumped storage power station according to an embodiment of the present application;

[0020] Figure 3 A schematic diagram of the structure of a pumped storage power station operation monitoring device according to an embodiment of the present application;

[0021] Figure 4 A schematic diagram of a specific electronic device hardware structure of an embodiment of the present application. DETAILED DESCRIPTION

[0022] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0023] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should be the usual meanings understood by people with general skills in the field to which the present application belongs. The "first", "second" and similar words used in the present application do not represent any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements or objects appearing in front of the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connecting" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, which can be direct connections, indirect connections, wired connections, and wireless connections. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly. In addition, in the description of the present application, unless otherwise specified, the term "multiple" refers to two or more. The term "and / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0024] The principles and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present application, and are not intended to limit the scope of the present application in any way. On the contrary, these embodiments are provided to make the present application more thorough and complete, and to fully convey the scope of the present application to those skilled in the art.

[0025] It is understandable that before using the technical solutions of each embodiment of the present application, the type, scope of use, usage scenarios, etc. of the personal information involved will be informed to the user in an appropriate manner, and the user's authorization will be obtained.

[0026] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly remind the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can independently choose whether to provide personal information to the electronic device, application, server, storage medium or other software or hardware that performs the operation of the technical solution of the present application according to the prompt message.

[0027] As an optional but non-limiting implementation, in response to receiving the user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0028] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation method of this application. Other methods that meet relevant laws and regulations may also be applied to the implementation method of this application.

[0029] It should be understood herein that any number of elements in the drawings is for illustration rather than limitation, and any naming is only for distinction rather than having any limiting meaning.

[0030] As described in the background technology section, when a pumped-storage power station is actually used, it is necessary to conduct regular personnel inspections to determine whether the pumped-storage power station is operating normally. During the inspection, it is necessary to judge the construction work specifications of the personnel. For example, maintenance personnel need to perform a series of actions before working at heights. The first step is to place a warning sign, the second step is to check whether the safety belt is damaged, the third step is to fix the safety belt, and the fourth step is to wear a safety helmet and fasten the safety rope. At present, the relevant technology usually manually determines the behavior specifications of the inspection personnel. This judgment method is not only inaccurate, but also fails to promptly remind the operator when abnormal work behavior occurs.

[0031] In summary, in order to solve the above problems, the present application embodiment proposes a pumped storage power station operation monitoring method, including:

[0032] First, monitoring image information of the target operator in the pumped-storage power station is obtained, and then the monitoring image information is input into the trained work behavior abnormality recognition model to obtain the recognition result corresponding to the monitoring image information. When it is determined that the recognition result corresponding to the monitoring image information is abnormal work behavior, an abnormal prompt instruction is sent to the MR device worn by the target operator, so that the MR device displays abnormal behavior prompt information to the user, thereby accurately and quickly identifying the abnormal work behavior of the operator through the recognition and judgment of the work behavior abnormality recognition model on the monitoring image information, and timely conveying it to the operating user through the MR device to ensure that the operating user corrects the abnormal work behavior in time, realizes real-time monitoring of the working behavior of the operating user, and improves the monitoring efficiency.

[0033] In some specific application scenarios, the pumped storage power station operation monitoring method of the present application can be applied to various platforms or systems involving pumped storage power station operation monitoring. As an example, the application scenario includes at least one server and at least one terminal. Figure 1 , which is a schematic diagram of an application scenario of a pumped storage power station operation monitoring method provided by an exemplary embodiment of the present disclosure. The application scenario includes a terminal device 101, a server 102, and a data storage system 103. Among them, the terminal device 101, the server 102 and the data storage system 103 can be connected through a wired or wireless communication network. The terminal device includes but is not limited to a desktop computer, a mobile phone, a mobile computer, a tablet computer, a media player, a smart wearable device, a personal digital assistant (PDA) or other electronic devices capable of realizing the above functions. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The server and the terminal can communicate through the network to realize data transmission. Among them, the network can be a wired network or a wireless network, which is not specifically limited in this application.

[0034] The server can be a server that provides various services. Specifically, the server can be used to provide background services for applications running on the terminal. Optionally, in some implementations, the pumped-storage power station operation monitoring method provided in the embodiment of the present application can be executed by the server. Optionally, in some implementations, the pumped-storage power station operation monitoring method provided in the embodiment of the present application can also be directly executed by the terminal device (i.e., MR device). Optionally, the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, software or software modules used to provide distributed services), or it can be implemented as a single software or software module. The embodiment of the present application does not specifically limit this.

[0035] Optionally, the wireless network or wired network uses standard communication technology and / or protocol. The network is usually the Internet, but it can also be any network, including but not limited to a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a mobile, wired or wireless network, a dedicated network or any combination of a virtual private network). In some embodiments, the data exchanged through the network is represented by technologies and / or formats including hypertext mark-up language (HTML), extensible markup language (XML), etc. In addition, conventional encryption technologies such as secure socket layer (SSL), transport layer security (TLS), virtual private network (VPN), and Internet protocol security (IPsec) can be used to encrypt all or some links. In other embodiments, customized and / or dedicated data communication technologies can also be used to replace or supplement the above data communication technologies.

[0036] The data storage system stores a large amount of data. Optionally, the data storage system can partition the data according to different uses and data types. The source of the data includes but is not limited to an existing database, data crawled from the Internet, or data uploaded by the user when using the client.

[0037] The following describes the pumped storage power station operation monitoring method according to the exemplary embodiment of the present application in conjunction with a specific application scenario. It should be noted that the above application scenario is only shown to facilitate understanding of the spirit and principle of the present application, and the implementation of the present application is not limited in this regard. On the contrary, the implementation of the present application can be applied to any applicable scenario.

[0038] refer to Figure 2 , is a flow chart of a method for monitoring operation of a pumped storage power station according to an embodiment of the present application, the method comprising the following steps:

[0039] S101, obtaining monitoring image information of target workers in a pumped-storage power station.

[0040] During specific implementation, the target operator may be any operator working in a pumped-storage power station, and the monitoring image information is the image information of the target operator when working on-site at the pumped-storage power station, which is collected by a shooting device. Optionally, the detection image information may be a photo or video information, which is not limited to this. Optionally, the specific collection of monitoring image information may be selected as needed, for example, it may be a camera set up on-site at a pumped-storage power station, which is not limited to this. It should be noted that, considering that the embodiment of the present application requires the use of a neural network for image recognition operations, the requirements for the device hardware are relatively high. In order to prevent jamming during the operation due to low device configuration, the present solution can be run through a server. When the present solution is run through a server, the monitoring image information can be first collected through a camera device, and then the camera device sends the collected detection image information to the server.

[0041] In some embodiments, obtaining monitoring image information of a target operator in a pumped-storage power station specifically includes:

[0042] The monitoring image information of the target operator is acquired through the MR device and / or the camera device arranged in the pumped-storage power station.

[0043] In specific implementation, in order to accurately collect the monitoring image information of the target operator at work, the monitoring image information of the target operator can be collected by the camera equipment set in the pumped storage power station and / or the MR device worn by the target operator. It should be noted that, considering that there may be blind spots in the collection if the monitoring image information is collected only by the camera equipment set in the pumped storage power station, the embodiment of the present application also includes collecting monitoring image information by the MR device worn by the target operator. Since the MR device is worn on the operator and can move with the operator, the shooting blind spot is further reduced, and the image information collected by the MR device is closer to the image information seen from the perspective of the operator, which is more conducive to analyzing the abnormal behavior of the user.

[0044] S102, inputting the monitoring image information into a trained work behavior abnormality recognition model to obtain a recognition result corresponding to the monitoring image information.

[0045] In specific implementation, after acquiring the monitoring image information of the target operator, the monitoring image information can be input into the trained work behavior abnormality recognition model to obtain the recognition result corresponding to the monitoring image information. Optionally, the recognition result generally includes: abnormal work behavior and normal work behavior. It should be noted that in the process of judging whether the work behavior of the target operator is abnormal through the work behavior abnormality recognition model, when there are multiple monitoring image information, each monitoring image information is input into the abnormal recognition model in turn. When it is determined that at least one of the multiple recognition results is abnormal work behavior, it is determined that the work behavior of the target operator is abnormal; when it is determined that all the recognition results are normal work behavior, it is determined that the work behavior of the target operator is normal.

[0046] In some embodiments, the process of training the abnormal work behavior recognition model includes:

[0047] Based on the first training sample set, a benchmark model corresponding to the abnormal work behavior recognition model is trained to obtain a first model; wherein the first training sample set includes historical sample images collected by the target operator in historical operations of the pumped-storage power station;

[0048] The first model is trained based on a second training sample set to obtain the work behavior abnormality recognition model; wherein the second training sample set includes instance sample images collected when the target operator wears the MR device and performs simulated work according to preset abnormal behavior.

[0049] The specific implementation is that if the historical sample images of the target operator in the historical operation of the pumped storage power station are directly used to train the model, since the target operator may not have all possible abnormal behaviors in daily operations, it may cause the model to be insufficiently trained for the recognition of some abnormal behaviors, which ultimately affects the behavior recognition of the model. In order to avoid this situation, in the embodiment of the present application, the benchmark model is first trained by the first training sample set to obtain the first model, and then the first model is trained by the second training sample set to finally obtain the abnormal recognition model of the work behavior. It should be noted that the first training sample set mainly includes the historical sample images collected by the target operator in the historical operation of the pumped storage power station. The model can be equipped with basic behavior recognition capabilities through the training module of the first training sample set, and the second training sample set is mainly composed of the example sample images obtained when the target operator wears the MR device to simulate the operation according to the preset abnormal behavior. Therefore, the model can be trained by the second training sample set to strengthen the model's recognition of various abnormal behaviors and further ensure the accuracy of model recognition. Optionally, the preset abnormal behavior can be set as needed, and there is no limitation on this.

[0050] In some embodiments, the reference model is a convolutional neural network model (CNN). Optionally, the user can select a neural network model of other structures as the reference model of the training model as needed, without limitation.

[0051] It should be noted that the structure of the convolutional neural network includes an input layer and a hidden layer. The input layer of the convolutional neural network can process multidimensional data. Commonly, the input layer of a one-dimensional convolutional neural network receives a one-dimensional or two-dimensional array, where the one-dimensional array is usually time or spectrum sampling; the two-dimensional array may contain multiple channels; the input layer of a two-dimensional convolutional neural network receives a two-dimensional or three-dimensional array; the input layer of a three-dimensional convolutional neural network receives a four-dimensional array. In some embodiments, three-dimensional input data can be used as the input of the convolutional neural network, that is, two-dimensional pixels and RGB channels on a plane. Optionally, the input features of the convolutional neural network need to be standardized. Specifically, before inputting the learning data into the convolutional neural network, the input data can be normalized in the channel or time / frequency dimension. If the input data is a pixel, the original pixel values ​​distributed in can also be normalized to an interval. Standardization of input features is conducive to improving the learning efficiency and performance of convolutional neural networks.

[0052] S103, in response to determining that the recognition result corresponding to the monitoring image information is abnormal work behavior, sending an abnormal prompt instruction to the MR device worn by the target operator, so that the MR device displays abnormal behavior prompt information to the user.

[0053] In specific implementation, when it is determined that the recognition result corresponding to the monitoring image information is abnormal work behavior, an abnormal prompt instruction can be sent to the MR device worn by the target operator, so that the MR device displays abnormal behavior prompt information to the user.

[0054] It should be noted that MR Mixed Reality is a new interactive mode that combines virtual reality (VR) and augmented reality (AR) technologies. In MR devices, virtuality and reality are integrated and can interact with each other to achieve a new interactive mode. MR Mixed Reality technology can project virtual digital content into the user's field of view through a dedicated head-mounted device or other smart terminal. It can also sense the user's actions and environment in real time and respond to them, making the user feel immersed. Displaying abnormal behavior prompt information to users through MR devices can improve the prompt effect and prevent users from ignoring abnormal behavior prompt information.

[0055] It should be noted that in some embodiments, when operators are working, wearing MR devices can not only provide timely safety reminders, but also provide some auxiliary support for the user's work. For example, the parameters of various equipment can be displayed in the graphic user interface provided by the MR device, or the dimensions of some equipment on site can be displayed in the graphical user interface.

[0056] In some embodiments, the abnormal behavior prompt information includes one or more of the following information: text prompt information, voice prompt information, image prompt information. Optionally, in some embodiments, the abnormal behavior prompt information may also include a vibration prompt issued by the MR device.

[0057] In some embodiments, in response to determining that the recognition result corresponding to the monitoring image information is abnormal working behavior, the method further includes:

[0058] Determining whether the working behavior corresponding to the recognition result is a preset abnormal behavior;

[0059] In response to determining that the working behavior corresponding to the recognition result is the preset abnormal behavior, an emergency alarm message is sent to the remote monitoring terminal so that the remote monitoring terminal issues an on-site guidance or emergency rescue instruction.

[0060] In the specific implementation, considering that some emergency situations may occur when the operators are on site at the pumped storage power station, for example, the operators faint or are in danger, or cannot complete the work independently, then it is necessary to notify external personnel as soon as possible for support. Therefore, in the embodiment of the present application, when it is determined that the work behavior corresponding to the recognition result is the preset abnormal behavior, an emergency alarm message is sent to the remote monitoring end so that the remote monitoring end issues instructions for on-site guidance or emergency rescue. Optionally, the preset abnormal behavior can be set as needed, and there is no limitation on this.

[0061] In some embodiments, in response to determining that the recognition result corresponding to the monitoring image information is abnormal working behavior, the method further includes:

[0062] Determine the standard work behavior information corresponding to the recognition result based on the work behavior corresponding to the recognition result;

[0063] The standard behavior information is sent to the MR device, so that the MR device displays the standard work behavior information to the user.

[0064] In specific implementation, in order to help the target operator to standardize the work behavior as soon as possible, after determining that the work behavior corresponding to the recognition result is the preset abnormal behavior, the standard work behavior information corresponding to the recognition result can be determined according to the work behavior corresponding to the recognition result, and then the standard behavior information is sent to the MR device, so that the MR device displays the standard work behavior information to the user. Optionally, a variety of standard work behavior information can be set in advance as needed, and then the standard work behavior information corresponding to the recognition result can be determined from the multiple standard work behavior information set in advance.

[0065] The pumped-storage power station operation monitoring method provided in the present application first obtains monitoring image information of a target operator in the pumped-storage power station, and then inputs the monitoring image information into a trained work behavior abnormality recognition model to obtain a recognition result corresponding to the monitoring image information; when it is determined that the recognition result corresponding to the monitoring image information is abnormal work behavior, an abnormal prompt instruction is sent to the MR device worn by the target operator, so that the MR device displays abnormal behavior prompt information to the user, thereby accurately and quickly identifying the abnormal work behavior of the operator through the recognition and judgment of the work behavior abnormality recognition model on the monitoring image information, and promptly conveying it to the operation user through the MR device, so as to ensure that the operation user promptly corrects the abnormal work behavior, realize real-time monitoring of the work behavior of the operation user, and improve the monitoring efficiency, further providing guarantee for safe operation in the pumped-storage power station.

[0066] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a pumped-storage power station operation monitoring device.

[0067] refer to Figure 3 , the pumped storage power station operation monitoring device comprises:

[0068] An acquisition module 201 acquires monitoring image information of a target operator in a pumped-storage power station;

[0069] The recognition module 202 inputs the monitoring image information into the trained abnormal work behavior recognition model to obtain a recognition result corresponding to the monitoring image information;

[0070] The prompt module 203, in response to determining that the recognition result corresponding to the monitoring image information is abnormal work behavior, sends an abnormal prompt instruction to the MR device worn by the target operator, so that the MR device displays abnormal behavior prompt information to the user.

[0071] In some embodiments, the acquisition module is specifically used to:

[0072] The monitoring image information of the target operator is acquired through the MR device and / or the camera device arranged in the pumped-storage power station.

[0073] In some embodiments, the apparatus further comprises a model training module for:

[0074] Based on the first training sample set, a benchmark model corresponding to the abnormal work behavior recognition model is trained to obtain a first model; wherein the first training sample set includes historical sample images collected by the target operator in historical operations of the pumped-storage power station;

[0075] The first model is trained based on a second training sample set to obtain the work behavior abnormality recognition model; wherein the second training sample set includes instance sample images collected when the target operator wears the MR device and performs simulated work according to preset abnormal behavior.

[0076] In some embodiments, the baseline model is a convolutional neural network model.

[0077] In some embodiments, the abnormal behavior prompt information includes one or more of the following information: text prompt information, voice prompt information, and image prompt information.

[0078] In some embodiments, the device further comprises an alarm module for:

[0079] Determining whether the working behavior corresponding to the recognition result is a preset abnormal behavior;

[0080] In response to determining that the working behavior corresponding to the recognition result is the preset abnormal behavior, an emergency alarm message is sent to the remote monitoring terminal so that the remote monitoring terminal issues an on-site guidance or emergency rescue instruction.

[0081] In some embodiments, the apparatus further comprises a specification module for:

[0082] Determine the standard work behavior information corresponding to the recognition result based on the work behavior corresponding to the recognition result;

[0083] The standard behavior information is sent to the MR device, so that the MR device displays the standard work behavior information to the user.

[0084] For the convenience of description, the above device is described in terms of functions divided into various modules. Of course, when implementing the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0085] The pumped-storage power station operation monitoring device of the above-mentioned embodiment is used to implement the corresponding pumped-storage power station operation monitoring method in any of the above-mentioned embodiments, and has the beneficial effects of the corresponding pumped-storage power station operation monitoring method embodiment, which will not be repeated here.

[0086] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the pumped-storage power station operation monitoring method described in any of the above embodiments is implemented.

[0087] It should be noted that the method of the embodiment of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete the described method.

[0088] It should be noted that the above describes some embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0089] Figure 4A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown. The device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040 and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030 and the communication interface 1040 are connected to each other in communication within the device through the bus 1050.

[0090] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0091] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.

[0092] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0093] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and the power equipment. The communication module can realize communication through a wired method (such as USB, network cable, etc.) or a wireless method (such as mobile network, WIFI, Bluetooth, etc.).

[0094] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).

[0095] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.

[0096] The electronic device of the above embodiment is used to implement the corresponding pumped storage power station operation monitoring method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0097] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present disclosure also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the pumped-storage power station operation monitoring method as described in any of the above embodiments.

[0098] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0099] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the pumped storage power station operation monitoring method as described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0100] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments, the present application also provides a computer program product, which includes a computer program. In some embodiments, the computer program instructions can be executed by one or more processors of a computer so that the computer and / or the processor execute the pumped storage power station operation monitoring method described in the above-mentioned embodiments. Corresponding to the execution subject corresponding to each step in each embodiment of the pumped storage power station operation monitoring method, the processor that executes the corresponding step may belong to the corresponding execution subject.

[0101] To simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the following fact, that is, the details of the implementation of these block diagram devices are highly dependent on the platform to be implemented in the embodiments of the present application (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuit) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.

[0102] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0103] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the present application as described above, which are not provided in detail for the sake of simplicity.

[0104] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the scope of protection of the present application.

Claims

1. A method for monitoring the operation of a pumped storage power station, characterized in that: include: Obtain monitoring image information of target operators in pumped storage power stations; Inputting the monitoring image information into the trained work behavior abnormality recognition model to obtain a recognition result corresponding to the monitoring image information; In response to determining that the recognition result corresponding to the monitoring image information is abnormal work behavior, an abnormal prompt instruction is sent to the MR device worn by the target operator, so that the MR device displays abnormal behavior prompt information to the user.

2. The method according to claim 1, characterized in that Obtain monitoring image information of target operators in pumped storage power stations, including: The monitoring image information of the target operator is acquired through the MR device and / or the camera device arranged in the pumped-storage power station.

3. The method according to claim 1, characterized in that The process of training the abnormal work behavior recognition model includes: Based on the first training sample set, a benchmark model corresponding to the abnormal work behavior recognition model is trained to obtain a first model; wherein the first training sample set includes historical sample images collected by the target operator in historical operations of the pumped-storage power station; The first model is trained based on a second training sample set to obtain the work behavior abnormality recognition model; wherein the second training sample set includes instance sample images collected when the target operator wears the MR device and performs simulated work according to preset abnormal behavior.

4. The method according to claim 3, characterized in that: The benchmark model is a convolutional neural network model.

5. The method according to claim 1, characterized in that The abnormal behavior prompt information includes one or more of the following information: text prompt information, voice prompt information, and image prompt information.

6. The method according to claim 1, characterized in that In response to determining that the recognition result corresponding to the monitoring image information is abnormal working behavior, the method further includes: Determining whether the working behavior corresponding to the recognition result is a preset abnormal behavior; In response to determining that the working behavior corresponding to the recognition result is the preset abnormal behavior, an emergency alarm message is sent to the remote monitoring terminal so that the remote monitoring terminal issues an on-site guidance or emergency rescue instruction.

7. The method according to claim 1, characterized in that In response to determining that the recognition result corresponding to the monitoring image information is abnormal working behavior, the method further includes: Determine the standard work behavior information corresponding to the recognition result based on the work behavior corresponding to the recognition result; The standard behavior information is sent to the MR device, so that the MR device displays the standard work behavior information to the user.

8. A pumped storage power station operation monitoring device, characterized in that: include: An acquisition module, which acquires monitoring image information of target operators in a pumped storage power station; A recognition module, inputting the monitoring image information into a trained abnormal work behavior recognition model to obtain a recognition result corresponding to the monitoring image information; The prompt module, in response to determining that the recognition result corresponding to the monitoring image information is abnormal work behavior, sends an abnormal prompt instruction to the MR device worn by the target operator, so that the MR device displays abnormal behavior prompt information to the user.

9. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method according to any one of claims 1 to 7 is implemented.

10. A non-transitory computer-readable storage medium, characterized in that: The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the method according to any one of claims 1 to 7.

Images