Nuclear power plant operation detection method and device, electronic equipment and storage medium
By combining a multi-sensor artificial intelligence framework with voice and visual recognition technologies, the problem of misjudgment in the detection of human error in nuclear power plants has been solved, enabling accurate detection of operational errors in nuclear power plants and improving the safety of nuclear power plant operations.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- CHINA NUCLEAR POWER ENGINEERING CO LTD
- Filing Date
- 2026-01-16
- Publication Date
- 2026-06-12
AI Technical Summary
In existing technologies, human error detection in nuclear power plants is still limited to single-mode technology, which leads to misjudgments and cannot effectively prevent operational deviations and safety risks.
By employing a multi-sensor artificial intelligence framework that combines speech recognition and visual recognition technologies, standard operating information from nuclear power plants is acquired, voice operation commands and panel images are identified, cross-validation of multi-source data is achieved, standardized operating benchmarks are constructed, and operational errors in nuclear power plants are detected.
It enables precise detection of operational errors in nuclear power plants, reduces the impact of environmental noise, improves the accuracy of panel image recognition, avoids human error, prevents input deviations in a timely manner, and enhances the safety of nuclear power plant operations.
Smart Images

Figure CN122198305A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of nuclear energy industry safety operation technology, specifically to nuclear power plant operation detection methods, devices, electronic equipment, and storage media. Background Technology
[0002] Nuclear energy plays a crucial role in the global energy transition, providing a low-carbon and stable power supply. However, the safe operation of nuclear power plants remains a significant challenge, with human error consistently being the leading cause of nuclear power plant accidents. Therefore, how to detect human error in nuclear power plants has become an urgent problem to be solved. Summary of the Invention
[0003] This invention provides a method, apparatus, electronic device, and storage medium for detecting human error in nuclear power plants, in order to solve the problem of detecting human error in nuclear power plants.
[0004] In a first aspect, the present invention provides a method for detecting the operation of a nuclear power plant, the method comprising: Obtain standard operating information for a nuclear power plant, the standard operating information including equipment information and standard setpoints for at least one nuclear power device; In response to a voice operation command for a target device, the voice operation command is recognized to obtain first operation information, the first operation information including first device information and a first set value; the at least one nuclear power device includes the target device; In response to a setting operation on the operation panel of the target device, a panel image of the operation panel is acquired, and the panel image of the operation panel is recognized to obtain second operation information, the second operation information including second device information and a second setting value; Based on the matching results between the standard operation information, the first operation information, and the second operation information, the operation detection results of the target device are obtained.
[0005] Secondly, the present invention provides a nuclear power plant operation monitoring device, the device comprising: The data acquisition module is used to acquire standard operating information of the nuclear power plant, the standard operating information including equipment information and standard set values of at least one nuclear power equipment; A voice recognition module is used to respond to a voice operation command for a target device, recognize the voice operation command, and obtain first operation information, the first operation information including first device information and a first set value; the at least one nuclear power device includes the target device; A visual recognition module is used to respond to a setting operation on the operation panel of the target device, acquire a panel image of the operation panel, and recognize the panel image of the operation panel to obtain second operation information, the second operation information including second device information and a second setting value; An operation detection module is used to obtain the operation detection result of the target device based on the matching situation between the standard operation information, the first operation information, and the second operation information.
[0006] Thirdly, the present invention provides an electronic device, comprising: a memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the computer instructions to perform the nuclear power plant operation detection method of the first aspect or any corresponding embodiment described above.
[0007] Fourthly, the present invention provides a computer-readable storage medium storing computer instructions for causing a computer to execute the nuclear power plant operation detection method of the first aspect or any corresponding embodiment described above.
[0008] The nuclear power plant operation detection method provided by this invention acquires standard operating information of the nuclear power plant, including equipment information and standard settings of at least one nuclear power device, thereby constructing a benchmark for standardized operation and providing data support. Responding to voice operation commands for the target device, the method recognizes the voice operation commands to obtain first operation information, achieving digital conversion of operation commands and reducing the impact of environmental noise. Furthermore, responding to setting operations on the operation panel of the target device, the method acquires a panel image of the operation panel and recognizes the panel image to obtain second operation information, improving the accuracy of panel image recognition and avoiding reading errors present in manual recognition. Finally, based on the matching between the standard operation information, the first operation information, and the second operation information, the operation detection result of the target device is obtained. Through cross-validation of multi-source data, input deviations can be actively detected and prevented, achieving accurate detection of nuclear power plant operation errors and enabling timely detection of human error in nuclear power plant operations. Attached Figure Description
[0009] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.
[0010] Figure 1This is a schematic diagram of the first process of a nuclear power plant operation detection method according to an embodiment of the present invention; Figure 2 This is a schematic diagram of a standard image of an operation panel according to an embodiment of the present invention; Figure 3 This is a schematic diagram of the second process of the nuclear power plant operation detection method according to an embodiment of the present invention; Figure 4 This is a schematic diagram of the third process of the nuclear power plant operation detection method according to an embodiment of the present invention; Figure 5 This is a structural block diagram of a nuclear power plant operation detection device according to an embodiment of the present invention; Figure 6 This is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present invention. Detailed Implementation
[0011] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0012] It is understood that before using the technical solutions disclosed in the various embodiments of the present invention, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in the present invention and their authorization should be obtained in accordance with relevant laws and regulations through appropriate means.
[0013] The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.
[0014] Most nuclear incidents worldwide can be attributed to human and organizational factors. Despite extensive corrective measures such as enhanced personnel training, optimized operating procedures, and strengthened oversight, human-related accidents still exhibit cyclical fluctuations, indicating inherent limitations in existing mitigation strategies. Accident report analysis shows that approximately 65% of nuclear accidents are related to human error. In the control room of a nuclear power plant, accurate input of equipment settings is crucial for ensuring safe operation. Incorrect input by operators can lead to operational deviations and trigger significant safety risks.
[0015] Human error in high-risk operations is persistent. Cognitive biases, such as confirmation bias, availability bias, and anchoring effects, have been well-established as significant contributors to errors and violations in the nuclear industry and other safety-critical sectors. Environmental stressors, particularly fatigue, are widely recognized as major factors leading to decreased operator performance and increased shift handover risks. System complexity further exacerbates error risk. Newly commissioned reactors present additional operational challenges, often accompanied by higher accident risks during their initial operational phases. The rapid expansion of nuclear power plants underscores the necessity of establishing robust personnel performance and error prevention strategies.
[0016] Recent advances in digitalization and artificial intelligence are driving new approaches to error prevention in nuclear power plant operations. Currently, human error detection in most nuclear power plants remains limited to single-modal technologies, focusing on visual, audio, or analog domains, leading to misjudgments. Multi-sensor AI frameworks integrating visual, auditory, and system-level data hold promise for further improving operational reliability.
[0017] According to an embodiment of the present invention, a method for detecting the operation of a nuclear power plant is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.
[0018] This embodiment provides a method for monitoring the operation of a nuclear power plant, which can be used in electronic devices such as servers and computers. Figure 1 This is a flowchart of a nuclear power plant operation detection method according to an embodiment of the present invention, such as... Figure 1 As shown, the process includes the following steps: Step S101: Obtain standard operating information for the nuclear power plant.
[0019] The standard operating information includes equipment information and standard settings for at least one nuclear power plant; the at least one nuclear power plant includes the target equipment.
[0020] Specifically, the operating procedures of nuclear power plants are processed to obtain standard operating information for nuclear power plants.
[0021] Step S102: In response to a voice operation command for the target device, the voice operation command is recognized to obtain first operation information.
[0022] The first operation information includes the first device information and the first set value.
[0023] Specifically, in response to voice operation commands for the target device, adaptive spectral subtraction is used at the acoustic front end to suppress background noise based on the voice recognition module interface, and the isolation of the operator's voice in unstable acoustic environments is improved by using energy threshold and zero crossover rate.
[0024] Furthermore, the Whisper-large-v3 model is employed, combined with kernel domain adaptation and an RNN converter architecture to achieve real-time transcription. Context bias is used to prioritize the identification of key kernel terms in speech operation instructions (e.g., ensuring that "ATWS" is accurately identified as "expected transient non-stopped heap," rather than a similar-sounding but unrelated term).
[0025] Furthermore, a rule-based correction mechanism is employed to enforce standardized numerical formats on voice operation commands (e.g., converting colloquial expressions like "eight o'clock" into the numerical form "8.1"). This, in turn, converts the voice operation commands into initial operation information.
[0026] In step S103, in response to the setting operation on the operation panel of the target device, the panel image of the operation panel is acquired, and the panel image of the operation panel is recognized to obtain the second operation information.
[0027] The second operation information includes the second device information and the second set value.
[0028] Specifically, in response to a setting operation on the operation panel of the target device, a panel image of the operation panel is acquired. Based on the matching between the standard image of the operation panel and the panel image, the panel image of the operation panel is recognized to obtain second operation information.
[0029] Step S104: Based on the matching of standard operation information, first operation information and second operation information, the operation detection result of the target device is obtained.
[0030] Specifically, the first operation information and the second operation information are matched with the standard operation information respectively, and the operation detection results of the target device are obtained based on the matching results.
[0031] The nuclear power plant operation detection method provided in this embodiment acquires standard operating information of the nuclear power plant, including equipment information and standard settings of at least one nuclear power device, thereby constructing a benchmark for standardized operation and providing data support. In response to voice operation commands for the target device, the method recognizes the voice operation commands to obtain first operation information, achieving digital conversion of operation commands and reducing the impact of environmental noise. Furthermore, in response to setting operations on the target device's operation panel, the method acquires the panel image and recognizes the panel image to obtain second operation information, improving the accuracy of panel image recognition and avoiding reading errors caused by manual verification. Finally, based on the matching between the standard operation information, the first operation information, and the second operation information, the operation detection result of the target device is obtained. Through cross-validation of multi-source data, input deviations can be actively detected and prevented, achieving accurate detection of nuclear power plant operation errors and enabling timely detection of human error in nuclear power plant operations.
[0032] In some optional implementations, obtaining standard operating information of a nuclear power plant in step S101 above includes: Step a1: Obtain the operating procedures for the nuclear power plant.
[0033] Each operating procedure includes at least one operating step.
[0034] Specifically, based on the purpose of the operation, the operating procedures are divided into functional categories (such as startup, shutdown, emergency response, and maintenance), supporting targeted access and analysis.
[0035] Step a2: Analyze the operating procedures to obtain the operating steps in the operating procedures.
[0036] Specifically, the operating procedures are parsed by a program parser, converting unstructured operating procedure documents into standardized, machine-readable formats (such as CSV / Excel).
[0037] Furthermore, a metadata template is defined to extract keywords from the operating procedures. The operating procedure ID, title (procedure description), operation step ID (a unique identifier for each operation step), and operation text (descriptive instructions for the operation steps, such as: "Cooling at a rate of 56°C / h using the normal steam generator atmospheric vent valve") are extracted from the operating procedures, and the extracted operating procedure ID, title, operation step ID, and operation text are stored in the metadata template.
[0038] Step a3 involves extracting keywords from the operational steps to obtain standard operating information for nuclear power plants.
[0039] Specifically, keywords in the operational steps are extracted based on the keyword template in a standardized manner, thereby obtaining the standard operating information of the nuclear power plant.
[0040] For example, key data is transformed into a unified structure containing required fields using keyword templates, and the resulting standard operating information for nuclear power plants is recorded in the keyword templates shown in Table 1.
[0041] Table 1 Keyword Templates
[0042] The nuclear power plant operation detection method provided in this embodiment obtains the operating procedures of the nuclear power plant and parses them to obtain the operating steps. Then, keywords from these operating steps are extracted to obtain the standard operating information of the nuclear power plant. This method can transform the unstructured procedure documents of the nuclear power plant into searchable and analyzable data assets, providing a data foundation for subsequent matching with standard operating information.
[0043] In some optional implementations, step S103 above includes: Step b1: In response to the setting operation on the operation panel of the target device, obtain the panel image of the operation panel.
[0044] It is important to note that the panel images for the control panel adhere to strict standardization specifications. All panel images conform to predefined size specifications, color schemes, and layout structures. This high degree of uniformity enables robust template matching of the panel images, achieving reliable panel image recognition.
[0045] Step b2: Locate the target image that matches the panel image in the standard images of the operation panel.
[0046] The standard image for the operation panel is a pre-registered template image, such as... Figure 2 As shown.
[0047] Step b3: Obtain the location information of the operation information in the target image.
[0048] The positioning information of the operation information is characterized by a relative offset.
[0049] Specifically, the position of the operation information in the target image is fixed relative to the upper left corner of the target image, that is, the relative offset of the operation information in the target image is fixed.
[0050] It is worth noting that the positioning information for operation information differs for different standard images.
[0051] Step b4: Based on the positioning information, the panel image of the operation panel is identified to obtain the second operation information.
[0052] Specifically, based on the positioning information of the operation information in the target image, the operation information in the panel image of the operation panel is identified to obtain the second operation information.
[0053] For example, first, locate the panel image at the top left corner (x, y). Then, find a target image that matches the panel image in the standard image of the operation panel, and locate the coordinates of the operation information based on the relative offset in the target image, such as (x+70, y+45).
[0054] The nuclear power plant operation detection method provided in this embodiment achieves rapid panel image matching by acquiring a panel image of the operation panel and searching for a target image that matches the panel image in a standard image of the operation panel. Furthermore, the panel image of the operation panel is identified based on the location information of the operation information in the target image to obtain second operation information, thus improving the accuracy and efficiency of the identification.
[0055] In some optional implementations, step b4 above involves recognizing the panel image of the operation panel based on the positioning information to obtain second operation information, including: Step b41: Extract the region image of the area where the operation information is located in the target image based on the positioning information.
[0056] Specifically, the location of the operation image in the target image is determined based on the positioning information, resulting in a region image of the area where the operation information is located in the target image. For example, the region image covers a range of (168×20) pixels.
[0057] Step b42: Perform character recognition on the region image to obtain the second operation information.
[0058] Specifically, optical character recognition (OCR) technology is used to identify characters in the region image to obtain the second operation information.
[0059] In some optional implementations, the character recognition of the region image in step b42 above to obtain the second operation information includes: performing character recognition of the region image based on the target recognition method to obtain the second operation information.
[0060] The target recognition method includes at least one of character whitelist recognition and number pattern recognition. The number pattern recognition is used to recognize the preset character as a preset value corresponding to the preset character.
[0061] Specifically, the region image is first subjected to multi-stage image preprocessing, including: 2x magnification based on cubic interpolation, contrast enhancement based on contrast-limited adaptive histogram equalization (CLAHE), sharpening through a custom kernel, and adaptive thresholding to optimize readability.
[0062] Furthermore, regional images often contain densely packed small-sized characters, where visually similar characters such as "VV" are easily misread as "W," while ambiguous character pairs such as O / 0 or 1 / l pose additional recognition risks. OCR technology uses character whitelist recognition and digit pattern recognition to perform character recognition on regional images, obtaining the second operational information.
[0063] For example, when the character "W" is present in the region image, it is automatically filtered during recognition because it is not in the predefined list, based on the character whitelist. When the preset character "O" is present in the region image, it is forcibly recognized as the number 0 based on the number pattern recognition. When the preset character "l" is present in the region image, it is recognized as the preset value "1".
[0064] The nuclear power plant operation detection method provided in this embodiment performs character recognition on the regional image through target recognition to obtain second operation information, which further reduces the probability of recognition errors and improves the accuracy of recognition.
[0065] In some optional implementations, the standard operating information includes equipment information of the nuclear power equipment operated in each operating step of the nuclear power plant's operating procedures, as well as the corresponding standard set values; the first operating information includes the first operating step, and the operation detection result of the target equipment obtained in step S104 based on the matching between the standard operating information, the first operating information, and the second operating information includes: Step c1: Search for the device information and standard settings that match the first operation step in the standard operation information to obtain the third operation information.
[0066] Step c2: Based on the matching of the first operation information, the second operation information, and the third operation information, the operation detection result of the target device is obtained.
[0067] Specifically, taking Table 1 above as an example, the third operation information corresponding to Table 1 is used as a standard reference, and the first operation information and the second operation information are matched with the third operation information corresponding to Table 1 to obtain the operation detection result of the target device.
[0068] It is worth noting that, in order to ensure the highest reliability and traceability of nuclear power plant operation, the cross-validation of the first, second, and third operational information deliberately avoids traditional feature comparison methods. The first, second, and third operational information are all converted into human-readable format (text / numerical representation) before comparison.
[0069] The design concept of cross-validation of the first, second, and third operational information includes three key safety objectives: 1. Establish a fully traceable verification trajectory, enabling operators or safety engineers to intuitively verify each comparison operation step in post-event analysis; 2. Eliminate the risk of misjudgment that may be caused by abstract feature matching algorithms; 3. Significantly reduce interfering alarms and avoid unnecessary interference to operators during critical procedures.
[0070] In some optional implementations, step c2, based on the matching between the first operation information, the second operation information, and the third operation information, obtains the operation detection result of the target device, including: Step c21: If the first operation information does not match the third operation information, but the second operation information matches the third operation information, then the operation detection result is determined to be a voice operation error.
[0071] Step c22: If the first operation information matches the third operation information, and the second operation information does not match the third operation information, then the operation detection result is determined to be an operation panel operation error.
[0072] Step c23: If the first operation information, the second operation information, and the third operation information do not match, then the operation detection result is determined to be that both the voice operation and the operation panel operation are incorrect.
[0073] In practical applications, the logic for generating the operation detection results of the target device is as follows:
[0074] Where A represents the third operation information; B represents the first operation information; and C represents the second operation information.
[0075] When executing each operation step, the first operation information, the second operation information, and the third operation information are automatically matched. The operation instruction is only approved when the first operation information and the third operation information are completely matched, and the second operation information and the third operation information are completely matched.
[0076] The nuclear power plant operation detection method provided in this embodiment obtains corresponding operation detection results by matching first, second, and third operation information. This method ensures that the behavior of operators is strictly consistent with operating procedures, thereby preventing deviations from escalating into major safety accidents and improving the safety of the nuclear power plant control system.
[0077] In some optional implementations, the nuclear power plant operation detection method further includes: if the operation detection result indicates an operation error of the target equipment, then determining the cause of the operation error of the target equipment based on the operation detection result; based on the cause of the operation error of the target equipment, determining a target error handling method from the error handling methods corresponding to the pre-configured operation error cause, and executing the target error handling method.
[0078] Specifically, if the operation detection result indicates a voice operation error, the error will be indicated via voice prompt. If the operation detection result indicates an operation panel error, i.e., the displayed device name or manually entered setting does not match the standard operating information, an alarm will be triggered, requiring the operator to immediately check and correct the input. This mechanism ensures that errors are eliminated at an early stage, preventing potential safety incidents. If the operation detection result indicates that both voice operation and operation panel operation are incorrect, the system will issue a warning and suspend operation. The operator must identify the root cause and implement corrective measures before continuing.
[0079] As a specific application embodiment of the present invention, the method of the present invention is verified by taking a scenario in which the operation steps of the operating procedure involve the operator manually inputting set values. See [link to documentation]. Figure 3 When the operator opens the panel image of the target device (e.g., 131VV) in the operation panel, the system uses OpenCV template matching technology to find a matching target image in the standard image of the operation panel. Based on the relative offset of the operation information in the target image, the system accurately locates the area where the operation information (e.g., 131VV External set) is located in the panel image. Then, OCR technology is used to recognize characters in the area image to obtain the second operation information. Next, clicking button 1 in the panel image redirects the operator to the input window, where the operator must input the device's settings as required by the procedure. In this test, the standard setting was "8.1", but the operator intentionally entered "3.1". The system successfully detected the mismatch between the input value and the standard setting and triggered an alarm for an operation error on the operation panel.
[0080] As a specific application embodiment of the present invention, see [link to relevant documentation]. Figure 4First, the operating procedures are parsed to obtain the corresponding operating steps. Then, keywords are extracted from these steps to obtain the standard operating information (including equipment information and standard settings). For operator voice commands, speech recognition technology is used to convert the commands into text, thus obtaining the first operating information. For operator settings on the control panel, visual recognition algorithms (such as OCR technology) are used to visually recognize the operating information in the panel image, thus obtaining the second operating information. Finally, the first, second, and standard operating information are cross-validated. Based on the matching results among these information, the nuclear power plant operation detection results are obtained, and corresponding correction measures are implemented.
[0081] This embodiment also provides a nuclear power plant operation monitoring device, which is used to implement the above embodiments and preferred embodiments; details already described will not be repeated. As used below, the term "module" can refer to a combination of software and / or hardware that performs a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.
[0082] This embodiment provides a nuclear power plant operation detection device, such as... Figure 5 As shown, it includes: The data acquisition module 501 is used to acquire standard operating information of the nuclear power plant, which includes equipment information and standard settings of at least one nuclear power device.
[0083] The voice recognition module 502 is used to respond to a voice operation command for the target device, recognize the voice operation command, and obtain first operation information, the first operation information including first device information and a first set value; at least one nuclear power device includes the target device.
[0084] The visual recognition module 503 is used to respond to the setting operation on the operation panel of the target device, acquire the panel image of the operation panel, and recognize the panel image of the operation panel to obtain second operation information, which includes second device information and second setting value.
[0085] The operation detection module 504 is used to obtain the operation detection result of the target device based on the matching between standard operation information, first operation information and second operation information.
[0086] In some optional implementations, the data acquisition module 501 includes: The first acquisition unit is used to acquire the operating procedures of the nuclear power plant.
[0087] The parsing unit is used to parse the operating procedure to obtain the operating steps in the operating procedure.
[0088] The second acquisition unit is used to extract keywords from the operation steps to obtain standard operating information for nuclear power plants.
[0089] In some alternative implementations, the visual recognition module 503 includes: The image acquisition unit is used to acquire the panel image of the operation panel in response to the setting operation on the operation panel of the target device.
[0090] The image matching unit is used to find a target image that matches the panel image in the standard image of the operation panel.
[0091] The fourth acquisition unit is used to acquire the positioning information of the operation information in the target image.
[0092] The image recognition unit is used to recognize the panel image of the operation panel based on the positioning information to obtain the second operation information.
[0093] In some optional implementations, the image recognition unit includes: The region recognition subunit is used to extract the region image of the area where the operation information is located in the target image based on the positioning information.
[0094] The character recognition subunit is used to perform character recognition on the region image to obtain the second operation information.
[0095] In some optional implementations, the character recognition subunit includes: a method for performing character recognition on a region image based on a target recognition method to obtain second operation information, wherein the target recognition method includes at least one of character whitelist recognition and digital pattern recognition, and the digital pattern recognition is used to recognize a preset character as a preset value corresponding to the preset character.
[0096] In some optional implementations, the standard operating information includes equipment information of the nuclear power equipment operated for each operating step in the nuclear power plant's operating procedures, as well as the corresponding standard setting values; the first operating information includes the first operating step; the operating detection module 504 includes: The information matching unit is used to search for equipment information and standard setting values that match the first operation step in the standard operation information to obtain the third operation information.
[0097] The operation detection unit is used to obtain the operation detection result of the target device based on the matching between the first operation information, the second operation information, and the third operation information.
[0098] In some optional implementations, the operation detection unit includes: The first detection unit is used to determine that the operation detection result is a voice operation error if the first operation information does not match the third operation information and the second operation information matches the third operation information.
[0099] The second detection unit is used to determine that the operation detection result is an operation panel operation error if the first operation information matches the third operation information and the second operation information does not match the third operation information.
[0100] The third detection unit is used to determine that the operation detection result is that both the voice operation and the operation panel operation are incorrect if there is no match between the first operation information, the second operation information and the third operation information.
[0101] The nuclear power plant operation detection device provided in this embodiment of the invention can execute the nuclear power plant operation detection method provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects for executing the method. Further functional descriptions of the various modules and units are the same as in the corresponding embodiments described above, and will not be repeated here.
[0102] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention.
[0103] The following is a detailed reference. Figure 6 This diagram illustrates a suitable structural design for implementing an electronic device according to embodiments of the present invention. The electronic device may include a processor (e.g., a central processing unit, graphics processor, etc.) 601, which can perform various appropriate actions and processes based on a program stored in read-only memory (ROM) 602 or a program loaded from memory 608 into random access memory (RAM) 603. RAM 603 also stores various programs and data required for the operation of the electronic device. The processor 601, ROM 602, and RAM 603 are interconnected via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.
[0104] Typically, the following devices can be connected to I / O interface 605: input devices 606 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 607 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; memory devices 608 including, for example, magnetic tapes, hard disks, etc.; and communication devices 609. Communication device 609 allows electronic devices to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 6 Electronic devices with various devices are shown, but it should be understood that it is not required to implement or have all of the devices shown, and more or fewer devices may be implemented or have instead.
[0105] In particular, according to embodiments of the present invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present invention include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 609, or installed from a memory 608, or installed from a ROM 602. When the computer program is executed by the processor 601, it performs the functions defined in the nuclear power plant operation detection method of the embodiments of the present invention.
[0106] Figure 6 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.
[0107] This invention also provides a computer-readable storage medium. The methods described above according to embodiments of the invention can be implemented in hardware or firmware, or implemented as computer code that can be recorded on a storage medium, or implemented as computer code downloaded via a network and originally stored on a remote storage medium or a non-transitory machine-readable storage medium and then stored on a local storage medium. Thus, the methods described herein can be processed by software stored on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. The storage medium can be a magnetic disk, optical disk, read-only memory, random access memory, flash memory, hard disk, or solid-state drive, etc.; further, the storage medium can also include combinations of the above types of memory. It is understood that the computer, processor, microprocessor controller, or programmable hardware includes storage components capable of storing or receiving software or computer code. When the software or computer code is accessed and executed by the computer, processor, or hardware, the nuclear power plant operation detection method shown in the above embodiments is implemented.
[0108] A portion of this invention can be applied as a computer program product, such as computer program instructions, which, when executed by a computer, can invoke or provide the methods and / or technical solutions according to the invention through the operation of the computer. Those skilled in the art will understand that the forms in which computer program instructions exist in a computer-readable medium include, but are not limited to, source files, executable files, installation package files, etc. Correspondingly, the ways in which computer program instructions are executed by a computer include, but are not limited to: the computer directly executing the instructions, or the computer compiling the instructions and then executing the corresponding compiled program, or the computer reading and executing the instructions, or the computer reading and installing the instructions and then executing the corresponding installed program. Here, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible to a computer.
[0109] Although embodiments of the invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations all fall within the scope defined by the appended claims.
Claims
1. A method for detecting the operation of a nuclear power plant, characterized in that, The method includes: Obtain standard operating information for a nuclear power plant, the standard operating information including equipment information and standard setpoints for at least one nuclear power device; In response to a voice operation command for a target device, the voice operation command is recognized to obtain first operation information, the first operation information including first device information and a first set value; the at least one nuclear power device includes the target device; In response to a setting operation on the operation panel of the target device, the panel image of the operation panel is acquired, and the panel image of the operation panel is recognized to obtain second operation information, the second operation information including second device information and second setting value; Based on the matching results between the standard operation information, the first operation information, and the second operation information, the operation detection results of the target device are obtained.
2. The method according to claim 1, characterized in that, The acquisition of standard operating information for nuclear power plants includes: Obtain the operating procedures of the nuclear power plant; The operation procedure is parsed to obtain the operation steps in the operation procedure; Keyword extraction is performed on the operation steps to obtain the standard operation information of the nuclear power plant.
3. The method according to claim 1, characterized in that, The step of responding to a setting operation on the operation panel of the target device, acquiring a panel image of the operation panel, and recognizing the panel image of the operation panel to obtain second operation information includes: In response to a setting operation on the operation panel of the target device, a panel image of the operation panel is acquired; Find a target image that matches the panel image in the standard image of the operation panel; Obtain the positioning information of the operation information in the target image; Based on the positioning information, the panel image of the operation panel is identified to obtain the second operation information.
4. The method according to claim 3, characterized in that, The step of recognizing the panel image of the operation panel based on the positioning information to obtain second operation information includes: Based on the positioning information, extract the region image of the area where the operation information is located in the target image; Character recognition is performed on the image of the region to obtain the second operation information.
5. The method according to claim 4, characterized in that, The step of performing character recognition on the region image to obtain the second operation information includes: The target recognition method is used to perform character recognition on the region image to obtain the second operation information. The target recognition method includes at least one of character whitelist recognition and number pattern recognition. The number pattern recognition is used to recognize a preset character as a preset value corresponding to the preset character.
6. The method according to claim 1, characterized in that, The standard operating information includes equipment information of the nuclear power equipment corresponding to each operating step in the nuclear power plant's operating procedures, as well as the corresponding standard set values; the first operating information includes the first operating step; obtaining the operation detection result of the target equipment based on the matching between the standard operating information, the first operating information, and the second operating information includes: The device information and standard setting value that match the first operation step are searched in the standard operation information to obtain the third operation information; Based on the matching results between the first operation information, the second operation information, and the third operation information, the operation detection result of the target device is obtained.
7. The method according to claim 6, characterized in that, The step of obtaining the operation detection result of the target device based on the matching situation between the first operation information, the second operation information, and the third operation information includes: If the first operation information does not match the third operation information, but the second operation information matches the third operation information, then the operation detection result is determined to be a voice operation error. If the first operation information matches the third operation information, and the second operation information does not match the third operation information, then the operation detection result is determined to be an operation panel operation error. If there is no match between the first operation information, the second operation information, and the third operation information, then the operation detection result is determined to be an error in both voice operation and operation panel operation.
8. A nuclear power plant operation detection device, characterized in that, The device includes: The data acquisition module is used to acquire standard operating information of the nuclear power plant, the standard operating information including equipment information and standard set values of at least one nuclear power equipment; A voice recognition module is used to respond to a voice operation command for a target device, recognize the voice operation command, and obtain first operation information, the first operation information including first device information and a first set value; the at least one nuclear power device includes the target device; A visual recognition module is used to respond to a setting operation on the operation panel of the target device, acquire a panel image of the operation panel, and recognize the panel image of the operation panel to obtain second operation information, the second operation information including second device information and a second setting value; An operation detection module is used to obtain the operation detection result of the target device based on the matching situation between the standard operation information, the first operation information, and the second operation information.
9. An electronic device, characterized in that, include: A memory and a processor are communicatively connected, the memory stores computer instructions, and the processor executes the computer instructions to perform the nuclear power plant operation detection method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions for causing the computer to execute the nuclear power plant operation detection method according to any one of claims 1 to 7.