Nuclear power station operator fatigue monitoring system and method, electronic equipment and medium

Abstract

The invention relates to the technical field of nuclear power station safety, in particular to a nuclear power station operator fatigue monitoring system and method, electronic equipment and a medium. The nuclear power station operator fatigue monitoring system comprises a plurality of nuclear power control terminals; the nuclear power control terminal is provided with a camera device, a wearable device and a sitting posture sensing device. According to the nuclear power station operator fatigue monitoring method, image acquisition is carried out on an operator in a nuclear power control room through camera devices arranged on a plurality of nuclear power control terminals, and operation image information is obtained; performing physical sign detection on the operator through the wearable device to obtain operator physical sign information; performing sitting posture detection on an operator through sitting posture sensing equipment to obtain sitting posture information of the operator; and performing fatigue detection on the operator based on the operation picture information, the operator sign information and the operator sitting posture information to obtain the fatigue degree of the operator. Therefore, the accuracy of detecting the fatigue degree of the nuclear power station operator can be improved.

Description

Technical Field

[0001] The present application relates to the field of nuclear power plant safety technology, and in particular to a nuclear power plant operator fatigue monitoring system and method, electronic equipment, and medium. Background Art

[0002] In the safe operation of nuclear power plants, the role of operators is crucial, as they need to continuously maintain a high level of alertness and accurate operation capabilities in front of the control panel. With the development of digitalization, the monitoring of operator mental fatigue has become increasingly important, as timely detection and reduction of fatigue can significantly reduce the risk of human error.

[0003] Among the related technologies, fatigue monitoring technology mainly relies on task performance, subjective evaluation and physiological indicators. The evaluation of task performance may affect individual work efficiency and initiative, while subjective fatigue reporting methods, such as visual analog scales, can assess the individual's self-perceived fatigue level, but may interfere with normal work and be affected by subjective consciousness, which has limitations. Therefore, how to improve the accuracy of fatigue detection for nuclear power plant operators has become an urgent problem to be solved. Summary of the invention

[0004] The present application aims to solve at least one of the technical problems existing in the prior art. To this end, the present application proposes a nuclear power plant operator fatigue monitoring system and method, electronic equipment, and medium, which can improve the accuracy of nuclear power plant operator fatigue detection.

[0005] A nuclear power plant operator fatigue monitoring system according to a first aspect of the present application is provided in a nuclear power control room of a nuclear power plant, and the nuclear power plant operator fatigue monitoring system includes:

[0006] A plurality of nuclear power operation terminals, wherein the nuclear power operation terminals are arranged in the nuclear power operation room; wherein the nuclear power operation terminals are equipped with corresponding camera devices, and the camera devices are used to collect images of operators in the nuclear power operation room;

[0007] A wearable device, used for detecting a vital sign of the operator when the operator wears the wearable device;

[0008] Sitting posture sensing equipment is arranged on the seats in the nuclear power control room.

[0009] A method for monitoring fatigue of a nuclear power plant operator according to a second aspect of the present application is applied to a system for monitoring fatigue of a nuclear power plant operator according to the first aspect of the present application, the method comprising:

[0010] The operator in the nuclear power control room is captured by using a plurality of camera devices equipped with the nuclear power control terminal to obtain operation picture information; wherein different camera devices are used to capture pictures of the operator from different shooting angles;

[0011] Performing physical sign detection on the operator through a wearable device to obtain physical sign information of the operator;

[0012] Performing sitting posture detection on the operator sitting on the seat by means of a sitting posture sensing device to obtain the sitting posture information of the operator;

[0013] The operator is fatigued based on the operation screen information, the operator's vital sign information and the operator's sitting posture information to obtain the operator's fatigue degree.

[0014] According to some embodiments of the present application, the image acquisition of the operator in the nuclear power control room by the camera devices equipped by the multiple nuclear power control terminals to obtain the operation image information includes:

[0015] Determine a current camera device from among the camera devices;

[0016] In response to the current camera device recognizing a valid facial image of the operator during image acquisition, determining the current camera device as a target camera device;

[0017] The operation screen information is generated according to the effective facial image captured by the target camera device.

[0018] According to some embodiments of the present application, before generating the operation screen information according to the valid facial image collected by the target camera device, the process further includes:

[0019] In response to the current camera device failing to recognize the valid facial image of the operator during image acquisition, the process returns to redetermine the current camera device from among the camera devices until the current camera device recognizes the valid facial image of the operator during image acquisition, and the current camera device is determined as the target camera device.

[0020] According to some embodiments of the present application, after determining the current camera from the camera devices, the method further includes:

[0021] Capturing the image of the operator through the current camera device to obtain current image information;

[0022] In response to the current screen information reflecting that the operator's face is facing the camera, the current screen information is determined as the valid facial image.

[0023] According to some embodiments of the present application, in response to the current screen information reflecting that the operator's face is facing the camera, determining the current screen information as the valid facial image includes:

[0024] In response to the current screen information reflecting that the nuclear power control room includes a plurality of candidate facial information, performing facial identity authentication for each of the candidate facial information to determine the target facial information of the operator from the plurality of candidate facial information;

[0025] In response to the target facial information reflecting that the operator's face is facing the camera, the target facial information is determined as the valid facial image.

[0026] According to some embodiments of the present application, the performing fatigue detection on the operator based on the operation screen information, the operator's vital sign information and the operator's sitting posture information to obtain the operator's fatigue degree includes:

[0027] Extracting facial physiological features and work behavior features corresponding to the operator from the work picture information to generate first fatigue determination factor information;

[0028] generating second fatigue determination factor information according to the operator's vital sign information;

[0029] extracting the sitting posture stability characteristic and the sitting posture pressure characteristic corresponding to the operator from the operator sitting posture information, and generating third fatigue determination factor information;

[0030] The first fatigue determination factor information, the second fatigue determination factor information, and the third fatigue determination factor information are input into a pre-trained fatigue degree detection model to perform fatigue detection on the operator to obtain the fatigue degree of the operator.

[0031] According to some embodiments of the present application, after performing fatigue detection on the operator based on the operation screen information, the operator's vital sign information and the operator's sitting posture information to obtain the operator's fatigue degree, the method further includes:

[0032] Generate a first interface display element according to the real-time operation screen information;

[0033] Generating a second interface display element according to the real-time vital sign information of the operator;

[0034] Generating a third interface display element according to the real-time sitting posture information of the operator;

[0035] generating a fourth interface display element based on the operator fatigue degree detected in real time;

[0036] An operator fatigue monitoring interface is displayed according to the first interface display element, the second interface display element, the third interface display element, and the fourth interface display element.

[0037] In a second aspect, an embodiment of the present application provides an electronic device, comprising: a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, it implements a method for monitoring fatigue of nuclear power plant operators as described in any one of the embodiments of the second aspect of the present application.

[0038] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the storage medium stores a program, and the program is executed by a processor to implement a nuclear power plant operator fatigue monitoring method as described in any one of the embodiments of the second aspect of the present application.

[0039] The nuclear power plant operator fatigue monitoring system and method, electronic equipment, and medium according to the embodiments of the present application have at least the following beneficial effects:

[0040] According to an embodiment of the present application, a nuclear power plant operator fatigue monitoring system is arranged in a nuclear power control room of a nuclear power plant, and the nuclear power plant operator fatigue monitoring system includes: a plurality of nuclear power control terminals, and the nuclear power control terminals are arranged in the nuclear power control room; wherein the nuclear power control terminals are equipped with corresponding camera devices, and the camera devices are used to capture images of operators in the nuclear power control room; wearable devices are used to detect vital signs of operators when the operators wear the wearable devices; and sitting posture sensing equipment is arranged on seats in the nuclear power control room. The nuclear power plant operator fatigue monitoring method of the second embodiment of the present application is applied to the nuclear power plant operator fatigue monitoring system of the first embodiment of the present application, and the nuclear power plant operator fatigue monitoring method includes: collecting images of operators in the nuclear power control room through camera devices equipped with multiple nuclear power control terminals to obtain operation picture information; wherein different camera devices are used to collect images of operators from different shooting angles; performing physical sign detection on operators through wearable devices to obtain operator physical sign information; performing sitting posture detection on operators sitting on seats through sitting posture sensing equipment to obtain operator sitting posture information; performing fatigue detection on operators based on operation picture information, operator physical sign information and operator sitting posture information to obtain operator fatigue. In this way, the accuracy of fatigue detection of nuclear power plant operators can be improved.

[0041] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0043] Figure 1 A schematic block diagram of a nuclear power plant operator fatigue monitoring system provided in an embodiment of the present application;

[0044] Figure 2 A schematic diagram of a process for monitoring fatigue of nuclear power plant operators provided in an embodiment of the present application;

[0045] Figure 3 A schematic diagram of a process for monitoring fatigue of nuclear power plant operators provided in an embodiment of the present application;

[0046] Figure 4 A schematic diagram of a process for monitoring fatigue of nuclear power plant operators provided in an embodiment of the present application;

[0047] Figure 5 A schematic diagram of a process for monitoring fatigue of nuclear power plant operators provided in an embodiment of the present application;

[0048] Figure 6 A schematic diagram of a process for monitoring fatigue of nuclear power plant operators provided in an embodiment of the present application;

[0049] Figure 7 A schematic diagram of a process for monitoring fatigue of nuclear power plant operators provided in an embodiment of the present application;

[0050] Figure 8 A schematic diagram of a process for monitoring fatigue of nuclear power plant operators provided in an embodiment of the present application;

[0051] Fig. 9 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0052] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be understood as limiting the present application.

[0053] In the description of this application, "several" means one or more, "more" means more than two, "greater than", "less than", "exceed", etc. are understood to exclude the number itself, and "above", "below", "within", etc. are understood to include the number itself. If there is a description of "first" or "second", it is only used for the purpose of distinguishing technical features, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features.

[0054] In the description of the present application, it should be understood that descriptions involving orientation, such as up, down, left, right, front, back, etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0055] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0056] In the description of this application, it should be noted that, unless otherwise clearly defined, the terms such as setting, installing, connecting, etc. should be understood in a broad sense, and technicians in the relevant technical field can reasonably determine the specific meanings of the above terms in this application in combination with the specific content of the technical solution. In addition, the identification of specific steps below does not represent a limitation on the order of steps and execution logic. The execution order and execution logic between each step should be understood and inferred with reference to the contents described in the embodiment.

[0057] In the safe operation of nuclear power plants, the role of operators is crucial because they need to maintain a high level of alertness and accurate operating capabilities in front of the control panel at all times. With the development of digitalization, the monitoring of operators' mental fatigue has become increasingly important, because timely detection and reduction of fatigue can significantly reduce the risk of human error. At present, there are relatively few studies on fatigue monitoring of operators working in visual display terminals, such as operators in the main control room of nuclear power plants. For positions that require high concentration, such as operators in the main control room of nuclear power plants, there is a linear relationship between their reaction time to special situations and the initial fatigue index, which shows that monitoring the degree of mental fatigue is crucial for workers in these positions.

[0058] The nuclear power operation room, also commonly known as the control room of a nuclear power plant, is one of the core areas of a nuclear power plant. It is the main place for operators to monitor and control the operation of the nuclear power plant. In this highly specialized working environment, operators manage the operation of the nuclear power plant reactor through various instruments, control systems and monitoring equipment to ensure the safe, stable and efficient output of electricity from the nuclear power plant.

[0059] Among the related technologies, fatigue monitoring technology mainly relies on task performance, subjective evaluation and physiological indicators. The evaluation of task performance may affect personal work efficiency and initiative, and subjective fatigue reporting methods, such as visual analog scales, although they can assess the individual's self-perceived fatigue level, may interfere with normal work and are affected by subjective consciousness and have limitations. Among them, the monitoring of physiological indicators includes two methods: contact and non-contact. Contact monitoring is mainly based on neuroelectrophysiological signals, such as electroencephalogram, electrooculogram and electrocardiogram, but these monitoring methods require dedicated hardware equipment and sampling electrodes, which may cause discomfort to the operator and affect their normal work. Wearing electrodes for a long time may cause sweating and other problems, affecting data collection.

[0060] The defects of related technologies are mainly reflected in the following aspects: there is a lack of continuous real-time fatigue monitoring system for operators suitable for the nuclear power control room of nuclear power plants, which means that existing monitoring equipment may not meet the needs of specific working environments and cannot achieve real-time and continuous monitoring of operator fatigue status.

[0061] The present application aims to solve at least one of the technical problems existing in the prior art. To this end, the present application proposes a nuclear power plant operator fatigue monitoring system and method, electronic equipment, and medium, which can improve the accuracy of nuclear power plant operator fatigue detection.

[0062] According to an embodiment of the present application, a nuclear power plant operator fatigue monitoring system is provided in a nuclear power control room of a nuclear power plant. The nuclear power plant operator fatigue monitoring system may include:

[0063] A plurality of nuclear power control terminals, wherein the nuclear power control terminals are arranged in the nuclear power control room; wherein the nuclear power control terminals are equipped with corresponding camera devices, and the camera devices are used to collect images of operators in the nuclear power control room;

[0064] A wearable device for detecting a vital sign of an operator when the operator wears the wearable device;

[0065] Sitting posture sensor equipment is installed on the seats in the nuclear power control room.

[0066] Reference Figure 1 In some specific embodiments, the fatigue monitoring system for nuclear power plant operators is intended to monitor the fatigue status of operators in real time to ensure the safe operation of nuclear power plants. The fatigue monitoring system for nuclear power plant operators can be composed of multiple key components, including nuclear power control terminals, camera devices, wearable devices, and sitting posture sensing devices.

[0067] Nuclear power operation terminals are the core of the fatigue monitoring system. They are set up in the nuclear power control room, and each terminal is equipped with a high-definition camera. These cameras are responsible for capturing key image information such as the operator's facial expressions, eye movements, and head postures, providing visual data for fatigue monitoring. The setting of the camera takes into account the dynamic activities of the operator in the control room, ensuring that no matter how the operator's position changes, their faces can be clearly captured from at least one camera.

[0068] To further enhance the accuracy of monitoring, the fatigue monitoring system also includes wearable devices that can monitor the operator's physical signs in real time when worn, such as heart rate, blood oxygen saturation and body temperature. These physiological parameters provide the system with the operator's physiological status data, which helps to assess the operator's fatigue level.

[0069] In addition, the fatigue monitoring system is also equipped with sitting posture sensors, which are integrated into the seats in the nuclear power control room. They are responsible for monitoring the operator's sitting posture stability and pressure distribution, and providing sitting posture-related data. Long-term improper sitting posture or frequent adjustments to sitting posture may indicate discomfort or fatigue of the operator, so this information is also important for fatigue monitoring.

[0070] In some embodiments, the fatigue monitoring system integrates the data collected by the camera device, wearable device and sitting posture sensor device through the front-end machine. The front-end machine is part of the multi-modal online fatigue monitoring device for operators in the main control room of a nuclear power plant, and it plays a vital role in the system. The design of the front-end machine adapts to the characteristics of the layout of the operator's panel in the control room, and integrates all the measurement equipment of the system, such as the camera device, wearable device and sitting posture sensor device configured for each nuclear power control terminal.

[0071] Overall, Figure 1 The fatigue monitoring system demonstrated integrates visual monitoring, physiological monitoring and sitting posture monitoring to form a multi-dimensional nuclear power plant fatigue monitoring network. This design enables the fatigue monitoring system to comprehensively evaluate the fatigue status of nuclear power plant operators, identify fatigue signs in a timely manner, and take corresponding measures, such as reminding operators to rest or adjust their workload to prevent potential risks caused by fatigue.

[0072] Reference Figure 2 According to the nuclear power plant operator fatigue monitoring method of the embodiment of the present application, applied to the nuclear power plant operator fatigue monitoring system of the embodiment of the present application, the nuclear power plant operator fatigue monitoring method may include:

[0073] Step S201, collecting images of operators in a nuclear power control room through multiple camera devices equipped at nuclear power control terminals to obtain operation image information; wherein different camera devices are used to collect images of operators from different shooting angles;

[0074] Step S202, performing physical sign detection on the operator through a wearable device to obtain the operator's physical sign information;

[0075] Step S203, performing sitting posture detection on the operator sitting on the seat by means of a sitting posture sensing device to obtain the sitting posture information of the operator;

[0076] Step S204: Perform fatigue detection on the operator based on the operation screen information, the operator's vital sign information and the operator's sitting posture information to obtain the operator's fatigue degree.

[0077] In order to improve the accuracy of detecting the fatigue of nuclear power plant operators, this application proposes a nuclear power plant operator fatigue monitoring system that comprehensively utilizes multiple camera devices, wearable devices, and sitting posture sensing devices through steps S201 to S204. This system is set up in the control room of the nuclear power plant and aims to improve the monitoring accuracy of the operator's fatigue state through multimodal data collection and analysis.

[0078] First, the nuclear power plant operator fatigue monitoring system collects images of operators through multiple cameras equipped at the nuclear power control terminal. These cameras capture key information such as the operator's facial expressions, eye movements, and head posture from different perspectives. This information is crucial for evaluating the operator's alertness and concentration. The multi-view setting of the camera helps to fully capture the operator's behavioral characteristics, and even when some perspectives are blocked or the lighting conditions are not ideal, the necessary data can be obtained from other perspectives.

[0079] Secondly, the nuclear power plant operator fatigue monitoring system uses wearable devices to detect the operator's physical signs and collect physiological parameters such as heart rate, blood oxygen saturation, skin temperature, etc. These physiological indicators can reflect the operator's physiological state and stress level, and are an important basis for assessing fatigue status. Wearable devices provide a non-invasive monitoring method, so that data collection will not interfere with the operator's normal work.

[0080] In addition, the nuclear power plant operator fatigue monitoring system also detects the operator's sitting posture through the sitting posture sensor device installed on the seat, collecting information such as sitting posture stability and pressure distribution. Long-term improper sitting posture or uneven pressure distribution may cause physical fatigue and affect the operator's work performance. The sitting posture sensor device can monitor the operator's sitting posture changes in real time, providing additional data support for fatigue assessment.

[0081] Finally, the nuclear power plant operator fatigue monitoring system will comprehensively analyze the operator's fatigue status based on data collected from cameras, wearable devices, and sitting posture sensors. By using machine learning algorithms and data analysis techniques, the nuclear power plant operator fatigue monitoring system can identify characteristic patterns of fatigue, such as frequent blinking, increased heart rate variability, unstable sitting posture, etc., and calculate the operator's fatigue level based on this. This multimodal monitoring method not only improves the accuracy of fatigue detection, but also enables real-time monitoring and early warning, helping to take timely measures to reduce operator fatigue, thereby reducing the risk of human error and ensuring the safe operation of nuclear power plants.

[0082] In step S201 of some embodiments, a plurality of cameras equipped at nuclear power operation terminals are used to collect images of operators in a nuclear power operation room to obtain operation image information; wherein different cameras are used to collect images of operators from different shooting angles;

[0083] In some embodiments of the present application, multiple cameras are deployed in the nuclear power control room to collect the operator's work screen information. These cameras are integrated into the nuclear power control terminal, and each device is responsible for capturing the operator's behavior and status from a specific shooting angle. This multi-camera setting is intended to ensure that no matter how the operator's position or posture changes in the control room, at least one camera can clearly capture their key behaviors and physiological reactions.

[0084] The function of each camera is to record the operator's facial expressions, eye movements, head posture, and gestures, which are critical to assessing the operator's fatigue status. For example, frequent blinking, increased eye closure, distraction, or slow response may all be signs of fatigue. The camera can provide more comprehensive monitoring data through the setting of different viewing angles, which helps the system to more accurately analyze the operator's fatigue status.

[0085] In order to ensure that the camera device can work continuously and stably, the fatigue monitoring system may also include some auxiliary functions, such as automatic adjustment of light sensitivity, image stabilization processing, and image quality optimization, so as to adapt to the changing lighting conditions and dynamic behaviors of operators in the nuclear power plant control room. Through this multi-angle and multi-dimensional image acquisition method, the fatigue status of operators can be monitored more comprehensively.

[0086] Reference Figure 3 According to some embodiments of the present application, in step S201, the camera devices equipped by multiple nuclear power operation terminals are used to collect images of operators in the nuclear power control room to obtain operation image information, which may include:

[0087] Step S301, determining a current camera device from various camera devices;

[0088] Step S302, in response to the current camera device recognizing a valid facial image of the operator during image acquisition, determining the current camera device as a target camera device;

[0089] Step S303, generating operation screen information according to the valid facial image captured by the target camera device.

[0090] In some embodiments of the present technical solution, multiple cameras are deployed in the nuclear power control room to collect the operator's work picture information. This process includes several key steps to ensure that the fatigue monitoring system can accurately capture the operator's facial image and use it as important data for analyzing fatigue status.

[0091] In step S301 of some embodiments, the camera device currently in use is determined from multiple cameras. This step is to ensure that the fatigue monitoring system can track and identify which camera device is working and providing data to the fatigue monitoring system. Since there are multiple cameras distributed in the control room, each may capture the operator's image at a different time point, so the fatigue monitoring system needs to be able to distinguish between these cameras and identify the camera device that is currently providing the image.

[0092] Reference Figure 4 According to some embodiments of the present application, after determining the current camera device from each camera device in step S301, the following may also be included:

[0093] Step S401, collecting the operator's picture through the current camera device to obtain current picture information;

[0094] Step S402, in response to the current picture information reflecting that the operator's face is facing the camera, the current picture information is determined as a valid facial image.

[0095] In some embodiments of the present technical solution, after the current camera device is determined, the fatigue monitoring system will enter a more detailed analysis and processing stage.

[0096] In step S401 of some embodiments, the current camera captures the operator's image to obtain current image information. This step is fundamental because it is directly related to the accuracy of subsequent fatigue monitoring. The current camera begins to capture the operator's real-time image based on its configuration and position, which may include key information such as the operator's facial expressions, eye movements, head posture, etc. This image information is crucial for evaluating the operator's alertness and concentration.

[0097] In step S402 of some embodiments, the fatigue monitoring system needs to check whether the current screen information reflects that the operator's face is facing the camera. This judgment is based on image recognition technology and algorithms. The fatigue monitoring system will analyze the operator's facial direction, eye position and other relevant facial features. If the fatigue monitoring system determines that the operator's face is indeed facing the camera, then the current screen information will be determined as a valid facial image. The valid facial image is key data for fatigue monitoring because it provides direct visual evidence of the operator's current state.

[0098] This confirmation of validity is based on the accurate capture of the operator's facial features, including but not limited to the position and state of the eyes, nose, mouth, and the overall contour of the face. When the operator's face is facing the camera, the fatigue monitoring system can obtain the clearest and most comprehensive data, which is crucial for subsequent fatigue feature extraction and analysis. Therefore, step S402 ensures that only high-quality, positive facial images are selected as valid data for further analysis, thereby improving the accuracy and reliability of fatigue monitoring. Through this continuous image acquisition and validity confirmation process, the fatigue monitoring system can ensure that the latest and most effective data is used when performing fatigue monitoring. This method helps to improve the accuracy and real-time nature of fatigue monitoring, thereby providing strong support for the safe operation of nuclear power plants. By monitoring the operator's facial image in real time, the fatigue monitoring system can promptly identify signs of fatigue so that subsequent measures can be taken, such as reminding the operator to rest or adjust the workload to prevent potential risks caused by fatigue.

[0099] Reference Figure 5 According to some embodiments of the present application, step S402, in response to the current picture information reflecting that the operator's face is facing the camera, determines the current picture information as a valid facial image, which may include:

[0100] Step S501, in response to the current screen information reflecting that the nuclear power control room includes a plurality of candidate facial information, performing facial identity authentication for each candidate facial information to determine target facial information of the operator from the plurality of candidate facial information;

[0101] Step S502 , in response to the target facial information reflecting that the operator's face is facing the camera, determining the target facial information as a valid facial image.

[0102] In some embodiments of the present technical solution, step S402 not only involves confirming whether the operator's face is facing the camera, but also includes a more complex facial information processing process. When the current screen information shows that there are multiple candidate facial information in the nuclear power control room, step S501 will be triggered to determine the target facial information of the operator from these candidate facial information.

[0103] Step S501 of some embodiments involves performing facial identity verification on each candidate facial information. This process may use advanced facial recognition technology, such as deep learning algorithms, to analyze and compare facial features to identify a specific operator. The purpose of facial identity verification is to ensure that the fatigue monitoring system can accurately identify the real operator from multiple faces that may be in the monitoring image. This step is particularly important in a multi-person working environment because it ensures the accuracy of the fatigue monitoring system and avoids misidentification or confusion between different personnel.

[0104] In step S502 of some embodiments, once the fatigue monitoring system successfully determines the target facial information of the operator from multiple candidate facial information, it further responds to the situation that the target facial information shows that the operator's face is facing the camera. In this case, the fatigue monitoring system will confirm that the target facial information is a valid facial image. This means that the image not only clearly captures the operator's face, but also that the operator's face is facing the camera, which provides high-quality visual data for subsequent fatigue monitoring.

[0105] Through the combined action of step S501 and step S502, the fatigue monitoring system can ensure that the operator is accurately identified and the front facial image is obtained in a complex working environment. Such a process improves the accuracy of fatigue monitoring because the fatigue monitoring system only focuses on the correct operator and only uses high-quality, front facial images for analysis. This method helps to improve the accuracy and real-time performance of fatigue monitoring, thereby providing strong support for the safe operation of nuclear power plants. By real-time monitoring of the operator's front facial image, the fatigue monitoring system can promptly identify signs of fatigue and take appropriate measures, such as reminding the operator to rest or adjust the workload, to prevent potential risks caused by fatigue.

[0106] In step S302 of some embodiments, in response to the current camera device recognizing a valid facial image of the operator during image acquisition, the current camera device is determined as a target camera device. When the camera device successfully captures the facial image of the operator, the fatigue monitoring system will mark the camera device as a target camera device, which means that it will focus on using the data provided by the camera device for subsequent fatigue monitoring analysis.

[0107] Step S303 of some embodiments involves generating operation picture information based on the valid facial images captured by the target camera device. Once the target camera device is determined, the fatigue monitoring system will use the facial images captured by the camera device as basic data for analyzing the fatigue status of the operator. These images contain key information such as the operator's facial expressions, eye movements, head posture, etc., which are very useful for evaluating the operator's alertness and concentration.

[0108] This meticulous camera management and facial image acquisition process ensures that the latest and most effective data is used when performing fatigue monitoring. This approach helps improve the accuracy and reliability of fatigue monitoring, thereby providing strong support for the safe operation of nuclear power plants. By monitoring the operator's facial image in real time, the fatigue monitoring system can promptly identify signs of fatigue and take appropriate measures, such as reminding the operator to rest or adjust the workload, to prevent potential risks caused by fatigue.

[0109] Reference Figure 6 According to some embodiments of the present application, before generating the operation screen information according to the valid facial image captured by the target camera device in step S303, the following may also be included:

[0110] Step S601, in response to the current camera device failing to recognize a valid facial image of the operator during image acquisition;

[0111] Step S602, returning to execute to re-determine the current camera device from each camera device until the current camera device recognizes the valid facial image of the operator during image acquisition, and determines the current camera device as the target camera device.

[0112] In some embodiments of the present technical solution, the process of determining the target camera device is not limited to the first picture acquisition, but includes a loop mechanism to ensure that the operator's effective facial image can be captured in all situations.

[0113] In step S601 of some embodiments, if the current camera fails to recognize a valid facial image of the operator during image acquisition, the fatigue monitoring system will not stop monitoring but trigger this step. This may occur when the operator temporarily leaves the camera range, poor lighting conditions lead to facial recognition failure, or the face is blocked. Step S601 ensures that the fatigue monitoring system can recognize these situations and prepare for the next action.

[0114] In step S602 of some embodiments, if the current camera device fails to recognize the valid facial image of the operator during image acquisition, the fatigue monitoring system will return to the initial state and re-determine the current camera device from each camera device. This step involves rescanning and evaluating the image acquisition status of all cameras to find a camera device that can capture the operator's valid facial image. The fatigue monitoring system will continue this process, constantly trying to obtain images from different cameras until it successfully recognizes the operator's valid facial image. Once a camera device successfully captures the operator's face, the fatigue monitoring system will determine the camera device as the target camera device and begin to use the facial image captured by the camera device as the operation image information.

[0115] The design of this loop mechanism reflects the robustness and adaptability of the fatigue monitoring system, ensuring that the operator's fatigue status can be continuously monitored even in complex or changing working environments. By constantly re-evaluating and adjusting the camera device, the fatigue monitoring system can adapt to changes in the operator's position, fluctuations in light conditions, and other factors that may affect facial recognition. This approach improves the reliability of the fatigue monitoring system and ensures that accurate monitoring results can be provided under all circumstances, thereby providing strong support for the safe operation of nuclear power plants. Through this continuous monitoring and adjustment, the fatigue monitoring system can ensure that when the operator shows signs of fatigue, timely measures can be taken to prevent accidents that may be caused by fatigue.

[0116] In step S202 of some embodiments, a wearable device is used to detect the operator's physical signs to obtain the operator's physical sign information;

[0117] In some embodiments of the present application, step S202 involves using a wearable device to perform physical sign detection on a nuclear power plant operator to obtain the operator's physical sign information. A wearable device is a portable technical product that can be directly worn on an operator. It can monitor and record a variety of physiological parameters in real time, providing important data support for fatigue monitoring.

[0118] These wearable devices may include but are not limited to smart watches, heart rate monitors, fitness trackers, etc., which can measure physiological indicators such as heart rate, blood oxygen saturation, skin temperature, sleep quality, exercise intensity, etc. These indicators are critical for assessing the operator's physiological state and fatigue level. For example, heart rate and heart rate variability can reflect the operator's stress level and physical stress response, blood oxygen saturation can indicate the functional state of the operator's respiratory and circulatory system, and changes in skin temperature may be related to the body's energy metabolism and thermal regulation mechanism.

[0119] During implementation, wearable devices collect physiological signals through built-in sensors and then convert these signals into digital data. These data can be transmitted to the monitoring system background in real time, connected to the central processing unit through wireless communication technologies such as Bluetooth or Wi-Fi. The fatigue monitoring system background can store, analyze and process the collected vital sign data to identify physiological patterns or abnormal trends that may indicate fatigue.

[0120] Through the physical sign detection of this wearable device, the nuclear power plant operator fatigue monitoring system can obtain more comprehensive physiological data, thereby more accurately assessing the operator's fatigue status, taking timely measures to prevent fatigue-related operational risks, and ensuring the safe and stable operation of the nuclear power plant.

[0121] In step S203 of some embodiments, a sitting posture detection is performed on an operator sitting on a seat by a sitting posture sensing device to obtain the sitting posture information of the operator;

[0122] In some embodiments of the present application, step S203 describes the process of performing sitting posture detection on an operator sitting on a seat by means of a sitting posture sensing device, with the purpose of obtaining the sitting posture information of the operator. The sitting posture sensing device is usually integrated into the seat or as an additional component of the seat (such as a seat cushion), and can monitor the sitting posture changes of the operator in real time, including the stability of the sitting posture, pressure distribution, and the contact area between the seat cushion and the backrest.

[0123] These sensors can be pressure sensors, inclination sensors or other types of motion sensors that are able to detect small movements and posture changes of the operator's body. For example, when the operator sits in an unstable position or adjusts their sitting position frequently, it may indicate that they are feeling uncomfortable or tired, and this information is very useful for assessing the operator's fatigue state. The data collected by the sensors can reveal the operator's sitting habits and fatigue patterns during long working hours.

[0124] By using posture sensing equipment to detect the sitting posture of the operator sitting on the seat, detailed information about the operator's sitting posture can be provided, which helps to further understand the operator's fatigue state and take corresponding measures to reduce fatigue and improve the safety and efficiency of nuclear power plant operations.

[0125] In step S204 of some embodiments, fatigue detection of the operator is performed based on the operation screen information, the operator's vital sign information and the operator's sitting posture information to obtain the operator's fatigue degree.

[0126] In some embodiments of the present application, step S204 needs to combine the operation screen information, the operator's vital signs information and the operator's sitting posture information for comprehensive analysis to detect the operator's fatigue. This step is the core of the entire fatigue monitoring system because it needs to fuse data from different sensors and use advanced algorithms to accurately evaluate the operator's fatigue status.

[0127] First, the fatigue monitoring system of the embodiment of the present application can analyze the operation screen information collected from the camera device, which includes the operator's facial expressions, eye movements, head postures and gestures. For example, by monitoring the blinking frequency, eye closure and line of sight direction, the fatigue monitoring system of the embodiment of the present application can identify the operator's concentration and alertness. If the operator shows behaviors such as frequent blinking, increased eye closure time or line of sight deviation, this may be a sign of fatigue.

[0128] Secondly, the fatigue monitoring system of the embodiment of the present application can also analyze the operator's physical information obtained from the wearable device, such as heart rate, blood oxygen saturation, skin temperature, etc. These physiological parameters can provide direct indicators of the operator's physical state. For example, an increase in heart rate and a change in heart rate variability may indicate that the operator is under stress or fatigue, while a decrease in blood oxygen saturation may indicate physical fatigue.

[0129] In addition, the fatigue monitoring system of the embodiment of the present application may also consider the operator's sitting posture information collected from the sitting posture sensing device. Maintaining a bad sitting posture for a long time or frequently adjusting the sitting posture may indicate discomfort or fatigue of the operator. It should be understood that by analyzing the stability and pressure distribution of the sitting posture, the fatigue monitoring system of the embodiment of the present application may also identify bad sitting habits that may cause fatigue to remind the operator.

[0130] Combining this information, the fatigue monitoring system of the embodiment of the present application can use a machine learning algorithm combined with a statistical model to evaluate the fatigue of the operator. Specifically, based on the collected data, the machine learning identifies the characteristic patterns of fatigue and quantifies the degree of fatigue. For example, the fatigue monitoring system of the embodiment of the present application can divide the fatigue into different levels, such as mild, moderate and severe fatigue, so that corresponding measures can be taken.

[0131] Ultimately, the fatigue monitoring system of the embodiment of the present application will output a fatigue value or fatigue level to provide real-time fatigue monitoring results for the management of the nuclear power plant. This fatigue value or fatigue level can help nuclear power plant managers to promptly understand the fatigue status of the operator and take appropriate rest or intervention measures to ensure the safety of the operator and the stable operation of the nuclear power plant. Through this multimodal fatigue detection method, the fatigue monitoring system of the embodiment of the present application can more comprehensively and accurately evaluate the fatigue of the operator, thereby improving the safety and efficiency of nuclear power plant operations.

[0132] Reference Figure 7 According to some embodiments of the present application, step S204 performs fatigue detection on the operator based on the operation screen information, the operator's vital sign information and the operator's sitting posture information to obtain the operator's fatigue degree, which may include:

[0133] Step S701, extracting facial physiological features and work behavior features corresponding to the operator from the work picture information to generate first fatigue determination factor information;

[0134] Step S702, generating second fatigue determination factor information according to the operator's physical sign information;

[0135] Step S703, extracting the sitting posture stability feature and sitting posture pressure feature corresponding to the operator from the operator's sitting posture information, and generating third fatigue determination factor information;

[0136] Step S704: input the first fatigue determination factor information, the second fatigue determination factor information and the third fatigue determination factor information into a pre-trained fatigue degree detection model to perform fatigue detection on the operator to obtain the fatigue degree of the operator.

[0137] In some embodiments of the present technical solution, step S204 involves a comprehensive fatigue detection process that evaluates the operator's fatigue based on information collected from multiple data sources.

[0138] In step S701 of some embodiments, the fatigue monitoring system extracts facial physiological features and work behavior features of the operator from the work picture information. Facial physiological features may include blinking frequency, eye closure, facial muscle movement, etc., while work behavior features may involve the operator's reaction time, head and hand movement patterns, etc. These features are used to generate first fatigue determination factor information, which are key indicators for evaluating the fatigue state of the operator.

[0139] In step S702 of some embodiments, second fatigue determination factor information is generated based on the operator's physical sign information. These physical sign information may include heart rate, blood oxygen saturation, skin electrical activity, etc., which are monitored and recorded in real time by wearable devices. Changes in these physiological parameters can reflect the operator's physiological stress response and fatigue level, providing an important physiological basis for fatigue assessment.

[0140] In step S703 of some embodiments, the sitting posture stability feature and the sitting posture pressure feature are extracted from the sitting posture information of the operator to generate the third fatigue determination factor information. These features are collected by sensors built into the seat, reflecting the sitting posture habits and possible discomfort of the operator. Long-term bad sitting posture may cause muscle fatigue and pressure accumulation, affecting the operator's work performance.

[0141] In step S704 of some embodiments, the fatigue monitoring system combines the first fatigue determination factor information, the second fatigue determination factor information, and the third fatigue determination factor information, and inputs them into a pre-trained fatigue detection model. This fatigue detection model is an artificial intelligence model built based on machine learning or deep learning technology, which can comprehensively analyze these multimodal data and output the fatigue of the operator. The model may have been trained with a large amount of data to identify the characteristic patterns of fatigue and can be adjusted according to different operating environments and individual differences.

[0142] Through this comprehensive analysis method, the fatigue monitoring system can comprehensively evaluate the fatigue status of operators, taking into account not only the physiological and behavioral responses of operators, but also their sitting habits. This method improves the accuracy and sensitivity of fatigue monitoring, allowing the fatigue monitoring system to identify signs of fatigue in a timely manner and take corresponding measures, such as reminding operators to rest or adjust their workload to prevent potential risks caused by fatigue. This meticulous monitoring and analysis process is essential to ensure the safety of operations in critical industries such as nuclear power plants.

[0143] Reference Figure 8 According to some embodiments of the present application, after performing fatigue detection on the operator based on the operation screen information, the operator's vital sign information and the operator's sitting posture information in step S204 to obtain the operator's fatigue degree, the following may also be included:

[0144] Step S801, generating a first interface display element according to real-time operation screen information;

[0145] Step S802, generating a second interface display element according to the real-time operator vital sign information;

[0146] Step S803, generating a third interface display element according to the real-time operator posture information;

[0147] Step S804, generating a fourth interface display element based on the operator fatigue level detected in real time;

[0148] Step S805: displaying an operator fatigue monitoring interface according to the first interface display element, the second interface display element, the third interface display element and the fourth interface display element.

[0149] In some embodiments of the present technical solution, after completing the fatigue detection of step S204, real-time monitoring and feedback are further provided, and a series of interface display elements are generated to intuitively display the operator's fatigue monitoring information. This process includes steps S801 to S805, and is intended to provide an intuitive and real-time monitoring interface for managers and operators themselves.

[0150] In step S801 of some embodiments, a first interface display element is generated based on the real-time operation screen information. This may include a real-time video stream of the operator, charts of key physiological indicators, such as heart rate or blinking frequency, and alarms for any abnormal behavior. These display elements can instantly reflect the operator's behavior and physiological state, allowing monitoring personnel to quickly identify any abnormal changes that may indicate fatigue.

[0151] In step S802 of some embodiments, a second interface display element is generated based on real-time operator vital signs information. This information may come from a wearable device, including real-time readings of physiological parameters such as heart rate, blood oxygen saturation, and skin temperature. These parameters are displayed in a graphical or numerical form, so that monitoring personnel can track the operator's physiological state and take action when necessary.

[0152] Step S803 of some embodiments focuses on generating a third interface display element based on the real-time operator sitting posture information. This may include real-time feedback on sitting posture stability, pressure distribution diagram, and cushion usage. Through these display elements, the monitoring personnel can evaluate whether the operator's sitting posture complies with ergonomic principles and remind the operator if a bad sitting posture is found for a long time.

[0153] In step S804 of some embodiments, a fourth interface display element is generated based on the operator fatigue detected in real time. This may include a real-time numerical value or level indication of fatigue, and any alarms triggered based on fatigue thresholds. These fourth interface display elements provide monitoring personnel with a clear fatigue indicator to help them determine whether the operator needs to rest or reduce workload.

[0154] In step S805 of some embodiments, the fatigue monitoring system integrates information based on the first interface display element to the fourth interface display element to display the operator fatigue monitoring interface. This interface summarizes all key health and performance indicators in an intuitive view, so that the monitoring personnel can understand the overall condition of the operator at a glance. This comprehensive monitoring interface not only helps to identify signs of fatigue in a timely manner, but also serves as a reference for daily health management and work arrangements.

[0155] Through this real-time monitoring and intuitive display method, fatigue monitoring systems can provide strong support for the operational safety of critical industries such as nuclear power plants. Managers can use this information to optimize work schedules, reduce the risk of fatigue-related accidents, and improve the overall well-being of operators. This meticulous monitoring and feedback process is essential to ensure the operational safety of critical industries.

[0156] In some more specific embodiments, the operator fatigue monitoring interface assesses the fatigue status of the operator by collecting and analyzing a variety of data in real time. The operator fatigue monitoring interface may include, but is not limited to, the following display functions, each of which is intended to provide real-time data and analysis results in a specific aspect.

[0157] The real-time facial video function can capture the operator's facial expressions and behaviors, ensure the correct operator is tracked through face recognition technology, and dynamically mark key points in the video. In the embodiment of the present application, if the face or key points are not recognized, an error reminder will be triggered. This function is crucial for real-time monitoring of the operator's alertness and concentration.

[0158] The sitting pressure distribution graph and sitting pressure distribution feature functions focus on the operator's sitting posture. The embodiment of the present application indicates the size of the sitting pressure through color changes, and displays the changes of sitting posture in real time, such as sitting upright, leaning left, leaning right, etc. At the same time, the embodiment of the present application also displays the main features of the sitting pressure distribution and provides links to view more detailed analysis data, such as time domain and frequency domain analysis results.

[0159] The wristband physiological data function displays various physiological parameters from the wearable device, such as blood oxygen saturation, body temperature, heart rate, etc. The embodiment of the present application not only displays real-time data, but also provides a link to view the detailed analysis results of these data. Similarly, the facial physiological characteristics, head posture, eye closure and gaze area prediction data functions also provide real-time monitoring and data analysis to help assess the fatigue status of the operator.

[0160] The fatigue evidence function uses machine learning algorithms to combine multimodal data such as video, sitting posture, and bracelets to extract fatigue evidence and generate a fatigue evidence list. The embodiment of the present application will display the evidence of fatigue in real time and dynamically display the latest fatigue evidence and corresponding time in the form of a log.

[0161] The life monitoring function of the embodiment of the present application ensures that the monitoring embodiment of the present application itself is operating normally. It monitors the transmission reliability of the camera, bracelet, and cushion data in real time, as well as the reliability of data analysis, fatigue evidence list calculation, fatigue algorithm operation, and fatigue monitoring result calculation. The embodiment of the present application will display the status of each sub-function with green or red prompts, and dynamically display the life monitoring information of the embodiment of the present application in the form of a log.

[0162] The real-time fatigue monitoring function displays a fatigue value from 0 to 1 and sets a preset fatigue threshold of 0.8. When the fatigue value exceeds this threshold, the embodiment of the present application will consider the operator to be in a task fatigue state. In addition, the embodiment of the present application also provides a countdown function to prompt the user how much time is expected to be generated for the first fatigue result.

[0163] The log query function allows users to save and replay historical log data by time tag and operator name tag. Users can select a specific time period and replay the interface of the time period on the monitoring interface. The embodiment of the present application provides a pause and start button to control the playback.

[0164] In summary, the operator fatigue monitoring interface provides a comprehensive, real-time monitoring view through these functions, allowing managers to quickly understand the operator's fatigue status and take appropriate measures to ensure operational safety.

[0165] Reference Fig. 9 , Fig. 9 The hardware structure of an electronic device of another embodiment is illustrated. The electronic device may include:

[0166] The processor 901 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;

[0167] The memory 902 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 902 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 902, and the processor 901 calls and executes the nuclear power plant operator fatigue monitoring method of the embodiment of this application;

[0168] Input / output interface 903, used to implement information input and output;

[0169] Communication interface 904, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WI FI, Bluetooth, etc.);

[0170] A bus 905 that transmits information between various components of the device (e.g., the processor 901, the memory 902, the input / output interface 903, and the communication interface 904);

[0171] The processor 901 , the memory 902 , the input / output interface 903 and the communication interface 904 are connected to each other in communication within the device via a bus 905 .

[0172] The embodiment of the present application also provides a computer program product, which includes a computer program. The processor of the computer device reads and executes the computer program, so that the computer device executes the above-mentioned nuclear power plant operator fatigue monitoring method.

[0173] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can, for example, be implemented in an order other than those illustrated or described herein. In addition, the terms "comprises" and "comprising" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0174] It should be understood that in the present disclosure, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0175] It should be understood that in the description of the embodiments of the present application, the meaning of multiple (or multiple items) is more than two, greater than, less than, exceed, etc. are understood to not include the number, and above, below, within, etc. are understood to include the number.

[0176] In the several embodiments provided in the present disclosure, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0177] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0178] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0179] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the various embodiments of the present disclosure. The aforementioned storage medium may include: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.

[0180] It should also be understood that the various implementations provided in the embodiments of the present application can be combined arbitrarily to achieve different technical effects.

[0181] The above is a specific description of the implementation methods of the present disclosure, but the present disclosure is not limited to the above implementation methods. Technical personnel familiar with the art can also make various equivalent modifications or substitutions without violating the spirit of the present disclosure. These equivalent modifications or substitutions are all included in the scope defined by the claims of the present disclosure.

Claims

1. A nuclear power plant operator fatigue monitoring system, characterized in that: The nuclear power plant operator fatigue monitoring system is arranged in a nuclear power plant operation room, and comprises: A plurality of nuclear power operation terminals, wherein the nuclear power operation terminals are arranged in the nuclear power operation room; wherein the nuclear power operation terminals are equipped with corresponding camera devices, and the camera devices are used to collect images of operators in the nuclear power operation room; A wearable device, used for detecting a vital sign of the operator when the operator wears the wearable device; Sitting posture sensing equipment is arranged on the seats in the nuclear power control room.

2. A method for monitoring fatigue of nuclear power plant operators, characterized in that: Applied to the nuclear power plant operator fatigue monitoring system of claim 1, the method comprising: The operator in the nuclear power control room is captured by using a plurality of camera devices equipped with the nuclear power control terminal to obtain operation picture information; wherein different camera devices are used to capture pictures of the operator from different shooting angles; Performing physical sign detection on the operator through a wearable device to obtain the operator's physical sign information; Performing sitting posture detection on the operator sitting on the seat by means of a sitting posture sensing device to obtain the sitting posture information of the operator; The operator is fatigued based on the operation screen information, the operator's vital sign information and the operator's sitting posture information to obtain the operator's fatigue degree.

3. The method according to claim 2, characterized in that The method of collecting images of operators in the nuclear power control room by using the camera devices equipped by the multiple nuclear power control terminals to obtain operation image information includes: Determine a current camera device from among the camera devices; In response to the current camera device recognizing a valid facial image of the operator during image acquisition, determining the current camera device as a target camera device; The operation screen information is generated according to the effective facial image captured by the target camera device.

4. The method according to claim 3, characterized in that Before generating the operation screen information according to the effective facial image collected by the target camera device, the method further includes: In response to the current camera device failing to recognize the valid facial image of the operator during image acquisition, the process returns to redetermine the current camera device from among the camera devices until the current camera device recognizes the valid facial image of the operator during image acquisition, and the current camera device is determined as the target camera device.

5. The method according to claim 2, characterized in that: After determining the current camera device from the camera devices, the method further includes: Capturing the image of the operator through the current camera device to obtain current image information; In response to the current screen information reflecting that the operator's face is facing the camera, the current screen information is determined as the valid facial image.

6. The method according to claim 5, characterized in that In response to the current picture information reflecting that the operator's face is facing the camera, determining the current picture information as the valid facial image includes: In response to the current screen information reflecting that the nuclear power control room includes a plurality of candidate facial information, performing facial identity authentication for each of the candidate facial information to determine the target facial information of the operator from the plurality of candidate facial information; In response to the target facial information reflecting that the operator's face is facing the camera, the target facial information is determined as the valid facial image.

7. The method according to claim 2, characterized in that The performing fatigue detection on the operator based on the operation screen information, the operator's vital sign information and the operator's sitting posture information to obtain the operator's fatigue degree includes: Extracting facial physiological features and work behavior features corresponding to the operator from the work picture information to generate first fatigue determination factor information; generating second fatigue determination factor information according to the operator's vital sign information; extracting the sitting posture stability characteristic and the sitting posture pressure characteristic corresponding to the operator from the operator sitting posture information, and generating third fatigue determination factor information; The first fatigue determination factor information, the second fatigue determination factor information, and the third fatigue determination factor information are input into a pre-trained fatigue degree detection model to perform fatigue detection on the operator to obtain the fatigue degree of the operator.

8. The method according to claim 2, characterized in that: After performing fatigue detection on the operator based on the operation screen information, the operator's vital sign information and the operator's sitting posture information to obtain the operator's fatigue degree, the method further includes: Generate a first interface display element according to the real-time operation screen information; Generating a second interface display element according to the real-time vital sign information of the operator; Generating a third interface display element according to the real-time sitting posture information of the operator; generating a fourth interface display element based on the operator fatigue degree detected in real time; An operator fatigue monitoring interface is displayed according to the first interface display element, the second interface display element, the third interface display element, and the fourth interface display element.

9. An electronic device, characterized in that: include: A memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the method for monitoring fatigue of nuclear power plant operators as described in any one of claims 2 to 8 is implemented.

10. A computer-readable storage medium, characterized in that: The storage medium stores a program, and the program is executed by a processor to implement the nuclear power plant operator fatigue monitoring method as described in any one of claims 2 to 8.

Images