Fatigue state recognition device and method

CN117122323BActive Publication Date: 2026-09-18CHINA GENERAL NUCLEAR POWER OPERATION
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202311093420.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-08-28
Publication Date
2026-09-18
Estimated Expiration
2043-08-28

AI Technical Summary

Technical Problem

[0004]然而,上述认知疲劳的判断方法的应用性低

Benefits of technology

[0031] The aforementioned fatigue state identification device and method, the fatigue state identification device includes a display screen, a motion control, a controller, and a housing; the controller is connected to both the display screen and the motion control, the display screen is set within a preset area on the outer surface of the housing; the motion control is embedded in the outer surface of the housing; the controller is located inside the housing; the controller is used to control the target object to move on the display screen according to preset rules; the motion control is used to control the tracked object to move on the display screen according to the user's operation; the controller is also used to identify the user's fatigue state based on the distance between the current tracked object and the target object when the target object stops moving on the display screen. Compared with existing fatigue state determination devices, this device does not require providing each operator with wearable equipment, and only requires controlling the tracked object to move on the display screen through a simple motion control, which can accurately determine the operator's current fatigue state within a very short time (generally, the test time is 30 seconds). That is, this solution can quickly and accurately identify the operator's fatigue state before starting work while saving costs, which helps to avoid safety and economic problems caused by the operator's poor condition, greatly improves the operator's work reliability, and also ensures the operation and maintenance safety of nuclear power to a certain extent.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117122323B_ABST
    Figure CN117122323B_ABST
Patent Text Reader

Abstract

This application relates to a fatigue state identification device and method. The method includes: a display screen, a motion control, a controller, and a housing; the controller is connected to both the display screen and the motion control, and the display screen is disposed within a preset area on the outer surface of the housing; the motion control is embedded in the outer surface of the housing; the controller is located inside the housing; the controller is used to control a target object to move on the display screen according to preset rules; the motion control is used to control the movement of the tracked object on the display screen according to the user's operation; the controller is also used to identify the user's fatigue state based on the distance between the currently tracked object and the target object when it is detected that the target object has stopped moving on the display screen. Compared with existing fatigue state determination devices, this device does not require providing each operator with wearable equipment, and only requires controlling the movement of the tracked object on the display screen through a simple motion control to accurately determine the operator's current fatigue state in a very short time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of nuclear power plant testing technology, and in particular to a device and method for identifying fatigue conditions. Background Technology

[0002] Due to the unique working environment of nuclear power plants, personnel in key positions are more prone to cognitive fatigue than those in ordinary work environments. Cognitive fatigue directly impacts the company's production and operational performance and safety. Therefore, it is necessary to test the cognitive abilities of personnel in key nuclear power positions before work commences to determine if they are experiencing cognitive fatigue.

[0003] Currently, the main method for judging fatigue is to have staff wear smart devices (such as smartwatches, smart bracelets, work hats, etc.) to collect physiological data (such as electroencephalogram data and heart rate data), and then analyze whether the staff are in a state of fatigue based on the physiological data.

[0004] However, the above-mentioned methods for judging cognitive fatigue have low applicability. Summary of the Invention

[0005] Therefore, it is necessary to provide a fatigue state identification device and method that can improve the applicability of the cognitive fatigue judgment method in order to address the above-mentioned technical problems.

[0006] In a first aspect, this application provides a fatigue state identification device. The identification device includes: a display screen, a motion control, a controller, and a housing; the controller is connected to both the display screen and the motion control; the display screen is disposed within a preset area on the outer surface of the housing; the motion control is embedded in the outer surface of the housing; and the controller is located inside the housing.

[0007] The controller is used to control the movement of the target object on the display screen according to preset rules;

[0008] The movement control is used to control the movement of the tracked object on the display screen based on user actions;

[0009] The controller is also used to identify the user's fatigue state based on the distance between the currently tracked object and the target object when the target object is detected to have stopped moving on the display screen.

[0010] In one embodiment, the above-mentioned recognition device further includes: a voice broadcast module and an editing window; the voice broadcast module is embedded in the outer surface of the housing;

[0011] The voice broadcast module is used to play voice information during the process of the controller moving the target object;

[0012] Correspondingly, the controller is also used to receive text information entered by the user in the editing window, and to identify the user's fatigue state based on the text information, voice information, and the distance between the tracked object and the target object.

[0013] In one embodiment, the controller is specifically used to determine the similarity between the text information and the voice information when it receives the text information entered by the user in the editing window, and to determine whether the distance between the tracked object and the target object is greater than a preset threshold, to obtain the judgment result, and to determine the user's fatigue state based on the similarity and the judgment result.

[0014] In one embodiment, the aforementioned motion control includes a first control and a second control. The first control is used to control the tracking object to move on the display screen in a first direction according to the user's operation; the second control is used to control the tracking object to move on the display screen in a second direction according to the user's operation; the first direction and the second direction are different.

[0015] In one embodiment, the identification device further includes: a first indicator light and a second indicator light; the first indicator light is embedded in the outer surface of the housing; the second indicator light is embedded in the outer surface of the housing; the first indicator light is disposed at any position in the surrounding area of ​​the first control; the second indicator light is disposed at any position in the surrounding area of ​​the second control;

[0016] The first indicator light is used to indicate the direction of movement of the first control controlled by the controller;

[0017] The second indicator light is used to indicate the direction of movement of the second control controlled by the controller.

[0018] In one embodiment, the first control is any one of a knob, a button, or a joystick; the second control is any one of a knob, a button, or a joystick.

[0019] In one embodiment, the controller is further configured to switch the operation direction of the first control and the second control after detecting that the target object has stopped moving on the display screen, and re-control the target object to move on the display screen according to a preset rule, and, when the target object is detected to have stopped moving on the display screen again, identify the user's fatigue state based on the distance between the currently tracked object and the target object.

[0020] Secondly, this application also provides a method for identifying fatigue states. The fatigue state identification method is applied to a controller in the fatigue state identification device as described in the first aspect above, and the fatigue state identification method includes:

[0021] The target object is controlled to move according to preset rules on the display screen of the fatigue state recognition device;

[0022] After receiving the operation command triggered by the user's operation in the fatigue state recognition device, the movement control controls the tracking object to move on the display screen;

[0023] When the target object stops moving on the display screen, the user's fatigue state is identified based on the distance between the currently tracked object and the target object.

[0024] In one embodiment, the method further includes:

[0025] The voice broadcast module is controlled to play voice information during the movement of the target object;

[0026] It receives text information entered by the user in the editing window and identifies the user's fatigue state based on the text information, voice information, and the distance between the tracked object and the target object.

[0027] In one embodiment, when the target object is detected to have stopped moving on the display screen, the user's fatigue state is identified based on the distance between the currently tracked object and the target object, including:

[0028] When receiving text information entered by the user in the editing window, determine the similarity between the text information and the voice information;

[0029] Determine whether the distance between the tracked object and the target object is greater than a preset threshold, and obtain the determination result;

[0030] Based on the similarity and the judgment result, the user's fatigue state is determined.

[0031] The aforementioned fatigue state identification device and method, the fatigue state identification device includes a display screen, a motion control, a controller, and a housing; the controller is connected to both the display screen and the motion control, the display screen is set within a preset area on the outer surface of the housing; the motion control is embedded in the outer surface of the housing; the controller is located inside the housing; the controller is used to control the target object to move on the display screen according to preset rules; the motion control is used to control the tracked object to move on the display screen according to the user's operation; the controller is also used to identify the user's fatigue state based on the distance between the current tracked object and the target object when the target object stops moving on the display screen. Compared with existing fatigue state determination devices, this device does not require providing each operator with wearable equipment, and only requires controlling the tracked object to move on the display screen through a simple motion control, which can accurately determine the operator's current fatigue state within a very short time (generally, the test time is 30 seconds). That is, this solution can quickly and accurately identify the operator's fatigue state before starting work while saving costs, which helps to avoid safety and economic problems caused by the operator's poor condition, greatly improves the operator's work reliability, and also ensures the operation and maintenance safety of nuclear power to a certain extent. Attached Figure Description

[0032] Figure 1 This is a schematic diagram of the structure of a fatigue state identification device in one embodiment;

[0033] Figure 2 This is a schematic diagram of the fatigue state identification device in another embodiment;

[0034] Figure 3 This is a schematic diagram of the fatigue state identification device in another embodiment;

[0035] Figure 4 This is a flowchart illustrating a fatigue state identification method in one embodiment;

[0036] Figure 5 This is a flowchart illustrating a fatigue state identification method in another embodiment;

[0037] Figure 6 for Figure 5 A flowchart illustrating step S203 in the embodiment. Detailed Implementation

[0038] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0039] Due to the unique working environment of nuclear power plants, personnel in key positions are more prone to cognitive fatigue than those in ordinary work environments. Cognitive fatigue directly impacts the company's production and operational performance and safety. For example, the complexity and high intensity of the work of operators in the main control room of a nuclear power plant require them to concentrate intensely and utilize a greater amount of cognitive resources to complete their tasks accurately and quickly. However, prolonged exposure to such a complex and demanding environment makes operators highly susceptible to cognitive fatigue.

[0040] In addition, the intense work pressure in the control room is also a significant cause of cognitive fatigue. Nuclear power plants are work environments where safety is of paramount importance. This emphasis on safety, and the potential irreversible consequences of nuclear accidents, creates significant work pressure for operators, especially when facing dangerous or emergency situations. This pressure leads to more pronounced cognitive fatigue after completing complex operations. Finally, the specific working hours are another important factor contributing to cognitive fatigue. Nuclear power plant operations must run 24 hours a day, requiring operators to work in shifts. Basic psychological research has found that shift work easily disrupts operators' normal sleep patterns, leading to cognitive fatigue due to insufficient sleep or poor sleep quality. Therefore, it is necessary to test the cognitive abilities of personnel in key nuclear power positions before work to determine if they are experiencing cognitive fatigue.

[0041] Currently, the main method for assessing fatigue involves having workers wear smart devices (e.g., smartwatches, smart bracelets, work caps, etc.) to collect physiological data (e.g., electroencephalogram data, heart rate data), and then analyzing this data to determine if the worker is fatigued. However, the applicability of these methods for assessing cognitive fatigue is limited. This application aims to address this problem.

[0042] After introducing the background technology of the fatigue state identification device provided in the embodiments of this application, the fatigue state identification device proposed in this solution will be described in detail below.

[0043] In one embodiment, such as Figure 1 As shown, a fatigue state identification device 01 is provided. The fatigue state identification device 01 includes: a display screen 010, a motion control 011, a controller 012, and a housing 013. The controller 012 is connected to the display screen 010 and the motion control 011 respectively. The display screen 010 is disposed within a preset area on the outer surface of the housing 013. The motion control 011 is embedded in the outer surface of the housing 013. The controller 012 is located inside the housing 013.

[0044] The display screen 010 may include an LCD screen, an e-ink screen, or a 120Hz high refresh rate touch screen, etc.

[0045] The movement control 011 can be any one of a knob, button, or joystick. The movement control 011 is used to control the movement of the tracked object on the display screen 010 according to the user's operation. For example, the user rotates the knob to the left to control the tracked object to move to the left on the display screen 010, and the user rotates the knob to the right to control the tracked object to move to the right on the display screen 010. As another example, the user drags the joystick to the left to control the tracked object to move to the left on the display screen 010, and the user drags the joystick to the right to control the tracked object to move to the right on the display screen 010.

[0046] The controller 012 is used to control the target object to move on the display screen 010 according to preset rules. For example, the controller 012 is used to control the target object to move on the display screen 010 in a circular movement rule, or to control the target object to move on the display screen 010 in a square movement rule, etc. The controller 012 is also used to identify the user's fatigue state based on the distance between the currently tracked object and the target object when the target object is detected to have stopped moving on the display screen 010. For example, if the distance between the tracked object and the target object is greater than a first preset threshold, the user's fatigue state is level 3 fatigue; if the distance between the tracked object and the target object is less than the first preset threshold but greater than a second preset threshold, the user's fatigue state is level 2 fatigue; if the distance between the tracked object and the target object is less than the first preset threshold but greater than a third preset threshold, the user's fatigue state is level 1 fatigue; if the distance between the tracked object and the target object is less than the third preset threshold, the user's condition is good.

[0047] The working principle of the fatigue state recognition device 01 provided in this application embodiment is as follows: When it is necessary to recognize the operator's cognitive fatigue state, the operator can trigger the "Start" button on the display screen 010 to inform the controller 012 in the fatigue state recognition device 01 to control the target object to start moving on the display screen 010 according to preset rules. When the operator notices that the target object has started moving on the display screen 010, the operator operates the movement control 011 to control the tracking object to move on the display screen until the target object stops moving on the display screen 010. The controller 012 detects the distance between the current tracking object and the target object, and determines the operator's current fatigue state based on the distance between the current tracking object and the target object.

[0048] The fatigue state identification device provided in this application includes a display screen, a motion control, a controller, and a housing. The controller is connected to both the display screen and the motion control. The display screen is located within a preset area on the outer surface of the housing. The motion control is embedded in the outer surface of the housing. The controller is located inside the housing. The controller controls the target object to move on the display screen according to preset rules. The motion control controls the tracking object to move on the display screen according to the user's operation. The controller also identifies the user's fatigue state based on the distance between the current tracking object and the target object when it detects that the target object has stopped moving on the display screen. Compared with existing fatigue state determination devices, this device does not require providing wearable devices for each operator. It only requires controlling the tracking object to move on the display screen through a simple motion control to accurately determine the operator's current fatigue state within a very short time (generally, the test time is 30 seconds). In other words, this solution can quickly and accurately identify the operator's fatigue state before starting work while saving costs. This helps to avoid safety and economic problems caused by the operator's poor condition, greatly improves the operator's work reliability, and also ensures the operation and maintenance safety of nuclear power plants to a certain extent.

[0049] In one embodiment, such as Figure 2 As shown, a fatigue state recognition device 01 is provided. The fatigue state recognition device 01 further includes: a voice broadcast module 014 and an editing window 015; the voice broadcast module 015 is embedded in the outer surface of the housing 013.

[0050] The voice broadcast module 014 includes an earpiece, a player, etc. The voice broadcast module 014 is used to play voice information during the process of the controller 012 controlling the movement of the target object. It should be noted that the voice information includes a string of numbers, a string of letters, and multiple words.

[0051] The editing window 015 includes a key input button or a display editing window. Users can input information through the key input button or directly input information in the display editing window 015.

[0052] The controller 012 is further configured to receive text information input by the user in the editing window 015, and identify the user's fatigue state based on the text information, voice information, and the distance between the tracked object and the target object. Optionally, a first similarity value is determined based on the similarity between the text information and the voice information, a second similarity value is determined based on the distance between the tracked object and the target object, a target similarity value is determined based on the first and second similarity values, and finally, the user's fatigue state is determined based on the relationship between the target similarity value and a preset similarity threshold.

[0053] In this embodiment, during the process of the controller 012 controlling the movement of the target object, voice information is played through the voice broadcast module 014. When the target object stops moving, the user inputs text information into the editing window 015. The controller 012 in the fatigue state recognition device 01 receives the text information input by the user in the editing window, determines the first similarity between the text information and the voice information based on the text information and the voice information, determines the second similarity based on the distance between the tracked object and the target object, and determines the user's fatigue state based on the first similarity and the second similarity. For example, if the user inputs text information "1234567899" and voice information "1234567890", then the first similarity value is determined to be 90% based on the similarity between the text and voice information, and the second similarity value is determined to be 80% based on the distance between the tracked object and the target object. Given that the weight of the first similarity value is 80% and the weight of the second similarity value is 20%, then the target similarity value is determined to be 88% based on the first similarity value and its corresponding weight, as well as the weight of the second similarity value. The preset target similarity value between 80% and 90% indicates that the user's fatigue state is Level 1 fatigue.

[0054] Optionally, the controller 012 is specifically used to determine the similarity between the text information and the voice information when it receives the text information entered by the user in the editing window 015, and to determine whether the distance between the tracked object and the target object is greater than a preset threshold, to obtain the judgment result, and to determine the user's fatigue state based on the similarity and the judgment result.

[0055] In this embodiment of the application, when the controller 012 receives text information input by the user in the editing window 015, it determines the similarity between the text information and the voice information, and judges the relationship between the distance between the tracked object and the target object and the preset distance threshold, determines the judgment result, and finally determines the user's fatigue state based on the similarity and the judgment result. Optionally, if the similarity between text and voice information is 90%, the distance between the tracked object and the target object is 10mm, and the judgment result within the preset distance threshold range of 0-20mm is level 1 fatigue, the similarity and judgment result are stored in the database, and the current performance is evaluated using the Z score (i.e., standard score). At this time, the following three Z score thresholds are set: (1) If the Z score is greater than 1.3 and less than 2, it is marked as level 3 fatigue, which means that there is a 90% probability that the user is in a fatigued state; (2) If the Z score is greater than 2 and less than 3.1, it is regarded as level 2 fatigue, which means that there is a 97.7% probability that the user is in a fatigued state; (3) If the Z score is greater than 3.1, it is marked as level 1 fatigue, which means that there is a 99.9% probability that the user is in a fatigued state. Thus, the current fatigue state of the user is determined.

[0056] In one embodiment, such as Figure 3 As shown, a fatigue state recognition device 01 is provided. The aforementioned movement control 011 includes a first control 0110 and a second control 0111. The first control 0110 is used to control the tracking object to move on the display screen 010 in a first direction according to the user's operation; the second control 0111 is used to control the tracking object to move on the display screen 010 in a second direction according to the user's operation; the first direction and the second direction are different.

[0057] Wherein, the first control 0110 can be any one of a knob, button, or joystick; the second control 0111 can be any one of a knob, button, or joystick. It should be noted that when both the first control 0110 and the second control 0111 are knobs, they are two knobs with uniform damping coefficients. Both the first control 0110 and the second control 0111 can be located at any position on the housing 013. For example, the first control 0110 can be located at the lower left edge of the housing 013, and the first control 0111 can be located at the lower right edge of the housing 013.

[0058] The first direction can be horizontal, vertical, or any other direction besides horizontal and vertical; the second direction can be horizontal, vertical, or any other direction besides horizontal and vertical; or, in the first time period, the first direction can be horizontal and the second direction can be vertical, and in the second time period adjacent to the first time period, the first direction can be vertical and the second direction can be horizontal; or, in the first time period, the first direction can be vertical and the second direction can be horizontal, and in the second time period adjacent to the first time period, the first direction can be horizontal and the second direction can be vertical.

[0059] In one embodiment, such as Figure 3 As shown, a fatigue state identification device 01 is provided. The fatigue state identification device 01 further includes: a first indicator light 016 and a second indicator light 017; the first indicator light 016 is embedded in the outer surface of the housing 013; the second indicator light 017 is embedded in the outer surface of the housing 013; the first indicator light 016 is disposed at any position in the surrounding area of ​​the first control 0110; the second indicator light 017 is disposed at any position in the surrounding area of ​​the second control 0111.

[0060] Specifically, the first indicator light 016 indicates the direction of movement of the first control 0110 controlled by the controller 012; the second indicator light 017 indicates the direction of movement of the second control 0111 controlled by the controller 012. For example, when the controller 012 controls the first control 0110 to move horizontally, the first indicator light 016 is green; when the controller 012 controls the first control 0110 to move vertically, the first indicator light 016 is red. When the controller 012 controls the second control 0111 to move horizontally, the second indicator light 017 is green; when the controller 012 controls the second control 0111 to move vertically, the second indicator light 017 is red. For example, the first indicator light 016 includes a third sub-indicator light and a fourth sub-indicator light. When the controller 012 controls the first control 0110 to move horizontally, the third sub-indicator light is on and the fourth sub-indicator light is off. When the controller 012 controls the first control 0110 to move vertically, the third sub-indicator light is off and the fourth sub-indicator light is on. Alternatively, the second indicator light 017 includes a fifth sub-indicator light and a sixth sub-indicator light. When the controller 012 controls the second control 0111 to move horizontally, the fifth sub-indicator light is on and the sixth sub-indicator light is off. When the controller 012 controls the second control 0111 to move vertically, the fifth sub-indicator light is off and the sixth sub-indicator light is on.

[0061] In one embodiment, the controller 012 is further configured to switch the operation direction of the first control 0110 and the second control 0111 after detecting that the target object has stopped moving on the display screen 010, and to re-control the target object to move on the display screen 010 according to a preset rule, and to identify the user's fatigue state based on the distance between the currently tracked object and the target object when the target object is detected to have stopped moving on the display screen 010 again.

[0062] In this embodiment, if the controller 012 detects that the target object has stopped moving on the display screen 010, it switches the operation direction of the first control 0110 and the second control 0111. When the controller 012 re-controls the target object to move on the display screen 010 according to the preset rules, the first control 0110 and the second control 0111 control the tracked object to move on the display screen 010 according to the new operation direction. In the case that the target object has stopped moving on the display screen 010 again, the user's fatigue state is identified again based on the distance between the current tracked object and the target object.

[0063] Compared with existing fatigue state determination devices, the fatigue state identification device provided in this application does not require providing each operator with wearable equipment. It only requires controlling the tracked object to move on the display screen through simple motion controls, and can accurately determine the operator's current fatigue state in a very short time (generally, the test time is 30 seconds). In other words, this solution can quickly and accurately identify the operator's fatigue state before starting work while saving costs, which helps to avoid safety and economic problems caused by the operator's poor condition, greatly improves the operator's work reliability, and also ensures the operation and maintenance safety of nuclear power to a certain extent.

[0064] In one embodiment, such as Figure 4 As shown, a method for identifying fatigue states is provided, which can be applied to... Figure 1-3 Taking the controller in the fatigue state identification device as an example, the following steps are included:

[0065] S201. Control the target object to move on the display screen of the fatigue state identification device according to preset rules.

[0066] In this embodiment of the application, when detecting the user's fatigue state, the controller in the fatigue state recognition device first controls the target object to move on the display screen of the fatigue state recognition device according to preset rules, such as moving according to a preset circle, or moving according to a preset square, or moving according to a preset ellipse.

[0067] S202. After receiving the operation command triggered by the user's operation in the motion control of the fatigue state recognition device, the tracking object is controlled to move on the display screen.

[0068] In this embodiment of the application, after the target object begins to move on the display screen of the fatigue state recognition device according to preset rules, the user operates the movement control in the fatigue state recognition device to rotate or swing. After receiving the user's operation of the movement control in the fatigue state recognition device, the controller controls the tracked object to move on the display screen according to the operation instructions of the movement control.

[0069] S203. When the target object is detected to have stopped moving on the display screen, the user's fatigue state is identified based on the distance between the currently tracked object and the target object.

[0070] In this embodiment, when the controller in the fatigue state recognition device detects that the target object has stopped moving on the display screen, it determines a first distance value based on the distance between the currently tracked object and the target object. Then, it determines the user's fatigue state based on the relationship between the first distance value and a preset distance threshold range. For example, if the first distance value is determined to be 10mm based on the distance between the currently tracked object and the target object, and the judgment result within the preset distance threshold range of 0-20mm is all Level 1 fatigue, then the user's fatigue state is Level 1 fatigue.

[0071] The fatigue state identification method provided in this application is applied to the controller of a fatigue state identification device. First, it controls the target object to move on the display screen of the fatigue state identification device according to preset rules. After receiving an operation command triggered by the user's operation from the movement control in the fatigue state identification device, it controls the tracked object to move on the display screen. When the target object stops moving on the display screen, the user's fatigue state is identified based on the distance between the current tracked object and the target object. Compared with existing fatigue state determination devices, this device does not require providing wearable devices for each operator and only needs to control the tracked object to move on the display screen through simple movement controls. It can accurately determine the operator's current fatigue state within a very short time (generally, the test time is 30 seconds). This solution can quickly and accurately identify the operator's fatigue state before starting work while saving costs, helping to avoid safety and economic problems caused by poor operator condition, greatly improving the operator's work reliability, and also ensuring the safety of nuclear power plant operation and maintenance to a certain extent.

[0072] In one embodiment, in Figure 4 Based on the illustrated embodiments, as Figure 5 As shown, the above method also includes:

[0073] S204. Control the voice broadcast module to play voice information during the movement of the target object.

[0074] The voice broadcast module is embedded in the housing of the fatigue state recognition device and is used to play voice information during the movement of the target object.

[0075] In this embodiment of the application, the controller in the fatigue state recognition device can also control the voice broadcast module to play voice information at any time when the target object moves. The voice information played can be any one or more of digital information, alphabetic information and text information.

[0076] S205. Receive text information entered by the user in the editing window, and identify the user's fatigue state based on the text information, voice information, and the distance between the tracked object and the target object.

[0077] In this embodiment, when the target object stops moving on the display screen, the user inputs the voice information played by the voice broadcast module at any time the target object moves into the editing window in the form of text information. This allows the controller in the fatigue state recognition device to receive the text information input by the user in the editing window and determine the first fatigue state based on the similarity between the text information and the voice information. The controller also determines the user's final fatigue state based on the user's fatigue state determined in the above embodiment S203.

[0078] In one embodiment, in Figure 5 Based on the illustrated embodiment, the process of identifying the user's fatigue state based on the distance between the currently tracked object and the target object when the target object stops moving on the display screen is described, such as... Figure 6 As shown, the above-mentioned S203 "when the target object is detected to have stopped moving on the display screen, the user's fatigue state is identified based on the distance between the currently tracked object and the target object" includes:

[0079] S301. When receiving text information entered by the user in the editing window, determine the similarity between the text information and the voice information.

[0080] In this embodiment, during the process of the controller controlling the movement of the target object, voice information is played through the voice broadcast module. When the target object stops moving, the user inputs text information into the editing window. The controller in the fatigue state recognition device receives the text information input by the user in the editing window and determines the similarity between the text information and the voice information based on their similarity. For example, if the user inputs the text information "1234567899" and the voice information "1234567890", then the first similarity value is determined to be 90% based on the similarity between the text information and the voice information.

[0081] S302. Determine whether the distance between the tracked object and the target object is greater than a preset threshold, and obtain the judgment result.

[0082] In this embodiment of the application, after the target stops moving, the tracking object also stops moving. At this time, the distance between the tracking object and the target object is determined, and it is determined whether the distance between the tracking object and the target object is greater than a preset threshold. If it is greater than the preset threshold, the judgment result is 70%; if it is not greater than the preset threshold, the judgment result is 30%.

[0083] S303. Determine the user's fatigue state based on the similarity and judgment results.

[0084] In this embodiment, after determining the similarity between text and voice information and the judgment result based on the distance between the tracked object and the target object, the user's fatigue state is determined based on the similarity and the judgment result. For example, a first similarity value of 90% is determined based on the similarity between text and voice information, and a second similarity value of 80% is determined based on the distance between the tracked object and the target object. Given that the weight of the first similarity value is 80% and the weight of the second similarity value is 20%, the target similarity value determined based on the first similarity value and its corresponding weight, as well as the weight of the second similarity value, is 88%. A preset target similarity value between 80% and 90% indicates that the user's fatigue state is Level 1 fatigue.

[0085] Compared with existing fatigue state determination devices, this device does not require providing each operator with wearable equipment. It only requires simple movement controls to move the tracked object on the display screen, which can accurately determine the operator's current fatigue state in a very short time (generally, the test time is 30 seconds). In other words, this solution can quickly and accurately identify the operator's fatigue state before starting work while saving costs. This helps to avoid safety and economic problems caused by the operator's poor condition, greatly improves the operator's work reliability, and also ensures the operation and maintenance safety of nuclear power plants to a certain extent.

[0086] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0087] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0088] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0089] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A fatigue state identification device, characterized in that, The recognition device includes: a display screen, a motion control, a controller, a housing, a voice broadcast module, and an editing window; the controller is connected to the display screen and the motion control respectively; the display screen is set within a preset area on the outer surface of the housing; the motion control is embedded in the outer surface of the housing; the controller is located inside the housing; and the voice broadcast module is embedded in the outer surface of the housing. The controller is used to control the target object to move on the display screen according to preset rules; The motion control is used to control the movement of the tracked object on the display screen according to the user's operation; The voice broadcast module is used to play voice information during the process of the controller controlling the movement of the target object; The controller is further configured to receive text information input by the user in the editing window, determine a first similarity value based on the similarity between the text information and the voice information, and determine a second similarity value based on the distance between the tracked object and the target object when the target object is detected to have stopped moving on the display screen; calculate a target similarity value by weighting the first similarity value and the second similarity value according to a preset weight; and determine the user's fatigue level based on the relationship between the target similarity value and a preset fatigue interval.

2. The apparatus according to claim 1, characterized in that, The voice broadcast module includes an earpiece and a player, and is used to play the voice information during the process of the controller controlling the movement of the target object.

3. The apparatus according to claim 2, characterized in that, The voice information includes a string of numbers, a string of letters, and multiple words.

4. The identification device according to claim 1, characterized in that, The movement control includes a first control and a second control. The first control is used to control the tracking object to move on the display screen in a first direction according to the user's operation. The second control is used to control the tracking object to move on the display screen in a second direction according to the user's operation. The first direction and the second direction are different.

5. The identification device according to claim 4, characterized in that, The identification device further includes: a first indicator light and a second indicator light; the first indicator light is embedded in the outer surface of the housing; the second indicator light is embedded in the outer surface of the housing; the first indicator light is disposed at any position in the surrounding area of ​​the first control; the second indicator light is disposed at any position in the surrounding area of ​​the second control; The first indicator light is used to indicate the direction of movement of the first control controlled by the controller; The second indicator light is used to indicate the direction of movement of the second control controlled by the controller.

6. The identification device according to claim 4, characterized in that, The first control is any one of a knob, button, or joystick; the second control is any one of a knob, button, or joystick.

7. The identification device according to claim 4, characterized in that, The controller is also configured to, after detecting that the target object has stopped moving on the display screen, switch the operation direction of the first control and the second control, and re-control the target object to move on the display screen according to a preset rule, and, when the target object is detected to have stopped moving on the display screen again, identify the user's fatigue state based on the current distance between the tracked object and the target object.

8. A method for identifying fatigue state, characterized in that, The method is applied to the controller in the fatigue state identification device as described in any one of claims 1-7, the method comprising: The target object is controlled to move on the display screen of the fatigue state identification device according to preset rules; After receiving an operation command triggered by the user's operation in the motion control of the fatigue state recognition device, the tracking object is controlled to move on the display screen; The voice broadcast module is controlled to play voice information during the movement of the target object; The system receives text information input by the user in the editing window, and when it detects that the target object has stopped moving on the display screen, it determines a first similarity value based on the similarity between the text information and the voice information, and determines a second similarity value based on the distance between the tracked object and the target object; it then performs a weighted calculation on the first similarity value and the second similarity value according to a preset weight to obtain a target similarity value; and finally, it determines the user's fatigue level based on the relationship between the target similarity value and a preset fatigue interval.

Citation Information

Patent Citations

  • Method and device for detecting sleep insufficiency

    CN108852378A

  • Reminding method and device and electronic equipment

    CN113835807A

  • Alertness testing method and apparatus

    US20080309616A1