A mental fatigue real-time monitoring method and system based on back of neck skin temperature

Abstract

The present disclosure provides a mental fatigue real-time monitoring method and system based on the back of the neck skin temperature, relates to the technical field of mental fatigue detection, and comprises the following steps: acquiring real-time back of the neck skin temperature of a target user in a monitoring period; calculating the back of the neck skin temperature change amount in real time based on the initial back of the neck skin temperature of the monitoring period; inputting the back of the neck skin temperature change amount into a constructed mental fatigue scoring model to evaluate the mental fatigue degree and obtain a mental fatigue score; and classifying the mental fatigue state according to the mental fatigue score to obtain the real-time mental fatigue state of the target user in the monitoring period; the present disclosure predicts the current mental fatigue degree of the target user by collecting the back of the neck skin temperature in real time, and provides protection for the work efficiency and physical health of personnel.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of mental fatigue detection, and particularly relates to a mental fatigue real-time monitoring method and system based on skin temperature of the back of the neck. BACKGROUND

[0002] Mental fatigue is a psychophysiological state caused by long-term cognitive tasks, and is also a common sub-health state in daily work and life. Due to the need for long-term processing of complex work in a typical office environment, mental fatigue problems have gradually become prominent. Therefore, it is of great significance to develop a mental fatigue monitoring technology suitable for daily work and life to timely reflect the current mental fatigue state of the target user, improve work efficiency and maintain physical health.

[0003] At present, the monitoring methods of mental fatigue mainly include electroencephalogram (EEG), blood detection (cortisol level), heart rate variability (HRV), etc. However, EEG needs to attach electrodes to the head of the human body, and has strict requirements on the movement state of the human body. Blood detection is an invasive method, which needs to extract blood multiple times and undergo relatively strict analysis methods to obtain the result, and is not suitable for monitoring in daily work and life. Heart rate variability needs at least 30 seconds or more of data window, and cannot capture the instantaneous mental fatigue change in real time.

[0004] Therefore, the existing mental fatigue monitoring methods rely on cumbersome equipment and cannot be used for real-time monitoring in daily work and life. SUMMARY

[0005] In order to solve the above problems, the present disclosure provides a mental fatigue real-time monitoring method and system based on skin temperature of the back of the neck, which predicts the current mental fatigue degree of the target user by real-time collection of the skin temperature of the back of the neck, and provides protection for the work efficiency and physical health of the personnel.

[0006] According to some embodiments, the present disclosure adopts the following technical solutions:

[0007] A mental fatigue real-time monitoring method based on skin temperature of the back of the neck, comprising:

[0008] obtaining real-time skin temperature of the back of the neck of the target user in a monitoring period;

[0009] based on the initial skin temperature of the back of the neck in the monitoring period, real-time calculating the change amount of the skin temperature of the back of the neck;

[0010] inputting the change amount of the skin temperature of the back of the neck into a constructed mental fatigue scoring model, evaluating the mental fatigue degree, and obtaining a mental fatigue score;

[0011] according to the mental fatigue score, classifying the mental fatigue state, and obtaining the real-time mental fatigue state of the target user in the monitoring period.

[0012] According to some embodiments, the present disclosure adopts the technical solutions as follows:

[0013] A mental fatigue real-time monitoring system based on the back of the neck skin temperature, comprising:

[0014] An acquisition module configured to acquire real-time back of the neck skin temperature in a target user monitoring period;

[0015] A calculation module configured to calculate a back of the neck skin temperature change amount in real time based on an initial back of the neck skin temperature in the monitoring period;

[0016] A scoring module configured to input the back of the neck skin temperature change amount into a constructed mental fatigue scoring model, evaluate the mental fatigue degree, and obtain a mental fatigue score;

[0017] A classification module configured to classify the mental fatigue state according to the mental fatigue score, and obtain the real-time mental fatigue state of the target user in the monitoring period.

[0018] According to some embodiments, the present disclosure adopts the technical solutions as follows:

[0019] A computer program product comprising a computer program, which, when executed by a processor, implements the mental fatigue real-time monitoring method based on the back of the neck skin temperature.

[0020] According to some embodiments, the present disclosure adopts the technical solutions as follows:

[0021] A non-transitory computer readable storage medium for storing computer instructions, which, when executed by a processor, implements the mental fatigue real-time monitoring method based on the back of the neck skin temperature.

[0022] According to some embodiments, the present disclosure adopts the technical solutions as follows:

[0023] An electronic device comprising a processor, a memory, and a computer program; wherein the processor is connected with the memory, and the computer program is stored in the memory; when the electronic device is running, the processor executes the computer program stored in the memory, so that the electronic device executes the mental fatigue real-time monitoring method based on the back of the neck skin temperature.

[0024] Compared with the prior art, the present disclosure has the beneficial effects that:

[0025] 1. The mental fatigue real-time monitoring method based on the skin temperature of the back of the neck is innovative, simple to operate, avoids physical pain and discomfort when judging the degree of mental fatigue of the target user, reduces the risk of infection caused by invasive operation, is convenient to use, and has high practicality.

[0026] 2. The mental fatigue real-time monitoring method based on the skin temperature of the back of the neck has high monitoring accuracy, can identify different regions, is suitable for non-continuous contact dynamic change scenes, has high applicability, and has a wide application range. BRIEF DESCRIPTION OF DRAWINGS

[0027] The accompanying drawings, which form a part of this disclosure, are intended to provide further understanding of the disclosure and are incorporated herein for illustrative purposes. The schematic embodiments of the disclosure and their descriptions are used to explain the disclosure and do not constitute an improper limitation on the disclosure.

[0028] Figure 1 The method flowchart of Example 1.

[0029] Figure 2 The specific implementation diagram of Example 1.

[0030] Figure 3 The graph of the change of the skin temperature of the back of the neck with time under three load tasks of Example 1.

[0031] Figure 4 is a graph of the analysis results under a low load task of Example 1.

[0032] Figure 5 is a graph of the analysis results under a load task of Example 1.

[0033] Figure 6 is a graph of the analysis results under a high load task of Example 1.

[0034] Figure 7 The graph of the change of RMSSD with time under a low load task of Example 1.

[0035] Figure 8 The graph of the change of RMSSD with time under a load task of Example 1.

[0036] Figure 9 The graph of the change of RMSSD with time under a high load task of Example 1. DETAILED DESCRIPTION

[0037] The disclosure will be further described below in conjunction with the drawings and examples.

[0038] It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the disclosure. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as generally understood by those skilled in the art to which the disclosure belongs.

[0039] It is also to be noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments according to the present disclosure. As used herein, the singular forms "a," "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, steps, operations, elements, components, and / or combinations thereof, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or combinations thereof.

[0040] Example 1

[0041] There are a large number of literatures on the relationship between mental fatigue and skin temperature, such as Mizuno et al. (2009) in the ICCAS-SICE conference (see Mizuno T, Nomura S, et al., 'Evaluation of effect of the mental work and the simple work by the nasal skin temperature', ICCAS-SICE, Fukuoka, Japan, 2009, pp. 2137-2138) proposed that the change of nasal skin temperature can reflect psychological load, Mizuno et al. (2015) in The International Conference on Electronics and Software Science confirmed that psychological work load will cause facial skin temperature fluctuation through thermography technology (see Mizuno T, et al., 'Facial Skin Temperature Fluctuation by Mental Work-Load with Thermography', The International Conference on Electronics and Software Science, Kagawa University, Takamatsu, Japan, 2015), Diaz-Piedra et al. (2019) confirmed that the change of nasal skin temperature can effectively reflect the change of arousal level caused by task time through thermal infrared imaging experiment (see Diaz-Piedra C, Gomez E, Stasi L L D. Nasal skin temperature reveals changes in arousal levels due to time on task: an experimental thermal infrared imaging study. Applied Ergonomics, 2019, 81: 102892), Nakasai et al. (2022) realized the quantification of cognitive load of software developers through nasal skin temperature measurement (see Nakasai K, Komeda S, Tsunoda M, et al. Measuring Cognitive Load of Software Developers Based on Nasal Skin Temperature. arXiv e-prints, 2022.), but in the past, the research in this regard mainly targets the facial skin temperature, and requires high-precision infrared temperature sensors to achieve, and the embodiment is to find the rule of the back neck skin temperature change and mental fatigue, and innovatively proposes a method of monitoring the back neck skin temperature change through the built-in temperature sensor in the collar to realize real-time monitoring of mental fatigue, which is simple to operate, avoids the physical pain and discomfort of the target user when judging the degree of mental fatigue, reduces the risk of infection caused by invasive operation, is convenient to use, and has strong practicality.

[0042] An embodiment of the present disclosure provides a mental fatigue real-time monitoring method based on back neck skin temperature, as shown in Figure 1 , which comprises the following steps:

[0043] Step S1: acquiring the real-time back neck skin temperature of the target user in the monitoring period;

[0044] Step S2: based on the initial back neck skin temperature of the monitoring period, calculating the back neck skin temperature change in real time;

[0045] Step S3: inputting the back neck skin temperature change into the constructed mental fatigue scoring model to evaluate the degree of mental fatigue and obtain the mental fatigue score;

[0046] Step S4: classifying the mental fatigue state according to the mental fatigue score to obtain the real-time mental fatigue state of the target user in the monitoring period.

[0047] As an embodiment, the mental fatigue real-time monitoring method based on back neck skin temperature of the present disclosure, through real-time collection of back neck skin temperature, predicts the current mental fatigue degree of the target user, and provides protection for the work efficiency and physical health of the personnel, as shown in Figure 2 , the specific implementation process is as follows:

[0048] The target user wears a collar position installed with a built-in temperature sensor, which is used to monitor the mental fatigue state in the working period in real time, and collects the initial back neck skin temperature x1 at the beginning of work and the real-time back neck skin temperature x2 during work through the temperature sensor.

[0049] The real-time back neck skin temperature x2 and the initial back neck skin temperature x1 are calculated by difference, and the real-time back neck skin temperature change Δx is obtained. Assuming that the change of the back neck skin temperature of the target user reaches 0℃ in 1 minute, 0.2℃ in 20 minutes, 0.6℃ in 40 minutes, and 0.8℃ in 60 minutes.

[0050] The neck skin temperature change amount Δx of the target user is introduced into a mental fatigue score model to evaluate the degree of mental fatigue, and a mental fatigue score is obtained, wherein the mental fatigue score model is a multiple function constructed by data fitting, and is expressed by a formula as follows:

[0051] y=a(Δx) n +bt m +c

[0052] In the formula, y is the mental fatigue score, Δx is the neck skin temperature change amount, t is the monitoring time length, which is the working time length in the embodiment, a and b are correction values, c is a constant, n is the index of the neck skin temperature change amount, and m is the index of the working time length.

[0053] The parameters a, b and c are obtained according to experiments, and in the embodiment, a=1, b=1, and c=0 are assumed; n is related to the working time length t, and n=1 when t<30 minutes, and n=0.5 when t>30 minutes; m is related to the environment temperature, and m=1 when the environment temperature is hot neutral, m=2 when the environment is in high temperature, and m=0.5 when the environment is in low temperature. In the embodiment, m=1 is assumed in the hot neutral environment, and the function of the mental fatigue score model is y=(Δx) n +t, and the real-time mental fatigue score y1 of the target user is calculated by the function.

[0054] The obtained mental fatigue score y1 is compared with preset threshold values z of different mental fatigue states to classify the mental fatigue states, and the real-time mental fatigue state of the target user in the working process is obtained.

[0055] In the embodiment, the mental fatigue state is divided into four categories: non-mental fatigue, mild mental fatigue, moderate mental fatigue and severe mental fatigue, and the mental fatigue state determination process is as shown in FIG. 2. Figure 2

[0056] The threshold value z1 is the demarcation point between mild mental fatigue and non-mental fatigue, the threshold value z2 is the demarcation point between moderate mental fatigue and mild mental fatigue, and the threshold value z3 is the demarcation point between severe mental fatigue and moderate mental fatigue, and in the embodiment, z1 is set to 20, z2 is set to 40, and z3 is set to 60.

[0057] According to the comparison between the mental fatigue score and the threshold values, the mental fatigue state of the target user is determined, and the target user is reminded to rest immediately to maintain the body health according to the determination result.

[0058] ​The embodiment verifies the feasibility and effectiveness of the method through experiments. The experiments are carried out in a thermoneutral environment (temperature 25±0.5℃, relative humidity 50±3%) and invite 90 subjects aged 18-50 years old to perform low, medium and high load tasks respectively. The test environment has an illuminance of 500lx, a CO2 concentration range of 700-900ppm, and an air flow speed of 0.2m / s. The test duration is 132 minutes. The physiological indexes used in the test include heart rate variability (HRV) index, skin electricity, oxygenated hemoglobin and deoxyhemoglobin concentration, skin temperature. Before and after each task stage, the emotional scale, load scale and VAS-F fatigue scale are used to investigate the changes of emotion, perceived load and subjective mental fatigue multiple times; according to the correlation analysis results of the research data, the sensitive parameters of mental fatigue level are obtained, and the quantitative relationship between the two is obtained by regression analysis; among them, the change of the skin temperature of the back of the neck with time under the three load tasks is as shown in Figure 3 The embodiment mines the quantitative relationship between the change rate of the skin temperature of the back of the neck and mental fatigue from the above relationship.

[0059] In order to further verify the quantitative relationship between the change rate of the skin temperature of the back of the neck and mental fatigue, the subjects perform multi-level work load tasks in a thermoneutral environment. High-precision skin temperature sensors are used to continuously measure the skin temperature of the back of the neck for a long time during the test. The VAS-F scale (visual analog scale) is used to investigate the subjective mental fatigue level multiple times during the test. The correlation analysis of the two is carried out, and the analysis results under low load task are shown in FIG. 4, the analysis results under medium load task are shown in FIG. 5, and the analysis results under high load task are shown in FIG. 6:

[0060] FIG. 4(a) is a graph of the change of mental fatigue degree with time under low load task, and FIG. 4(b) is a graph of the change of the change amount of the back of the neck temperature with time under low load task. FIG. 4 reflects the law of the change of mental fatigue with time under low load task. As can be seen from FIG. 4, under low load task, the subjects appear mental fatigue with the extension of task time, and there is a significant cumulative effect; at the same time, the change amount of the back of the neck temperature appears a similar change law as mental fatigue.

[0061] FIG. 4(a) is a graph of the change of mental fatigue degree with time under low load task, and FIG. 4(b) is a graph of the change of the change amount of the back of the neck temperature with time under low load task. FIG. 4 reflects the law of the change of mental fatigue with time under low load task. As can be seen from FIG. 4, under low load task, the subjects appear mental fatigue with the extension of task time, and there is a significant cumulative effect; at the same time, the change amount of the back of the neck temperature appears a similar change law as mental fatigue.

[0062] Fig. 5(a) is a diagram of mental fatigue degree changing with time under a medium load task, and Fig. 5(b) is a diagram of the change amount of the back neck temperature changing with time under the medium load task. Fig. 5 reflects the rule of mental fatigue changing with time under the medium load task. As can be seen from Fig. 5, under the medium load task, the subjects appear mental fatigue with the prolongation of the task time, and there is a significant cumulative effect; at the same time, the change amount of the back neck temperature appears a similar change rule to the mental fatigue.

[0063] Fig. 6(a) is a diagram of mental fatigue degree changing with time under a high load task, and Fig. 6(b) is a diagram of the change amount of the back neck temperature changing with time under the high load task. Fig. 6 reflects the rule of mental fatigue changing with time under the high load task. As can be seen from Fig. 6, under the high load task, the subjects appear significant mental fatigue with the prolongation of the task time, and there is a more significant cumulative effect; at the same time, the change amount of the back neck temperature appears a similar change rule to the mental fatigue.

[0064] The present embodiment also carries out a comparison test between the present method and the prior art method. The prior art method selects the method of judging mental fatigue based on the heart rate variability of ECG. The ECG data is continuously collected, time domain and frequency domain analysis is carried out, and the change of the time domain index RMSSD of the heart rate variability representing the degree of mental fatigue is obtained. Therefore, the change of the time domain index RMSSD of the heart rate variability is used to indicate the mental fatigue. The RMSSD is a reliable index for measuring the parasympathetic nervous system, and its validity has been supported by many published papers.

[0065] In combination with the above-mentioned correlation results of the back neck skin temperature and the mental fatigue under the low load task, the medium load task and the high load task, the change results of the time domain index RMSSD of the heart rate variability under the low load task, the medium load task and the high load task are used to provide a comparison of the effects of the prior art, as follows.

[0066] Figure 7 reflects the rule of RMSSD changing with time under the low load task, and Figure 7 As can be seen, under the low load task, the RMSSD of the subjects significantly increases with the prolongation of the task time, and there is a significant cumulative effect; Figure 8 reflects the rule of RMSSD changing with time under the medium load task, Figure 9 reflects the rule of RMSSD changing with time under the high load task, and has a similar change rule to the low load task.

[0067] Through the above experiment, it is verified that the posterior neck skin temperature and the heart rate variability have the same change trend, and it can be considered that the posterior neck skin temperature has the ability to monitor mental fatigue similar to the time domain index RMSSD of the heart rate variability; and, considering that the collection of skin temperature is more convenient than the acquisition of HRV index, therefore, it is more suitable for application in reality.

[0068] Embodiment 2

[0069] In an embodiment of the present disclosure, a posterior neck skin temperature-based mental fatigue real-time monitoring system is provided, comprising:

[0070] The acquisition module is configured to acquire real-time posterior neck skin temperature in a monitoring period of a target user;

[0071] The calculation module is configured to calculate a posterior neck skin temperature change amount in real time based on an initial posterior neck skin temperature in the monitoring period;

[0072] The scoring module is configured to input the posterior neck skin temperature change amount into a constructed mental fatigue scoring model, evaluate the degree of mental fatigue, and obtain a mental fatigue score;

[0073] The classification module is configured to classify the mental fatigue state according to the mental fatigue score, and obtain the real-time mental fatigue state of the target user in the monitoring period.

[0074] Embodiment 3

[0075] In an embodiment of the present disclosure, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the mental fatigue real-time monitoring method based on the posterior neck skin temperature.

[0076] Embodiment 4

[0077] In an embodiment of the present disclosure, a non-transitory computer readable storage medium is provided, which is used to store computer instructions, and the computer instructions, when executed by a processor, implement the mental fatigue real-time monitoring method based on the posterior neck skin temperature.

[0078] Embodiment 5

[0079] In an embodiment of the present disclosure, an electronic device is provided, comprising a processor, a memory and a computer program; wherein the processor is connected with the memory, and the computer program is stored in the memory; when the electronic device is running, the processor executes the computer program stored in the memory, so that the electronic device executes the mental fatigue real-time monitoring method based on the posterior neck skin temperature.

[0080] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flow or blocks. Figure 1 one or more flow or blocks.

[0081] These computer program instructions can also be loaded into a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flow or blocks. Figure 1 one or more flow or blocks.

[0082] Although the present disclosure has been described with reference to the embodiments thereof, it is apparent that a variety of modifications or changes can be made thereto without departing from the scope of the present disclosure.

Claims

1. A method for real-time monitoring of mental fatigue based on the temperature of the back of the neck, characterized in that, The method comprises the following steps: acquiring real-time nape skin temperature in a monitoring period of a target user; calculating a nape skin temperature change amount in real time based on an initial nape skin temperature in the monitoring period; inputting the nape skin temperature change amount into a mental fatigue score model constructed in a data fitting manner to evaluate a mental fatigue degree and obtain a mental fatigue score, wherein the mental fatigue score model is a function expressed by a formula as follows: ； wherein y represents the mental fatigue score, Δx represents the nape skin temperature change amount, t represents a monitoring duration, a and b represent correction values, c represents a constant, parameters a, b and c are obtained according to experiments, n represents an index of the nape skin temperature change amount, m represents an index of a working duration, and the index n is related to the monitoring duration and the index m is related to an environmental temperature; classifying mental fatigue states according to the mental fatigue score to obtain real-time mental fatigue states of the target user in the monitoring period.

2. A mental fatigue real-time monitoring method based on the back of the neck skin temperature according to claim 1, characterized in that, The nape skin temperature is collected by a built-in temperature sensor of a collar of the target user.

3. A mental fatigue real-time monitoring method based on the back of the neck skin temperature according to claim 1, characterized in that, The initial nape skin temperature is collected at the beginning of the monitoring period.

4. The real-time mental fatigue monitoring method based on the back of the neck skin temperature according to claim 1, characterized in that, The classifying of the mental fatigue states is based on the mental fatigue score and is performed by threshold comparison to identify a final mental fatigue state.

5. A real-time mental fatigue monitoring system based on the temperature of the back of the neck, characterized in that, The method comprises the following steps: an acquiring module configured to acquire real-time nape skin temperature in a monitoring period of a target user; a calculating module configured to calculate a nape skin temperature change amount in real time based on an initial nape skin temperature in the monitoring period; a scoring module configured to input the nape skin temperature change amount into a mental fatigue score model constructed in a data fitting manner to evaluate a mental fatigue degree and obtain a mental fatigue score, wherein the mental fatigue score model is a function expressed by a formula as follows: ； wherein y represents the mental fatigue score, Δx represents the nape skin temperature change amount, t represents a monitoring duration, a and b represent correction values, c represents a constant, parameters a, b and c are obtained according to experiments, n represents an index of the nape skin temperature change amount, m represents an index of a working duration, and the index n is related to the monitoring duration and the index m is related to an environmental temperature; a classifying module configured to classify mental fatigue states according to the mental fatigue score to obtain real-time mental fatigue states of the target user in the monitoring period.

6. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the mental fatigue real-time monitoring method based on nape skin temperature according to any one of claims 1-4.

7. A non-transitory computer-readable storage medium, comprising: The non-transitory computer readable storage medium is used to store computer instructions, and the computer instructions are executed by the processor to implement the mental fatigue real-time monitoring method based on nape skin temperature according to any one of claims 1-4.

8. An electronic device, comprising: The electronic device comprises a processor, a memory and a computer program; the processor is connected with the memory, and the computer program is stored in the memory; when the electronic device is running, the processor executes the computer program stored in the memory to enable the electronic device to implement the mental fatigue real-time monitoring method based on nape skin temperature according to any one of claims 1-4. ​

Images